2023-12-19T15:49:03.304 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T15:49:03.304 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066 --owner scheduled_vshankar@teuthology --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} --verbose --name vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi -- /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066/orig.config.yaml 2023-12-19T15:49:03.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:49:03.431 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066 branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} email: vshankar@redhat.com first_in_suite: false job_id: '7497066' kernel: client: branch: testing flavor: default kdb: true sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e owner: scheduled_vshankar@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 430 sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e sleep_before_teardown: 0 subset: 301/1024 suite: fs suite_branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLC3HYK0HgfNM7g/c5+f6H1JBDH7l2u8f8+8aghJwChwAt2AwvutoVKH9XH78ofqYTZ77wk3O9OYIWy4cjkSxFY= smithi078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtnDg9DmOslbC2XB5fDJLZO6QCLpyuPIu+wauED0UaelHaDToCXKE3NYU7OcSn5dX9iwqvGaq++RFWj4tHXcjo= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKrNCTuMGC/FXM8yGMmHjs5cvqKWNlrKt8PQhN1FijJ9JMdldr8Mmuq5ja2h962rxxOnvpyTaLyRjpiWWe+V2w8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-19_13:22:41 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-19T15:49:03.431 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa; will attempt to use it 2023-12-19T15:49:03.432 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks 2023-12-19T15:49:03.432 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-19T15:49:03.433 INFO:teuthology.task.internal:Checking packages... 2023-12-19T15:49:03.458 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '568df92b7e50b2108bce4c77c393ff294d6a5e5e' 2023-12-19T15:49:03.458 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-19T15:49:03.458 INFO:teuthology.packaging:ref: None 2023-12-19T15:49:03.458 INFO:teuthology.packaging:tag: None 2023-12-19T15:49:03.458 INFO:teuthology.packaging:branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 2023-12-19T15:49:03.458 INFO:teuthology.packaging:sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T15:49:03.458 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing1-2023-12-18-1207-reef-2 2023-12-19T15:49:03.604 INFO:teuthology.task.internal:Found packages for ceph version 18.2.1-132.g568df92b 2023-12-19T15:49:03.605 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-19T15:49:03.612 INFO:teuthology.task.internal:no buildpackages task found 2023-12-19T15:49:03.612 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-19T15:49:03.620 INFO:teuthology.task.internal:Saving configuration 2023-12-19T15:49:03.640 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-19T15:49:03.645 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T15:49:03.671 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:43:50.566691', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLC3HYK0HgfNM7g/c5+f6H1JBDH7l2u8f8+8aghJwChwAt2AwvutoVKH9XH78ofqYTZ77wk3O9OYIWy4cjkSxFY='} 2023-12-19T15:49:03.695 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:43:50.568164', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtnDg9DmOslbC2XB5fDJLZO6QCLpyuPIu+wauED0UaelHaDToCXKE3NYU7OcSn5dX9iwqvGaq++RFWj4tHXcjo='} 2023-12-19T15:49:03.716 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:43:50.564833', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKrNCTuMGC/FXM8yGMmHjs5cvqKWNlrKt8PQhN1FijJ9JMdldr8Mmuq5ja2h962rxxOnvpyTaLyRjpiWWe+V2w8='} 2023-12-19T15:49:03.717 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-19T15:49:03.723 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-12-19T15:49:03.723 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-12-19T15:49:03.723 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['client.0'] 2023-12-19T15:49:03.723 INFO:teuthology.run_tasks:Running task console_log... 2023-12-19T15:49:03.819 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f51cac55dc0>, signals=[15]) 2023-12-19T15:49:03.820 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-19T15:49:03.826 INFO:teuthology.task.internal:Opening connections... 2023-12-19T15:49:03.826 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2023-12-19T15:49:03.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:49:03.930 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2023-12-19T15:49:03.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:49:04.014 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T15:49:04.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:49:04.104 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-19T15:49:04.111 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-12-19T15:49:04.130 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-12-19T15:49:04.130 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-12-19T15:49:04.188 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2023-12-19T15:49:04.188 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2023-12-19T15:49:04.188 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2023-12-19T15:49:04.189 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2023-12-19T15:49:04.189 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2023-12-19T15:49:04.189 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2023-12-19T15:49:04.189 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-19T15:49:04.189 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-12-19T15:49:04.189 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2023-12-19T15:49:04.189 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-19T15:49:04.189 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2023-12-19T15:49:04.189 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T15:49:04.189 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-19T15:49:04.189 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T15:49:04.190 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-12-19T15:49:04.221 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2023-12-19T15:49:04.240 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2023-12-19T15:49:04.240 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-12-19T15:49:04.298 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream" 2023-12-19T15:49:04.298 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9" 2023-12-19T15:49:04.298 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2023-12-19T15:49:04.298 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2023-12-19T15:49:04.298 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9" 2023-12-19T15:49:04.298 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9" 2023-12-19T15:49:04.298 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-19T15:49:04.298 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2023-12-19T15:49:04.298 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon" 2023-12-19T15:49:04.299 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-19T15:49:04.299 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/" 2023-12-19T15:49:04.299 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T15:49:04.299 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-19T15:49:04.299 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T15:49:04.299 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-12-19T15:49:04.321 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-12-19T15:49:04.340 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-12-19T15:49:04.340 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-12-19T15:49:04.396 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2023-12-19T15:49:04.397 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9" 2023-12-19T15:49:04.397 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2023-12-19T15:49:04.397 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2023-12-19T15:49:04.397 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9" 2023-12-19T15:49:04.397 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9" 2023-12-19T15:49:04.397 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-19T15:49:04.397 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-12-19T15:49:04.397 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon" 2023-12-19T15:49:04.397 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-19T15:49:04.397 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2023-12-19T15:49:04.397 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T15:49:04.398 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-19T15:49:04.398 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T15:49:04.398 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-12-19T15:49:04.421 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-19T15:49:04.431 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-19T15:49:04.437 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-19T15:49:04.438 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2023-12-19T15:49:04.440 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2023-12-19T15:49:04.442 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2023-12-19T15:49:04.458 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-19T15:49:04.469 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-19T15:49:04.469 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2023-12-19T15:49:04.498 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2023-12-19T15:49:04.500 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2023-12-19T15:49:04.583 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-19T15:49:04.658 INFO:teuthology.run_tasks:Running task kernel... 2023-12-19T15:49:04.676 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'} 2023-12-19T15:49:04.676 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-12-19T15:49:04.676 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-12-19T15:49:04.677 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T15:49:04.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T15:49:04.694 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-19T15:49:05.035 DEBUG:teuthology.task.kernel:sha1 for client.0 is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T15:49:05.035 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-19T15:49:05.036 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-12-19T15:49:05.053 INFO:teuthology.orchestra.run.smithi151.stdout:5.14.0-361.el9.x86_64 2023-12-19T15:49:05.053 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T15:49:05.053 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-19T15:49:05.054 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum upgrade -y linux-firmware 2023-12-19T15:49:07.695 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - AppStream 8.1 MB/s | 6.4 MB 00:00 2023-12-19T15:49:09.387 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - BaseOS 3.1 MB/s | 2.0 MB 00:00 2023-12-19T15:49:11.177 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 7.9 MB 00:01 2023-12-19T15:49:16.678 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 4.1 MB/s | 18 MB 00:04 2023-12-19T15:49:22.237 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 5.8 MB 00:02 2023-12-19T15:49:23.995 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 15 kB 00:00 2023-12-19T15:49:26.233 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 9.3 MB/s | 20 MB 00:02 2023-12-19T15:49:31.022 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2023-12-19T15:49:33.351 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-12-19T15:49:33.359 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-12-19T15:49:33.360 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-12-19T15:49:33.360 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-12-19T15:49:33.360 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2023-12-19T15:49:33.360 INFO:teuthology.orchestra.run.smithi151.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-19T15:49:33.360 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T15:49:33.360 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-12-19T15:49:33.360 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-12-19T15:49:33.360 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 1 Package 2023-12-19T15:49:33.361 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T15:49:33.361 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 328 M 2023-12-19T15:49:33.361 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-12-19T15:49:43.939 INFO:teuthology.orchestra.run.smithi151.stdout:linux-firmware-20231030-141.el9.noarch.rpm 31 MB/s | 328 MB 00:10 2023-12-19T15:49:43.940 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-12-19T15:49:43.940 INFO:teuthology.orchestra.run.smithi151.stdout:Total 31 MB/s | 328 MB 00:10 2023-12-19T15:49:43.941 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-12-19T15:49:44.036 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-12-19T15:49:44.036 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-12-19T15:49:46.157 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-12-19T15:49:46.157 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-12-19T15:49:52.195 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-12-19T15:49:52.658 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-19T15:49:52.761 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T15:49:53.662 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T15:49:53.663 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-19T15:49:54.042 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T15:49:54.042 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T15:49:54.042 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2023-12-19T15:49:54.042 INFO:teuthology.orchestra.run.smithi151.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-19T15:49:54.042 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T15:49:54.043 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-12-19T15:49:54.312 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-19T15:49:54.313 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T15:49:54.464 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ 2023-12-19T15:49:54.465 DEBUG:teuthology.orchestra.run.smithi151:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-19T15:49:54.467 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi151.front.sepia.ceph.com to complete... 2023-12-19T15:50:20.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-19 15:50:20 URL:https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [321162729/321162729] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-19T15:50:20.760 INFO:teuthology.orchestra.run.smithi151.stderr:FINISHED --2023-12-19 15:50:20-- 2023-12-19T15:50:20.760 INFO:teuthology.orchestra.run.smithi151.stderr:Total wall clock time: 26s 2023-12-19T15:50:20.760 INFO:teuthology.orchestra.run.smithi151.stderr:Downloaded: 1 files, 306M in 26s (11.8 MB/s) 2023-12-19T15:50:20.763 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-19T15:50:20.764 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-19T15:50:22.608 INFO:teuthology.orchestra.run.smithi151.stdout:Verifying... ######################################## 2023-12-19T15:50:22.682 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing... ######################################## 2023-12-19T15:50:22.763 INFO:teuthology.orchestra.run.smithi151.stdout:Updating / installing... 2023-12-19T15:50:29.846 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-19T15:50:45.848 INFO:teuthology.orchestra.run.smithi151.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-19T15:51:07.114 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-19T15:51:07.114 DEBUG:teuthology.orchestra.run.smithi151:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-19T15:51:07.204 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T15:51:07.204 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-19T15:51:07.204 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T15:51:07.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-19T15:51:07.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-19T15:51:07.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-19T15:51:07.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-19T15:51:07.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-19T15:51:07.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-19T15:51:07.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-19T15:51:07.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-19T15:51:07.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-19T15:51:07.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-19T15:51:07.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-19T15:51:07.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-19T15:51:07.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-19T15:51:07.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-19T15:51:07.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-19T15:51:07.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-19T15:51:07.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-19T15:51:07.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-19T15:51:07.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-19T15:51:07.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-19T15:51:07.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-19T15:51:07.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-19T15:51:07.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-19T15:51:07.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-19T15:51:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-19T15:51:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-19T15:51:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-19T15:51:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-19T15:51:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-19T15:51:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-19T15:51:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-19T15:51:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-19T15:51:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-19T15:51:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-19T15:51:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-19T15:51:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-19T15:51:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-19T15:51:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-19T15:51:07.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-19T15:51:07.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-19T15:51:07.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-19T15:51:07.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-19T15:51:07.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-19T15:51:07.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-19T15:51:07.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-19T15:51:07.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-19T15:51:07.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-19T15:51:07.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-19T15:51:07.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-19T15:51:07.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-19T15:51:07.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-19T15:51:07.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-19T15:51:07.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-19T15:51:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-19T15:51:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-19T15:51:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-19T15:51:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-19T15:51:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-19T15:51:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-19T15:51:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-19T15:51:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-19T15:51:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-19T15:51:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-19T15:51:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-19T15:51:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-19T15:51:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-19T15:51:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-19T15:51:07.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-19T15:51:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-19T15:51:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-19T15:51:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-19T15:51:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-19T15:51:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-19T15:51:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-19T15:51:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-19T15:51:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-19T15:51:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-19T15:51:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-19T15:51:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-19T15:51:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-19T15:51:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-19T15:51:07.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-19T15:51:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-19T15:51:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-19T15:51:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-19T15:51:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-19T15:51:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-19T15:51:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-19T15:51:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-19T15:51:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-19T15:51:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-19T15:51:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-19T15:51:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-19T15:51:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-19T15:51:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-19T15:51:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-19T15:51:07.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-19T15:51:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-19T15:51:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-19T15:51:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-19T15:51:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-19T15:51:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-19T15:51:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-19T15:51:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-19T15:51:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-19T15:51:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-19T15:51:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-19T15:51:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-19T15:51:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-19T15:51:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-19T15:51:07.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-19T15:51:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-19T15:51:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-19T15:51:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-19T15:51:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-19T15:51:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-19T15:51:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-19T15:51:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-19T15:51:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-19T15:51:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-19T15:51:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-19T15:51:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-19T15:51:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-19T15:51:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-19T15:51:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-19T15:51:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-19T15:51:07.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-19T15:51:07.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-19T15:51:07.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-19T15:51:07.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-19T15:51:07.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-19T15:51:07.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-19T15:51:07.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-19T15:51:07.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-19T15:51:07.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-19T15:51:07.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-19T15:51:07.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-19T15:51:07.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-19T15:51:07.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-19T15:51:07.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-19T15:51:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-19T15:51:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-19T15:51:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-19T15:51:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-19T15:51:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-19T15:51:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-19T15:51:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-19T15:51:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-19T15:51:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-19T15:51:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-19T15:51:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-19T15:51:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-19T15:51:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-19T15:51:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-19T15:51:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-19T15:51:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-19T15:51:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-19T15:51:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-19T15:51:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-19T15:51:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-19T15:51:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-19T15:51:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-19T15:51:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-19T15:51:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-19T15:51:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-19T15:51:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-19T15:51:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-19T15:51:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-19T15:51:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-19T15:51:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-19T15:51:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-19T15:51:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-19T15:51:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-19T15:51:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-19T15:51:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-19T15:51:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-19T15:51:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-19T15:51:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-19T15:51:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-19T15:51:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-19T15:51:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-19T15:51:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-19T15:51:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-19T15:51:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-19T15:51:07.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-19T15:51:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-19T15:51:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-19T15:51:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-19T15:51:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-19T15:51:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-19T15:51:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-19T15:51:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-19T15:51:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-19T15:51:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-19T15:51:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-19T15:51:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-19T15:51:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-19T15:51:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-19T15:51:07.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-19T15:51:07.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-19T15:51:07.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-19T15:51:07.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-19T15:51:07.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-19T15:51:07.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-19T15:51:07.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-19T15:51:07.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-19T15:51:07.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-19T15:51:07.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-19T15:51:07.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-19T15:51:07.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-19T15:51:07.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-19T15:51:07.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-19T15:51:07.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-19T15:51:07.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-19T15:51:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-19T15:51:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-19T15:51:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-19T15:51:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-19T15:51:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-19T15:51:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-19T15:51:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-19T15:51:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-19T15:51:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-19T15:51:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-19T15:51:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-19T15:51:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-19T15:51:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-19T15:51:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-19T15:51:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-19T15:51:07.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-19T15:51:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-19T15:51:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-19T15:51:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-19T15:51:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-19T15:51:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-19T15:51:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-19T15:51:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-19T15:51:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-19T15:51:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-19T15:51:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-19T15:51:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-19T15:51:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-19T15:51:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-19T15:51:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-19T15:51:07.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-19T15:51:07.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-19T15:51:07.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-19T15:51:07.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-19T15:51:07.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-19T15:51:07.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-19T15:51:07.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-19T15:51:07.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-19T15:51:07.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-19T15:51:07.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-19T15:51:07.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-19T15:51:07.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-19T15:51:07.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-19T15:51:07.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-19T15:51:07.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-19T15:51:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-19T15:51:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-19T15:51:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-19T15:51:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-19T15:51:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-19T15:51:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-19T15:51:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-19T15:51:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-19T15:51:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-19T15:51:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-19T15:51:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-19T15:51:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-19T15:51:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-19T15:51:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-19T15:51:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-19T15:51:07.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-19T15:51:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-19T15:51:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-19T15:51:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-19T15:51:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-19T15:51:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-19T15:51:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-19T15:51:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-19T15:51:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-19T15:51:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-19T15:51:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-19T15:51:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-19T15:51:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-19T15:51:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-19T15:51:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-19T15:51:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-19T15:51:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-19T15:51:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-19T15:51:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-19T15:51:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-19T15:51:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-19T15:51:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-19T15:51:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-19T15:51:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-19T15:51:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-19T15:51:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-19T15:51:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-19T15:51:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-19T15:51:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-19T15:51:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-19T15:51:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-19T15:51:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-19T15:51:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-19T15:51:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-19T15:51:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-19T15:51:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-19T15:51:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-19T15:51:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-19T15:51:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-19T15:51:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-19T15:51:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-19T15:51:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-19T15:51:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-19T15:51:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-19T15:51:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-19T15:51:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-19T15:51:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-19T15:51:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-19T15:51:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-19T15:51:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-19T15:51:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-19T15:51:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-19T15:51:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-19T15:51:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-19T15:51:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-19T15:51:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-19T15:51:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-19T15:51:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-19T15:51:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-19T15:51:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-19T15:51:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-19T15:51:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-19T15:51:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-19T15:51:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-19T15:51:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-19T15:51:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-19T15:51:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-19T15:51:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-19T15:51:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-19T15:51:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-19T15:51:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-19T15:51:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-19T15:51:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-19T15:51:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-19T15:51:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-19T15:51:07.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-19T15:51:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-19T15:51:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-19T15:51:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-19T15:51:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-19T15:51:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-19T15:51:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-19T15:51:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-19T15:51:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-19T15:51:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-19T15:51:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-19T15:51:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-19T15:51:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-19T15:51:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-19T15:51:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-19T15:51:07.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-19T15:51:07.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-19T15:51:07.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-19T15:51:07.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-19T15:51:07.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-19T15:51:07.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-19T15:51:07.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-19T15:51:07.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-19T15:51:07.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-19T15:51:07.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-19T15:51:07.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-19T15:51:07.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-19T15:51:07.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-19T15:51:07.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-19T15:51:07.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-19T15:51:07.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-19T15:51:07.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-19T15:51:07.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-19T15:51:07.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-19T15:51:07.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-19T15:51:07.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-19T15:51:07.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-19T15:51:07.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-19T15:51:07.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-19T15:51:07.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-19T15:51:07.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-19T15:51:07.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-19T15:51:07.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-19T15:51:07.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-19T15:51:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-19T15:51:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-19T15:51:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-19T15:51:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-19T15:51:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-19T15:51:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-19T15:51:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-19T15:51:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-19T15:51:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-19T15:51:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-19T15:51:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-19T15:51:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-19T15:51:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-19T15:51:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-19T15:51:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-19T15:51:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-19T15:51:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-19T15:51:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-19T15:51:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-19T15:51:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-19T15:51:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-19T15:51:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-19T15:51:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-19T15:51:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-19T15:51:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-19T15:51:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-19T15:51:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-19T15:51:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-19T15:51:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-19T15:51:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-19T15:51:07.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-19T15:51:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-19T15:51:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-19T15:51:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-19T15:51:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-19T15:51:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-19T15:51:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-19T15:51:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-19T15:51:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-19T15:51:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-19T15:51:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-19T15:51:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-19T15:51:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-19T15:51:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-19T15:51:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-19T15:51:07.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-19T15:51:07.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-19T15:51:07.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-19T15:51:07.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-19T15:51:07.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-19T15:51:07.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-19T15:51:07.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-19T15:51:07.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-19T15:51:07.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-19T15:51:07.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-19T15:51:07.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-19T15:51:07.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-19T15:51:07.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-19T15:51:07.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-19T15:51:07.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-19T15:51:07.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-19T15:51:07.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-19T15:51:07.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-19T15:51:07.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-19T15:51:07.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-19T15:51:07.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-19T15:51:07.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-19T15:51:07.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-19T15:51:07.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-19T15:51:07.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-19T15:51:07.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-19T15:51:07.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-19T15:51:07.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-19T15:51:07.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-19T15:51:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-19T15:51:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-19T15:51:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-19T15:51:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-19T15:51:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-19T15:51:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-19T15:51:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-19T15:51:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-19T15:51:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-19T15:51:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-19T15:51:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-19T15:51:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-19T15:51:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-19T15:51:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-19T15:51:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-19T15:51:07.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-19T15:51:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-19T15:51:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-19T15:51:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-19T15:51:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-19T15:51:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-19T15:51:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-19T15:51:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-19T15:51:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-19T15:51:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-19T15:51:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-19T15:51:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-19T15:51:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-19T15:51:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-19T15:51:07.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-19T15:51:07.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-19T15:51:07.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-19T15:51:07.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-19T15:51:07.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-19T15:51:07.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-19T15:51:07.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-19T15:51:07.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-19T15:51:07.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-19T15:51:07.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-19T15:51:07.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-19T15:51:07.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-19T15:51:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-19T15:51:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-19T15:51:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-19T15:51:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-19T15:51:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-19T15:51:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-19T15:51:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-19T15:51:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-19T15:51:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-19T15:51:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-19T15:51:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-19T15:51:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-19T15:51:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-19T15:51:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-19T15:51:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-19T15:51:07.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-19T15:51:07.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-19T15:51:07.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-19T15:51:07.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-19T15:51:07.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-19T15:51:07.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-19T15:51:07.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-19T15:51:07.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-19T15:51:07.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-19T15:51:07.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-19T15:51:07.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-19T15:51:07.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-19T15:51:07.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-19T15:51:07.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-19T15:51:07.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-19T15:51:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-19T15:51:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-19T15:51:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-19T15:51:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-19T15:51:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-19T15:51:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-19T15:51:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-19T15:51:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-19T15:51:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-19T15:51:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-19T15:51:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-19T15:51:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-19T15:51:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-19T15:51:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-19T15:51:07.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-19T15:51:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-19T15:51:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-19T15:51:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-19T15:51:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-19T15:51:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-19T15:51:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-19T15:51:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-19T15:51:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-19T15:51:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-19T15:51:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-19T15:51:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-19T15:51:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-19T15:51:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-19T15:51:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-19T15:51:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-19T15:51:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-19T15:51:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-19T15:51:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-19T15:51:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-19T15:51:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-19T15:51:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-19T15:51:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-19T15:51:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-19T15:51:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-19T15:51:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-19T15:51:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-19T15:51:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-19T15:51:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-19T15:51:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-19T15:51:07.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-19T15:51:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-19T15:51:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-19T15:51:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-19T15:51:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-19T15:51:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-19T15:51:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-19T15:51:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-19T15:51:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-19T15:51:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-19T15:51:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-19T15:51:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-19T15:51:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-19T15:51:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-19T15:51:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-19T15:51:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-19T15:51:07.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-19T15:51:07.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-19T15:51:07.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-19T15:51:07.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-19T15:51:07.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-19T15:51:07.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-19T15:51:07.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-19T15:51:07.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-19T15:51:07.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-19T15:51:07.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-19T15:51:07.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-19T15:51:07.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-19T15:51:07.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-19T15:51:07.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-19T15:51:07.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-19T15:51:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-19T15:51:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-19T15:51:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-19T15:51:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-19T15:51:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-19T15:51:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-19T15:51:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-19T15:51:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-19T15:51:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-19T15:51:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-19T15:51:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-19T15:51:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-19T15:51:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-19T15:51:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-19T15:51:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-19T15:51:07.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-19T15:51:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-19T15:51:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-19T15:51:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-19T15:51:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-19T15:51:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-19T15:51:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-19T15:51:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-19T15:51:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-19T15:51:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-19T15:51:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-19T15:51:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-19T15:51:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-19T15:51:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-19T15:51:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-19T15:51:07.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-19T15:51:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-19T15:51:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-19T15:51:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-19T15:51:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-19T15:51:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-19T15:51:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-19T15:51:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-19T15:51:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-19T15:51:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-19T15:51:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-19T15:51:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-19T15:51:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-19T15:51:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-19T15:51:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-19T15:51:07.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-19T15:51:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-19T15:51:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-19T15:51:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-19T15:51:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-19T15:51:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-19T15:51:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-19T15:51:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-19T15:51:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-19T15:51:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-19T15:51:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-19T15:51:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-19T15:51:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-19T15:51:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-19T15:51:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-19T15:51:07.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-19T15:51:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-19T15:51:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-19T15:51:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-19T15:51:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-19T15:51:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-19T15:51:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-19T15:51:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-19T15:51:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-19T15:51:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-19T15:51:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-19T15:51:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-19T15:51:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-19T15:51:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-19T15:51:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-19T15:51:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-19T15:51:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-19T15:51:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-19T15:51:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-19T15:51:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-19T15:51:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-19T15:51:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-19T15:51:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-19T15:51:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-19T15:51:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-19T15:51:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-19T15:51:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-19T15:51:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-19T15:51:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-19T15:51:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-19T15:51:07.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-19T15:51:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-19T15:51:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-19T15:51:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-19T15:51:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-19T15:51:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-19T15:51:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-19T15:51:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-19T15:51:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-19T15:51:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-19T15:51:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-19T15:51:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-19T15:51:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-19T15:51:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-19T15:51:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-19T15:51:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-19T15:51:07.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-19T15:51:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-19T15:51:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-19T15:51:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-19T15:51:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-19T15:51:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-19T15:51:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-19T15:51:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-19T15:51:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-19T15:51:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-19T15:51:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-19T15:51:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-19T15:51:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-19T15:51:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-19T15:51:07.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-19T15:51:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-19T15:51:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-19T15:51:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-19T15:51:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-19T15:51:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-19T15:51:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-19T15:51:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-19T15:51:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-19T15:51:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-19T15:51:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-19T15:51:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-19T15:51:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-19T15:51:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-19T15:51:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-19T15:51:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-19T15:51:07.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-19T15:51:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-19T15:51:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-19T15:51:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-19T15:51:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-19T15:51:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-19T15:51:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-19T15:51:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-19T15:51:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-19T15:51:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-19T15:51:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-19T15:51:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-19T15:51:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-19T15:51:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-19T15:51:07.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-19T15:51:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-19T15:51:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-19T15:51:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-19T15:51:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-19T15:51:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-19T15:51:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-19T15:51:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-19T15:51:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-19T15:51:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-19T15:51:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-19T15:51:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-19T15:51:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-19T15:51:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-19T15:51:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-19T15:51:07.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-19T15:51:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-19T15:51:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-19T15:51:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-19T15:51:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-19T15:51:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-19T15:51:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-19T15:51:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-19T15:51:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-19T15:51:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-19T15:51:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-19T15:51:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-19T15:51:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-19T15:51:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-19T15:51:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-19T15:51:07.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-19T15:51:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-19T15:51:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-19T15:51:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-19T15:51:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-19T15:51:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-19T15:51:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-19T15:51:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-19T15:51:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-19T15:51:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-19T15:51:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-19T15:51:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-19T15:51:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-19T15:51:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-19T15:51:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-19T15:51:07.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-19T15:51:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-19T15:51:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-19T15:51:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-19T15:51:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-19T15:51:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-19T15:51:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-19T15:51:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-19T15:51:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-19T15:51:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-19T15:51:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-19T15:51:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-19T15:51:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-19T15:51:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-19T15:51:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-19T15:51:07.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-19T15:51:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-19T15:51:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-19T15:51:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-19T15:51:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-19T15:51:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-19T15:51:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-19T15:51:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-19T15:51:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-19T15:51:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-19T15:51:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-19T15:51:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-19T15:51:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-19T15:51:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-19T15:51:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-19T15:51:07.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-19T15:51:07.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-19T15:51:07.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-19T15:51:07.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-19T15:51:07.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-19T15:51:07.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-19T15:51:07.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-19T15:51:07.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-19T15:51:07.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-19T15:51:07.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-19T15:51:07.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-19T15:51:07.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-19T15:51:07.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-19T15:51:07.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-19T15:51:07.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-19T15:51:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-19T15:51:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-19T15:51:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-19T15:51:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-19T15:51:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-19T15:51:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-19T15:51:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-19T15:51:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-19T15:51:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-19T15:51:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-19T15:51:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-19T15:51:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-19T15:51:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-19T15:51:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-19T15:51:07.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-19T15:51:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-19T15:51:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-19T15:51:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-19T15:51:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-19T15:51:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-19T15:51:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-19T15:51:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-19T15:51:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-19T15:51:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-19T15:51:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-19T15:51:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-19T15:51:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-19T15:51:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-19T15:51:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-19T15:51:07.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-19T15:51:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-19T15:51:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-19T15:51:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-19T15:51:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-19T15:51:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-19T15:51:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-19T15:51:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-19T15:51:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-19T15:51:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-19T15:51:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-19T15:51:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-19T15:51:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-19T15:51:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-19T15:51:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-19T15:51:07.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-19T15:51:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-19T15:51:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-19T15:51:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-19T15:51:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-19T15:51:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-19T15:51:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-19T15:51:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-19T15:51:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-19T15:51:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-19T15:51:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-19T15:51:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-19T15:51:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-19T15:51:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-19T15:51:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-19T15:51:07.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-19T15:51:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-19T15:51:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-19T15:51:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-19T15:51:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-19T15:51:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-19T15:51:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-19T15:51:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-19T15:51:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-19T15:51:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-19T15:51:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-19T15:51:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-19T15:51:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-19T15:51:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-19T15:51:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-19T15:51:07.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-19T15:51:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-19T15:51:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-19T15:51:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-19T15:51:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-19T15:51:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-19T15:51:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-19T15:51:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-19T15:51:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-19T15:51:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-19T15:51:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-19T15:51:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-19T15:51:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-19T15:51:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-19T15:51:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-19T15:51:07.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-19T15:51:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-19T15:51:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-19T15:51:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-19T15:51:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-19T15:51:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-19T15:51:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-19T15:51:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-19T15:51:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-19T15:51:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-19T15:51:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-19T15:51:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-19T15:51:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-19T15:51:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-19T15:51:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-19T15:51:07.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-19T15:51:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-19T15:51:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-19T15:51:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-19T15:51:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-19T15:51:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-19T15:51:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-19T15:51:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-19T15:51:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-19T15:51:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-19T15:51:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-19T15:51:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-19T15:51:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-19T15:51:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-19T15:51:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-19T15:51:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-19T15:51:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-19T15:51:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-19T15:51:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-19T15:51:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-19T15:51:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-19T15:51:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-19T15:51:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-19T15:51:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-19T15:51:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-19T15:51:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-19T15:51:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-19T15:51:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-19T15:51:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-19T15:51:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-19T15:51:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-19T15:51:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-19T15:51:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-19T15:51:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-19T15:51:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-19T15:51:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-19T15:51:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-19T15:51:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-19T15:51:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-19T15:51:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-19T15:51:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-19T15:51:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-19T15:51:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-19T15:51:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-19T15:51:07.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-19T15:51:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-19T15:51:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-19T15:51:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-19T15:51:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-19T15:51:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-19T15:51:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-19T15:51:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-19T15:51:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-19T15:51:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-19T15:51:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-19T15:51:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-19T15:51:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-19T15:51:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-19T15:51:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-19T15:51:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-19T15:51:07.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-19T15:51:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-19T15:51:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-19T15:51:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-19T15:51:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-19T15:51:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-19T15:51:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-19T15:51:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-19T15:51:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-19T15:51:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-19T15:51:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-19T15:51:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-19T15:51:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-19T15:51:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-19T15:51:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-19T15:51:07.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-19T15:51:07.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-19T15:51:07.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-19T15:51:07.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-19T15:51:07.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-19T15:51:07.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-19T15:51:07.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-19T15:51:07.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-19T15:51:07.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-19T15:51:07.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-19T15:51:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-19T15:51:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-19T15:51:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-19T15:51:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-19T15:51:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-19T15:51:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-19T15:51:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-19T15:51:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-19T15:51:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-19T15:51:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-19T15:51:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-19T15:51:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-19T15:51:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-19T15:51:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-19T15:51:07.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-19T15:51:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-19T15:51:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-19T15:51:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-19T15:51:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-19T15:51:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-19T15:51:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-19T15:51:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-19T15:51:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-19T15:51:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-19T15:51:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-19T15:51:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-19T15:51:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-19T15:51:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-19T15:51:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-19T15:51:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-19T15:51:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-19T15:51:07.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-19T15:51:07.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-19T15:51:07.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-19T15:51:07.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-19T15:51:07.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-19T15:51:07.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-19T15:51:07.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-19T15:51:07.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-19T15:51:07.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-19T15:51:07.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-19T15:51:07.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-19T15:51:07.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-19T15:51:07.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-19T15:51:07.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-19T15:51:07.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-19T15:51:07.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-19T15:51:07.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-19T15:51:07.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-19T15:51:07.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-19T15:51:07.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-19T15:51:07.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-19T15:51:07.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-19T15:51:07.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-19T15:51:07.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-19T15:51:07.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-19T15:51:07.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-19T15:51:07.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-19T15:51:07.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-19T15:51:07.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-19T15:51:07.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-19T15:51:07.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-19T15:51:07.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-19T15:51:07.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-19T15:51:07.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-19T15:51:07.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-19T15:51:07.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-19T15:51:07.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-19T15:51:07.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-19T15:51:07.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-19T15:51:07.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-19T15:51:07.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-19T15:51:07.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-19T15:51:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-19T15:51:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-19T15:51:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-19T15:51:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-19T15:51:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-19T15:51:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-19T15:51:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-19T15:51:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-19T15:51:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-19T15:51:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-19T15:51:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-19T15:51:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-19T15:51:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-19T15:51:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-19T15:51:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-19T15:51:07.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-19T15:51:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-19T15:51:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-19T15:51:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-19T15:51:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-19T15:51:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-19T15:51:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-19T15:51:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-19T15:51:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-19T15:51:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-19T15:51:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-19T15:51:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-19T15:51:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-19T15:51:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-19T15:51:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-19T15:51:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-19T15:51:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-19T15:51:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-19T15:51:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-19T15:51:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-19T15:51:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-19T15:51:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-19T15:51:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-19T15:51:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-19T15:51:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-19T15:51:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-19T15:51:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-19T15:51:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-19T15:51:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-19T15:51:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-19T15:51:07.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-19T15:51:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-19T15:51:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-19T15:51:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-19T15:51:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-19T15:51:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-19T15:51:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-19T15:51:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-19T15:51:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-19T15:51:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-19T15:51:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-19T15:51:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-19T15:51:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-19T15:51:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-19T15:51:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-19T15:51:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-19T15:51:07.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-19T15:51:07.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-19T15:51:07.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-19T15:51:07.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-19T15:51:07.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-19T15:51:07.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-19T15:51:07.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-19T15:51:07.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-19T15:51:07.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-19T15:51:07.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-19T15:51:07.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-19T15:51:07.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-19T15:51:07.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-19T15:51:07.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-19T15:51:07.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-19T15:51:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-19T15:51:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-19T15:51:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-19T15:51:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-19T15:51:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-19T15:51:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-19T15:51:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-19T15:51:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-19T15:51:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-19T15:51:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-19T15:51:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-19T15:51:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-19T15:51:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-19T15:51:07.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-19T15:51:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-19T15:51:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-19T15:51:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-19T15:51:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-19T15:51:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-19T15:51:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-19T15:51:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-19T15:51:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-19T15:51:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-19T15:51:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-19T15:51:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-19T15:51:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-19T15:51:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-19T15:51:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-19T15:51:07.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-19T15:51:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-19T15:51:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-19T15:51:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-19T15:51:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-19T15:51:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-19T15:51:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-19T15:51:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-19T15:51:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-19T15:51:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-19T15:51:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-19T15:51:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-19T15:51:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-19T15:51:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-19T15:51:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-19T15:51:07.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-19T15:51:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-19T15:51:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-19T15:51:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-19T15:51:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-19T15:51:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-19T15:51:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-19T15:51:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-19T15:51:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-19T15:51:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-19T15:51:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-19T15:51:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-19T15:51:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-19T15:51:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-19T15:51:07.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-19T15:51:07.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-19T15:51:07.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-19T15:51:07.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-19T15:51:07.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-19T15:51:07.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-19T15:51:07.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-19T15:51:07.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-19T15:51:07.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-19T15:51:07.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-19T15:51:07.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-19T15:51:07.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-19T15:51:07.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-19T15:51:07.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-19T15:51:07.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-19T15:51:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-19T15:51:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-19T15:51:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-19T15:51:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-19T15:51:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-19T15:51:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-19T15:51:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-19T15:51:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-19T15:51:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-19T15:51:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-19T15:51:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-19T15:51:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-19T15:51:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-19T15:51:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-19T15:51:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-19T15:51:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-19T15:51:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-19T15:51:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-19T15:51:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-19T15:51:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-19T15:51:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-19T15:51:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-19T15:51:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-19T15:51:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-19T15:51:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-19T15:51:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-19T15:51:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-19T15:51:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-19T15:51:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-19T15:51:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-19T15:51:07.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-19T15:51:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-19T15:51:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-19T15:51:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-19T15:51:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-19T15:51:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-19T15:51:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-19T15:51:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-19T15:51:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-19T15:51:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-19T15:51:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-19T15:51:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-19T15:51:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-19T15:51:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-19T15:51:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-19T15:51:07.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-19T15:51:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-19T15:51:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-19T15:51:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-19T15:51:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-19T15:51:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-19T15:51:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-19T15:51:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-19T15:51:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-19T15:51:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-19T15:51:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-19T15:51:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-19T15:51:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-19T15:51:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-19T15:51:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-19T15:51:07.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-19T15:51:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-19T15:51:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-19T15:51:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-19T15:51:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-19T15:51:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-19T15:51:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-19T15:51:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-19T15:51:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-19T15:51:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-19T15:51:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-19T15:51:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-19T15:51:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-19T15:51:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-19T15:51:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-19T15:51:07.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-19T15:51:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-19T15:51:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-19T15:51:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-19T15:51:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-19T15:51:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-19T15:51:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-19T15:51:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-19T15:51:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-19T15:51:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-19T15:51:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-19T15:51:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-19T15:51:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-19T15:51:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-19T15:51:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-19T15:51:07.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-19T15:51:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-19T15:51:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-19T15:51:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-19T15:51:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-19T15:51:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-19T15:51:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-19T15:51:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-19T15:51:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-19T15:51:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-19T15:51:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-19T15:51:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-19T15:51:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-19T15:51:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-19T15:51:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-19T15:51:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-19T15:51:07.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-19T15:51:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-19T15:51:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-19T15:51:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-19T15:51:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-19T15:51:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-19T15:51:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-19T15:51:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-19T15:51:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-19T15:51:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-19T15:51:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-19T15:51:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-19T15:51:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-19T15:51:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-19T15:51:07.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-19T15:51:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-19T15:51:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-19T15:51:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-19T15:51:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-19T15:51:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-19T15:51:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-19T15:51:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-19T15:51:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-19T15:51:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-19T15:51:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-19T15:51:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-19T15:51:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-19T15:51:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-19T15:51:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-19T15:51:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-19T15:51:07.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-19T15:51:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-19T15:51:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-19T15:51:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-19T15:51:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-19T15:51:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-19T15:51:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-19T15:51:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-19T15:51:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-19T15:51:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-19T15:51:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-19T15:51:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-19T15:51:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-19T15:51:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-19T15:51:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-19T15:51:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-19T15:51:07.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-19T15:51:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-19T15:51:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-19T15:51:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-19T15:51:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-19T15:51:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-19T15:51:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-19T15:51:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-19T15:51:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-19T15:51:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-19T15:51:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-19T15:51:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-19T15:51:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-19T15:51:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-19T15:51:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-19T15:51:07.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-19T15:51:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-19T15:51:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-19T15:51:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-19T15:51:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-19T15:51:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-19T15:51:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-19T15:51:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-19T15:51:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-19T15:51:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-19T15:51:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-19T15:51:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-19T15:51:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-19T15:51:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-19T15:51:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-19T15:51:07.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-19T15:51:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-19T15:51:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-19T15:51:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-19T15:51:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-19T15:51:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-19T15:51:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-19T15:51:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-19T15:51:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-19T15:51:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-19T15:51:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-19T15:51:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-19T15:51:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-19T15:51:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-19T15:51:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-19T15:51:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-19T15:51:07.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-19T15:51:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-19T15:51:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-19T15:51:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-19T15:51:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-19T15:51:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-19T15:51:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-19T15:51:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-19T15:51:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-19T15:51:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-19T15:51:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-19T15:51:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-19T15:51:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-19T15:51:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-19T15:51:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-19T15:51:07.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-19T15:51:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-19T15:51:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-19T15:51:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-19T15:51:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-19T15:51:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-19T15:51:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-19T15:51:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-19T15:51:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-19T15:51:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-19T15:51:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-19T15:51:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-19T15:51:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-19T15:51:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-19T15:51:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-19T15:51:07.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-19T15:51:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-19T15:51:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-19T15:51:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-19T15:51:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-19T15:51:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-19T15:51:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-19T15:51:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-19T15:51:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-19T15:51:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-19T15:51:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-19T15:51:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-19T15:51:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-19T15:51:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-19T15:51:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-19T15:51:07.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-19T15:51:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-19T15:51:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-19T15:51:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-19T15:51:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-19T15:51:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-19T15:51:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-19T15:51:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-19T15:51:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-19T15:51:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-19T15:51:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-19T15:51:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-19T15:51:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-19T15:51:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-19T15:51:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-19T15:51:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-19T15:51:07.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-19T15:51:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-19T15:51:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-19T15:51:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-19T15:51:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-19T15:51:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-19T15:51:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-19T15:51:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-19T15:51:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-19T15:51:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-19T15:51:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-19T15:51:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-19T15:51:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-19T15:51:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-19T15:51:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-19T15:51:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-19T15:51:07.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-19T15:51:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-19T15:51:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-19T15:51:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-19T15:51:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-19T15:51:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-19T15:51:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-19T15:51:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-19T15:51:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-19T15:51:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-19T15:51:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-19T15:51:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-19T15:51:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-19T15:51:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-19T15:51:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-19T15:51:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-19T15:51:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-19T15:51:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-19T15:51:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-19T15:51:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-19T15:51:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-19T15:51:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-19T15:51:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-19T15:51:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-19T15:51:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-19T15:51:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-19T15:51:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-19T15:51:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-19T15:51:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-19T15:51:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-19T15:51:07.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-19T15:51:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-19T15:51:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-19T15:51:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-19T15:51:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-19T15:51:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-19T15:51:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-19T15:51:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-19T15:51:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-19T15:51:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-19T15:51:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-19T15:51:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-19T15:51:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-19T15:51:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-19T15:51:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-19T15:51:07.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-19T15:51:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-19T15:51:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-19T15:51:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-19T15:51:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-19T15:51:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-19T15:51:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-19T15:51:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-19T15:51:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-19T15:51:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-19T15:51:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-19T15:51:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-19T15:51:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-19T15:51:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-19T15:51:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-19T15:51:07.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-19T15:51:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-19T15:51:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-19T15:51:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-19T15:51:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-19T15:51:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-19T15:51:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-19T15:51:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-19T15:51:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-19T15:51:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-19T15:51:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-19T15:51:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-19T15:51:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-19T15:51:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-19T15:51:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-19T15:51:07.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-19T15:51:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-19T15:51:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-19T15:51:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-19T15:51:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-19T15:51:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-19T15:51:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-19T15:51:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-19T15:51:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-19T15:51:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-19T15:51:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-19T15:51:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-19T15:51:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-19T15:51:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-19T15:51:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-19T15:51:07.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-19T15:51:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-19T15:51:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-19T15:51:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-19T15:51:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-19T15:51:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-19T15:51:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-19T15:51:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-19T15:51:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-19T15:51:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-19T15:51:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-19T15:51:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-19T15:51:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-19T15:51:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-19T15:51:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-19T15:51:07.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-19T15:51:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-19T15:51:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-19T15:51:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-19T15:51:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-19T15:51:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-19T15:51:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-19T15:51:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-19T15:51:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-19T15:51:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-19T15:51:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-19T15:51:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-19T15:51:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-19T15:51:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-19T15:51:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-19T15:51:07.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-19T15:51:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-19T15:51:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-19T15:51:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-19T15:51:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-19T15:51:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-19T15:51:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-19T15:51:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-19T15:51:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-19T15:51:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-19T15:51:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-19T15:51:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-19T15:51:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-19T15:51:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-19T15:51:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-19T15:51:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-19T15:51:07.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-19T15:51:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-19T15:51:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-19T15:51:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-19T15:51:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-19T15:51:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-19T15:51:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-19T15:51:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-19T15:51:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-19T15:51:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-19T15:51:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-19T15:51:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-19T15:51:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-19T15:51:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-19T15:51:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-19T15:51:07.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-19T15:51:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-19T15:51:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-19T15:51:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-19T15:51:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-19T15:51:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-19T15:51:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-19T15:51:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-19T15:51:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-19T15:51:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-19T15:51:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-19T15:51:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-19T15:51:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-19T15:51:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-19T15:51:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-19T15:51:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-19T15:51:07.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-19T15:51:07.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-19T15:51:07.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-19T15:51:07.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-19T15:51:07.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-19T15:51:07.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-19T15:51:07.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-19T15:51:07.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-19T15:51:07.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-19T15:51:07.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-19T15:51:07.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-19T15:51:07.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-19T15:51:07.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-19T15:51:07.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-19T15:51:07.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-19T15:51:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-19T15:51:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-19T15:51:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-19T15:51:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-19T15:51:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-19T15:51:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-19T15:51:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-19T15:51:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-19T15:51:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-19T15:51:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-19T15:51:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-19T15:51:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-19T15:51:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-19T15:51:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-19T15:51:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-19T15:51:07.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-19T15:51:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-19T15:51:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-19T15:51:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-19T15:51:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-19T15:51:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-19T15:51:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-19T15:51:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-19T15:51:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-19T15:51:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-19T15:51:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-19T15:51:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-19T15:51:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-19T15:51:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-19T15:51:07.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-19T15:51:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-19T15:51:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-19T15:51:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-19T15:51:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-19T15:51:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-19T15:51:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-19T15:51:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-19T15:51:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-19T15:51:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-19T15:51:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-19T15:51:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-19T15:51:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-19T15:51:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-19T15:51:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-19T15:51:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-19T15:51:07.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-19T15:51:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-19T15:51:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-19T15:51:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-19T15:51:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-19T15:51:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-19T15:51:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-19T15:51:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-19T15:51:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-19T15:51:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-19T15:51:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-19T15:51:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-19T15:51:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-19T15:51:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-19T15:51:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-19T15:51:07.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-19T15:51:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-19T15:51:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-19T15:51:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-19T15:51:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-19T15:51:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-19T15:51:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-19T15:51:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-19T15:51:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-19T15:51:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-19T15:51:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-19T15:51:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-19T15:51:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-19T15:51:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-19T15:51:07.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-19T15:51:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-19T15:51:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-19T15:51:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-19T15:51:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-19T15:51:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-19T15:51:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-19T15:51:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-19T15:51:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-19T15:51:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-19T15:51:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-19T15:51:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-19T15:51:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-19T15:51:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-19T15:51:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-19T15:51:07.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-19T15:51:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-19T15:51:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-19T15:51:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-19T15:51:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-19T15:51:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-19T15:51:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-19T15:51:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-19T15:51:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-19T15:51:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-19T15:51:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-19T15:51:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-19T15:51:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-19T15:51:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-19T15:51:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-19T15:51:07.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-19T15:51:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-19T15:51:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-19T15:51:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-19T15:51:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-19T15:51:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-19T15:51:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-19T15:51:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-19T15:51:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-19T15:51:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-19T15:51:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-19T15:51:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-19T15:51:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-19T15:51:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-19T15:51:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-19T15:51:07.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-19T15:51:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-19T15:51:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-19T15:51:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-19T15:51:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-19T15:51:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-19T15:51:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-19T15:51:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-19T15:51:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-19T15:51:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-19T15:51:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-19T15:51:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-19T15:51:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-19T15:51:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-19T15:51:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-19T15:51:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-19T15:51:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-19T15:51:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-19T15:51:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-19T15:51:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-19T15:51:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-19T15:51:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-19T15:51:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-19T15:51:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-19T15:51:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-19T15:51:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-19T15:51:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-19T15:51:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-19T15:51:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-19T15:51:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-19T15:51:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-19T15:51:07.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-19T15:51:07.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-19T15:51:07.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-19T15:51:07.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-19T15:51:07.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-19T15:51:07.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-19T15:51:07.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-19T15:51:07.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-19T15:51:07.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-19T15:51:07.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-19T15:51:07.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-19T15:51:07.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-19T15:51:07.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-19T15:51:07.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-19T15:51:07.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-19T15:51:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-19T15:51:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-19T15:51:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-19T15:51:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-19T15:51:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-19T15:51:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-19T15:51:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-19T15:51:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-19T15:51:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-19T15:51:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-19T15:51:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-19T15:51:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-19T15:51:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-19T15:51:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-19T15:51:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-19T15:51:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-19T15:51:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-19T15:51:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-19T15:51:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-19T15:51:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-19T15:51:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-19T15:51:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-19T15:51:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-19T15:51:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-19T15:51:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-19T15:51:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-19T15:51:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-19T15:51:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-19T15:51:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-19T15:51:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-19T15:51:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-19T15:51:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-19T15:51:07.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-19T15:51:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-19T15:51:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-19T15:51:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-19T15:51:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-19T15:51:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-19T15:51:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-19T15:51:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-19T15:51:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-19T15:51:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-19T15:51:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-19T15:51:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-19T15:51:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-19T15:51:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-19T15:51:07.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-19T15:51:07.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-19T15:51:07.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-19T15:51:07.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-19T15:51:07.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-19T15:51:07.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-19T15:51:07.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-19T15:51:07.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-19T15:51:07.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-19T15:51:07.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-19T15:51:07.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-19T15:51:07.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-19T15:51:07.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-19T15:51:07.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-19T15:51:07.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-19T15:51:07.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-19T15:51:07.338 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-19T15:51:07.338 DEBUG:teuthology.orchestra.run.smithi151:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-19T15:51:07.360 INFO:teuthology.orchestra.run.smithi151.stdout:postinstall scriptlet (using /bin/sh): 2023-12-19T15:51:07.360 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-19T15:51:07.360 INFO:teuthology.orchestra.run.smithi151.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-19T15:51:07.360 INFO:teuthology.orchestra.run.smithi151.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T15:51:07.360 INFO:teuthology.orchestra.run.smithi151.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T15:51:07.360 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T15:51:07.360 INFO:teuthology.orchestra.run.smithi151.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T15:51:07.360 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-12-19T15:51:07.360 INFO:teuthology.orchestra.run.smithi151.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-19T15:51:07.361 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-19T15:51:07.361 INFO:teuthology.orchestra.run.smithi151.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-19T15:51:07.361 INFO:teuthology.orchestra.run.smithi151.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-19T15:51:07.361 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-19T15:51:07.361 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-12-19T15:51:07.361 INFO:teuthology.orchestra.run.smithi151.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-19T15:51:07.361 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-19T15:51:07.361 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-19T15:51:07.361 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-12-19T15:51:07.362 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -qi grub2-tools 2023-12-19T15:51:07.436 INFO:teuthology.orchestra.run.smithi151.stdout:Name : grub2-tools 2023-12-19T15:51:07.436 INFO:teuthology.orchestra.run.smithi151.stdout:Epoch : 1 2023-12-19T15:51:07.436 INFO:teuthology.orchestra.run.smithi151.stdout:Version : 2.06 2023-12-19T15:51:07.436 INFO:teuthology.orchestra.run.smithi151.stdout:Release : 68.el9 2023-12-19T15:51:07.436 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: x86_64 2023-12-19T15:51:07.436 INFO:teuthology.orchestra.run.smithi151.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-19T15:51:07.436 INFO:teuthology.orchestra.run.smithi151.stdout:Group : Unspecified 2023-12-19T15:51:07.436 INFO:teuthology.orchestra.run.smithi151.stdout:Size : 8264254 2023-12-19T15:51:07.436 INFO:teuthology.orchestra.run.smithi151.stdout:License : GPLv3+ 2023-12-19T15:51:07.436 INFO:teuthology.orchestra.run.smithi151.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-19T15:51:07.436 INFO:teuthology.orchestra.run.smithi151.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-19T15:51:07.437 INFO:teuthology.orchestra.run.smithi151.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-19T15:51:07.437 INFO:teuthology.orchestra.run.smithi151.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-19T15:51:07.437 INFO:teuthology.orchestra.run.smithi151.stdout:Packager : builder@centos.org 2023-12-19T15:51:07.437 INFO:teuthology.orchestra.run.smithi151.stdout:Vendor : CentOS 2023-12-19T15:51:07.437 INFO:teuthology.orchestra.run.smithi151.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-19T15:51:07.437 INFO:teuthology.orchestra.run.smithi151.stdout:Summary : Support tools for GRUB. 2023-12-19T15:51:07.437 INFO:teuthology.orchestra.run.smithi151.stdout:Description : 2023-12-19T15:51:07.437 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T15:51:07.437 INFO:teuthology.orchestra.run.smithi151.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-19T15:51:07.437 INFO:teuthology.orchestra.run.smithi151.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-19T15:51:07.437 INFO:teuthology.orchestra.run.smithi151.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-19T15:51:07.437 INFO:teuthology.orchestra.run.smithi151.stdout:hardware devices. 2023-12-19T15:51:07.437 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T15:51:07.437 INFO:teuthology.orchestra.run.smithi151.stdout:This subpackage provides tools for support of all platforms. 2023-12-19T15:51:07.438 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-19T15:51:07.438 INFO:teuthology.task.kernel:Updating grub on smithi151 to boot 6.6.0-gcd68252d7b4d 2023-12-19T15:51:07.439 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-19T15:51:08.006 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2023-12-19T15:51:09.383 INFO:teuthology.orchestra.run.smithi151.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-19T15:51:09.415 INFO:teuthology.orchestra.run.smithi151.stderr:done 2023-12-19T15:51:09.418 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2023-12-19T15:51:09.433 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.LznUXQjB67 2023-12-19T15:51:09.433 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.LznUXQjB67 2023-12-19T15:51:09.502 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.LznUXQjB67 2023-12-19T15:51:09.648 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.LznUXQjB67 is 6KB 2023-12-19T15:51:09.697 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.LznUXQjB67 2023-12-19T15:51:09.712 DEBUG:teuthology.orchestra.run.smithi151:> sudo /bin/ls /boot/loader/entries || true 2023-12-19T15:51:09.779 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-19T15:51:09.780 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-19T15:51:09.780 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-19T15:51:09.780 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d.conf 2023-12-19T15:51:09.782 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d 2023-12-19T15:51:09.942 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2023-12-19T15:51:39.945 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-19T15:51:39.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-19T15:51:39.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:51:58.485 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-12-19T15:52:07.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-19T15:52:07.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:52:10.545 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-12-19T15:52:22.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-19T15:52:22.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:53:22.550 DEBUG:teuthology.orchestra.remote:timed out 2023-12-19T15:53:37.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-19T15:53:37.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:53:38.098 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-12-19T15:53:38.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-19T15:53:38.775 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-gcd68252d7b4d"... 2023-12-19T15:53:38.776 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-12-19T15:53:38.829 INFO:teuthology.orchestra.run.smithi151.stdout:6.6.0-gcd68252d7b4d 2023-12-19T15:53:38.830 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-19T15:53:38.830 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-19T15:53:38.830 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-19T15:53:39.831 DEBUG:teuthology.parallel:result is None 2023-12-19T15:53:39.831 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-19T15:53:39.838 INFO:teuthology.task.internal:Creating test directory... 2023-12-19T15:53:39.839 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T15:53:39.842 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T15:53:39.844 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T15:53:39.904 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-19T15:53:39.911 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-19T15:53:39.921 INFO:teuthology.task.internal:Creating archive directory... 2023-12-19T15:53:39.922 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T15:53:39.924 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T15:53:39.926 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T15:53:40.022 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-19T15:53:40.031 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-19T15:53:40.031 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T15:53:40.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T15:53:40.049 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T15:53:40.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T15:53:40.066 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T15:53:40.092 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T15:53:40.108 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T15:53:40.134 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T15:53:40.157 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T15:53:40.173 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T15:53:40.191 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T15:53:40.251 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T15:53:40.323 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T15:53:40.328 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-19T15:53:40.336 INFO:teuthology.task.internal:Configuring sudo... 2023-12-19T15:53:40.336 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T15:53:40.338 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T15:53:40.341 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T15:53:40.440 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-19T15:53:40.451 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-19T15:53:40.451 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T15:53:40.453 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T15:53:40.455 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T15:53:40.513 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T15:53:40.558 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T15:53:40.615 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T15:53:40.694 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T15:53:40.748 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T15:53:40.749 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T15:53:40.822 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T15:53:40.863 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T15:53:40.925 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T15:53:41.006 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T15:53:41.055 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T15:53:41.056 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T15:53:41.126 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T15:53:41.205 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T15:53:41.323 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T15:53:41.403 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T15:53:41.503 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T15:53:41.503 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T15:53:41.595 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2023-12-19T15:53:41.598 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2023-12-19T15:53:41.600 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2023-12-19T15:53:41.640 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T15:53:41.645 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T15:53:41.771 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T15:53:42.006 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-19T15:53:42.016 INFO:teuthology.task.internal:Starting timer... 2023-12-19T15:53:42.016 INFO:teuthology.run_tasks:Running task pcp... 2023-12-19T15:53:42.042 INFO:teuthology.run_tasks:Running task selinux... 2023-12-19T15:53:42.091 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2023-12-19T15:53:42.175 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2023-12-19T15:53:42.177 DEBUG:teuthology.orchestra.run.smithi078:> sudo service auditd rotate 2023-12-19T15:53:42.234 INFO:teuthology.orchestra.run.smithi078.stdout:Rotating logs: 2023-12-19T15:53:42.236 DEBUG:teuthology.orchestra.run.smithi151:> sudo service auditd rotate 2023-12-19T15:53:42.380 INFO:teuthology.orchestra.run.smithi151.stdout:Rotating logs: 2023-12-19T15:53:42.385 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-19T15:53:42.385 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2023-12-19T15:53:42.409 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2023-12-19T15:53:42.409 DEBUG:teuthology.orchestra.run.smithi078:> /usr/sbin/getenforce 2023-12-19T15:53:42.427 INFO:teuthology.orchestra.run.smithi078.stdout:Permissive 2023-12-19T15:53:42.428 DEBUG:teuthology.orchestra.run.smithi151:> /usr/sbin/getenforce 2023-12-19T15:53:42.489 INFO:teuthology.orchestra.run.smithi151.stdout:Permissive 2023-12-19T15:53:42.489 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi078.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi151.front.sepia.ceph.com': 'permissive'} 2023-12-19T15:53:42.489 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T15:53:42.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T15:53:42.522 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T15:53:42.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T15:53:42.550 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T15:53:42.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T15:53:42.650 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-19T15:53:42.650 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2023-12-19T15:53:42.695 DEBUG:teuthology.orchestra.run.smithi078:> sudo /usr/sbin/setenforce permissive 2023-12-19T15:53:42.730 DEBUG:teuthology.orchestra.run.smithi151:> sudo /usr/sbin/setenforce permissive 2023-12-19T15:53:42.842 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-19T15:53:42.852 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-19T15:53:42.858 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-19T15:53:42.993 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-19T15:53:43.010 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-19T15:53:43.011 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi078.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-19T16:03:57.670 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi078.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2023-12-19T16:03:57.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-19T16:03:57.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:03:57.779 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-12-19T16:03:57.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-19T16:03:57.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-12-19T16:03:57.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:03:57.938 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-12-19T16:03:58.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-12-19T16:03:58.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-19T16:03:58.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:03:58.144 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-12-19T16:03:58.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-19T16:03:58.301 INFO:teuthology.run_tasks:Running task clock... 2023-12-19T16:03:58.312 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-19T16:03:58.313 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T16:03:58.313 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T16:03:58.316 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T16:03:58.317 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T16:03:58.319 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T16:03:58.320 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T16:03:58.353 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-19T16:03:58.354 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-19T16:03:58.372 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-19T16:03:58.376 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-19T16:03:58.404 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: ntpd: command not found 2023-12-19T16:03:58.414 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2023-12-19T16:03:58.418 INFO:teuthology.orchestra.run.smithi078.stdout:506 Cannot talk to daemon 2023-12-19T16:03:58.419 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-19T16:03:58.432 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2023-12-19T16:03:58.436 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-19T16:03:58.453 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-19T16:03:58.453 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-19T16:03:58.472 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-19T16:03:58.473 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-19T16:03:58.497 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: ntpq: command not found 2023-12-19T16:03:58.501 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T16:03:58.501 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2023-12-19T16:03:58.501 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T16:03:58.501 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T16:03:58.501 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T16:03:58.502 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T16:03:58.521 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2023-12-19T16:03:58.525 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T16:03:58.525 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2023-12-19T16:03:58.525 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T16:03:58.525 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T16:03:58.525 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T16:03:58.525 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T16:03:58.564 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: ntpd: command not found 2023-12-19T16:03:58.603 INFO:teuthology.orchestra.run.smithi151.stdout:506 Cannot talk to daemon 2023-12-19T16:03:58.649 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-19T16:03:58.696 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-19T16:03:58.816 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2023-12-19T16:03:58.824 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T16:03:58.824 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-12-19T16:03:58.824 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T16:03:58.825 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T16:03:58.825 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T16:03:58.825 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T16:03:58.826 INFO:teuthology.run_tasks:Running task install... 2023-12-19T16:03:58.839 DEBUG:teuthology.task.install:project ceph 2023-12-19T16:03:58.839 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}} 2023-12-19T16:03:58.839 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'} 2023-12-19T16:03:58.839 INFO:teuthology.task.install:Using flavor: default 2023-12-19T16:03:58.845 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-19T16:03:58.845 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-19T16:03:58.846 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'tag': None, 'wait_for_package': False} 2023-12-19T16:03:58.846 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T16:03:58.848 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'tag': None, 'wait_for_package': False} 2023-12-19T16:03:58.849 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T16:03:58.850 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'tag': None, 'wait_for_package': False} 2023-12-19T16:03:58.850 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T16:03:58.994 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/ 2023-12-19T16:03:58.994 INFO:teuthology.task.install.rpm:Package version is 18.2.1-132.g568df92b 2023-12-19T16:03:58.998 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/ 2023-12-19T16:03:58.998 INFO:teuthology.task.install.rpm:Package version is 18.2.1-132.g568df92b 2023-12-19T16:03:59.161 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/ 2023-12-19T16:03:59.162 INFO:teuthology.task.install.rpm:Package version is 18.2.1-132.g568df92b 2023-12-19T16:03:59.271 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-19T16:03:59.271 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T16:03:59.272 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-19T16:03:59.374 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-19T16:03:59.375 DEBUG:teuthology.orchestra.run.smithi151:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/568df92b7e50b2108bce4c77c393ff294d6a5e5e/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-19T16:03:59.402 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-19T16:03:59.402 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:03:59.402 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-19T16:03:59.440 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-19T16:03:59.440 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/568df92b7e50b2108bce4c77c393ff294d6a5e5e/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-19T16:03:59.452 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-19T16:03:59.453 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T16:03:59.453 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-19T16:03:59.485 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-19T16:03:59.485 DEBUG:teuthology.orchestra.run.smithi078:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/568df92b7e50b2108bce4c77c393ff294d6a5e5e/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-19T16:03:59.517 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-19T16:03:59.520 DEBUG:teuthology.orchestra.run.smithi151:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-19T16:03:59.557 DEBUG:teuthology.orchestra.run.smithi078:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-19T16:03:59.609 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-19T16:03:59.642 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2023-12-19T16:03:59.643 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2023-12-19T16:03:59.644 DEBUG:teuthology.orchestra.run.smithi078:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-19T16:03:59.656 DEBUG:teuthology.orchestra.run.smithi151:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-19T16:03:59.671 INFO:teuthology.orchestra.run.smithi078.stdout:check_obsoletes = 1 2023-12-19T16:03:59.673 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum clean all 2023-12-19T16:03:59.747 INFO:teuthology.orchestra.run.smithi151.stdout:check_obsoletes = 1 2023-12-19T16:03:59.751 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum clean all 2023-12-19T16:03:59.893 INFO:teuthology.orchestra.run.smithi037.stdout:73 files removed 2023-12-19T16:03:59.910 INFO:teuthology.orchestra.run.smithi078.stdout:73 files removed 2023-12-19T16:03:59.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-19T16:03:59.937 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-19T16:04:00.118 INFO:teuthology.orchestra.run.smithi151.stdout:73 files removed 2023-12-19T16:04:00.156 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-19T16:04:00.577 INFO:teuthology.orchestra.run.smithi078.stdout:ceph packages for x86_64 221 kB/s | 77 kB 00:00 2023-12-19T16:04:00.870 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 121 kB/s | 77 kB 00:00 2023-12-19T16:04:01.177 INFO:teuthology.orchestra.run.smithi078.stdout:ceph noarch packages 17 kB/s | 9.5 kB 00:00 2023-12-19T16:04:01.291 INFO:teuthology.orchestra.run.smithi151.stdout:ceph packages for x86_64 125 kB/s | 77 kB 00:00 2023-12-19T16:04:01.320 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 23 kB/s | 9.5 kB 00:00 2023-12-19T16:04:01.594 INFO:teuthology.orchestra.run.smithi078.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2023-12-19T16:04:01.762 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 4.6 kB/s | 1.9 kB 00:00 2023-12-19T16:04:01.975 INFO:teuthology.orchestra.run.smithi151.stdout:ceph noarch packages 16 kB/s | 9.5 kB 00:00 2023-12-19T16:04:02.247 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS-9 - AppStream 10 MB/s | 6.4 MB 00:00 2023-12-19T16:04:02.473 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-9 - AppStream 9.4 MB/s | 6.4 MB 00:00 2023-12-19T16:04:02.617 INFO:teuthology.orchestra.run.smithi151.stdout:ceph source packages 3.3 kB/s | 1.9 kB 00:00 2023-12-19T16:04:03.629 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - AppStream 6.8 MB/s | 6.4 MB 00:00 2023-12-19T16:04:03.831 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS-9 - BaseOS 3.8 MB/s | 2.0 MB 00:00 2023-12-19T16:04:04.132 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-9 - BaseOS 4.1 MB/s | 2.0 MB 00:00 2023-12-19T16:04:05.397 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - BaseOS 3.7 MB/s | 2.0 MB 00:00 2023-12-19T16:04:06.134 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 7.9 MB 00:01 2023-12-19T16:04:07.542 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 7.9 MB 00:01 2023-12-19T16:04:08.329 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - BaseOS 1.9 MB/s | 7.9 MB 00:04 2023-12-19T16:04:09.852 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 16 MB/s | 18 MB 00:01 2023-12-19T16:04:10.720 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - AppStream 14 MB/s | 18 MB 00:01 2023-12-19T16:04:12.281 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 3.6 MB/s | 18 MB 00:05 2023-12-19T16:04:14.648 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - CRB 10 MB/s | 5.8 MB 00:00 2023-12-19T16:04:14.968 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 5.8 MB 00:01 2023-12-19T16:04:16.065 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 15 kB 00:00 2023-12-19T16:04:16.182 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 14 MB/s | 5.8 MB 00:00 2023-12-19T16:04:16.755 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 15 kB 00:00 2023-12-19T16:04:17.566 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 15 kB 00:00 2023-12-19T16:04:17.790 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 23 MB/s | 20 MB 00:00 2023-12-19T16:04:18.729 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2023-12-19T16:04:18.884 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 7.3 MB/s | 20 MB 00:02 2023-12-19T16:04:23.307 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2023-12-19T16:04:23.568 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2023-12-19T16:04:23.575 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2023-12-19T16:04:25.953 INFO:teuthology.orchestra.run.smithi151.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T16:04:25.955 INFO:teuthology.orchestra.run.smithi151.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T16:04:25.975 INFO:teuthology.orchestra.run.smithi151.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-19T16:04:25.977 INFO:teuthology.orchestra.run.smithi151.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-19T16:04:25.978 INFO:teuthology.orchestra.run.smithi151.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-19T16:04:25.979 INFO:teuthology.orchestra.run.smithi151.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-19T16:04:25.982 INFO:teuthology.orchestra.run.smithi151.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-19T16:04:25.984 INFO:teuthology.orchestra.run.smithi078.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T16:04:25.985 INFO:teuthology.orchestra.run.smithi078.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T16:04:25.985 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-19T16:04:25.987 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T16:04:25.999 INFO:teuthology.orchestra.run.smithi078.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-19T16:04:25.999 INFO:teuthology.orchestra.run.smithi078.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-19T16:04:26.000 INFO:teuthology.orchestra.run.smithi078.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-19T16:04:26.002 INFO:teuthology.orchestra.run.smithi078.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-19T16:04:26.004 INFO:teuthology.orchestra.run.smithi078.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-19T16:04:26.006 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-19T16:04:26.007 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T16:04:26.043 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T16:04:26.044 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T16:04:26.058 INFO:teuthology.orchestra.run.smithi037.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-19T16:04:26.059 INFO:teuthology.orchestra.run.smithi037.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-19T16:04:26.060 INFO:teuthology.orchestra.run.smithi037.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-19T16:04:26.061 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-19T16:04:26.063 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-19T16:04:26.066 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-19T16:04:26.067 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T16:04:26.069 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-12-19T16:04:26.079 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2023-12-19T16:04:26.101 INFO:teuthology.orchestra.run.smithi151.stdout:=========================================================================================== 2023-12-19T16:04:26.105 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-12-19T16:04:26.105 INFO:teuthology.orchestra.run.smithi151.stdout:=========================================================================================== 2023-12-19T16:04:26.105 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-12-19T16:04:26.105 INFO:teuthology.orchestra.run.smithi151.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-19T16:04:26.105 INFO:teuthology.orchestra.run.smithi151.stdout: ceph x86_64 2:18.2.1-132.g568df92b.el9 ceph 6.5 k 2023-12-19T16:04:26.105 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base x86_64 2:18.2.1-132.g568df92b.el9 ceph 5.2 M 2023-12-19T16:04:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse x86_64 2:18.2.1-132.g568df92b.el9 ceph 840 k 2023-12-19T16:04:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-132.g568df92b.el9 ceph 142 k 2023-12-19T16:04:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr x86_64 2:18.2.1-132.g568df92b.el9 ceph 1.4 M 2023-12-19T16:04:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 132 k 2023-12-19T16:04:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 1.8 M 2023-12-19T16:04:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 7.4 M 2023-12-19T16:04:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 50 k 2023-12-19T16:04:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw x86_64 2:18.2.1-132.g568df92b.el9 ceph 7.7 M 2023-12-19T16:04:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test x86_64 2:18.2.1-132.g568df92b.el9 ceph 40 M 2023-12-19T16:04:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 262 k 2023-12-19T16:04:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 221 k 2023-12-19T16:04:26.106 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror x86_64 2:18.2.1-132.g568df92b.el9 ceph 219 k 2023-12-19T16:04:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-shell x86_64 2:18.2.1-132.g568df92b.el9 ceph 27 k 2023-12-19T16:04:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 18 k 2023-12-19T16:04:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-19T16:04:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-19T16:04:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-19T16:04:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel x86_64 2:18.2.1-132.g568df92b.el9 ceph 31 k 2023-12-19T16:04:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 658 k 2023-12-19T16:04:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel x86_64 2:18.2.1-132.g568df92b.el9 ceph 126 k 2023-12-19T16:04:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-19T16:04:26.107 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-19T16:04:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-19T16:04:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-19T16:04:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-19T16:04:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-19T16:04:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs x86_64 2:18.2.1-132.g568df92b.el9 ceph 161 k 2023-12-19T16:04:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados x86_64 2:18.2.1-132.g568df92b.el9 ceph 321 k 2023-12-19T16:04:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd x86_64 2:18.2.1-132.g568df92b.el9 ceph 298 k 2023-12-19T16:04:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw x86_64 2:18.2.1-132.g568df92b.el9 ceph 99 k 2023-12-19T16:04:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse x86_64 2:18.2.1-132.g568df92b.el9 ceph 86 k 2023-12-19T16:04:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.0 M 2023-12-19T16:04:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd x86_64 2:18.2.1-132.g568df92b.el9 ceph 171 k 2023-12-19T16:04:26.108 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-19T16:04:26.108 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2023-12-19T16:04:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-19T16:04:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-19T16:04:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-19T16:04:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-19T16:04:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-19T16:04:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-19T16:04:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-19T16:04:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-19T16:04:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-19T16:04:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-19T16:04:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.3 M 2023-12-19T16:04:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1 x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.0 M 2023-12-19T16:04:26.109 INFO:teuthology.orchestra.run.smithi151.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-19T16:04:26.110 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-19T16:04:26.110 INFO:teuthology.orchestra.run.smithi151.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-19T16:04:26.110 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-12-19T16:04:26.110 INFO:teuthology.orchestra.run.smithi151.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-19T16:04:26.110 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-19T16:04:26.110 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common x86_64 2:18.2.1-132.g568df92b.el9 ceph 18 M 2023-12-19T16:04:26.110 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 23 k 2023-12-19T16:04:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds x86_64 2:18.2.1-132.g568df92b.el9 ceph 2.1 M 2023-12-19T16:04:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 242 k 2023-12-19T16:04:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon x86_64 2:18.2.1-132.g568df92b.el9 ceph 4.4 M 2023-12-19T16:04:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd x86_64 2:18.2.1-132.g568df92b.el9 ceph 18 M 2023-12-19T16:04:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 15 k 2023-12-19T16:04:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux x86_64 2:18.2.1-132.g568df92b.el9 ceph 24 k 2023-12-19T16:04:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-19T16:04:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-19T16:04:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-19T16:04:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-19T16:04:26.111 INFO:teuthology.orchestra.run.smithi151.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-19T16:04:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-19T16:04:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-19T16:04:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-19T16:04:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-19T16:04:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite x86_64 2:18.2.1-132.g568df92b.el9 ceph 166 k 2023-12-19T16:04:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-19T16:04:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-19T16:04:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-19T16:04:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-19T16:04:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-19T16:04:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 x86_64 2:18.2.1-132.g568df92b.el9 ceph 475 k 2023-12-19T16:04:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-19T16:04:26.112 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 4.5 M 2023-12-19T16:04:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-19T16:04:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-19T16:04:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-19T16:04:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-19T16:04:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-19T16:04:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-19T16:04:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-19T16:04:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-19T16:04:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-19T16:04:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-19T16:04:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-19T16:04:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-19T16:04:26.113 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-19T16:04:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse x86_64 2:18.2.1-132.g568df92b.el9 ceph 45 k 2023-12-19T16:04:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common x86_64 2:18.2.1-132.g568df92b.el9 ceph 124 k 2023-12-19T16:04:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-19T16:04:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-19T16:04:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-19T16:04:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-19T16:04:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-19T16:04:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-19T16:04:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-19T16:04:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-19T16:04:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-19T16:04:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-19T16:04:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-19T16:04:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-19T16:04:26.114 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-19T16:04:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-19T16:04:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-19T16:04:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-19T16:04:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-19T16:04:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-19T16:04:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-19T16:04:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-19T16:04:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-19T16:04:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-19T16:04:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-19T16:04:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-19T16:04:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-19T16:04:26.115 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-19T16:04:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-19T16:04:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-19T16:04:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-19T16:04:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-19T16:04:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-19T16:04:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-19T16:04:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-19T16:04:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-19T16:04:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-19T16:04:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-19T16:04:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-19T16:04:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-19T16:04:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-19T16:04:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-19T16:04:26.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-19T16:04:26.117 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-19T16:04:26.117 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-19T16:04:26.117 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-19T16:04:26.117 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-19T16:04:26.117 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-19T16:04:26.117 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-19T16:04:26.117 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-19T16:04:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-19T16:04:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-19T16:04:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-19T16:04:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-19T16:04:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-19T16:04:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-19T16:04:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-19T16:04:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-19T16:04:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-19T16:04:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-19T16:04:26.118 INFO:teuthology.orchestra.run.smithi151.stdout:Installing weak dependencies: 2023-12-19T16:04:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-19T16:04:26.118 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:04:26.118 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-12-19T16:04:26.119 INFO:teuthology.orchestra.run.smithi151.stdout:=========================================================================================== 2023-12-19T16:04:26.119 INFO:teuthology.orchestra.run.smithi151.stdout:Install 139 Packages 2023-12-19T16:04:26.119 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 15 Packages 2023-12-19T16:04:26.119 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:04:26.120 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 200 M 2023-12-19T16:04:26.120 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-12-19T16:04:26.120 INFO:teuthology.orchestra.run.smithi078.stdout:=========================================================================================== 2023-12-19T16:04:26.120 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2023-12-19T16:04:26.121 INFO:teuthology.orchestra.run.smithi078.stdout:=========================================================================================== 2023-12-19T16:04:26.121 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2023-12-19T16:04:26.121 INFO:teuthology.orchestra.run.smithi078.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-19T16:04:26.121 INFO:teuthology.orchestra.run.smithi078.stdout: ceph x86_64 2:18.2.1-132.g568df92b.el9 ceph 6.5 k 2023-12-19T16:04:26.121 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base x86_64 2:18.2.1-132.g568df92b.el9 ceph 5.2 M 2023-12-19T16:04:26.121 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse x86_64 2:18.2.1-132.g568df92b.el9 ceph 840 k 2023-12-19T16:04:26.121 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-132.g568df92b.el9 ceph 142 k 2023-12-19T16:04:26.121 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr x86_64 2:18.2.1-132.g568df92b.el9 ceph 1.4 M 2023-12-19T16:04:26.121 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 132 k 2023-12-19T16:04:26.121 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 1.8 M 2023-12-19T16:04:26.122 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 7.4 M 2023-12-19T16:04:26.122 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 50 k 2023-12-19T16:04:26.122 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw x86_64 2:18.2.1-132.g568df92b.el9 ceph 7.7 M 2023-12-19T16:04:26.122 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test x86_64 2:18.2.1-132.g568df92b.el9 ceph 40 M 2023-12-19T16:04:26.122 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-volume noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 262 k 2023-12-19T16:04:26.122 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 221 k 2023-12-19T16:04:26.122 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror x86_64 2:18.2.1-132.g568df92b.el9 ceph 219 k 2023-12-19T16:04:26.122 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-shell x86_64 2:18.2.1-132.g568df92b.el9 ceph 27 k 2023-12-19T16:04:26.122 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-top noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 18 k 2023-12-19T16:04:26.122 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-19T16:04:26.122 INFO:teuthology.orchestra.run.smithi078.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-19T16:04:26.122 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-19T16:04:26.122 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel x86_64 2:18.2.1-132.g568df92b.el9 ceph 31 k 2023-12-19T16:04:26.123 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 658 k 2023-12-19T16:04:26.123 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel x86_64 2:18.2.1-132.g568df92b.el9 ceph 126 k 2023-12-19T16:04:26.123 INFO:teuthology.orchestra.run.smithi078.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-19T16:04:26.123 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-19T16:04:26.123 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-19T16:04:26.123 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-19T16:04:26.123 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-19T16:04:26.123 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-19T16:04:26.123 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs x86_64 2:18.2.1-132.g568df92b.el9 ceph 161 k 2023-12-19T16:04:26.123 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados x86_64 2:18.2.1-132.g568df92b.el9 ceph 321 k 2023-12-19T16:04:26.123 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd x86_64 2:18.2.1-132.g568df92b.el9 ceph 298 k 2023-12-19T16:04:26.123 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw x86_64 2:18.2.1-132.g568df92b.el9 ceph 99 k 2023-12-19T16:04:26.123 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse x86_64 2:18.2.1-132.g568df92b.el9 ceph 86 k 2023-12-19T16:04:26.124 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.0 M 2023-12-19T16:04:26.124 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd x86_64 2:18.2.1-132.g568df92b.el9 ceph 171 k 2023-12-19T16:04:26.124 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-19T16:04:26.124 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrading: 2023-12-19T16:04:26.124 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-19T16:04:26.124 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-19T16:04:26.124 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-19T16:04:26.124 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-19T16:04:26.124 INFO:teuthology.orchestra.run.smithi078.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-19T16:04:26.124 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-19T16:04:26.124 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-19T16:04:26.124 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-19T16:04:26.124 INFO:teuthology.orchestra.run.smithi078.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-19T16:04:26.124 INFO:teuthology.orchestra.run.smithi078.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-19T16:04:26.125 INFO:teuthology.orchestra.run.smithi078.stdout: librados2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.3 M 2023-12-19T16:04:26.125 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1 x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.0 M 2023-12-19T16:04:26.125 INFO:teuthology.orchestra.run.smithi078.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-19T16:04:26.125 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-19T16:04:26.125 INFO:teuthology.orchestra.run.smithi078.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-19T16:04:26.125 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2023-12-19T16:04:26.125 INFO:teuthology.orchestra.run.smithi078.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-19T16:04:26.125 INFO:teuthology.orchestra.run.smithi078.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-19T16:04:26.125 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common x86_64 2:18.2.1-132.g568df92b.el9 ceph 18 M 2023-12-19T16:04:26.125 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 23 k 2023-12-19T16:04:26.125 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds x86_64 2:18.2.1-132.g568df92b.el9 ceph 2.1 M 2023-12-19T16:04:26.125 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 242 k 2023-12-19T16:04:26.125 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon x86_64 2:18.2.1-132.g568df92b.el9 ceph 4.4 M 2023-12-19T16:04:26.125 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd x86_64 2:18.2.1-132.g568df92b.el9 ceph 18 M 2023-12-19T16:04:26.126 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 15 k 2023-12-19T16:04:26.126 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux x86_64 2:18.2.1-132.g568df92b.el9 ceph 24 k 2023-12-19T16:04:26.126 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-19T16:04:26.126 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-19T16:04:26.126 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-19T16:04:26.126 INFO:teuthology.orchestra.run.smithi078.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-19T16:04:26.126 INFO:teuthology.orchestra.run.smithi078.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-19T16:04:26.126 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-19T16:04:26.126 INFO:teuthology.orchestra.run.smithi078.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-19T16:04:26.126 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-19T16:04:26.126 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-19T16:04:26.126 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite x86_64 2:18.2.1-132.g568df92b.el9 ceph 166 k 2023-12-19T16:04:26.126 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-19T16:04:26.126 INFO:teuthology.orchestra.run.smithi078.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-19T16:04:26.127 INFO:teuthology.orchestra.run.smithi078.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-19T16:04:26.127 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-19T16:04:26.127 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-19T16:04:26.127 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 x86_64 2:18.2.1-132.g568df92b.el9 ceph 475 k 2023-12-19T16:04:26.127 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-19T16:04:26.127 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 4.5 M 2023-12-19T16:04:26.127 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-19T16:04:26.127 INFO:teuthology.orchestra.run.smithi078.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-19T16:04:26.127 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-19T16:04:26.127 INFO:teuthology.orchestra.run.smithi078.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-19T16:04:26.127 INFO:teuthology.orchestra.run.smithi078.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-19T16:04:26.127 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-19T16:04:26.127 INFO:teuthology.orchestra.run.smithi078.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-19T16:04:26.127 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-19T16:04:26.128 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-19T16:04:26.128 INFO:teuthology.orchestra.run.smithi078.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-19T16:04:26.128 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-19T16:04:26.128 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-19T16:04:26.128 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-19T16:04:26.128 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse x86_64 2:18.2.1-132.g568df92b.el9 ceph 45 k 2023-12-19T16:04:26.128 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common x86_64 2:18.2.1-132.g568df92b.el9 ceph 124 k 2023-12-19T16:04:26.128 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-19T16:04:26.128 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-19T16:04:26.128 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-19T16:04:26.128 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-19T16:04:26.128 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-19T16:04:26.128 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-19T16:04:26.128 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-19T16:04:26.129 INFO:teuthology.orchestra.run.smithi078.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-19T16:04:26.129 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-19T16:04:26.129 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-19T16:04:26.129 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-19T16:04:26.129 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-19T16:04:26.129 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-19T16:04:26.129 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-19T16:04:26.129 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-19T16:04:26.129 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-19T16:04:26.129 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-19T16:04:26.129 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-19T16:04:26.129 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-19T16:04:26.129 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-19T16:04:26.130 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-19T16:04:26.130 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-19T16:04:26.130 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-19T16:04:26.130 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-19T16:04:26.130 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-19T16:04:26.130 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-19T16:04:26.130 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-19T16:04:26.130 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-19T16:04:26.130 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-19T16:04:26.130 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-19T16:04:26.130 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-19T16:04:26.130 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-19T16:04:26.130 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-19T16:04:26.131 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-19T16:04:26.131 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-19T16:04:26.131 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-19T16:04:26.131 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-19T16:04:26.131 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-19T16:04:26.131 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-19T16:04:26.131 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-19T16:04:26.131 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-19T16:04:26.131 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-19T16:04:26.131 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-19T16:04:26.132 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-19T16:04:26.132 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-19T16:04:26.132 INFO:teuthology.orchestra.run.smithi078.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-19T16:04:26.132 INFO:teuthology.orchestra.run.smithi078.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-19T16:04:26.132 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-19T16:04:26.132 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-19T16:04:26.132 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-19T16:04:26.132 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-19T16:04:26.132 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-19T16:04:26.132 INFO:teuthology.orchestra.run.smithi078.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-19T16:04:26.132 INFO:teuthology.orchestra.run.smithi078.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-19T16:04:26.133 INFO:teuthology.orchestra.run.smithi078.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-19T16:04:26.133 INFO:teuthology.orchestra.run.smithi078.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-19T16:04:26.133 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-19T16:04:26.133 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-19T16:04:26.133 INFO:teuthology.orchestra.run.smithi078.stdout:Installing weak dependencies: 2023-12-19T16:04:26.133 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-19T16:04:26.133 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:04:26.133 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2023-12-19T16:04:26.133 INFO:teuthology.orchestra.run.smithi078.stdout:=========================================================================================== 2023-12-19T16:04:26.133 INFO:teuthology.orchestra.run.smithi078.stdout:Install 139 Packages 2023-12-19T16:04:26.133 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrade 15 Packages 2023-12-19T16:04:26.133 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:04:26.133 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 200 M 2023-12-19T16:04:26.134 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2023-12-19T16:04:26.147 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-12-19T16:04:26.172 INFO:teuthology.orchestra.run.smithi037.stdout:=========================================================================================== 2023-12-19T16:04:26.172 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-12-19T16:04:26.172 INFO:teuthology.orchestra.run.smithi037.stdout:=========================================================================================== 2023-12-19T16:04:26.172 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-12-19T16:04:26.172 INFO:teuthology.orchestra.run.smithi037.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-19T16:04:26.172 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:18.2.1-132.g568df92b.el9 ceph 6.5 k 2023-12-19T16:04:26.173 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:18.2.1-132.g568df92b.el9 ceph 5.2 M 2023-12-19T16:04:26.173 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:18.2.1-132.g568df92b.el9 ceph 840 k 2023-12-19T16:04:26.173 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-132.g568df92b.el9 ceph 142 k 2023-12-19T16:04:26.173 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:18.2.1-132.g568df92b.el9 ceph 1.4 M 2023-12-19T16:04:26.173 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 132 k 2023-12-19T16:04:26.173 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 1.8 M 2023-12-19T16:04:26.173 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 7.4 M 2023-12-19T16:04:26.173 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 50 k 2023-12-19T16:04:26.173 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:18.2.1-132.g568df92b.el9 ceph 7.7 M 2023-12-19T16:04:26.173 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:18.2.1-132.g568df92b.el9 ceph 40 M 2023-12-19T16:04:26.173 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 262 k 2023-12-19T16:04:26.173 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 221 k 2023-12-19T16:04:26.173 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror x86_64 2:18.2.1-132.g568df92b.el9 ceph 219 k 2023-12-19T16:04:26.173 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell x86_64 2:18.2.1-132.g568df92b.el9 ceph 27 k 2023-12-19T16:04:26.174 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 18 k 2023-12-19T16:04:26.174 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-19T16:04:26.174 INFO:teuthology.orchestra.run.smithi037.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-19T16:04:26.174 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-19T16:04:26.174 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:18.2.1-132.g568df92b.el9 ceph 31 k 2023-12-19T16:04:26.174 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 658 k 2023-12-19T16:04:26.174 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:18.2.1-132.g568df92b.el9 ceph 126 k 2023-12-19T16:04:26.174 INFO:teuthology.orchestra.run.smithi037.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-19T16:04:26.174 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-19T16:04:26.174 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-19T16:04:26.174 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-19T16:04:26.174 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-19T16:04:26.174 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-19T16:04:26.175 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:18.2.1-132.g568df92b.el9 ceph 161 k 2023-12-19T16:04:26.175 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:18.2.1-132.g568df92b.el9 ceph 321 k 2023-12-19T16:04:26.175 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:18.2.1-132.g568df92b.el9 ceph 298 k 2023-12-19T16:04:26.175 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:18.2.1-132.g568df92b.el9 ceph 99 k 2023-12-19T16:04:26.175 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:18.2.1-132.g568df92b.el9 ceph 86 k 2023-12-19T16:04:26.175 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.0 M 2023-12-19T16:04:26.175 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:18.2.1-132.g568df92b.el9 ceph 171 k 2023-12-19T16:04:26.175 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-19T16:04:26.175 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2023-12-19T16:04:26.175 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-19T16:04:26.175 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-19T16:04:26.175 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-19T16:04:26.176 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-19T16:04:26.176 INFO:teuthology.orchestra.run.smithi037.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-19T16:04:26.176 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-19T16:04:26.176 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-19T16:04:26.176 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-19T16:04:26.176 INFO:teuthology.orchestra.run.smithi037.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-19T16:04:26.176 INFO:teuthology.orchestra.run.smithi037.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-19T16:04:26.176 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.3 M 2023-12-19T16:04:26.176 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.0 M 2023-12-19T16:04:26.176 INFO:teuthology.orchestra.run.smithi037.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-19T16:04:26.176 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-19T16:04:26.176 INFO:teuthology.orchestra.run.smithi037.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-19T16:04:26.176 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-12-19T16:04:26.177 INFO:teuthology.orchestra.run.smithi037.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-19T16:04:26.177 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-19T16:04:26.177 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:18.2.1-132.g568df92b.el9 ceph 18 M 2023-12-19T16:04:26.177 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 23 k 2023-12-19T16:04:26.177 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:18.2.1-132.g568df92b.el9 ceph 2.1 M 2023-12-19T16:04:26.177 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 242 k 2023-12-19T16:04:26.177 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:18.2.1-132.g568df92b.el9 ceph 4.4 M 2023-12-19T16:04:26.177 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:18.2.1-132.g568df92b.el9 ceph 18 M 2023-12-19T16:04:26.177 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 15 k 2023-12-19T16:04:26.177 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:18.2.1-132.g568df92b.el9 ceph 24 k 2023-12-19T16:04:26.177 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-19T16:04:26.177 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-19T16:04:26.178 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-19T16:04:26.178 INFO:teuthology.orchestra.run.smithi037.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-19T16:04:26.178 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-19T16:04:26.178 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-19T16:04:26.178 INFO:teuthology.orchestra.run.smithi037.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-19T16:04:26.178 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-19T16:04:26.178 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-19T16:04:26.178 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:18.2.1-132.g568df92b.el9 ceph 166 k 2023-12-19T16:04:26.178 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-19T16:04:26.178 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-19T16:04:26.178 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-19T16:04:26.178 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-19T16:04:26.179 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-19T16:04:26.179 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:18.2.1-132.g568df92b.el9 ceph 475 k 2023-12-19T16:04:26.179 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-19T16:04:26.179 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 4.5 M 2023-12-19T16:04:26.179 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-19T16:04:26.179 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-19T16:04:26.179 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-19T16:04:26.179 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-19T16:04:26.179 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-19T16:04:26.179 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-19T16:04:26.179 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-19T16:04:26.180 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-19T16:04:26.180 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-19T16:04:26.180 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-19T16:04:26.180 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-19T16:04:26.180 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-19T16:04:26.180 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-19T16:04:26.180 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:18.2.1-132.g568df92b.el9 ceph 45 k 2023-12-19T16:04:26.180 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:18.2.1-132.g568df92b.el9 ceph 124 k 2023-12-19T16:04:26.180 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-19T16:04:26.180 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-19T16:04:26.180 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-19T16:04:26.181 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-19T16:04:26.181 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-19T16:04:26.181 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-19T16:04:26.181 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-19T16:04:26.181 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-19T16:04:26.181 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-19T16:04:26.181 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-19T16:04:26.181 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-19T16:04:26.181 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-19T16:04:26.181 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-19T16:04:26.182 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-19T16:04:26.182 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-19T16:04:26.182 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-19T16:04:26.182 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-19T16:04:26.182 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-19T16:04:26.182 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-19T16:04:26.182 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-19T16:04:26.182 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-19T16:04:26.182 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-19T16:04:26.182 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-19T16:04:26.182 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-19T16:04:26.182 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-19T16:04:26.182 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-19T16:04:26.183 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-19T16:04:26.183 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-19T16:04:26.183 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-19T16:04:26.183 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-19T16:04:26.183 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-19T16:04:26.183 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-19T16:04:26.183 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-19T16:04:26.183 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-19T16:04:26.183 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-19T16:04:26.183 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-19T16:04:26.183 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-19T16:04:26.183 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-19T16:04:26.183 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-19T16:04:26.184 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-19T16:04:26.184 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-19T16:04:26.184 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-19T16:04:26.184 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-19T16:04:26.184 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-19T16:04:26.184 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-19T16:04:26.184 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-19T16:04:26.184 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-19T16:04:26.184 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-19T16:04:26.184 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-19T16:04:26.184 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-19T16:04:26.184 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-19T16:04:26.184 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-19T16:04:26.185 INFO:teuthology.orchestra.run.smithi037.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-19T16:04:26.185 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-19T16:04:26.185 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-19T16:04:26.185 INFO:teuthology.orchestra.run.smithi037.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-19T16:04:26.185 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-19T16:04:26.185 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-19T16:04:26.185 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2023-12-19T16:04:26.185 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-19T16:04:26.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:04:26.185 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-12-19T16:04:26.185 INFO:teuthology.orchestra.run.smithi037.stdout:=========================================================================================== 2023-12-19T16:04:26.185 INFO:teuthology.orchestra.run.smithi037.stdout:Install 139 Packages 2023-12-19T16:04:26.186 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 15 Packages 2023-12-19T16:04:26.186 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:04:26.186 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 200 M 2023-12-19T16:04:26.186 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-12-19T16:04:26.643 INFO:teuthology.orchestra.run.smithi078.stdout:(1/154): ceph-18.2.1-132.g568df92b.el9.x86_64.r 39 kB/s | 6.5 kB 00:00 2023-12-19T16:04:26.835 INFO:teuthology.orchestra.run.smithi078.stdout:(2/154): ceph-fuse-18.2.1-132.g568df92b.el9.x86 4.3 MB/s | 840 kB 00:00 2023-12-19T16:04:26.894 INFO:teuthology.orchestra.run.smithi078.stdout:(3/154): ceph-immutable-object-cache-18.2.1-132 2.4 MB/s | 142 kB 00:00 2023-12-19T16:04:27.010 INFO:teuthology.orchestra.run.smithi037.stdout:(1/154): ceph-18.2.1-132.g568df92b.el9.x86_64.r 27 kB/s | 6.5 kB 00:00 2023-12-19T16:04:27.114 INFO:teuthology.orchestra.run.smithi151.stdout:(1/154): ceph-18.2.1-132.g568df92b.el9.x86_64.r 15 kB/s | 6.5 kB 00:00 2023-12-19T16:04:27.261 INFO:teuthology.orchestra.run.smithi078.stdout:(4/154): ceph-mds-18.2.1-132.g568df92b.el9.x86_ 5.8 MB/s | 2.1 MB 00:00 2023-12-19T16:04:27.328 INFO:teuthology.orchestra.run.smithi078.stdout:(5/154): ceph-base-18.2.1-132.g568df92b.el9.x86 6.1 MB/s | 5.2 MB 00:00 2023-12-19T16:04:27.487 INFO:teuthology.orchestra.run.smithi078.stdout:(6/154): ceph-mgr-18.2.1-132.g568df92b.el9.x86_ 6.4 MB/s | 1.4 MB 00:00 2023-12-19T16:04:27.878 INFO:teuthology.orchestra.run.smithi078.stdout:(7/154): ceph-mon-18.2.1-132.g568df92b.el9.x86_ 8.0 MB/s | 4.4 MB 00:00 2023-12-19T16:04:28.002 INFO:teuthology.orchestra.run.smithi037.stdout:(2/154): ceph-fuse-18.2.1-132.g568df92b.el9.x86 847 kB/s | 840 kB 00:00 2023-12-19T16:04:28.236 INFO:teuthology.orchestra.run.smithi037.stdout:(3/154): ceph-immutable-object-cache-18.2.1-132 611 kB/s | 142 kB 00:00 2023-12-19T16:04:28.689 INFO:teuthology.orchestra.run.smithi151.stdout:(2/154): ceph-fuse-18.2.1-132.g568df92b.el9.x86 534 kB/s | 840 kB 00:01 2023-12-19T16:04:28.795 INFO:teuthology.orchestra.run.smithi078.stdout:(8/154): ceph-radosgw-18.2.1-132.g568df92b.el9. 8.4 MB/s | 7.7 MB 00:00 2023-12-19T16:04:28.887 INFO:teuthology.orchestra.run.smithi078.stdout:(9/154): ceph-selinux-18.2.1-132.g568df92b.el9. 262 kB/s | 24 kB 00:00 2023-12-19T16:04:28.907 INFO:teuthology.orchestra.run.smithi151.stdout:(3/154): ceph-immutable-object-cache-18.2.1-132 660 kB/s | 142 kB 00:00 2023-12-19T16:04:29.521 INFO:teuthology.orchestra.run.smithi078.stdout:(10/154): ceph-common-18.2.1-132.g568df92b.el9. 6.0 MB/s | 18 MB 00:03 2023-12-19T16:04:29.629 INFO:teuthology.orchestra.run.smithi078.stdout:(11/154): cephfs-mirror-18.2.1-132.g568df92b.el 2.0 MB/s | 219 kB 00:00 2023-12-19T16:04:29.713 INFO:teuthology.orchestra.run.smithi078.stdout:(12/154): cephfs-shell-18.2.1-132.g568df92b.el9 325 kB/s | 27 kB 00:00 2023-12-19T16:04:29.946 INFO:teuthology.orchestra.run.smithi078.stdout:(13/154): ceph-osd-18.2.1-132.g568df92b.el9.x86 7.2 MB/s | 18 MB 00:02 2023-12-19T16:04:29.963 INFO:teuthology.orchestra.run.smithi078.stdout:(14/154): libcephfs-devel-18.2.1-132.g568df92b. 124 kB/s | 31 kB 00:00 2023-12-19T16:04:29.969 INFO:teuthology.orchestra.run.smithi037.stdout:(4/154): ceph-mds-18.2.1-132.g568df92b.el9.x86_ 1.2 MB/s | 2.1 MB 00:01 2023-12-19T16:04:30.064 INFO:teuthology.orchestra.run.smithi078.stdout:(15/154): libcephsqlite-18.2.1-132.g568df92b.el 1.6 MB/s | 166 kB 00:00 2023-12-19T16:04:30.098 INFO:teuthology.orchestra.run.smithi078.stdout:(16/154): libcephfs2-18.2.1-132.g568df92b.el9.x 4.2 MB/s | 658 kB 00:00 2023-12-19T16:04:30.147 INFO:teuthology.orchestra.run.smithi078.stdout:(17/154): librados-devel-18.2.1-132.g568df92b.e 1.5 MB/s | 126 kB 00:00 2023-12-19T16:04:30.239 INFO:teuthology.orchestra.run.smithi078.stdout:(18/154): libradosstriper1-18.2.1-132.g568df92b 3.3 MB/s | 475 kB 00:00 2023-12-19T16:04:30.323 INFO:teuthology.orchestra.run.smithi078.stdout:(19/154): python3-ceph-argparse-18.2.1-132.g568 540 kB/s | 45 kB 00:00 2023-12-19T16:04:30.415 INFO:teuthology.orchestra.run.smithi078.stdout:(20/154): python3-ceph-common-18.2.1-132.g568df 1.3 MB/s | 124 kB 00:00 2023-12-19T16:04:30.507 INFO:teuthology.orchestra.run.smithi078.stdout:(21/154): python3-cephfs-18.2.1-132.g568df92b.e 1.7 MB/s | 161 kB 00:00 2023-12-19T16:04:30.655 INFO:teuthology.orchestra.run.smithi078.stdout:(22/154): python3-rados-18.2.1-132.g568df92b.el 2.1 MB/s | 321 kB 00:00 2023-12-19T16:04:30.749 INFO:teuthology.orchestra.run.smithi078.stdout:(23/154): python3-rbd-18.2.1-132.g568df92b.el9. 3.1 MB/s | 298 kB 00:00 2023-12-19T16:04:30.841 INFO:teuthology.orchestra.run.smithi078.stdout:(24/154): python3-rgw-18.2.1-132.g568df92b.el9. 1.1 MB/s | 99 kB 00:00 2023-12-19T16:04:30.925 INFO:teuthology.orchestra.run.smithi078.stdout:(25/154): rbd-fuse-18.2.1-132.g568df92b.el9.x86 1.0 MB/s | 86 kB 00:00 2023-12-19T16:04:31.003 INFO:teuthology.orchestra.run.smithi037.stdout:(5/154): ceph-mgr-18.2.1-132.g568df92b.el9.x86_ 1.4 MB/s | 1.4 MB 00:01 2023-12-19T16:04:31.115 INFO:teuthology.orchestra.run.smithi151.stdout:(4/154): ceph-base-18.2.1-132.g568df92b.el9.x86 1.2 MB/s | 5.2 MB 00:04 2023-12-19T16:04:31.142 INFO:teuthology.orchestra.run.smithi078.stdout:(26/154): librgw2-18.2.1-132.g568df92b.el9.x86_ 4.5 MB/s | 4.5 MB 00:00 2023-12-19T16:04:31.251 INFO:teuthology.orchestra.run.smithi078.stdout:(27/154): rbd-nbd-18.2.1-132.g568df92b.el9.x86_ 1.5 MB/s | 171 kB 00:00 2023-12-19T16:04:31.351 INFO:teuthology.orchestra.run.smithi078.stdout:(28/154): ceph-grafana-dashboards-18.2.1-132.g5 232 kB/s | 23 kB 00:00 2023-12-19T16:04:31.366 INFO:teuthology.orchestra.run.smithi151.stdout:(5/154): ceph-mds-18.2.1-132.g568df92b.el9.x86_ 878 kB/s | 2.1 MB 00:02 2023-12-19T16:04:31.451 INFO:teuthology.orchestra.run.smithi078.stdout:(29/154): ceph-mgr-cephadm-18.2.1-132.g568df92b 1.3 MB/s | 132 kB 00:00 2023-12-19T16:04:31.502 INFO:teuthology.orchestra.run.smithi078.stdout:(30/154): rbd-mirror-18.2.1-132.g568df92b.el9.x 5.2 MB/s | 3.0 MB 00:00 2023-12-19T16:04:31.811 INFO:teuthology.orchestra.run.smithi037.stdout:(6/154): ceph-base-18.2.1-132.g568df92b.el9.x86 1.0 MB/s | 5.2 MB 00:05 2023-12-19T16:04:31.877 INFO:teuthology.orchestra.run.smithi078.stdout:(31/154): ceph-mgr-dashboard-18.2.1-132.g568df9 4.1 MB/s | 1.8 MB 00:00 2023-12-19T16:04:31.977 INFO:teuthology.orchestra.run.smithi078.stdout:(32/154): ceph-mgr-modules-core-18.2.1-132.g568 2.4 MB/s | 242 kB 00:00 2023-12-19T16:04:32.049 INFO:teuthology.orchestra.run.smithi151.stdout:(6/154): ceph-mgr-18.2.1-132.g568df92b.el9.x86_ 1.6 MB/s | 1.4 MB 00:00 2023-12-19T16:04:32.077 INFO:teuthology.orchestra.run.smithi078.stdout:(33/154): ceph-mgr-rook-18.2.1-132.g568df92b.el 502 kB/s | 50 kB 00:00 2023-12-19T16:04:32.428 INFO:teuthology.orchestra.run.smithi078.stdout:(34/154): ceph-test-18.2.1-132.g568df92b.el9.x8 11 MB/s | 40 MB 00:03 2023-12-19T16:04:32.453 INFO:teuthology.orchestra.run.smithi078.stdout:(35/154): ceph-prometheus-alerts-18.2.1-132.g56 39 kB/s | 15 kB 00:00 2023-12-19T16:04:32.503 INFO:teuthology.orchestra.run.smithi078.stdout:(36/154): ceph-volume-18.2.1-132.g568df92b.el9. 3.4 MB/s | 262 kB 00:00 2023-12-19T16:04:32.570 INFO:teuthology.orchestra.run.smithi078.stdout:(37/154): cephfs-top-18.2.1-132.g568df92b.el9.n 272 kB/s | 18 kB 00:00 2023-12-19T16:04:32.595 INFO:teuthology.orchestra.run.smithi078.stdout:(38/154): cephadm-18.2.1-132.g568df92b.el9.noar 1.5 MB/s | 221 kB 00:00 2023-12-19T16:04:32.695 INFO:teuthology.orchestra.run.smithi037.stdout:(7/154): ceph-mon-18.2.1-132.g568df92b.el9.x86_ 2.6 MB/s | 4.4 MB 00:01 2023-12-19T16:04:32.746 INFO:teuthology.orchestra.run.smithi078.stdout:(39/154): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 662 kB 00:00 2023-12-19T16:04:32.788 INFO:teuthology.orchestra.run.smithi078.stdout:(40/154): bison-3.7.4-5.el9.x86_64.rpm 4.7 MB/s | 920 kB 00:00 2023-12-19T16:04:32.813 INFO:teuthology.orchestra.run.smithi078.stdout:(41/154): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2023-12-19T16:04:32.830 INFO:teuthology.orchestra.run.smithi078.stdout:(42/154): elfutils-libelf-devel-0.190-1.el9.x86 514 kB/s | 21 kB 00:00 2023-12-19T16:04:32.864 INFO:teuthology.orchestra.run.smithi078.stdout:(43/154): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2023-12-19T16:04:32.880 INFO:teuthology.orchestra.run.smithi078.stdout:(44/154): flexiblas-3.0.4-8.el9.x86_64.rpm 636 kB/s | 32 kB 00:00 2023-12-19T16:04:32.964 INFO:teuthology.orchestra.run.smithi078.stdout:(45/154): ceph-mgr-diskprediction-local-18.2.1- 5.1 MB/s | 7.4 MB 00:01 2023-12-19T16:04:33.040 INFO:teuthology.orchestra.run.smithi078.stdout:(46/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2023-12-19T16:04:33.065 INFO:teuthology.orchestra.run.smithi078.stdout:(47/154): flexiblas-openblas-openmp-3.0.4-8.el9 93 kB/s | 17 kB 00:00 2023-12-19T16:04:33.090 INFO:teuthology.orchestra.run.smithi078.stdout:(48/154): jq-1.6-16.el9.x86_64.rpm 1.5 MB/s | 186 kB 00:00 2023-12-19T16:04:33.115 INFO:teuthology.orchestra.run.smithi078.stdout:(49/154): libaio-devel-0.3.111-13.el9.x86_64.rp 134 kB/s | 10 kB 00:00 2023-12-19T16:04:33.140 INFO:teuthology.orchestra.run.smithi078.stdout:(50/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 881 kB/s | 44 kB 00:00 2023-12-19T16:04:33.166 INFO:teuthology.orchestra.run.smithi078.stdout:(51/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2023-12-19T16:04:33.199 INFO:teuthology.orchestra.run.smithi078.stdout:(52/154): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 661 kB 00:00 2023-12-19T16:04:33.225 INFO:teuthology.orchestra.run.smithi078.stdout:(53/154): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 578 kB 00:00 2023-12-19T16:04:33.250 INFO:teuthology.orchestra.run.smithi078.stdout:(54/154): libuuid-devel-2.37.4-15.el9.x86_64.rp 493 kB/s | 24 kB 00:00 2023-12-19T16:04:33.275 INFO:teuthology.orchestra.run.smithi078.stdout:(55/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 621 kB/s | 46 kB 00:00 2023-12-19T16:04:33.300 INFO:teuthology.orchestra.run.smithi078.stdout:(56/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2023-12-19T16:04:33.326 INFO:teuthology.orchestra.run.smithi078.stdout:(57/154): openblas-0.3.21-2.el9.x86_64.rpm 688 kB/s | 34 kB 00:00 2023-12-19T16:04:33.352 INFO:teuthology.orchestra.run.smithi078.stdout:(58/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2023-12-19T16:04:33.437 INFO:teuthology.orchestra.run.smithi037.stdout:(8/154): ceph-common-18.2.1-132.g568df92b.el9.x 2.8 MB/s | 18 MB 00:06 2023-12-19T16:04:33.443 INFO:teuthology.orchestra.run.smithi078.stdout:(59/154): openblas-openmp-0.3.21-2.el9.x86_64.r 33 MB/s | 4.7 MB 00:00 2023-12-19T16:04:33.485 INFO:teuthology.orchestra.run.smithi078.stdout:(60/154): postgresql-13.11-1.el9.x86_64.rpm 9.7 MB/s | 1.5 MB 00:00 2023-12-19T16:04:33.495 INFO:teuthology.orchestra.run.smithi037.stdout:(9/154): ceph-selinux-18.2.1-132.g568df92b.el9. 415 kB/s | 24 kB 00:00 2023-12-19T16:04:33.518 INFO:teuthology.orchestra.run.smithi078.stdout:(61/154): postgresql-contrib-13.11-1.el9.x86_64 4.8 MB/s | 811 kB 00:00 2023-12-19T16:04:33.544 INFO:teuthology.orchestra.run.smithi078.stdout:(62/154): postgresql-private-libs-13.11-1.el9.x 1.3 MB/s | 134 kB 00:00 2023-12-19T16:04:33.569 INFO:teuthology.orchestra.run.smithi078.stdout:(63/154): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 78 kB 00:00 2023-12-19T16:04:33.703 INFO:teuthology.orchestra.run.smithi078.stdout:(64/154): postgresql-server-13.11-1.el9.x86_64. 31 MB/s | 5.7 MB 00:00 2023-12-19T16:04:33.820 INFO:teuthology.orchestra.run.smithi078.stdout:(65/154): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 5.8 MB 00:00 2023-12-19T16:04:33.845 INFO:teuthology.orchestra.run.smithi078.stdout:(66/154): python3-jinja2-2.11.3-4.el9.noarch.rp 835 kB/s | 228 kB 00:00 2023-12-19T16:04:33.878 INFO:teuthology.orchestra.run.smithi078.stdout:(67/154): python3-jsonpatch-1.21-16.el9.noarch. 141 kB/s | 24 kB 00:00 2023-12-19T16:04:33.903 INFO:teuthology.orchestra.run.smithi078.stdout:(68/154): python3-jsonpointer-2.0-4.el9.noarch. 217 kB/s | 18 kB 00:00 2023-12-19T16:04:33.929 INFO:teuthology.orchestra.run.smithi078.stdout:(69/154): python3-markupsafe-1.1.1-12.el9.x86_6 631 kB/s | 32 kB 00:00 2023-12-19T16:04:33.954 INFO:teuthology.orchestra.run.smithi078.stdout:(70/154): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2023-12-19T16:04:34.054 INFO:teuthology.orchestra.run.smithi078.stdout:(71/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2023-12-19T16:04:34.080 INFO:teuthology.orchestra.run.smithi078.stdout:(72/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2023-12-19T16:04:34.096 INFO:teuthology.orchestra.run.smithi037.stdout:(10/154): ceph-radosgw-18.2.1-132.g568df92b.el9 5.5 MB/s | 7.7 MB 00:01 2023-12-19T16:04:34.105 INFO:teuthology.orchestra.run.smithi078.stdout:(73/154): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 174 kB 00:00 2023-12-19T16:04:34.130 INFO:teuthology.orchestra.run.smithi078.stdout:(74/154): python3-prettytable-0.7.2-27.el9.noar 552 kB/s | 41 kB 00:00 2023-12-19T16:04:34.155 INFO:teuthology.orchestra.run.smithi078.stdout:(75/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-12-19T16:04:34.163 INFO:teuthology.orchestra.run.smithi037.stdout:(11/154): cephfs-mirror-18.2.1-132.g568df92b.el 3.2 MB/s | 219 kB 00:00 2023-12-19T16:04:34.181 INFO:teuthology.orchestra.run.smithi078.stdout:(76/154): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2023-12-19T16:04:34.199 INFO:teuthology.orchestra.run.smithi151.stdout:(7/154): ceph-mon-18.2.1-132.g568df92b.el9.x86_ 1.6 MB/s | 4.4 MB 00:02 2023-12-19T16:04:34.204 INFO:teuthology.orchestra.run.smithi037.stdout:(12/154): cephfs-shell-18.2.1-132.g568df92b.el9 655 kB/s | 27 kB 00:00 2023-12-19T16:04:34.205 INFO:teuthology.orchestra.run.smithi078.stdout:(77/154): python3-pytz-2021.1-5.el9.noarch.rpm 628 kB/s | 47 kB 00:00 2023-12-19T16:04:34.231 INFO:teuthology.orchestra.run.smithi078.stdout:(78/154): python3-requests-oauthlib-1.3.0-12.el 855 kB/s | 43 kB 00:00 2023-12-19T16:04:34.255 INFO:teuthology.orchestra.run.smithi037.stdout:(13/154): libcephfs-devel-18.2.1-132.g568df92b. 621 kB/s | 31 kB 00:00 2023-12-19T16:04:34.390 INFO:teuthology.orchestra.run.smithi078.stdout:(79/154): python3-toml-0.10.2-6.el9.noarch.rpm 210 kB/s | 39 kB 00:00 2023-12-19T16:04:34.396 INFO:teuthology.orchestra.run.smithi037.stdout:(14/154): libcephfs2-18.2.1-132.g568df92b.el9.x 4.5 MB/s | 658 kB 00:00 2023-12-19T16:04:34.472 INFO:teuthology.orchestra.run.smithi037.stdout:(15/154): libcephsqlite-18.2.1-132.g568df92b.el 2.2 MB/s | 166 kB 00:00 2023-12-19T16:04:34.522 INFO:teuthology.orchestra.run.smithi037.stdout:(16/154): librados-devel-18.2.1-132.g568df92b.e 2.5 MB/s | 126 kB 00:00 2023-12-19T16:04:34.557 INFO:teuthology.orchestra.run.smithi078.stdout:(80/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2023-12-19T16:04:34.582 INFO:teuthology.orchestra.run.smithi078.stdout:(81/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 118 kB/s | 41 kB 00:00 2023-12-19T16:04:34.615 INFO:teuthology.orchestra.run.smithi078.stdout:(82/154): socat-1.7.4.1-5.el9.x86_64.rpm 1.3 MB/s | 300 kB 00:00 2023-12-19T16:04:34.622 INFO:teuthology.orchestra.run.smithi037.stdout:(17/154): libradosstriper1-18.2.1-132.g568df92b 4.6 MB/s | 475 kB 00:00 2023-12-19T16:04:34.641 INFO:teuthology.orchestra.run.smithi078.stdout:(83/154): uuid-1.6.2-55.el9.x86_64.rpm 679 kB/s | 56 kB 00:00 2023-12-19T16:04:34.758 INFO:teuthology.orchestra.run.smithi078.stdout:(84/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 601 kB/s | 85 kB 00:00 2023-12-19T16:04:34.783 INFO:teuthology.orchestra.run.smithi078.stdout:(85/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 375 kB/s | 63 kB 00:00 2023-12-19T16:04:34.808 INFO:teuthology.orchestra.run.smithi078.stdout:(86/154): zlib-devel-1.2.11-40.el9.x86_64.rpm 264 kB/s | 44 kB 00:00 2023-12-19T16:04:34.833 INFO:teuthology.orchestra.run.smithi078.stdout:(87/154): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2023-12-19T16:04:34.967 INFO:teuthology.orchestra.run.smithi078.stdout:(88/154): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2023-12-19T16:04:35.001 INFO:teuthology.orchestra.run.smithi078.stdout:(89/154): libgfortran-11.4.1-2.3.el9.x86_64.rpm 4.1 MB/s | 803 kB 00:00 2023-12-19T16:04:35.024 INFO:teuthology.orchestra.run.smithi151.stdout:(8/154): ceph-osd-18.2.1-132.g568df92b.el9.x86_ 5.9 MB/s | 18 MB 00:02 2023-12-19T16:04:35.034 INFO:teuthology.orchestra.run.smithi078.stdout:(90/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 241 kB 00:00 2023-12-19T16:04:35.074 INFO:teuthology.orchestra.run.smithi151.stdout:(9/154): ceph-selinux-18.2.1-132.g568df92b.el9. 493 kB/s | 24 kB 00:00 2023-12-19T16:04:35.076 INFO:teuthology.orchestra.run.smithi078.stdout:(91/154): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2023-12-19T16:04:35.110 INFO:teuthology.orchestra.run.smithi078.stdout:(92/154): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2023-12-19T16:04:35.135 INFO:teuthology.orchestra.run.smithi078.stdout:(93/154): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 124 kB 00:00 2023-12-19T16:04:35.160 INFO:teuthology.orchestra.run.smithi078.stdout:(94/154): python3-requests-2.25.1-7.el9.noarch. 1.3 MB/s | 113 kB 00:00 2023-12-19T16:04:35.189 INFO:teuthology.orchestra.run.smithi037.stdout:(18/154): ceph-osd-18.2.1-132.g568df92b.el9.x86 5.2 MB/s | 18 MB 00:03 2023-12-19T16:04:35.194 INFO:teuthology.orchestra.run.smithi078.stdout:(95/154): python3-urllib3-1.26.5-4.el9.noarch.r 3.1 MB/s | 187 kB 00:00 2023-12-19T16:04:35.231 INFO:teuthology.orchestra.run.smithi037.stdout:(19/154): python3-ceph-argparse-18.2.1-132.g568 1.1 MB/s | 45 kB 00:00 2023-12-19T16:04:35.281 INFO:teuthology.orchestra.run.smithi037.stdout:(20/154): python3-ceph-common-18.2.1-132.g568df 2.4 MB/s | 124 kB 00:00 2023-12-19T16:04:35.365 INFO:teuthology.orchestra.run.smithi037.stdout:(21/154): librgw2-18.2.1-132.g568df92b.el9.x86_ 6.0 MB/s | 4.5 MB 00:00 2023-12-19T16:04:35.386 INFO:teuthology.orchestra.run.smithi078.stdout:(96/154): fmt-8.1.1-5.el9.x86_64.rpm 577 kB/s | 111 kB 00:00 2023-12-19T16:04:35.390 INFO:teuthology.orchestra.run.smithi037.stdout:(22/154): python3-cephfs-18.2.1-132.g568df92b.e 1.5 MB/s | 161 kB 00:00 2023-12-19T16:04:35.441 INFO:teuthology.orchestra.run.smithi037.stdout:(23/154): python3-rados-18.2.1-132.g568df92b.el 4.2 MB/s | 321 kB 00:00 2023-12-19T16:04:35.474 INFO:teuthology.orchestra.run.smithi037.stdout:(24/154): python3-rbd-18.2.1-132.g568df92b.el9. 3.5 MB/s | 298 kB 00:00 2023-12-19T16:04:35.499 INFO:teuthology.orchestra.run.smithi037.stdout:(25/154): python3-rgw-18.2.1-132.g568df92b.el9. 1.7 MB/s | 99 kB 00:00 2023-12-19T16:04:35.503 INFO:teuthology.orchestra.run.smithi078.stdout:(97/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.6 MB/s | 309 kB 00:00 2023-12-19T16:04:35.525 INFO:teuthology.orchestra.run.smithi037.stdout:(26/154): rbd-fuse-18.2.1-132.g568df92b.el9.x86 1.7 MB/s | 86 kB 00:00 2023-12-19T16:04:35.575 INFO:teuthology.orchestra.run.smithi037.stdout:(27/154): rbd-nbd-18.2.1-132.g568df92b.el9.x86_ 3.3 MB/s | 171 kB 00:00 2023-12-19T16:04:35.609 INFO:teuthology.orchestra.run.smithi037.stdout:(28/154): ceph-grafana-dashboards-18.2.1-132.g5 694 kB/s | 23 kB 00:00 2023-12-19T16:04:35.659 INFO:teuthology.orchestra.run.smithi037.stdout:(29/154): ceph-mgr-cephadm-18.2.1-132.g568df92b 2.6 MB/s | 132 kB 00:00 2023-12-19T16:04:35.704 INFO:teuthology.orchestra.run.smithi078.stdout:(98/154): libarrow-9.0.0-10.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2023-12-19T16:04:35.729 INFO:teuthology.orchestra.run.smithi078.stdout:(99/154): python3-devel-3.9.17-2.el9.x86_64.rpm 432 kB/s | 245 kB 00:00 2023-12-19T16:04:35.754 INFO:teuthology.orchestra.run.smithi078.stdout:(100/154): libarrow-doc-9.0.0-10.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2023-12-19T16:04:35.804 INFO:teuthology.orchestra.run.smithi078.stdout:(101/154): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2023-12-19T16:04:35.855 INFO:teuthology.orchestra.run.smithi078.stdout:(102/154): liboath-2.6.7-2.el9.x86_64.rpm 387 kB/s | 49 kB 00:00 2023-12-19T16:04:35.963 INFO:teuthology.orchestra.run.smithi078.stdout:(103/154): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.2 MB/s | 838 kB 00:00 2023-12-19T16:04:35.993 INFO:teuthology.orchestra.run.smithi037.stdout:(30/154): rbd-mirror-18.2.1-132.g568df92b.el9.x 6.1 MB/s | 3.0 MB 00:00 2023-12-19T16:04:36.030 INFO:teuthology.orchestra.run.smithi078.stdout:(104/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 654 kB/s | 43 kB 00:00 2023-12-19T16:04:36.035 INFO:teuthology.orchestra.run.smithi037.stdout:(31/154): ceph-mgr-dashboard-18.2.1-132.g568df9 4.7 MB/s | 1.8 MB 00:00 2023-12-19T16:04:36.072 INFO:teuthology.orchestra.run.smithi078.stdout:(105/154): python3-asyncssh-2.13.2-3.el9.noarch 2.5 MB/s | 548 kB 00:00 2023-12-19T16:04:36.097 INFO:teuthology.orchestra.run.smithi078.stdout:(106/154): python3-cachetools-4.2.4-1.el9.noarc 480 kB/s | 32 kB 00:00 2023-12-19T16:04:36.110 INFO:teuthology.orchestra.run.smithi037.stdout:(32/154): ceph-mgr-modules-core-18.2.1-132.g568 3.2 MB/s | 242 kB 00:00 2023-12-19T16:04:36.152 INFO:teuthology.orchestra.run.smithi037.stdout:(33/154): ceph-mgr-rook-18.2.1-132.g568df92b.el 1.2 MB/s | 50 kB 00:00 2023-12-19T16:04:36.164 INFO:teuthology.orchestra.run.smithi078.stdout:(107/154): openssl-devel-3.0.7-25.el9.x86_64.rp 4.0 MB/s | 4.1 MB 00:01 2023-12-19T16:04:36.190 INFO:teuthology.orchestra.run.smithi078.stdout:(108/154): python3-certifi-2021.10.8-2.el9.noar 128 kB/s | 15 kB 00:00 2023-12-19T16:04:36.194 INFO:teuthology.orchestra.run.smithi037.stdout:(34/154): ceph-prometheus-alerts-18.2.1-132.g56 353 kB/s | 15 kB 00:00 2023-12-19T16:04:36.215 INFO:teuthology.orchestra.run.smithi078.stdout:(109/154): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2023-12-19T16:04:36.240 INFO:teuthology.orchestra.run.smithi078.stdout:(110/154): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2023-12-19T16:04:36.269 INFO:teuthology.orchestra.run.smithi037.stdout:(35/154): ceph-volume-18.2.1-132.g568df92b.el9. 3.4 MB/s | 262 kB 00:00 2023-12-19T16:04:36.273 INFO:teuthology.orchestra.run.smithi078.stdout:(111/154): python3-colorama-0.4.4-12.el9.noarch 603 kB/s | 35 kB 00:00 2023-12-19T16:04:36.299 INFO:teuthology.orchestra.run.smithi078.stdout:(112/154): python3-google-auth-2.23.4-1.el9.noa 3.3 MB/s | 197 kB 00:00 2023-12-19T16:04:36.324 INFO:teuthology.orchestra.run.smithi078.stdout:(113/154): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2023-12-19T16:04:36.341 INFO:teuthology.orchestra.run.smithi078.stdout:(114/154): python3-jaraco-classes-3.2.1-5.el9.n 422 kB/s | 18 kB 00:00 2023-12-19T16:04:36.344 INFO:teuthology.orchestra.run.smithi037.stdout:(36/154): cephadm-18.2.1-132.g568df92b.el9.noar 2.9 MB/s | 221 kB 00:00 2023-12-19T16:04:36.383 INFO:teuthology.orchestra.run.smithi078.stdout:(115/154): python3-jaraco-collections-3.0.0-8.e 396 kB/s | 23 kB 00:00 2023-12-19T16:04:36.386 INFO:teuthology.orchestra.run.smithi037.stdout:(37/154): cephfs-top-18.2.1-132.g568df92b.el9.n 437 kB/s | 18 kB 00:00 2023-12-19T16:04:36.400 INFO:teuthology.orchestra.run.smithi078.stdout:(116/154): python3-jaraco-functools-3.5.0-2.el9 330 kB/s | 19 kB 00:00 2023-12-19T16:04:36.434 INFO:teuthology.orchestra.run.smithi078.stdout:(117/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.2 MB/s | 303 kB 00:00 2023-12-19T16:04:36.451 INFO:teuthology.orchestra.run.smithi078.stdout:(118/154): python3-jwt+crypto-2.4.0-1.el9.noarc 180 kB/s | 9.0 kB 00:00 2023-12-19T16:04:36.468 INFO:teuthology.orchestra.run.smithi078.stdout:(119/154): python3-jaraco-text-3.2.0-6.el9.noar 233 kB/s | 20 kB 00:00 2023-12-19T16:04:36.493 INFO:teuthology.orchestra.run.smithi078.stdout:(120/154): python3-jwt-2.4.0-1.el9.noarch.rpm 698 kB/s | 41 kB 00:00 2023-12-19T16:04:36.543 INFO:teuthology.orchestra.run.smithi078.stdout:(121/154): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2023-12-19T16:04:36.569 INFO:teuthology.orchestra.run.smithi078.stdout:(122/154): python3-logutils-0.3.5-21.el9.noarch 461 kB/s | 46 kB 00:00 2023-12-19T16:04:36.602 INFO:teuthology.orchestra.run.smithi078.stdout:(123/154): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2023-12-19T16:04:36.627 INFO:teuthology.orchestra.run.smithi078.stdout:(124/154): python3-natsort-7.1.1-5.el9.noarch.r 689 kB/s | 58 kB 00:00 2023-12-19T16:04:36.645 INFO:teuthology.orchestra.run.smithi037.stdout:(38/154): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 662 kB 00:00 2023-12-19T16:04:36.653 INFO:teuthology.orchestra.run.smithi078.stdout:(125/154): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2023-12-19T16:04:36.678 INFO:teuthology.orchestra.run.smithi078.stdout:(126/154): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2023-12-19T16:04:36.703 INFO:teuthology.orchestra.run.smithi078.stdout:(127/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2023-12-19T16:04:36.720 INFO:teuthology.orchestra.run.smithi037.stdout:(39/154): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 920 kB 00:00 2023-12-19T16:04:36.728 INFO:teuthology.orchestra.run.smithi078.stdout:(128/154): python3-pyperclip-1.8.2-2.el9.noarch 373 kB/s | 28 kB 00:00 2023-12-19T16:04:36.754 INFO:teuthology.orchestra.run.smithi078.stdout:(129/154): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2023-12-19T16:04:36.779 INFO:teuthology.orchestra.run.smithi037.stdout:(40/154): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2023-12-19T16:04:36.787 INFO:teuthology.orchestra.run.smithi078.stdout:(130/154): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2023-12-19T16:04:36.821 INFO:teuthology.orchestra.run.smithi037.stdout:(41/154): elfutils-libelf-devel-0.190-1.el9.x86 518 kB/s | 21 kB 00:00 2023-12-19T16:04:36.821 INFO:teuthology.orchestra.run.smithi078.stdout:(131/154): python3-rsa-4.9-2.el9.noarch.rpm 642 kB/s | 59 kB 00:00 2023-12-19T16:04:36.864 INFO:teuthology.orchestra.run.smithi078.stdout:(132/154): python3-tempora-5.0.0-2.el9.noarch.r 328 kB/s | 36 kB 00:00 2023-12-19T16:04:36.879 INFO:teuthology.orchestra.run.smithi037.stdout:(42/154): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 307 kB 00:00 2023-12-19T16:04:36.890 INFO:teuthology.orchestra.run.smithi078.stdout:(133/154): python3-typing-extensions-4.4.0-2.el 507 kB/s | 51 kB 00:00 2023-12-19T16:04:36.913 INFO:teuthology.orchestra.run.smithi037.stdout:(43/154): flexiblas-3.0.4-8.el9.x86_64.rpm 948 kB/s | 32 kB 00:00 2023-12-19T16:04:36.922 INFO:teuthology.orchestra.run.smithi078.stdout:(134/154): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2023-12-19T16:04:36.955 INFO:teuthology.orchestra.run.smithi078.stdout:(135/154): python3-websocket-client-1.2.3-2.el9 975 kB/s | 90 kB 00:00 2023-12-19T16:04:36.981 INFO:teuthology.orchestra.run.smithi078.stdout:(136/154): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2023-12-19T16:04:36.996 INFO:teuthology.orchestra.run.smithi037.stdout:(44/154): ceph-mgr-diskprediction-local-18.2.1- 7.4 MB/s | 7.4 MB 00:01 2023-12-19T16:04:37.006 INFO:teuthology.orchestra.run.smithi078.stdout:(137/154): python3-zc-lockfile-2.0-10.el9.noarc 238 kB/s | 20 kB 00:00 2023-12-19T16:04:37.048 INFO:teuthology.orchestra.run.smithi078.stdout:(138/154): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2023-12-19T16:04:37.072 INFO:teuthology.orchestra.run.smithi037.stdout:(45/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2023-12-19T16:04:37.097 INFO:teuthology.orchestra.run.smithi037.stdout:(46/154): flexiblas-openblas-openmp-3.0.4-8.el9 176 kB/s | 17 kB 00:00 2023-12-19T16:04:37.122 INFO:teuthology.orchestra.run.smithi037.stdout:(47/154): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2023-12-19T16:04:37.131 INFO:teuthology.orchestra.run.smithi078.stdout:(139/154): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2023-12-19T16:04:37.149 INFO:teuthology.orchestra.run.smithi037.stdout:(48/154): libaio-devel-0.3.111-13.el9.x86_64.rp 202 kB/s | 10 kB 00:00 2023-12-19T16:04:37.173 INFO:teuthology.orchestra.run.smithi037.stdout:(49/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2023-12-19T16:04:37.174 INFO:teuthology.orchestra.run.smithi078.stdout:(140/154): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-12-19T16:04:37.198 INFO:teuthology.orchestra.run.smithi037.stdout:(50/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 888 kB/s | 44 kB 00:00 2023-12-19T16:04:37.207 INFO:teuthology.orchestra.run.smithi078.stdout:(141/154): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2023-12-19T16:04:37.224 INFO:teuthology.orchestra.run.smithi037.stdout:(51/154): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-12-19T16:04:37.241 INFO:teuthology.orchestra.run.smithi078.stdout:(142/154): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-12-19T16:04:37.257 INFO:teuthology.orchestra.run.smithi037.stdout:(52/154): libtool-2.4.6-45.el9.x86_64.rpm 9.9 MB/s | 578 kB 00:00 2023-12-19T16:04:37.282 INFO:teuthology.orchestra.run.smithi037.stdout:(53/154): libuuid-devel-2.37.4-15.el9.x86_64.rp 428 kB/s | 24 kB 00:00 2023-12-19T16:04:37.291 INFO:teuthology.orchestra.run.smithi078.stdout:(143/154): elfutils-libelf-0.190-1.el9.x86_64.r 3.8 MB/s | 192 kB 00:00 2023-12-19T16:04:37.308 INFO:teuthology.orchestra.run.smithi037.stdout:(54/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 924 kB/s | 46 kB 00:00 2023-12-19T16:04:37.333 INFO:teuthology.orchestra.run.smithi078.stdout:(144/154): elfutils-libs-0.190-1.el9.x86_64.rpm 6.0 MB/s | 255 kB 00:00 2023-12-19T16:04:37.333 INFO:teuthology.orchestra.run.smithi037.stdout:(55/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2023-12-19T16:04:37.358 INFO:teuthology.orchestra.run.smithi037.stdout:(56/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2023-12-19T16:04:37.366 INFO:teuthology.orchestra.run.smithi078.stdout:(145/154): libacl-2.3.1-4.el9.x86_64.rpm 661 kB/s | 22 kB 00:00 2023-12-19T16:04:37.375 INFO:teuthology.orchestra.run.smithi037.stdout:(57/154): openblas-0.3.21-2.el9.x86_64.rpm 825 kB/s | 34 kB 00:00 2023-12-19T16:04:37.425 INFO:teuthology.orchestra.run.smithi078.stdout:(146/154): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2023-12-19T16:04:37.534 INFO:teuthology.orchestra.run.smithi037.stdout:(58/154): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2023-12-19T16:04:37.568 INFO:teuthology.orchestra.run.smithi037.stdout:(59/154): postgresql-13.11-1.el9.x86_64.rpm 8.0 MB/s | 1.5 MB 00:00 2023-12-19T16:04:37.584 INFO:teuthology.orchestra.run.smithi078.stdout:(147/154): librados2-18.2.1-132.g568df92b.el9.x 5.7 MB/s | 3.3 MB 00:00 2023-12-19T16:04:37.601 INFO:teuthology.orchestra.run.smithi037.stdout:(60/154): postgresql-contrib-13.11-1.el9.x86_64 12 MB/s | 811 kB 00:00 2023-12-19T16:04:37.626 INFO:teuthology.orchestra.run.smithi037.stdout:(61/154): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2023-12-19T16:04:37.651 INFO:teuthology.orchestra.run.smithi078.stdout:(148/154): librbd1-18.2.1-132.g568df92b.el9.x86 5.0 MB/s | 3.0 MB 00:00 2023-12-19T16:04:37.802 INFO:teuthology.orchestra.run.smithi037.stdout:(62/154): postgresql-server-13.11-1.el9.x86_64. 28 MB/s | 5.7 MB 00:00 2023-12-19T16:04:37.827 INFO:teuthology.orchestra.run.smithi037.stdout:(63/154): python3-attrs-20.3.0-7.el9.noarch.rpm 390 kB/s | 78 kB 00:00 2023-12-19T16:04:38.043 INFO:teuthology.orchestra.run.smithi078.stdout:(149/154): NetworkManager-team-1.45.7-1.el9.x86 110 kB/s | 43 kB 00:00 2023-12-19T16:04:38.136 INFO:teuthology.orchestra.run.smithi037.stdout:(64/154): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 5.8 MB 00:00 2023-12-19T16:04:38.153 INFO:teuthology.orchestra.run.smithi037.stdout:(65/154): python3-jinja2-2.11.3-4.el9.noarch.rp 704 kB/s | 228 kB 00:00 2023-12-19T16:04:38.186 INFO:teuthology.orchestra.run.smithi037.stdout:(66/154): python3-jsonpatch-1.21-16.el9.noarch. 492 kB/s | 24 kB 00:00 2023-12-19T16:04:38.212 INFO:teuthology.orchestra.run.smithi037.stdout:(67/154): python3-jsonpointer-2.0-4.el9.noarch. 308 kB/s | 18 kB 00:00 2023-12-19T16:04:38.237 INFO:teuthology.orchestra.run.smithi037.stdout:(68/154): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2023-12-19T16:04:38.262 INFO:teuthology.orchestra.run.smithi037.stdout:(69/154): python3-markupsafe-1.1.1-12.el9.x86_6 635 kB/s | 32 kB 00:00 2023-12-19T16:04:38.360 INFO:teuthology.orchestra.run.smithi078.stdout:(150/154): NetworkManager-tui-1.45.7-1.el9.x86_ 779 kB/s | 246 kB 00:00 2023-12-19T16:04:38.462 INFO:teuthology.orchestra.run.smithi037.stdout:(70/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 4.8 MB 00:00 2023-12-19T16:04:38.488 INFO:teuthology.orchestra.run.smithi037.stdout:(71/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 966 kB/s | 217 kB 00:00 2023-12-19T16:04:38.504 INFO:teuthology.orchestra.run.smithi037.stdout:(72/154): python3-oauthlib-3.1.1-5.el9.noarch.r 4.1 MB/s | 174 kB 00:00 2023-12-19T16:04:38.510 INFO:teuthology.orchestra.run.smithi078.stdout:(151/154): NetworkManager-1.45.7-1.el9.x86_64.r 2.1 MB/s | 2.3 MB 00:01 2023-12-19T16:04:38.530 INFO:teuthology.orchestra.run.smithi037.stdout:(73/154): python3-prettytable-0.7.2-27.el9.noar 990 kB/s | 41 kB 00:00 2023-12-19T16:04:38.555 INFO:teuthology.orchestra.run.smithi037.stdout:(74/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-12-19T16:04:38.560 INFO:teuthology.orchestra.run.smithi078.stdout:(152/154): NetworkManager-libnm-1.45.7-1.el9.x8 1.8 MB/s | 1.8 MB 00:00 2023-12-19T16:04:38.580 INFO:teuthology.orchestra.run.smithi037.stdout:(75/154): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2023-12-19T16:04:38.606 INFO:teuthology.orchestra.run.smithi037.stdout:(76/154): python3-pytz-2021.1-5.el9.noarch.rpm 950 kB/s | 47 kB 00:00 2023-12-19T16:04:38.631 INFO:teuthology.orchestra.run.smithi037.stdout:(77/154): python3-requests-oauthlib-1.3.0-12.el 857 kB/s | 43 kB 00:00 2023-12-19T16:04:39.065 INFO:teuthology.orchestra.run.smithi037.stdout:(78/154): python3-toml-0.10.2-6.el9.noarch.rpm 89 kB/s | 39 kB 00:00 2023-12-19T16:04:39.233 INFO:teuthology.orchestra.run.smithi151.stdout:(10/154): ceph-test-18.2.1-132.g568df92b.el9.x8 9.5 MB/s | 40 MB 00:04 2023-12-19T16:04:39.390 INFO:teuthology.orchestra.run.smithi037.stdout:(79/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2023-12-19T16:04:39.400 INFO:teuthology.orchestra.run.smithi151.stdout:(11/154): ceph-radosgw-18.2.1-132.g568df92b.el9 1.5 MB/s | 7.7 MB 00:05 2023-12-19T16:04:39.416 INFO:teuthology.orchestra.run.smithi037.stdout:(80/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 117 kB/s | 41 kB 00:00 2023-12-19T16:04:39.433 INFO:teuthology.orchestra.run.smithi151.stdout:(12/154): cephfs-mirror-18.2.1-132.g568df92b.el 1.1 MB/s | 219 kB 00:00 2023-12-19T16:04:39.440 INFO:teuthology.orchestra.run.smithi037.stdout:(81/154): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2023-12-19T16:04:39.465 INFO:teuthology.orchestra.run.smithi037.stdout:(82/154): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2023-12-19T16:04:39.467 INFO:teuthology.orchestra.run.smithi151.stdout:(13/154): cephfs-shell-18.2.1-132.g568df92b.el9 409 kB/s | 27 kB 00:00 2023-12-19T16:04:39.491 INFO:teuthology.orchestra.run.smithi037.stdout:(83/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.7 MB/s | 85 kB 00:00 2023-12-19T16:04:39.492 INFO:teuthology.orchestra.run.smithi151.stdout:(14/154): libcephfs-devel-18.2.1-132.g568df92b. 535 kB/s | 31 kB 00:00 2023-12-19T16:04:39.516 INFO:teuthology.orchestra.run.smithi037.stdout:(84/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-12-19T16:04:39.542 INFO:teuthology.orchestra.run.smithi037.stdout:(85/154): zlib-devel-1.2.11-40.el9.x86_64.rpm 883 kB/s | 44 kB 00:00 2023-12-19T16:04:39.542 INFO:teuthology.orchestra.run.smithi151.stdout:(15/154): libcephsqlite-18.2.1-132.g568df92b.el 3.3 MB/s | 166 kB 00:00 2023-12-19T16:04:39.575 INFO:teuthology.orchestra.run.smithi037.stdout:(86/154): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-12-19T16:04:39.593 INFO:teuthology.orchestra.run.smithi151.stdout:(16/154): librados-devel-18.2.1-132.g568df92b.e 2.5 MB/s | 126 kB 00:00 2023-12-19T16:04:39.617 INFO:teuthology.orchestra.run.smithi037.stdout:(87/154): libgfortran-11.4.1-2.3.el9.x86_64.rpm 10 MB/s | 803 kB 00:00 2023-12-19T16:04:39.642 INFO:teuthology.orchestra.run.smithi037.stdout:(88/154): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2023-12-19T16:04:39.668 INFO:teuthology.orchestra.run.smithi037.stdout:(89/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-12-19T16:04:39.669 INFO:teuthology.orchestra.run.smithi151.stdout:(17/154): libradosstriper1-18.2.1-132.g568df92b 6.2 MB/s | 475 kB 00:00 2023-12-19T16:04:39.726 INFO:teuthology.orchestra.run.smithi037.stdout:(90/154): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2023-12-19T16:04:39.751 INFO:teuthology.orchestra.run.smithi037.stdout:(91/154): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2023-12-19T16:04:39.777 INFO:teuthology.orchestra.run.smithi037.stdout:(92/154): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2023-12-19T16:04:39.786 INFO:teuthology.orchestra.run.smithi151.stdout:(18/154): libcephfs2-18.2.1-132.g568df92b.el9.x 2.0 MB/s | 658 kB 00:00 2023-12-19T16:04:39.802 INFO:teuthology.orchestra.run.smithi037.stdout:(93/154): python3-requests-2.25.1-7.el9.noarch. 2.2 MB/s | 113 kB 00:00 2023-12-19T16:04:39.810 INFO:teuthology.orchestra.run.smithi078.stdout:(153/154): openssl-libs-3.0.7-25.el9.x86_64.rpm 1.7 MB/s | 2.2 MB 00:01 2023-12-19T16:04:39.828 INFO:teuthology.orchestra.run.smithi037.stdout:(94/154): python3-urllib3-1.26.5-4.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2023-12-19T16:04:39.853 INFO:teuthology.orchestra.run.smithi151.stdout:(19/154): python3-ceph-argparse-18.2.1-132.g568 684 kB/s | 45 kB 00:00 2023-12-19T16:04:39.969 INFO:teuthology.orchestra.run.smithi037.stdout:(95/154): python3-devel-3.9.17-2.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2023-12-19T16:04:40.103 INFO:teuthology.orchestra.run.smithi151.stdout:(20/154): ceph-common-18.2.1-132.g568df92b.el9. 1.4 MB/s | 18 MB 00:13 2023-12-19T16:04:40.137 INFO:teuthology.orchestra.run.smithi151.stdout:(21/154): python3-ceph-common-18.2.1-132.g568df 440 kB/s | 124 kB 00:00 2023-12-19T16:04:40.246 INFO:teuthology.orchestra.run.smithi151.stdout:(22/154): python3-cephfs-18.2.1-132.g568df92b.e 1.1 MB/s | 161 kB 00:00 2023-12-19T16:04:40.404 INFO:teuthology.orchestra.run.smithi151.stdout:(23/154): librgw2-18.2.1-132.g568df92b.el9.x86_ 6.1 MB/s | 4.5 MB 00:00 2023-12-19T16:04:40.438 INFO:teuthology.orchestra.run.smithi151.stdout:(24/154): python3-rados-18.2.1-132.g568df92b.el 1.0 MB/s | 321 kB 00:00 2023-12-19T16:04:40.472 INFO:teuthology.orchestra.run.smithi151.stdout:(25/154): python3-rgw-18.2.1-132.g568df92b.el9. 1.5 MB/s | 99 kB 00:00 2023-12-19T16:04:40.514 INFO:teuthology.orchestra.run.smithi151.stdout:(26/154): python3-rbd-18.2.1-132.g568df92b.el9. 1.1 MB/s | 298 kB 00:00 2023-12-19T16:04:40.539 INFO:teuthology.orchestra.run.smithi151.stdout:(27/154): rbd-fuse-18.2.1-132.g568df92b.el9.x86 863 kB/s | 86 kB 00:00 2023-12-19T16:04:40.557 INFO:teuthology.orchestra.run.smithi037.stdout:(96/154): fmt-8.1.1-5.el9.x86_64.rpm 188 kB/s | 111 kB 00:00 2023-12-19T16:04:40.631 INFO:teuthology.orchestra.run.smithi151.stdout:(28/154): ceph-grafana-dashboards-18.2.1-132.g5 254 kB/s | 23 kB 00:00 2023-12-19T16:04:40.673 INFO:teuthology.orchestra.run.smithi151.stdout:(29/154): rbd-nbd-18.2.1-132.g568df92b.el9.x86_ 1.1 MB/s | 171 kB 00:00 2023-12-19T16:04:40.778 INFO:teuthology.orchestra.run.smithi037.stdout:(97/154): openssl-devel-3.0.7-25.el9.x86_64.rpm 4.2 MB/s | 4.1 MB 00:00 2023-12-19T16:04:40.849 INFO:teuthology.orchestra.run.smithi151.stdout:(30/154): ceph-mgr-cephadm-18.2.1-132.g568df92b 608 kB/s | 132 kB 00:00 2023-12-19T16:04:40.853 INFO:teuthology.orchestra.run.smithi037.stdout:(98/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.0 MB/s | 309 kB 00:00 2023-12-19T16:04:40.995 INFO:teuthology.orchestra.run.smithi037.stdout:(99/154): libarrow-doc-9.0.0-10.el9.noarch.rpm 183 kB/s | 26 kB 00:00 2023-12-19T16:04:41.091 INFO:teuthology.orchestra.run.smithi151.stdout:(31/154): rbd-mirror-18.2.1-132.g568df92b.el9.x 4.8 MB/s | 3.0 MB 00:00 2023-12-19T16:04:41.137 INFO:teuthology.orchestra.run.smithi037.stdout:(100/154): liboath-2.6.7-2.el9.x86_64.rpm 346 kB/s | 49 kB 00:00 2023-12-19T16:04:41.191 INFO:teuthology.orchestra.run.smithi151.stdout:(32/154): ceph-mgr-modules-core-18.2.1-132.g568 2.4 MB/s | 242 kB 00:00 2023-12-19T16:04:41.235 INFO:teuthology.orchestra.run.smithi078.stdout:(154/154): openssl-3.0.7-25.el9.x86_64.rpm 432 kB/s | 1.2 MB 00:02 2023-12-19T16:04:41.240 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2023-12-19T16:04:41.240 INFO:teuthology.orchestra.run.smithi078.stdout:Total 13 MB/s | 200 MB 00:15 2023-12-19T16:04:41.271 INFO:teuthology.orchestra.run.smithi037.stdout:(101/154): libunwind-1.6.2-1.el9.x86_64.rpm 506 kB/s | 67 kB 00:00 2023-12-19T16:04:41.301 INFO:teuthology.orchestra.run.smithi151.stdout:(33/154): ceph-mgr-rook-18.2.1-132.g568df92b.el 465 kB/s | 50 kB 00:00 2023-12-19T16:04:41.400 INFO:teuthology.orchestra.run.smithi151.stdout:(34/154): ceph-prometheus-alerts-18.2.1-132.g56 148 kB/s | 15 kB 00:00 2023-12-19T16:04:41.404 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2023-12-19T16:04:41.526 INFO:teuthology.orchestra.run.smithi151.stdout:(35/154): ceph-volume-18.2.1-132.g568df92b.el9. 2.1 MB/s | 262 kB 00:00 2023-12-19T16:04:41.588 INFO:teuthology.orchestra.run.smithi037.stdout:(102/154): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.6 MB/s | 838 kB 00:00 2023-12-19T16:04:41.591 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2023-12-19T16:04:41.591 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2023-12-19T16:04:41.626 INFO:teuthology.orchestra.run.smithi151.stdout:(36/154): cephadm-18.2.1-132.g568df92b.el9.noar 2.2 MB/s | 221 kB 00:00 2023-12-19T16:04:41.710 INFO:teuthology.orchestra.run.smithi151.stdout:(37/154): cephfs-top-18.2.1-132.g568df92b.el9.n 219 kB/s | 18 kB 00:00 2023-12-19T16:04:41.763 INFO:teuthology.orchestra.run.smithi037.stdout:(103/154): python3-asyncssh-2.13.2-3.el9.noarch 3.1 MB/s | 548 kB 00:00 2023-12-19T16:04:41.847 INFO:teuthology.orchestra.run.smithi037.stdout:(104/154): libarrow-9.0.0-10.el9.x86_64.rpm 4.1 MB/s | 4.4 MB 00:01 2023-12-19T16:04:41.875 INFO:teuthology.orchestra.run.smithi037.stdout:(105/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 400 kB/s | 43 kB 00:00 2023-12-19T16:04:41.901 INFO:teuthology.orchestra.run.smithi151.stdout:(38/154): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 662 kB 00:00 2023-12-19T16:04:41.964 INFO:teuthology.orchestra.run.smithi037.stdout:(106/154): python3-cachetools-4.2.4-1.el9.noarc 276 kB/s | 32 kB 00:00 2023-12-19T16:04:41.977 INFO:teuthology.orchestra.run.smithi151.stdout:(39/154): ceph-mgr-dashboard-18.2.1-132.g568df9 1.3 MB/s | 1.8 MB 00:01 2023-12-19T16:04:41.989 INFO:teuthology.orchestra.run.smithi037.stdout:(107/154): python3-certifi-2021.10.8-2.el9.noar 128 kB/s | 15 kB 00:00 2023-12-19T16:04:42.027 INFO:teuthology.orchestra.run.smithi151.stdout:(40/154): bison-3.7.4-5.el9.x86_64.rpm 7.2 MB/s | 920 kB 00:00 2023-12-19T16:04:42.053 INFO:teuthology.orchestra.run.smithi151.stdout:(41/154): boost-program-options-1.75.0-8.el9.x8 1.5 MB/s | 106 kB 00:00 2023-12-19T16:04:42.096 INFO:teuthology.orchestra.run.smithi151.stdout:(42/154): elfutils-libelf-devel-0.190-1.el9.x86 328 kB/s | 21 kB 00:00 2023-12-19T16:04:42.097 INFO:teuthology.orchestra.run.smithi037.stdout:(108/154): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2023-12-19T16:04:42.123 INFO:teuthology.orchestra.run.smithi037.stdout:(109/154): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2023-12-19T16:04:42.129 INFO:teuthology.orchestra.run.smithi151.stdout:(43/154): flex-2.6.4-9.el9.x86_64.rpm 4.0 MB/s | 307 kB 00:00 2023-12-19T16:04:42.154 INFO:teuthology.orchestra.run.smithi151.stdout:(44/154): flexiblas-3.0.4-8.el9.x86_64.rpm 571 kB/s | 32 kB 00:00 2023-12-19T16:04:42.240 INFO:teuthology.orchestra.run.smithi037.stdout:(110/154): python3-colorama-0.4.4-12.el9.noarch 302 kB/s | 35 kB 00:00 2023-12-19T16:04:42.254 INFO:teuthology.orchestra.run.smithi151.stdout:(45/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2023-12-19T16:04:42.265 INFO:teuthology.orchestra.run.smithi037.stdout:(111/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.8 MB/s | 303 kB 00:00 2023-12-19T16:04:42.281 INFO:teuthology.orchestra.run.smithi151.stdout:(46/154): flexiblas-openblas-openmp-3.0.4-8.el9 157 kB/s | 17 kB 00:00 2023-12-19T16:04:42.313 INFO:teuthology.orchestra.run.smithi151.stdout:(47/154): jq-1.6-16.el9.x86_64.rpm 3.2 MB/s | 186 kB 00:00 2023-12-19T16:04:42.331 INFO:teuthology.orchestra.run.smithi151.stdout:(48/154): libaio-devel-0.3.111-13.el9.x86_64.rp 209 kB/s | 10 kB 00:00 2023-12-19T16:04:42.356 INFO:teuthology.orchestra.run.smithi151.stdout:(49/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2023-12-19T16:04:42.374 INFO:teuthology.orchestra.run.smithi037.stdout:(112/154): python3-google-auth-2.23.4-1.el9.noa 1.4 MB/s | 197 kB 00:00 2023-12-19T16:04:42.381 INFO:teuthology.orchestra.run.smithi151.stdout:(50/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 916 kB/s | 44 kB 00:00 2023-12-19T16:04:42.399 INFO:teuthology.orchestra.run.smithi037.stdout:(113/154): python3-jaraco-8.2.1-3.el9.noarch.rp 80 kB/s | 11 kB 00:00 2023-12-19T16:04:42.423 INFO:teuthology.orchestra.run.smithi151.stdout:(51/154): librdkafka-1.6.1-102.el9.x86_64.rpm 9.8 MB/s | 661 kB 00:00 2023-12-19T16:04:42.465 INFO:teuthology.orchestra.run.smithi151.stdout:(52/154): libtool-2.4.6-45.el9.x86_64.rpm 7.3 MB/s | 578 kB 00:00 2023-12-19T16:04:42.474 INFO:teuthology.orchestra.run.smithi037.stdout:(114/154): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2023-12-19T16:04:42.491 INFO:teuthology.orchestra.run.smithi151.stdout:(53/154): libuuid-devel-2.37.4-15.el9.x86_64.rp 398 kB/s | 24 kB 00:00 2023-12-19T16:04:42.500 INFO:teuthology.orchestra.run.smithi037.stdout:(115/154): python3-jaraco-collections-3.0.0-8.e 232 kB/s | 23 kB 00:00 2023-12-19T16:04:42.516 INFO:teuthology.orchestra.run.smithi151.stdout:(54/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 940 kB/s | 46 kB 00:00 2023-12-19T16:04:42.558 INFO:teuthology.orchestra.run.smithi151.stdout:(55/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2023-12-19T16:04:42.575 INFO:teuthology.orchestra.run.smithi037.stdout:(116/154): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2023-12-19T16:04:42.592 INFO:teuthology.orchestra.run.smithi151.stdout:(56/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.9 MB/s | 217 kB 00:00 2023-12-19T16:04:42.600 INFO:teuthology.orchestra.run.smithi037.stdout:(117/154): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2023-12-19T16:04:42.617 INFO:teuthology.orchestra.run.smithi151.stdout:(57/154): openblas-0.3.21-2.el9.x86_64.rpm 609 kB/s | 34 kB 00:00 2023-12-19T16:04:42.700 INFO:teuthology.orchestra.run.smithi037.stdout:(118/154): python3-jwt+crypto-2.4.0-1.el9.noarc 72 kB/s | 9.0 kB 00:00 2023-12-19T16:04:42.734 INFO:teuthology.orchestra.run.smithi037.stdout:(119/154): python3-jwt-2.4.0-1.el9.noarch.rpm 306 kB/s | 41 kB 00:00 2023-12-19T16:04:42.793 INFO:teuthology.orchestra.run.smithi151.stdout:(58/154): openblas-openmp-0.3.21-2.el9.x86_64.r 24 MB/s | 4.7 MB 00:00 2023-12-19T16:04:42.851 INFO:teuthology.orchestra.run.smithi037.stdout:(120/154): python3-logutils-0.3.5-21.el9.noarch 397 kB/s | 46 kB 00:00 2023-12-19T16:04:42.860 INFO:teuthology.orchestra.run.smithi151.stdout:(59/154): postgresql-13.11-1.el9.x86_64.rpm 6.7 MB/s | 1.5 MB 00:00 2023-12-19T16:04:42.901 INFO:teuthology.orchestra.run.smithi037.stdout:(121/154): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2023-12-19T16:04:42.910 INFO:teuthology.orchestra.run.smithi151.stdout:(60/154): postgresql-contrib-13.11-1.el9.x86_64 7.4 MB/s | 811 kB 00:00 2023-12-19T16:04:42.935 INFO:teuthology.orchestra.run.smithi151.stdout:(61/154): postgresql-private-libs-13.11-1.el9.x 1.9 MB/s | 134 kB 00:00 2023-12-19T16:04:42.976 INFO:teuthology.orchestra.run.smithi037.stdout:(122/154): python3-more-itertools-8.12.0-2.el9. 630 kB/s | 79 kB 00:00 2023-12-19T16:04:43.027 INFO:teuthology.orchestra.run.smithi037.stdout:(123/154): python3-natsort-7.1.1-5.el9.noarch.r 461 kB/s | 58 kB 00:00 2023-12-19T16:04:43.121 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2023-12-19T16:04:43.121 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2023-12-19T16:04:43.135 INFO:teuthology.orchestra.run.smithi037.stdout:(124/154): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2023-12-19T16:04:43.144 INFO:teuthology.orchestra.run.smithi151.stdout:(62/154): postgresql-server-13.11-1.el9.x86_64. 25 MB/s | 5.7 MB 00:00 2023-12-19T16:04:43.161 INFO:teuthology.orchestra.run.smithi037.stdout:(125/154): python3-portend-3.1.0-2.el9.noarch.r 123 kB/s | 16 kB 00:00 2023-12-19T16:04:43.170 INFO:teuthology.orchestra.run.smithi151.stdout:(63/154): python3-attrs-20.3.0-7.el9.noarch.rpm 355 kB/s | 78 kB 00:00 2023-12-19T16:04:43.252 INFO:teuthology.orchestra.run.smithi037.stdout:(126/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 770 kB/s | 90 kB 00:00 2023-12-19T16:04:43.305 INFO:teuthology.orchestra.run.smithi037.stdout:(127/154): python3-pyperclip-1.8.2-2.el9.noarch 199 kB/s | 28 kB 00:00 2023-12-19T16:04:43.370 INFO:teuthology.orchestra.run.smithi037.stdout:(128/154): python3-repoze-lru-0.7-16.el9.noarch 263 kB/s | 31 kB 00:00 2023-12-19T16:04:43.395 INFO:teuthology.orchestra.run.smithi151.stdout:(64/154): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 5.8 MB 00:00 2023-12-19T16:04:43.420 INFO:teuthology.orchestra.run.smithi037.stdout:(129/154): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2023-12-19T16:04:43.437 INFO:teuthology.orchestra.run.smithi151.stdout:(65/154): python3-jinja2-2.11.3-4.el9.noarch.rp 889 kB/s | 228 kB 00:00 2023-12-19T16:04:43.464 INFO:teuthology.orchestra.run.smithi151.stdout:(66/154): python3-jsonpatch-1.21-16.el9.noarch. 377 kB/s | 24 kB 00:00 2023-12-19T16:04:43.464 INFO:teuthology.orchestra.run.smithi037.stdout:(130/154): python3-rsa-4.9-2.el9.noarch.rpm 643 kB/s | 59 kB 00:00 2023-12-19T16:04:43.488 INFO:teuthology.orchestra.run.smithi151.stdout:(67/154): python3-jsonpointer-2.0-4.el9.noarch. 366 kB/s | 18 kB 00:00 2023-12-19T16:04:43.514 INFO:teuthology.orchestra.run.smithi151.stdout:(68/154): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 144 kB 00:00 2023-12-19T16:04:43.529 INFO:teuthology.orchestra.run.smithi037.stdout:(131/154): python3-tempora-5.0.0-2.el9.noarch.r 330 kB/s | 36 kB 00:00 2023-12-19T16:04:43.538 INFO:teuthology.orchestra.run.smithi151.stdout:(69/154): python3-markupsafe-1.1.1-12.el9.x86_6 656 kB/s | 32 kB 00:00 2023-12-19T16:04:43.579 INFO:teuthology.orchestra.run.smithi037.stdout:(132/154): python3-typing-extensions-4.4.0-2.el 436 kB/s | 51 kB 00:00 2023-12-19T16:04:43.688 INFO:teuthology.orchestra.run.smithi037.stdout:(133/154): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2023-12-19T16:04:43.713 INFO:teuthology.orchestra.run.smithi037.stdout:(134/154): python3-websocket-client-1.2.3-2.el9 672 kB/s | 90 kB 00:00 2023-12-19T16:04:43.764 INFO:teuthology.orchestra.run.smithi151.stdout:(70/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 4.8 MB 00:00 2023-12-19T16:04:43.798 INFO:teuthology.orchestra.run.smithi151.stdout:(71/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 858 kB/s | 217 kB 00:00 2023-12-19T16:04:43.823 INFO:teuthology.orchestra.run.smithi151.stdout:(72/154): python3-oauthlib-3.1.1-5.el9.noarch.r 3.0 MB/s | 174 kB 00:00 2023-12-19T16:04:43.838 INFO:teuthology.orchestra.run.smithi037.stdout:(135/154): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2023-12-19T16:04:43.848 INFO:teuthology.orchestra.run.smithi151.stdout:(73/154): python3-prettytable-0.7.2-27.el9.noar 852 kB/s | 41 kB 00:00 2023-12-19T16:04:43.855 INFO:teuthology.orchestra.run.smithi037.stdout:(136/154): python3-zc-lockfile-2.0-10.el9.noarc 141 kB/s | 20 kB 00:00 2023-12-19T16:04:43.882 INFO:teuthology.orchestra.run.smithi151.stdout:(74/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2023-12-19T16:04:43.916 INFO:teuthology.orchestra.run.smithi151.stdout:(75/154): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2023-12-19T16:04:43.941 INFO:teuthology.orchestra.run.smithi151.stdout:(76/154): python3-pytz-2021.1-5.el9.noarch.rpm 839 kB/s | 47 kB 00:00 2023-12-19T16:04:43.975 INFO:teuthology.orchestra.run.smithi151.stdout:(77/154): python3-requests-oauthlib-1.3.0-12.el 746 kB/s | 43 kB 00:00 2023-12-19T16:04:43.980 INFO:teuthology.orchestra.run.smithi037.stdout:(137/154): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2023-12-19T16:04:44.047 INFO:teuthology.orchestra.run.smithi037.stdout:(138/154): thrift-0.15.0-2.el9.x86_64.rpm 8.2 MB/s | 1.6 MB 00:00 2023-12-19T16:04:44.325 INFO:teuthology.orchestra.run.smithi151.stdout:(78/154): python3-toml-0.10.2-6.el9.noarch.rpm 110 kB/s | 39 kB 00:00 2023-12-19T16:04:44.751 INFO:teuthology.orchestra.run.smithi151.stdout:(79/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2023-12-19T16:04:44.777 INFO:teuthology.orchestra.run.smithi151.stdout:(80/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 92 kB/s | 41 kB 00:00 2023-12-19T16:04:44.868 INFO:teuthology.orchestra.run.smithi151.stdout:(81/154): socat-1.7.4.1-5.el9.x86_64.rpm 2.5 MB/s | 300 kB 00:00 2023-12-19T16:04:44.894 INFO:teuthology.orchestra.run.smithi151.stdout:(82/154): uuid-1.6.2-55.el9.x86_64.rpm 494 kB/s | 56 kB 00:00 2023-12-19T16:04:44.919 INFO:teuthology.orchestra.run.smithi151.stdout:(83/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.7 MB/s | 85 kB 00:00 2023-12-19T16:04:44.931 INFO:teuthology.orchestra.run.smithi037.stdout:(139/154): librados2-18.2.1-132.g568df92b.el9.x 3.4 MB/s | 3.3 MB 00:00 2023-12-19T16:04:44.944 INFO:teuthology.orchestra.run.smithi151.stdout:(84/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2023-12-19T16:04:44.970 INFO:teuthology.orchestra.run.smithi151.stdout:(85/154): zlib-devel-1.2.11-40.el9.x86_64.rpm 889 kB/s | 44 kB 00:00 2023-12-19T16:04:44.990 INFO:teuthology.orchestra.run.smithi037.stdout:(140/154): librbd1-18.2.1-132.g568df92b.el9.x86 3.2 MB/s | 3.0 MB 00:00 2023-12-19T16:04:44.995 INFO:teuthology.orchestra.run.smithi151.stdout:(86/154): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-12-19T16:04:45.015 INFO:teuthology.orchestra.run.smithi037.stdout:(141/154): libacl-devel-2.3.1-4.el9.x86_64.rpm 810 kB/s | 68 kB 00:00 2023-12-19T16:04:45.048 INFO:teuthology.orchestra.run.smithi037.stdout:(142/154): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 69 kB 00:00 2023-12-19T16:04:45.062 INFO:teuthology.orchestra.run.smithi151.stdout:(87/154): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.6 MB/s | 803 kB 00:00 2023-12-19T16:04:45.073 INFO:teuthology.orchestra.run.smithi037.stdout:(143/154): elfutils-debuginfod-client-0.190-1.e 625 kB/s | 36 kB 00:00 2023-12-19T16:04:45.096 INFO:teuthology.orchestra.run.smithi151.stdout:(88/154): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2023-12-19T16:04:45.107 INFO:teuthology.orchestra.run.smithi037.stdout:(144/154): elfutils-libelf-0.190-1.el9.x86_64.r 3.2 MB/s | 192 kB 00:00 2023-12-19T16:04:45.130 INFO:teuthology.orchestra.run.smithi151.stdout:(89/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.6 MB/s | 241 kB 00:00 2023-12-19T16:04:45.157 INFO:teuthology.orchestra.run.smithi037.stdout:(145/154): elfutils-libs-0.190-1.el9.x86_64.rpm 3.0 MB/s | 255 kB 00:00 2023-12-19T16:04:45.222 INFO:teuthology.orchestra.run.smithi151.stdout:(90/154): python3-cryptography-36.0.1-4.el9.x86 9.3 MB/s | 1.1 MB 00:00 2023-12-19T16:04:45.255 INFO:teuthology.orchestra.run.smithi151.stdout:(91/154): python3-ply-3.11-14.el9.noarch.rpm 863 kB/s | 103 kB 00:00 2023-12-19T16:04:45.281 INFO:teuthology.orchestra.run.smithi151.stdout:(92/154): python3-pycparser-2.20-6.el9.noarch.r 2.1 MB/s | 124 kB 00:00 2023-12-19T16:04:45.308 INFO:teuthology.orchestra.run.smithi037.stdout:(146/154): libacl-2.3.1-4.el9.x86_64.rpm 110 kB/s | 22 kB 00:00 2023-12-19T16:04:45.314 INFO:teuthology.orchestra.run.smithi151.stdout:(93/154): python3-requests-2.25.1-7.el9.noarch. 1.9 MB/s | 113 kB 00:00 2023-12-19T16:04:45.333 INFO:teuthology.orchestra.run.smithi037.stdout:(147/154): xfsdump-3.1.12-4.el9.x86_64.rpm 1.8 MB/s | 321 kB 00:00 2023-12-19T16:04:45.348 INFO:teuthology.orchestra.run.smithi151.stdout:(94/154): python3-urllib3-1.26.5-4.el9.noarch.r 2.8 MB/s | 187 kB 00:00 2023-12-19T16:04:45.524 INFO:teuthology.orchestra.run.smithi151.stdout:(95/154): python3-devel-3.9.17-2.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2023-12-19T16:04:45.683 INFO:teuthology.orchestra.run.smithi151.stdout:(96/154): fmt-8.1.1-5.el9.x86_64.rpm 704 kB/s | 111 kB 00:00 2023-12-19T16:04:45.759 INFO:teuthology.orchestra.run.smithi037.stdout:(148/154): NetworkManager-1.45.7-1.el9.x86_64.r 5.0 MB/s | 2.3 MB 00:00 2023-12-19T16:04:45.766 INFO:teuthology.orchestra.run.smithi151.stdout:(97/154): openssl-devel-3.0.7-25.el9.x86_64.rpm 9.2 MB/s | 4.1 MB 00:00 2023-12-19T16:04:45.800 INFO:teuthology.orchestra.run.smithi037.stdout:(149/154): NetworkManager-libnm-1.45.7-1.el9.x8 3.8 MB/s | 1.8 MB 00:00 2023-12-19T16:04:45.826 INFO:teuthology.orchestra.run.smithi037.stdout:(150/154): NetworkManager-team-1.45.7-1.el9.x86 647 kB/s | 43 kB 00:00 2023-12-19T16:04:45.868 INFO:teuthology.orchestra.run.smithi037.stdout:(151/154): NetworkManager-tui-1.45.7-1.el9.x86_ 3.6 MB/s | 246 kB 00:00 2023-12-19T16:04:45.975 INFO:teuthology.orchestra.run.smithi151.stdout:(98/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.0 MB/s | 309 kB 00:00 2023-12-19T16:04:46.109 INFO:teuthology.orchestra.run.smithi151.stdout:(99/154): ceph-mgr-diskprediction-local-18.2.1- 1.4 MB/s | 7.4 MB 00:05 2023-12-19T16:04:46.134 INFO:teuthology.orchestra.run.smithi151.stdout:(100/154): libarrow-doc-9.0.0-10.el9.noarch.rpm 164 kB/s | 26 kB 00:00 2023-12-19T16:04:46.184 INFO:teuthology.orchestra.run.smithi151.stdout:(101/154): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2023-12-19T16:04:46.210 INFO:teuthology.orchestra.run.smithi037.stdout:(152/154): openssl-libs-3.0.7-25.el9.x86_64.rpm 6.3 MB/s | 2.2 MB 00:00 2023-12-19T16:04:46.235 INFO:teuthology.orchestra.run.smithi151.stdout:(102/154): liboath-2.6.7-2.el9.x86_64.rpm 388 kB/s | 49 kB 00:00 2023-12-19T16:04:46.310 INFO:teuthology.orchestra.run.smithi151.stdout:(103/154): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.5 MB/s | 838 kB 00:00 2023-12-19T16:04:46.361 INFO:teuthology.orchestra.run.smithi151.stdout:(104/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 884 kB/s | 43 kB 00:00 2023-12-19T16:04:46.411 INFO:teuthology.orchestra.run.smithi151.stdout:(105/154): python3-cachetools-4.2.4-1.el9.noarc 654 kB/s | 32 kB 00:00 2023-12-19T16:04:46.445 INFO:teuthology.orchestra.run.smithi151.stdout:(106/154): python3-asyncssh-2.13.2-3.el9.noarch 2.6 MB/s | 548 kB 00:00 2023-12-19T16:04:46.470 INFO:teuthology.orchestra.run.smithi151.stdout:(107/154): python3-certifi-2021.10.8-2.el9.noar 257 kB/s | 15 kB 00:00 2023-12-19T16:04:46.504 INFO:teuthology.orchestra.run.smithi151.stdout:(108/154): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2023-12-19T16:04:46.546 INFO:teuthology.orchestra.run.smithi151.stdout:(109/154): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2023-12-19T16:04:46.580 INFO:teuthology.orchestra.run.smithi151.stdout:(110/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.0 MB/s | 303 kB 00:00 2023-12-19T16:04:46.605 INFO:teuthology.orchestra.run.smithi151.stdout:(111/154): python3-colorama-0.4.4-12.el9.noarch 609 kB/s | 35 kB 00:00 2023-12-19T16:04:46.639 INFO:teuthology.orchestra.run.smithi151.stdout:(112/154): python3-google-auth-2.23.4-1.el9.noa 3.3 MB/s | 197 kB 00:00 2023-12-19T16:04:46.656 INFO:teuthology.orchestra.run.smithi151.stdout:(113/154): python3-jaraco-8.2.1-3.el9.noarch.rp 215 kB/s | 11 kB 00:00 2023-12-19T16:04:46.681 INFO:teuthology.orchestra.run.smithi151.stdout:(114/154): python3-jaraco-classes-3.2.1-5.el9.n 430 kB/s | 18 kB 00:00 2023-12-19T16:04:46.685 INFO:teuthology.orchestra.run.smithi037.stdout:(153/154): openssl-3.0.7-25.el9.x86_64.rpm 1.4 MB/s | 1.2 MB 00:00 2023-12-19T16:04:46.698 INFO:teuthology.orchestra.run.smithi151.stdout:(115/154): python3-jaraco-collections-3.0.0-8.e 559 kB/s | 23 kB 00:00 2023-12-19T16:04:46.724 INFO:teuthology.orchestra.run.smithi151.stdout:(116/154): python3-jaraco-functools-3.5.0-2.el9 471 kB/s | 19 kB 00:00 2023-12-19T16:04:46.749 INFO:teuthology.orchestra.run.smithi151.stdout:(117/154): python3-jaraco-text-3.2.0-6.el9.noar 396 kB/s | 20 kB 00:00 2023-12-19T16:04:46.775 INFO:teuthology.orchestra.run.smithi151.stdout:(118/154): python3-jwt+crypto-2.4.0-1.el9.noarc 183 kB/s | 9.0 kB 00:00 2023-12-19T16:04:46.800 INFO:teuthology.orchestra.run.smithi151.stdout:(119/154): python3-jwt-2.4.0-1.el9.noarch.rpm 825 kB/s | 41 kB 00:00 2023-12-19T16:04:46.850 INFO:teuthology.orchestra.run.smithi151.stdout:(120/154): python3-logutils-0.3.5-21.el9.noarch 943 kB/s | 46 kB 00:00 2023-12-19T16:04:46.892 INFO:teuthology.orchestra.run.smithi151.stdout:(121/154): python3-kubernetes-26.1.0-2.el9.noar 8.8 MB/s | 1.0 MB 00:00 2023-12-19T16:04:46.917 INFO:teuthology.orchestra.run.smithi151.stdout:(122/154): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2023-12-19T16:04:46.943 INFO:teuthology.orchestra.run.smithi151.stdout:(123/154): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2023-12-19T16:04:46.977 INFO:teuthology.orchestra.run.smithi151.stdout:(124/154): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2023-12-19T16:04:47.003 INFO:teuthology.orchestra.run.smithi151.stdout:(125/154): python3-portend-3.1.0-2.el9.noarch.r 282 kB/s | 16 kB 00:00 2023-12-19T16:04:47.027 INFO:teuthology.orchestra.run.smithi151.stdout:(126/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2023-12-19T16:04:47.053 INFO:teuthology.orchestra.run.smithi151.stdout:(127/154): python3-pyperclip-1.8.2-2.el9.noarch 569 kB/s | 28 kB 00:00 2023-12-19T16:04:47.079 INFO:teuthology.orchestra.run.smithi151.stdout:(128/154): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2023-12-19T16:04:47.112 INFO:teuthology.orchestra.run.smithi151.stdout:(129/154): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2023-12-19T16:04:47.137 INFO:teuthology.orchestra.run.smithi151.stdout:(130/154): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2023-12-19T16:04:47.163 INFO:teuthology.orchestra.run.smithi151.stdout:(131/154): python3-tempora-5.0.0-2.el9.noarch.r 724 kB/s | 36 kB 00:00 2023-12-19T16:04:47.188 INFO:teuthology.orchestra.run.smithi151.stdout:(132/154): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2023-12-19T16:04:47.222 INFO:teuthology.orchestra.run.smithi151.stdout:(133/154): python3-webob-1.8.7-6.el9.noarch.rpm 3.9 MB/s | 230 kB 00:00 2023-12-19T16:04:47.247 INFO:teuthology.orchestra.run.smithi151.stdout:(134/154): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2023-12-19T16:04:47.289 INFO:teuthology.orchestra.run.smithi151.stdout:(135/154): python3-werkzeug-2.0.3-3.el9.1.noarc 6.3 MB/s | 427 kB 00:00 2023-12-19T16:04:47.315 INFO:teuthology.orchestra.run.smithi151.stdout:(136/154): python3-zc-lockfile-2.0-10.el9.noarc 301 kB/s | 20 kB 00:00 2023-12-19T16:04:47.349 INFO:teuthology.orchestra.run.smithi151.stdout:(137/154): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2023-12-19T16:04:47.424 INFO:teuthology.orchestra.run.smithi151.stdout:(138/154): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2023-12-19T16:04:47.574 INFO:teuthology.orchestra.run.smithi151.stdout:(139/154): libarrow-9.0.0-10.el9.x86_64.rpm 2.4 MB/s | 4.4 MB 00:01 2023-12-19T16:04:47.616 INFO:teuthology.orchestra.run.smithi151.stdout:(140/154): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-12-19T16:04:47.658 INFO:teuthology.orchestra.run.smithi151.stdout:(141/154): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2023-12-19T16:04:47.692 INFO:teuthology.orchestra.run.smithi151.stdout:(142/154): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-12-19T16:04:47.734 INFO:teuthology.orchestra.run.smithi151.stdout:(143/154): elfutils-libelf-0.190-1.el9.x86_64.r 4.5 MB/s | 192 kB 00:00 2023-12-19T16:04:47.785 INFO:teuthology.orchestra.run.smithi151.stdout:(144/154): elfutils-libs-0.190-1.el9.x86_64.rpm 5.1 MB/s | 255 kB 00:00 2023-12-19T16:04:47.818 INFO:teuthology.orchestra.run.smithi151.stdout:(145/154): libacl-2.3.1-4.el9.x86_64.rpm 671 kB/s | 22 kB 00:00 2023-12-19T16:04:47.869 INFO:teuthology.orchestra.run.smithi151.stdout:(146/154): xfsdump-3.1.12-4.el9.x86_64.rpm 6.4 MB/s | 321 kB 00:00 2023-12-19T16:04:48.369 INFO:teuthology.orchestra.run.smithi151.stdout:(147/154): NetworkManager-1.45.7-1.el9.x86_64.r 4.5 MB/s | 2.3 MB 00:00 2023-12-19T16:04:48.561 INFO:teuthology.orchestra.run.smithi151.stdout:(148/154): librbd1-18.2.1-132.g568df92b.el9.x86 2.6 MB/s | 3.0 MB 00:01 2023-12-19T16:04:48.720 INFO:teuthology.orchestra.run.smithi151.stdout:(149/154): NetworkManager-libnm-1.45.7-1.el9.x8 5.1 MB/s | 1.8 MB 00:00 2023-12-19T16:04:48.745 INFO:teuthology.orchestra.run.smithi151.stdout:(150/154): NetworkManager-team-1.45.7-1.el9.x86 236 kB/s | 43 kB 00:00 2023-12-19T16:04:48.796 INFO:teuthology.orchestra.run.smithi151.stdout:(151/154): NetworkManager-tui-1.45.7-1.el9.x86_ 3.2 MB/s | 246 kB 00:00 2023-12-19T16:04:49.054 INFO:teuthology.orchestra.run.smithi151.stdout:(152/154): openssl-3.0.7-25.el9.x86_64.rpm 3.9 MB/s | 1.2 MB 00:00 2023-12-19T16:04:49.205 INFO:teuthology.orchestra.run.smithi151.stdout:(153/154): openssl-libs-3.0.7-25.el9.x86_64.rpm 5.3 MB/s | 2.2 MB 00:00 2023-12-19T16:04:49.298 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2023-12-19T16:04:49.355 INFO:teuthology.orchestra.run.smithi151.stdout:(154/154): librados2-18.2.1-132.g568df92b.el9.x 1.6 MB/s | 3.3 MB 00:02 2023-12-19T16:04:49.363 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-12-19T16:04:49.363 INFO:teuthology.orchestra.run.smithi151.stdout:Total 8.6 MB/s | 200 MB 00:23 2023-12-19T16:04:49.438 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/169 2023-12-19T16:04:49.473 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/169 2023-12-19T16:04:49.512 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/169 2023-12-19T16:04:49.557 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/169 2023-12-19T16:04:49.582 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/169 2023-12-19T16:04:49.624 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/169 2023-12-19T16:04:49.787 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-12-19T16:04:49.933 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/169 2023-12-19T16:04:50.008 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librados2-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-19T16:04:50.069 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-12-19T16:04:50.069 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-12-19T16:04:50.131 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-19T16:04:50.160 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-19T16:04:50.234 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-19T16:04:50.273 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 10/169 2023-12-19T16:04:50.308 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/169 2023-12-19T16:04:50.487 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/169 2023-12-19T16:04:50.545 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/169 2023-12-19T16:04:50.573 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-19T16:04:50.673 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-19T16:04:50.699 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 15/169 2023-12-19T16:04:50.829 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 15/169 2023-12-19T16:04:50.953 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T16:04:50.996 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T16:04:51.074 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T16:04:51.122 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T16:04:51.331 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T16:04:51.430 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/169 2023-12-19T16:04:51.468 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/169 2023-12-19T16:04:51.546 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/169 2023-12-19T16:04:51.599 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/169 2023-12-19T16:04:51.630 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/169 2023-12-19T16:04:51.675 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/169 2023-12-19T16:04:51.714 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/169 2023-12-19T16:04:51.788 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/169 2023-12-19T16:04:51.822 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/169 2023-12-19T16:04:51.849 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/169 2023-12-19T16:04:51.935 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/169 2023-12-19T16:04:51.979 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-common-2:18.2.1-132.g568df92b.el9.x 29/169 2023-12-19T16:04:52.023 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-argparse-2:18.2.1-132.g568df92b.el9 30/169 2023-12-19T16:04:52.097 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 31/169 2023-12-19T16:04:52.231 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/169 2023-12-19T16:04:52.283 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/169 2023-12-19T16:04:52.303 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-12-19T16:04:52.303 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-12-19T16:04:52.326 INFO:teuthology.orchestra.run.smithi037.stdout:(154/154): ceph-test-18.2.1-132.g568df92b.el9.x 2.1 MB/s | 40 MB 00:18 2023-12-19T16:04:52.333 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-12-19T16:04:52.333 INFO:teuthology.orchestra.run.smithi037.stdout:Total 7.7 MB/s | 200 MB 00:26 2023-12-19T16:04:52.508 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-12-19T16:04:52.715 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-12-19T16:04:52.715 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-12-19T16:04:52.816 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/169 2023-12-19T16:04:52.896 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/169 2023-12-19T16:04:52.926 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/169 2023-12-19T16:04:52.992 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/169 2023-12-19T16:04:53.030 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 38/169 2023-12-19T16:04:53.072 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/169 2023-12-19T16:04:53.232 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/169 2023-12-19T16:04:53.271 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/169 2023-12-19T16:04:53.380 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/169 2023-12-19T16:04:53.417 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/169 2023-12-19T16:04:53.480 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/169 2023-12-19T16:04:53.570 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/169 2023-12-19T16:04:53.601 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/169 2023-12-19T16:04:53.637 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/169 2023-12-19T16:04:53.685 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/169 2023-12-19T16:04:53.720 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/169 2023-12-19T16:04:53.763 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/169 2023-12-19T16:04:53.805 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/169 2023-12-19T16:04:53.939 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/169 2023-12-19T16:04:53.986 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/169 2023-12-19T16:04:54.016 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/169 2023-12-19T16:04:54.057 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/169 2023-12-19T16:04:54.152 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/169 2023-12-19T16:04:54.330 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-12-19T16:04:54.330 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-12-19T16:04:54.433 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 57/169 2023-12-19T16:04:54.474 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/169 2023-12-19T16:04:54.507 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/169 2023-12-19T16:04:54.534 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/169 2023-12-19T16:04:54.638 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : fmt-8.1.1-5.el9.x86_64 61/169 2023-12-19T16:04:54.685 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/169 2023-12-19T16:04:54.742 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/169 2023-12-19T16:04:54.797 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/169 2023-12-19T16:04:54.981 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/169 2023-12-19T16:04:55.030 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/169 2023-12-19T16:04:55.161 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/169 2023-12-19T16:04:55.208 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/169 2023-12-19T16:04:55.238 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/169 2023-12-19T16:04:55.271 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/169 2023-12-19T16:04:55.303 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/169 2023-12-19T16:04:55.334 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/169 2023-12-19T16:04:55.362 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/169 2023-12-19T16:04:55.397 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/169 2023-12-19T16:04:55.444 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/169 2023-12-19T16:04:55.475 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/169 2023-12-19T16:04:55.505 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/169 2023-12-19T16:04:55.581 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/169 2023-12-19T16:04:55.618 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/169 2023-12-19T16:04:55.658 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/169 2023-12-19T16:04:55.699 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/169 2023-12-19T16:04:55.734 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/169 2023-12-19T16:04:55.823 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/169 2023-12-19T16:04:55.853 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/169 2023-12-19T16:04:55.982 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/169 2023-12-19T16:04:56.037 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/169 2023-12-19T16:04:56.764 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/169 2023-12-19T16:04:56.818 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/169 2023-12-19T16:04:56.860 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/169 2023-12-19T16:04:56.908 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/169 2023-12-19T16:04:56.987 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/169 2023-12-19T16:04:57.036 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/169 2023-12-19T16:04:57.213 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/169 2023-12-19T16:04:57.246 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/169 2023-12-19T16:04:57.328 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/169 2023-12-19T16:04:57.965 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/169 2023-12-19T16:04:58.082 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/169 2023-12-19T16:04:58.825 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-12-19T16:04:59.020 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/169 2023-12-19T16:04:59.147 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/169 2023-12-19T16:04:59.236 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/169 2023-12-19T16:04:59.294 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/169 2023-12-19T16:04:59.310 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/169 2023-12-19T16:04:59.365 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/169 2023-12-19T16:04:59.367 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/169 2023-12-19T16:04:59.398 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/169 2023-12-19T16:04:59.429 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : jq-1.6-16.el9.x86_64 101/169 2023-12-19T16:04:59.458 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/169 2023-12-19T16:04:59.462 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/169 2023-12-19T16:04:59.493 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/169 2023-12-19T16:04:59.791 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/169 2023-12-19T16:04:59.830 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librbd1-2:18.2.1-132.g568df92b.el9.x86_64 105/169 2023-12-19T16:04:59.874 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/169 2023-12-19T16:04:59.919 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:18.2.1-132.g568df92b.el9.x86_64 105/169 2023-12-19T16:04:59.946 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librados2-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-19T16:04:59.951 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 106/169 2023-12-19T16:05:00.012 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/169 2023-12-19T16:05:00.084 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-19T16:05:00.114 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-19T16:05:00.237 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-19T16:05:00.277 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 10/169 2023-12-19T16:05:00.352 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/169 2023-12-19T16:05:00.413 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/169 2023-12-19T16:05:00.449 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librgw2-2:18.2.1-132.g568df92b.el9.x86_64 109/169 2023-12-19T16:05:00.522 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librgw2-2:18.2.1-132.g568df92b.el9.x86_64 109/169 2023-12-19T16:05:00.542 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 110/169 2023-12-19T16:05:00.696 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/169 2023-12-19T16:05:00.762 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/169 2023-12-19T16:05:00.779 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-19T16:05:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-12-19T16:05:00.934 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-19T16:05:00.947 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/169 2023-12-19T16:05:00.955 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 15/169 2023-12-19T16:05:00.972 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/169 2023-12-19T16:05:01.011 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/169 2023-12-19T16:05:01.057 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/169 2023-12-19T16:05:01.081 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/169 2023-12-19T16:05:01.124 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/169 2023-12-19T16:05:01.251 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 15/169 2023-12-19T16:05:01.457 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/169 2023-12-19T16:05:01.470 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T16:05:01.515 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-19T16:05:01.575 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T16:05:01.624 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-19T16:05:01.658 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-19T16:05:01.734 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-19T16:05:01.762 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 10/169 2023-12-19T16:05:01.764 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T16:05:01.798 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/169 2023-12-19T16:05:01.815 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T16:05:01.986 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/169 2023-12-19T16:05:02.042 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/169 2023-12-19T16:05:02.070 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-19T16:05:02.121 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T16:05:02.156 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-19T16:05:02.179 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 15/169 2023-12-19T16:05:02.284 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/169 2023-12-19T16:05:02.321 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 15/169 2023-12-19T16:05:02.321 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/169 2023-12-19T16:05:02.408 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T16:05:02.438 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/169 2023-12-19T16:05:02.468 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T16:05:02.512 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/169 2023-12-19T16:05:02.535 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-19T16:05:02.539 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T16:05:02.551 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/169 2023-12-19T16:05:02.573 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-19T16:05:02.602 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T16:05:02.611 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/169 2023-12-19T16:05:02.672 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/169 2023-12-19T16:05:02.788 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/169 2023-12-19T16:05:02.811 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T16:05:02.838 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/169 2023-12-19T16:05:02.872 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/169 2023-12-19T16:05:02.905 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/169 2023-12-19T16:05:02.939 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/169 2023-12-19T16:05:02.974 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/169 2023-12-19T16:05:03.001 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-common-2:18.2.1-132.g568df92b.el9.x 29/169 2023-12-19T16:05:03.012 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/169 2023-12-19T16:05:03.050 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-argparse-2:18.2.1-132.g568df92b.el9 30/169 2023-12-19T16:05:03.072 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/169 2023-12-19T16:05:03.101 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/169 2023-12-19T16:05:03.110 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-19T16:05:03.137 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/169 2023-12-19T16:05:03.151 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 112/169 2023-12-19T16:05:03.151 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 31/169 2023-12-19T16:05:03.177 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/169 2023-12-19T16:05:03.241 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 112/169 2023-12-19T16:05:03.242 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-19T16:05:03.242 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-19T16:05:03.242 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:05:03.243 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/169 2023-12-19T16:05:03.276 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/169 2023-12-19T16:05:03.277 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 113/169 2023-12-19T16:05:03.303 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/169 2023-12-19T16:05:03.326 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/169 2023-12-19T16:05:03.374 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/169 2023-12-19T16:05:03.397 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/169 2023-12-19T16:05:03.417 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:18.2.1-132.g568df92b.el9.x 29/169 2023-12-19T16:05:03.460 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:18.2.1-132.g568df92b.el9 30/169 2023-12-19T16:05:03.536 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 31/169 2023-12-19T16:05:03.698 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/169 2023-12-19T16:05:03.754 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/169 2023-12-19T16:05:04.077 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/169 2023-12-19T16:05:04.170 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/169 2023-12-19T16:05:04.233 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/169 2023-12-19T16:05:04.305 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/169 2023-12-19T16:05:04.312 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/169 2023-12-19T16:05:04.354 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 38/169 2023-12-19T16:05:04.393 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/169 2023-12-19T16:05:04.410 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/169 2023-12-19T16:05:04.430 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/169 2023-12-19T16:05:04.479 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/169 2023-12-19T16:05:04.517 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 38/169 2023-12-19T16:05:04.559 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/169 2023-12-19T16:05:04.594 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/169 2023-12-19T16:05:04.641 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/169 2023-12-19T16:05:04.693 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/169 2023-12-19T16:05:04.759 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/169 2023-12-19T16:05:04.782 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/169 2023-12-19T16:05:04.827 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/169 2023-12-19T16:05:04.869 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/169 2023-12-19T16:05:04.890 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/169 2023-12-19T16:05:04.904 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/169 2023-12-19T16:05:04.960 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/169 2023-12-19T16:05:04.977 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/169 2023-12-19T16:05:05.020 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/169 2023-12-19T16:05:05.034 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/169 2023-12-19T16:05:05.060 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/169 2023-12-19T16:05:05.071 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/169 2023-12-19T16:05:05.116 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/169 2023-12-19T16:05:05.125 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/169 2023-12-19T16:05:05.163 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/169 2023-12-19T16:05:05.168 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/169 2023-12-19T16:05:05.198 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/169 2023-12-19T16:05:05.231 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/169 2023-12-19T16:05:05.245 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/169 2023-12-19T16:05:05.284 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/169 2023-12-19T16:05:05.290 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/169 2023-12-19T16:05:05.425 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/169 2023-12-19T16:05:05.473 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/169 2023-12-19T16:05:05.476 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/169 2023-12-19T16:05:05.503 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/169 2023-12-19T16:05:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/169 2023-12-19T16:05:05.544 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/169 2023-12-19T16:05:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/169 2023-12-19T16:05:05.620 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/169 2023-12-19T16:05:05.641 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/169 2023-12-19T16:05:05.677 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 57/169 2023-12-19T16:05:05.718 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/169 2023-12-19T16:05:05.743 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/169 2023-12-19T16:05:05.747 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/169 2023-12-19T16:05:05.770 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/169 2023-12-19T16:05:05.783 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 57/169 2023-12-19T16:05:05.828 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/169 2023-12-19T16:05:05.875 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fmt-8.1.1-5.el9.x86_64 61/169 2023-12-19T16:05:05.882 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/169 2023-12-19T16:05:05.919 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/169 2023-12-19T16:05:05.921 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/169 2023-12-19T16:05:05.980 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/169 2023-12-19T16:05:06.035 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/169 2023-12-19T16:05:06.086 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fmt-8.1.1-5.el9.x86_64 61/169 2023-12-19T16:05:06.144 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/169 2023-12-19T16:05:06.215 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/169 2023-12-19T16:05:06.231 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/169 2023-12-19T16:05:06.295 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/169 2023-12-19T16:05:06.451 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/169 2023-12-19T16:05:06.538 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/169 2023-12-19T16:05:06.595 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/169 2023-12-19T16:05:06.599 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/169 2023-12-19T16:05:06.645 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/169 2023-12-19T16:05:06.674 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/169 2023-12-19T16:05:06.707 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/169 2023-12-19T16:05:06.739 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/169 2023-12-19T16:05:06.769 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/169 2023-12-19T16:05:06.770 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/169 2023-12-19T16:05:06.807 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/169 2023-12-19T16:05:06.824 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/169 2023-12-19T16:05:06.841 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/169 2023-12-19T16:05:06.872 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/169 2023-12-19T16:05:06.904 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/169 2023-12-19T16:05:06.933 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/169 2023-12-19T16:05:07.013 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/169 2023-12-19T16:05:07.052 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/169 2023-12-19T16:05:07.085 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/169 2023-12-19T16:05:07.127 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/169 2023-12-19T16:05:07.161 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/169 2023-12-19T16:05:07.254 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/169 2023-12-19T16:05:07.260 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/169 2023-12-19T16:05:07.288 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/169 2023-12-19T16:05:07.314 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/169 2023-12-19T16:05:07.370 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/169 2023-12-19T16:05:07.396 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/169 2023-12-19T16:05:07.416 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/169 2023-12-19T16:05:07.448 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/169 2023-12-19T16:05:07.459 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/169 2023-12-19T16:05:07.516 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/169 2023-12-19T16:05:07.588 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/169 2023-12-19T16:05:07.650 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/169 2023-12-19T16:05:07.699 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/169 2023-12-19T16:05:07.826 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/169 2023-12-19T16:05:07.868 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/169 2023-12-19T16:05:07.902 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/169 2023-12-19T16:05:07.958 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/169 2023-12-19T16:05:07.998 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/169 2023-12-19T16:05:08.139 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/169 2023-12-19T16:05:08.179 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/169 2023-12-19T16:05:08.233 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/169 2023-12-19T16:05:08.278 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/169 2023-12-19T16:05:08.308 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/169 2023-12-19T16:05:08.311 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/169 2023-12-19T16:05:08.361 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/169 2023-12-19T16:05:08.369 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/169 2023-12-19T16:05:08.460 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/169 2023-12-19T16:05:08.505 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/169 2023-12-19T16:05:08.689 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/169 2023-12-19T16:05:08.719 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/169 2023-12-19T16:05:08.798 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/169 2023-12-19T16:05:09.284 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/169 2023-12-19T16:05:09.345 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/169 2023-12-19T16:05:09.393 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/169 2023-12-19T16:05:09.454 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/169 2023-12-19T16:05:09.498 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/169 2023-12-19T16:05:09.574 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/169 2023-12-19T16:05:09.614 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/169 2023-12-19T16:05:09.622 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/169 2023-12-19T16:05:09.850 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/169 2023-12-19T16:05:09.878 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/169 2023-12-19T16:05:09.970 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/169 2023-12-19T16:05:10.758 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/169 2023-12-19T16:05:10.907 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/169 2023-12-19T16:05:10.912 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/169 2023-12-19T16:05:10.994 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/169 2023-12-19T16:05:11.025 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/169 2023-12-19T16:05:11.056 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jq-1.6-16.el9.x86_64 101/169 2023-12-19T16:05:11.085 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/169 2023-12-19T16:05:11.117 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/169 2023-12-19T16:05:11.431 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/169 2023-12-19T16:05:11.464 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:18.2.1-132.g568df92b.el9.x86_64 105/169 2023-12-19T16:05:11.555 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:18.2.1-132.g568df92b.el9.x86_64 105/169 2023-12-19T16:05:11.585 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 106/169 2023-12-19T16:05:11.621 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/169 2023-12-19T16:05:12.042 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/169 2023-12-19T16:05:12.066 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:18.2.1-132.g568df92b.el9.x86_64 109/169 2023-12-19T16:05:12.121 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:18.2.1-132.g568df92b.el9.x86_64 109/169 2023-12-19T16:05:12.151 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 110/169 2023-12-19T16:05:12.421 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/169 2023-12-19T16:05:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/169 2023-12-19T16:05:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/169 2023-12-19T16:05:12.600 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : jq-1.6-16.el9.x86_64 101/169 2023-12-19T16:05:12.643 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/169 2023-12-19T16:05:12.684 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/169 2023-12-19T16:05:13.051 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/169 2023-12-19T16:05:13.081 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librbd1-2:18.2.1-132.g568df92b.el9.x86_64 105/169 2023-12-19T16:05:13.191 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:18.2.1-132.g568df92b.el9.x86_64 105/169 2023-12-19T16:05:13.221 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 106/169 2023-12-19T16:05:13.275 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/169 2023-12-19T16:05:13.721 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/169 2023-12-19T16:05:13.751 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librgw2-2:18.2.1-132.g568df92b.el9.x86_64 109/169 2023-12-19T16:05:13.834 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librgw2-2:18.2.1-132.g568df92b.el9.x86_64 109/169 2023-12-19T16:05:13.862 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 110/169 2023-12-19T16:05:14.253 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-19T16:05:14.289 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-19T16:05:14.851 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-19T16:05:14.856 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 113/169 2023-12-19T16:05:14.856 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /sys 2023-12-19T16:05:14.856 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /proc 2023-12-19T16:05:14.856 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /mnt 2023-12-19T16:05:14.857 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /var/tmp 2023-12-19T16:05:14.857 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /home 2023-12-19T16:05:14.857 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /root 2023-12-19T16:05:14.857 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /tmp 2023-12-19T16:05:14.857 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:05:14.892 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 112/169 2023-12-19T16:05:14.968 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 112/169 2023-12-19T16:05:14.968 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-19T16:05:14.968 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-19T16:05:14.968 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:05:14.994 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 113/169 2023-12-19T16:05:15.024 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 114/169 2023-12-19T16:05:15.039 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 114/169 2023-12-19T16:05:15.039 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:15.039 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-19T16:05:15.040 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:05:16.195 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-19T16:05:16.235 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-19T16:05:16.585 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 115/169 2023-12-19T16:05:16.610 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 115/169 2023-12-19T16:05:16.610 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:16.610 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-19T16:05:16.611 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T16:05:16.611 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T16:05:16.611 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:05:16.819 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 116/169 2023-12-19T16:05:16.841 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 116/169 2023-12-19T16:05:16.841 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:16.841 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-19T16:05:16.842 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T16:05:16.842 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T16:05:16.842 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:05:16.861 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-19T16:05:16.906 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 112/169 2023-12-19T16:05:17.063 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 112/169 2023-12-19T16:05:17.063 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-19T16:05:17.063 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-19T16:05:17.063 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:05:17.107 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 113/169 2023-12-19T16:05:17.295 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 117/169 2023-12-19T16:05:17.317 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 117/169 2023-12-19T16:05:17.317 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:17.317 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-19T16:05:17.317 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T16:05:17.317 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T16:05:17.317 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:05:17.422 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : automake-1.16.2-8.el9.noarch 118/169 2023-12-19T16:05:17.851 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephadm-2:18.2.1-132.g568df92b.el9.noarch 119/169 2023-12-19T16:05:17.878 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephadm-2:18.2.1-132.g568df92b.el9.noarch 119/169 2023-12-19T16:05:17.907 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el 120/169 2023-12-19T16:05:17.969 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-132.g568df92b.e 121/169 2023-12-19T16:05:18.030 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 122/169 2023-12-19T16:05:18.250 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 122/169 2023-12-19T16:05:18.286 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 123/169 2023-12-19T16:05:19.250 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 123/169 2023-12-19T16:05:19.278 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 124/169 2023-12-19T16:05:19.375 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 124/169 2023-12-19T16:05:19.525 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9 125/169 2023-12-19T16:05:19.564 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 126/169 2023-12-19T16:05:19.586 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 126/169 2023-12-19T16:05:19.587 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:19.587 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-19T16:05:19.587 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T16:05:19.587 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T16:05:19.587 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:05:19.631 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 127/169 2023-12-19T16:05:19.642 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 127/169 2023-12-19T16:05:19.686 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-2:18.2.1-132.g568df92b.el9.x86_64 128/169 2023-12-19T16:05:20.389 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/169 2023-12-19T16:05:20.416 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 130/169 2023-12-19T16:05:20.438 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 130/169 2023-12-19T16:05:20.438 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:20.438 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-19T16:05:20.439 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T16:05:20.439 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T16:05:20.439 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:05:20.475 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-132.g568df9 131/169 2023-12-19T16:05:20.497 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-132.g568df9 131/169 2023-12-19T16:05:20.497 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:20.497 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-19T16:05:20.497 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:05:20.551 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 132/169 2023-12-19T16:05:20.573 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 132/169 2023-12-19T16:05:20.573 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:20.574 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-19T16:05:20.574 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T16:05:20.574 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T16:05:20.574 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:05:20.876 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 133/169 2023-12-19T16:05:20.899 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 133/169 2023-12-19T16:05:20.899 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:20.899 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-19T16:05:20.899 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T16:05:20.900 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T16:05:20.900 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:05:24.563 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 134/169 2023-12-19T16:05:24.604 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 135/169 2023-12-19T16:05:24.645 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 136/169 2023-12-19T16:05:24.677 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 137/169 2023-12-19T16:05:24.730 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 138/169 2023-12-19T16:05:24.906 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 139/169 2023-12-19T16:05:25.016 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/169 2023-12-19T16:05:25.059 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 141/169 2023-12-19T16:05:25.084 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_6 142/169 2023-12-19T16:05:25.141 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/169 2023-12-19T16:05:25.186 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T16:05:25.227 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 145/169 2023-12-19T16:05:25.257 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 146/169 2023-12-19T16:05:25.302 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 147/169 2023-12-19T16:05:25.896 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T16:05:25.935 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T16:05:25.955 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T16:05:26.568 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 113/169 2023-12-19T16:05:26.568 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2023-12-19T16:05:26.568 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2023-12-19T16:05:26.568 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2023-12-19T16:05:26.568 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2023-12-19T16:05:26.569 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2023-12-19T16:05:26.569 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2023-12-19T16:05:26.569 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2023-12-19T16:05:26.569 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:05:26.748 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 114/169 2023-12-19T16:05:26.766 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 114/169 2023-12-19T16:05:26.766 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:26.766 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-19T16:05:26.766 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:05:26.766 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 149/169 2023-12-19T16:05:26.857 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 150/169 2023-12-19T16:05:26.922 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/169 2023-12-19T16:05:26.963 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/169 2023-12-19T16:05:27.043 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/169 2023-12-19T16:05:27.093 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/169 2023-12-19T16:05:27.118 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 155/169 2023-12-19T16:05:27.143 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 156/169 2023-12-19T16:05:27.170 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 157/169 2023-12-19T16:05:27.170 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T16:05:27.238 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T16:05:27.265 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 159/169 2023-12-19T16:05:27.304 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/169 2023-12-19T16:05:27.329 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 161/169 2023-12-19T16:05:27.330 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T16:05:27.414 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T16:05:27.439 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T16:05:27.445 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T16:05:27.445 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T16:05:27.617 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T16:05:27.617 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T16:05:27.700 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T16:05:27.725 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 166/169 2023-12-19T16:05:27.750 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 167/169 2023-12-19T16:05:27.776 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 168/169 2023-12-19T16:05:27.839 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T16:05:28.368 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 115/169 2023-12-19T16:05:28.395 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 115/169 2023-12-19T16:05:28.395 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:28.395 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-19T16:05:28.395 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T16:05:28.395 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T16:05:28.395 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:05:28.610 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 116/169 2023-12-19T16:05:28.634 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 116/169 2023-12-19T16:05:28.634 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:28.634 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-19T16:05:28.634 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T16:05:28.634 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T16:05:28.635 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:05:29.102 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 117/169 2023-12-19T16:05:29.126 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 117/169 2023-12-19T16:05:29.126 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:29.126 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-19T16:05:29.126 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T16:05:29.127 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T16:05:29.127 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:05:29.212 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : automake-1.16.2-8.el9.noarch 118/169 2023-12-19T16:05:29.534 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:18.2.1-132.g568df92b.el9.noarch 119/169 2023-12-19T16:05:29.560 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:18.2.1-132.g568df92b.el9.noarch 119/169 2023-12-19T16:05:29.589 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el 120/169 2023-12-19T16:05:29.653 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-132.g568df92b.e 121/169 2023-12-19T16:05:29.683 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 122/169 2023-12-19T16:05:29.917 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 122/169 2023-12-19T16:05:29.942 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 123/169 2023-12-19T16:05:30.140 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 113/169 2023-12-19T16:05:30.140 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /sys 2023-12-19T16:05:30.140 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /proc 2023-12-19T16:05:30.140 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /mnt 2023-12-19T16:05:30.140 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /var/tmp 2023-12-19T16:05:30.140 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /home 2023-12-19T16:05:30.140 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /root 2023-12-19T16:05:30.140 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /tmp 2023-12-19T16:05:30.140 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:05:30.347 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 114/169 2023-12-19T16:05:30.392 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 114/169 2023-12-19T16:05:30.392 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:30.392 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-19T16:05:30.392 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:05:30.959 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 123/169 2023-12-19T16:05:30.993 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 124/169 2023-12-19T16:05:31.102 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 124/169 2023-12-19T16:05:31.264 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9 125/169 2023-12-19T16:05:31.295 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 126/169 2023-12-19T16:05:31.320 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 126/169 2023-12-19T16:05:31.320 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:31.320 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-19T16:05:31.320 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T16:05:31.320 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T16:05:31.320 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:05:31.371 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 127/169 2023-12-19T16:05:31.382 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 127/169 2023-12-19T16:05:31.428 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:18.2.1-132.g568df92b.el9.x86_64 128/169 2023-12-19T16:05:32.111 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 115/169 2023-12-19T16:05:32.170 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/169 2023-12-19T16:05:32.198 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 130/169 2023-12-19T16:05:32.206 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 115/169 2023-12-19T16:05:32.206 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:32.206 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-19T16:05:32.206 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T16:05:32.206 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T16:05:32.206 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:05:32.222 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 130/169 2023-12-19T16:05:32.222 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:32.222 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-19T16:05:32.222 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T16:05:32.222 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T16:05:32.222 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:05:32.265 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-132.g568df9 131/169 2023-12-19T16:05:32.266 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T16:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-2:18.2.1-132.g568df92b.el9.x86_64 1/169 2023-12-19T16:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 2/169 2023-12-19T16:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 3/169 2023-12-19T16:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 4/169 2023-12-19T16:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-132.g568df9 5/169 2023-12-19T16:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 6/169 2023-12-19T16:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 7/169 2023-12-19T16:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-19T16:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-19T16:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 10/169 2023-12-19T16:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 11/169 2023-12-19T16:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 12/169 2023-12-19T16:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 13/169 2023-12-19T16:05:32.267 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-19T16:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_6 15/169 2023-12-19T16:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 16/169 2023-12-19T16:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 17/169 2023-12-19T16:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 18/169 2023-12-19T16:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 19/169 2023-12-19T16:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librgw2-2:18.2.1-132.g568df92b.el9.x86_64 20/169 2023-12-19T16:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-argparse-2:18.2.1-132.g568df92b.el9 21/169 2023-12-19T16:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-common-2:18.2.1-132.g568df92b.el9.x 22/169 2023-12-19T16:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 23/169 2023-12-19T16:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 24/169 2023-12-19T16:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 25/169 2023-12-19T16:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 26/169 2023-12-19T16:05:32.268 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 27/169 2023-12-19T16:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 28/169 2023-12-19T16:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 29/169 2023-12-19T16:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-132.g568df92b.e 30/169 2023-12-19T16:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 31/169 2023-12-19T16:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 32/169 2023-12-19T16:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 33/169 2023-12-19T16:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9 34/169 2023-12-19T16:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 35/169 2023-12-19T16:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el 36/169 2023-12-19T16:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 37/169 2023-12-19T16:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephadm-2:18.2.1-132.g568df92b.el9.noarch 38/169 2023-12-19T16:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 39/169 2023-12-19T16:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/169 2023-12-19T16:05:32.269 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/169 2023-12-19T16:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/169 2023-12-19T16:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 43/169 2023-12-19T16:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/169 2023-12-19T16:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/169 2023-12-19T16:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/169 2023-12-19T16:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/169 2023-12-19T16:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : jq-1.6-16.el9.x86_64 48/169 2023-12-19T16:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 49/169 2023-12-19T16:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/169 2023-12-19T16:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/169 2023-12-19T16:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/169 2023-12-19T16:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 53/169 2023-12-19T16:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 54/169 2023-12-19T16:05:32.270 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 55/169 2023-12-19T16:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 56/169 2023-12-19T16:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/169 2023-12-19T16:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/169 2023-12-19T16:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/169 2023-12-19T16:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/169 2023-12-19T16:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/169 2023-12-19T16:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/169 2023-12-19T16:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/169 2023-12-19T16:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/169 2023-12-19T16:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/169 2023-12-19T16:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/169 2023-12-19T16:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/169 2023-12-19T16:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/169 2023-12-19T16:05:32.271 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/169 2023-12-19T16:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/169 2023-12-19T16:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/169 2023-12-19T16:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/169 2023-12-19T16:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/169 2023-12-19T16:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/169 2023-12-19T16:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/169 2023-12-19T16:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/169 2023-12-19T16:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/169 2023-12-19T16:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/169 2023-12-19T16:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/169 2023-12-19T16:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/169 2023-12-19T16:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/169 2023-12-19T16:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/169 2023-12-19T16:05:32.272 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/169 2023-12-19T16:05:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 84/169 2023-12-19T16:05:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/169 2023-12-19T16:05:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/169 2023-12-19T16:05:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/169 2023-12-19T16:05:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/169 2023-12-19T16:05:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/169 2023-12-19T16:05:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/169 2023-12-19T16:05:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/169 2023-12-19T16:05:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/169 2023-12-19T16:05:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/169 2023-12-19T16:05:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 94/169 2023-12-19T16:05:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 95/169 2023-12-19T16:05:32.273 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 96/169 2023-12-19T16:05:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/169 2023-12-19T16:05:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/169 2023-12-19T16:05:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/169 2023-12-19T16:05:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2023-12-19T16:05:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2023-12-19T16:05:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2023-12-19T16:05:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2023-12-19T16:05:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/169 2023-12-19T16:05:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/169 2023-12-19T16:05:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/169 2023-12-19T16:05:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/169 2023-12-19T16:05:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/169 2023-12-19T16:05:32.274 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/169 2023-12-19T16:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/169 2023-12-19T16:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/169 2023-12-19T16:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/169 2023-12-19T16:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 113/169 2023-12-19T16:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/169 2023-12-19T16:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/169 2023-12-19T16:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/169 2023-12-19T16:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/169 2023-12-19T16:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/169 2023-12-19T16:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/169 2023-12-19T16:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/169 2023-12-19T16:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/169 2023-12-19T16:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/169 2023-12-19T16:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/169 2023-12-19T16:05:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/169 2023-12-19T16:05:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/169 2023-12-19T16:05:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/169 2023-12-19T16:05:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/169 2023-12-19T16:05:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/169 2023-12-19T16:05:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/169 2023-12-19T16:05:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/169 2023-12-19T16:05:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/169 2023-12-19T16:05:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/169 2023-12-19T16:05:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/169 2023-12-19T16:05:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/169 2023-12-19T16:05:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/169 2023-12-19T16:05:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/169 2023-12-19T16:05:32.276 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/169 2023-12-19T16:05:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/169 2023-12-19T16:05:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/169 2023-12-19T16:05:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:18.2.1-132.g568df92b.el9.x86_64 140/169 2023-12-19T16:05:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/169 2023-12-19T16:05:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:18.2.1-132.g568df92b.el9.x86_64 142/169 2023-12-19T16:05:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/169 2023-12-19T16:05:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T16:05:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/169 2023-12-19T16:05:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : acl-2.3.1-4.el9.x86_64 146/169 2023-12-19T16:05:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : acl-2.3.1-3.el9.x86_64 147/169 2023-12-19T16:05:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 148/169 2023-12-19T16:05:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/169 2023-12-19T16:05:32.277 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 150/169 2023-12-19T16:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 151/169 2023-12-19T16:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 152/169 2023-12-19T16:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 153/169 2023-12-19T16:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 154/169 2023-12-19T16:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 155/169 2023-12-19T16:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 156/169 2023-12-19T16:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 157/169 2023-12-19T16:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 158/169 2023-12-19T16:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 159/169 2023-12-19T16:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 160/169 2023-12-19T16:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/169 2023-12-19T16:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 162/169 2023-12-19T16:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T16:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 164/169 2023-12-19T16:05:32.278 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T16:05:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 166/169 2023-12-19T16:05:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 167/169 2023-12-19T16:05:32.279 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 168/169 2023-12-19T16:05:32.289 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-132.g568df9 131/169 2023-12-19T16:05:32.289 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:32.289 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-19T16:05:32.289 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:05:32.332 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 132/169 2023-12-19T16:05:32.356 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 132/169 2023-12-19T16:05:32.356 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:32.356 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-19T16:05:32.357 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T16:05:32.357 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T16:05:32.357 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:05:32.436 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 116/169 2023-12-19T16:05:32.514 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 116/169 2023-12-19T16:05:32.514 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:32.515 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-19T16:05:32.515 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T16:05:32.515 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T16:05:32.515 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:05:32.658 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 133/169 2023-12-19T16:05:32.682 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 133/169 2023-12-19T16:05:32.682 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:32.682 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-19T16:05:32.682 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T16:05:32.682 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T16:05:32.682 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:05:33.012 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 117/169 2023-12-19T16:05:33.096 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 117/169 2023-12-19T16:05:33.096 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:33.096 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-19T16:05:33.096 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T16:05:33.096 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T16:05:33.096 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:05:33.214 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : automake-1.16.2-8.el9.noarch 118/169 2023-12-19T16:05:33.764 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:18.2.1-132.g568df92b.el9.noarch 119/169 2023-12-19T16:05:33.801 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephadm-2:18.2.1-132.g568df92b.el9.noarch 119/169 2023-12-19T16:05:33.849 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el 120/169 2023-12-19T16:05:33.969 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-132.g568df92b.e 121/169 2023-12-19T16:05:33.995 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 122/169 2023-12-19T16:05:34.320 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 122/169 2023-12-19T16:05:34.355 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 123/169 2023-12-19T16:05:34.725 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 169/169 2023-12-19T16:05:34.726 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:05:34.726 INFO:teuthology.orchestra.run.smithi078.stdout:Upgraded: 2023-12-19T16:05:34.726 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-19T16:05:34.726 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-19T16:05:34.726 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-19T16:05:34.726 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-19T16:05:34.726 INFO:teuthology.orchestra.run.smithi078.stdout: acl-2.3.1-4.el9.x86_64 2023-12-19T16:05:34.726 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-19T16:05:34.726 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-19T16:05:34.726 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-19T16:05:34.726 INFO:teuthology.orchestra.run.smithi078.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-19T16:05:34.726 INFO:teuthology.orchestra.run.smithi078.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-19T16:05:34.726 INFO:teuthology.orchestra.run.smithi078.stdout: librados2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.726 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.727 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-19T16:05:34.727 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-19T16:05:34.727 INFO:teuthology.orchestra.run.smithi078.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-19T16:05:34.727 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2023-12-19T16:05:34.727 INFO:teuthology.orchestra.run.smithi078.stdout: automake-1.16.2-8.el9.noarch 2023-12-19T16:05:34.727 INFO:teuthology.orchestra.run.smithi078.stdout: bison-3.7.4-5.el9.x86_64 2023-12-19T16:05:34.727 INFO:teuthology.orchestra.run.smithi078.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-19T16:05:34.727 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.727 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.727 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.727 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.727 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:34.727 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.727 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.728 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.728 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:34.728 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:34.728 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:34.728 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:34.728 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:34.728 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.728 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.728 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:34.728 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.728 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.728 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.728 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:34.728 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:34.729 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.729 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.729 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:34.729 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-19T16:05:34.729 INFO:teuthology.orchestra.run.smithi078.stdout: flex-2.6.4-9.el9.x86_64 2023-12-19T16:05:34.729 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-19T16:05:34.729 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-19T16:05:34.729 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-19T16:05:34.729 INFO:teuthology.orchestra.run.smithi078.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-19T16:05:34.729 INFO:teuthology.orchestra.run.smithi078.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-19T16:05:34.729 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-19T16:05:34.729 INFO:teuthology.orchestra.run.smithi078.stdout: jq-1.6-16.el9.x86_64 2023-12-19T16:05:34.729 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-19T16:05:34.729 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-19T16:05:34.730 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-19T16:05:34.730 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.730 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.733 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.733 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-19T16:05:34.733 INFO:teuthology.orchestra.run.smithi078.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-19T16:05:34.734 INFO:teuthology.orchestra.run.smithi078.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-19T16:05:34.734 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-19T16:05:34.734 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-19T16:05:34.734 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.734 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.734 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-19T16:05:34.734 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.734 INFO:teuthology.orchestra.run.smithi078.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-19T16:05:34.734 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-19T16:05:34.734 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-19T16:05:34.734 INFO:teuthology.orchestra.run.smithi078.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-19T16:05:34.734 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-19T16:05:34.734 INFO:teuthology.orchestra.run.smithi078.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-19T16:05:34.735 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-19T16:05:34.735 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-19T16:05:34.735 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-19T16:05:34.735 INFO:teuthology.orchestra.run.smithi078.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-19T16:05:34.735 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-13.11-1.el9.x86_64 2023-12-19T16:05:34.735 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-19T16:05:34.735 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-19T16:05:34.735 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-19T16:05:34.735 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-19T16:05:34.735 INFO:teuthology.orchestra.run.smithi078.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-19T16:05:34.735 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-19T16:05:34.735 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-19T16:05:34.735 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-19T16:05:34.735 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.736 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.736 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.736 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-19T16:05:34.736 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-19T16:05:34.736 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-19T16:05:34.736 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-19T16:05:34.736 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-19T16:05:34.736 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-19T16:05:34.737 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-19T16:05:34.737 INFO:teuthology.orchestra.run.smithi078.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-19T16:05:34.737 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-19T16:05:34.737 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-19T16:05:34.737 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-19T16:05:34.737 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-19T16:05:34.737 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-19T16:05:34.737 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-19T16:05:34.737 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-19T16:05:34.737 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-19T16:05:34.738 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-19T16:05:34.738 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-19T16:05:34.738 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-19T16:05:34.740 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-19T16:05:34.741 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-19T16:05:34.741 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-19T16:05:34.741 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-19T16:05:34.741 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-19T16:05:34.741 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-19T16:05:34.741 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-19T16:05:34.742 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-19T16:05:34.742 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-19T16:05:34.742 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-19T16:05:34.742 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ply-3.11-14.el9.noarch 2023-12-19T16:05:34.742 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-19T16:05:34.742 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-19T16:05:34.742 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-19T16:05:34.742 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-19T16:05:34.742 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-19T16:05:34.742 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-19T16:05:34.742 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-19T16:05:34.742 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-19T16:05:34.742 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.742 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.743 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-19T16:05:34.743 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-19T16:05:34.743 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-19T16:05:34.743 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.743 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-19T16:05:34.743 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-19T16:05:34.743 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-19T16:05:34.743 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-19T16:05:34.743 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-19T16:05:34.743 INFO:teuthology.orchestra.run.smithi078.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-19T16:05:34.743 INFO:teuthology.orchestra.run.smithi078.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-19T16:05:34.743 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-19T16:05:34.743 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-19T16:05:34.743 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-19T16:05:34.744 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-19T16:05:34.744 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-19T16:05:34.744 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.744 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.744 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:34.744 INFO:teuthology.orchestra.run.smithi078.stdout: re2-1:20211101-3.el9.x86_64 2023-12-19T16:05:34.744 INFO:teuthology.orchestra.run.smithi078.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-19T16:05:34.744 INFO:teuthology.orchestra.run.smithi078.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-19T16:05:34.744 INFO:teuthology.orchestra.run.smithi078.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-19T16:05:34.744 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-19T16:05:34.744 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-19T16:05:34.745 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-19T16:05:34.745 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:05:34.745 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2023-12-19T16:05:35.308 DEBUG:teuthology.parallel:result is None 2023-12-19T16:05:35.462 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 123/169 2023-12-19T16:05:35.497 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 124/169 2023-12-19T16:05:35.638 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 124/169 2023-12-19T16:05:35.804 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9 125/169 2023-12-19T16:05:35.833 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 126/169 2023-12-19T16:05:35.904 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 126/169 2023-12-19T16:05:35.904 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:35.904 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-19T16:05:35.905 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T16:05:35.905 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T16:05:35.905 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:05:35.951 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 127/169 2023-12-19T16:05:35.991 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 127/169 2023-12-19T16:05:36.070 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-2:18.2.1-132.g568df92b.el9.x86_64 128/169 2023-12-19T16:05:36.578 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 134/169 2023-12-19T16:05:36.620 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 135/169 2023-12-19T16:05:36.660 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 136/169 2023-12-19T16:05:36.692 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 137/169 2023-12-19T16:05:36.720 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 138/169 2023-12-19T16:05:36.862 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/169 2023-12-19T16:05:36.895 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 130/169 2023-12-19T16:05:36.912 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 139/169 2023-12-19T16:05:36.990 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 130/169 2023-12-19T16:05:36.990 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:36.990 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-19T16:05:36.990 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T16:05:36.990 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T16:05:36.990 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:05:37.026 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/169 2023-12-19T16:05:37.046 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-132.g568df9 131/169 2023-12-19T16:05:37.057 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 141/169 2023-12-19T16:05:37.089 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_6 142/169 2023-12-19T16:05:37.126 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-132.g568df9 131/169 2023-12-19T16:05:37.126 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:37.126 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-19T16:05:37.126 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:05:37.145 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/169 2023-12-19T16:05:37.181 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T16:05:37.205 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 132/169 2023-12-19T16:05:37.240 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 145/169 2023-12-19T16:05:37.271 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 146/169 2023-12-19T16:05:37.299 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 147/169 2023-12-19T16:05:37.311 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 132/169 2023-12-19T16:05:37.311 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:37.311 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-19T16:05:37.312 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T16:05:37.312 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T16:05:37.312 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:05:37.689 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 133/169 2023-12-19T16:05:37.771 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 133/169 2023-12-19T16:05:37.771 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T16:05:37.771 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-19T16:05:37.771 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T16:05:37.771 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T16:05:37.772 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:05:37.913 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T16:05:37.948 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T16:05:37.968 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T16:05:38.854 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 149/169 2023-12-19T16:05:38.945 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 150/169 2023-12-19T16:05:39.010 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/169 2023-12-19T16:05:39.052 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/169 2023-12-19T16:05:39.136 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/169 2023-12-19T16:05:39.172 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/169 2023-12-19T16:05:39.198 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 155/169 2023-12-19T16:05:39.223 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 156/169 2023-12-19T16:05:39.250 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 157/169 2023-12-19T16:05:39.250 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T16:05:39.325 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T16:05:39.353 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 159/169 2023-12-19T16:05:39.383 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/169 2023-12-19T16:05:39.409 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 161/169 2023-12-19T16:05:39.409 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T16:05:39.476 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T16:05:39.501 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T16:05:39.508 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T16:05:39.508 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T16:05:39.696 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T16:05:39.696 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T16:05:39.779 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T16:05:39.804 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 166/169 2023-12-19T16:05:39.829 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 167/169 2023-12-19T16:05:39.854 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 168/169 2023-12-19T16:05:39.930 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T16:05:41.797 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 134/169 2023-12-19T16:05:41.855 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 135/169 2023-12-19T16:05:41.918 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 136/169 2023-12-19T16:05:41.964 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 137/169 2023-12-19T16:05:41.990 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 138/169 2023-12-19T16:05:42.251 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 139/169 2023-12-19T16:05:42.370 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/169 2023-12-19T16:05:42.393 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 141/169 2023-12-19T16:05:42.418 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_6 142/169 2023-12-19T16:05:42.490 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/169 2023-12-19T16:05:42.543 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T16:05:42.580 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 145/169 2023-12-19T16:05:42.620 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 146/169 2023-12-19T16:05:42.664 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 147/169 2023-12-19T16:05:43.543 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T16:05:43.589 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T16:05:43.644 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T16:05:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T16:05:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:18.2.1-132.g568df92b.el9.x86_64 1/169 2023-12-19T16:05:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 2/169 2023-12-19T16:05:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 3/169 2023-12-19T16:05:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 4/169 2023-12-19T16:05:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-132.g568df9 5/169 2023-12-19T16:05:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 6/169 2023-12-19T16:05:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 7/169 2023-12-19T16:05:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-19T16:05:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-19T16:05:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 10/169 2023-12-19T16:05:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 11/169 2023-12-19T16:05:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 12/169 2023-12-19T16:05:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 13/169 2023-12-19T16:05:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-19T16:05:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_6 15/169 2023-12-19T16:05:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 16/169 2023-12-19T16:05:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 17/169 2023-12-19T16:05:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 18/169 2023-12-19T16:05:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 19/169 2023-12-19T16:05:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:18.2.1-132.g568df92b.el9.x86_64 20/169 2023-12-19T16:05:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:18.2.1-132.g568df92b.el9 21/169 2023-12-19T16:05:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:18.2.1-132.g568df92b.el9.x 22/169 2023-12-19T16:05:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 23/169 2023-12-19T16:05:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 24/169 2023-12-19T16:05:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 25/169 2023-12-19T16:05:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 26/169 2023-12-19T16:05:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 27/169 2023-12-19T16:05:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 28/169 2023-12-19T16:05:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 29/169 2023-12-19T16:05:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-132.g568df92b.e 30/169 2023-12-19T16:05:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 31/169 2023-12-19T16:05:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 32/169 2023-12-19T16:05:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 33/169 2023-12-19T16:05:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9 34/169 2023-12-19T16:05:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 35/169 2023-12-19T16:05:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el 36/169 2023-12-19T16:05:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 37/169 2023-12-19T16:05:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:18.2.1-132.g568df92b.el9.noarch 38/169 2023-12-19T16:05:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 39/169 2023-12-19T16:05:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/169 2023-12-19T16:05:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/169 2023-12-19T16:05:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/169 2023-12-19T16:05:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 43/169 2023-12-19T16:05:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/169 2023-12-19T16:05:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/169 2023-12-19T16:05:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/169 2023-12-19T16:05:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/169 2023-12-19T16:05:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jq-1.6-16.el9.x86_64 48/169 2023-12-19T16:05:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 49/169 2023-12-19T16:05:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/169 2023-12-19T16:05:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/169 2023-12-19T16:05:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/169 2023-12-19T16:05:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 53/169 2023-12-19T16:05:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 54/169 2023-12-19T16:05:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 55/169 2023-12-19T16:05:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 56/169 2023-12-19T16:05:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/169 2023-12-19T16:05:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/169 2023-12-19T16:05:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/169 2023-12-19T16:05:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/169 2023-12-19T16:05:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/169 2023-12-19T16:05:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/169 2023-12-19T16:05:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/169 2023-12-19T16:05:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/169 2023-12-19T16:05:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/169 2023-12-19T16:05:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/169 2023-12-19T16:05:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/169 2023-12-19T16:05:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/169 2023-12-19T16:05:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/169 2023-12-19T16:05:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/169 2023-12-19T16:05:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/169 2023-12-19T16:05:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/169 2023-12-19T16:05:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/169 2023-12-19T16:05:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/169 2023-12-19T16:05:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/169 2023-12-19T16:05:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/169 2023-12-19T16:05:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/169 2023-12-19T16:05:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/169 2023-12-19T16:05:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/169 2023-12-19T16:05:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/169 2023-12-19T16:05:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/169 2023-12-19T16:05:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/169 2023-12-19T16:05:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/169 2023-12-19T16:05:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 84/169 2023-12-19T16:05:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/169 2023-12-19T16:05:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/169 2023-12-19T16:05:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/169 2023-12-19T16:05:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/169 2023-12-19T16:05:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/169 2023-12-19T16:05:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/169 2023-12-19T16:05:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/169 2023-12-19T16:05:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/169 2023-12-19T16:05:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/169 2023-12-19T16:05:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 94/169 2023-12-19T16:05:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 95/169 2023-12-19T16:05:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 96/169 2023-12-19T16:05:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/169 2023-12-19T16:05:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/169 2023-12-19T16:05:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/169 2023-12-19T16:05:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2023-12-19T16:05:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2023-12-19T16:05:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2023-12-19T16:05:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2023-12-19T16:05:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/169 2023-12-19T16:05:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/169 2023-12-19T16:05:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/169 2023-12-19T16:05:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/169 2023-12-19T16:05:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/169 2023-12-19T16:05:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/169 2023-12-19T16:05:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/169 2023-12-19T16:05:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/169 2023-12-19T16:05:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/169 2023-12-19T16:05:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 113/169 2023-12-19T16:05:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/169 2023-12-19T16:05:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/169 2023-12-19T16:05:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/169 2023-12-19T16:05:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/169 2023-12-19T16:05:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/169 2023-12-19T16:05:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/169 2023-12-19T16:05:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/169 2023-12-19T16:05:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/169 2023-12-19T16:05:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/169 2023-12-19T16:05:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/169 2023-12-19T16:05:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/169 2023-12-19T16:05:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/169 2023-12-19T16:05:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/169 2023-12-19T16:05:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/169 2023-12-19T16:05:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/169 2023-12-19T16:05:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/169 2023-12-19T16:05:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/169 2023-12-19T16:05:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/169 2023-12-19T16:05:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/169 2023-12-19T16:05:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/169 2023-12-19T16:05:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/169 2023-12-19T16:05:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/169 2023-12-19T16:05:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/169 2023-12-19T16:05:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/169 2023-12-19T16:05:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/169 2023-12-19T16:05:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/169 2023-12-19T16:05:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:18.2.1-132.g568df92b.el9.x86_64 140/169 2023-12-19T16:05:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/169 2023-12-19T16:05:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:18.2.1-132.g568df92b.el9.x86_64 142/169 2023-12-19T16:05:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/169 2023-12-19T16:05:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T16:05:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/169 2023-12-19T16:05:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : acl-2.3.1-4.el9.x86_64 146/169 2023-12-19T16:05:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : acl-2.3.1-3.el9.x86_64 147/169 2023-12-19T16:05:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 148/169 2023-12-19T16:05:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/169 2023-12-19T16:05:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 150/169 2023-12-19T16:05:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 151/169 2023-12-19T16:05:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 152/169 2023-12-19T16:05:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 153/169 2023-12-19T16:05:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 154/169 2023-12-19T16:05:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 155/169 2023-12-19T16:05:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 156/169 2023-12-19T16:05:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 157/169 2023-12-19T16:05:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 158/169 2023-12-19T16:05:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 159/169 2023-12-19T16:05:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 160/169 2023-12-19T16:05:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/169 2023-12-19T16:05:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 162/169 2023-12-19T16:05:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T16:05:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 164/169 2023-12-19T16:05:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T16:05:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 166/169 2023-12-19T16:05:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 167/169 2023-12-19T16:05:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 168/169 2023-12-19T16:05:44.981 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 149/169 2023-12-19T16:05:45.285 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 150/169 2023-12-19T16:05:45.339 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/169 2023-12-19T16:05:45.422 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/169 2023-12-19T16:05:45.584 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/169 2023-12-19T16:05:45.621 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/169 2023-12-19T16:05:45.661 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 155/169 2023-12-19T16:05:45.703 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 156/169 2023-12-19T16:05:45.754 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 157/169 2023-12-19T16:05:45.755 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T16:05:45.894 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T16:05:45.945 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 159/169 2023-12-19T16:05:46.015 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/169 2023-12-19T16:05:46.058 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 161/169 2023-12-19T16:05:46.058 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T16:05:46.187 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T16:05:46.218 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T16:05:46.257 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T16:05:46.257 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T16:05:46.584 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T16:05:46.584 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T16:05:46.818 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T16:05:46.863 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 166/169 2023-12-19T16:05:46.897 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 167/169 2023-12-19T16:05:46.932 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 168/169 2023-12-19T16:05:47.037 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 169/169 2023-12-19T16:05:47.037 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:05:47.037 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2023-12-19T16:05:47.037 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-19T16:05:47.037 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-19T16:05:47.038 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-19T16:05:47.038 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-19T16:05:47.038 INFO:teuthology.orchestra.run.smithi037.stdout: acl-2.3.1-4.el9.x86_64 2023-12-19T16:05:47.038 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-19T16:05:47.038 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-19T16:05:47.038 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-19T16:05:47.038 INFO:teuthology.orchestra.run.smithi037.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-19T16:05:47.038 INFO:teuthology.orchestra.run.smithi037.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-19T16:05:47.038 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.039 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.039 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-19T16:05:47.039 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-19T16:05:47.039 INFO:teuthology.orchestra.run.smithi037.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-19T16:05:47.039 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-12-19T16:05:47.039 INFO:teuthology.orchestra.run.smithi037.stdout: automake-1.16.2-8.el9.noarch 2023-12-19T16:05:47.039 INFO:teuthology.orchestra.run.smithi037.stdout: bison-3.7.4-5.el9.x86_64 2023-12-19T16:05:47.039 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-19T16:05:47.039 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.039 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.039 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.039 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:47.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:47.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:47.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:47.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:47.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:47.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.040 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.041 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:47.041 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.041 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.041 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.041 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:47.041 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:47.041 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.041 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.041 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:47.041 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-19T16:05:47.041 INFO:teuthology.orchestra.run.smithi037.stdout: flex-2.6.4-9.el9.x86_64 2023-12-19T16:05:47.041 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-19T16:05:47.042 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-19T16:05:47.042 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-19T16:05:47.042 INFO:teuthology.orchestra.run.smithi037.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-19T16:05:47.042 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-19T16:05:47.042 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-19T16:05:47.042 INFO:teuthology.orchestra.run.smithi037.stdout: jq-1.6-16.el9.x86_64 2023-12-19T16:05:47.042 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-19T16:05:47.042 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-19T16:05:47.042 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-19T16:05:47.042 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.042 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.042 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.042 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-19T16:05:47.042 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-19T16:05:47.043 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-19T16:05:47.043 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-19T16:05:47.043 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-19T16:05:47.043 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.043 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.043 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-19T16:05:47.043 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.043 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-19T16:05:47.043 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-19T16:05:47.043 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-19T16:05:47.043 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-19T16:05:47.043 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-19T16:05:47.043 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-19T16:05:47.043 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-19T16:05:47.044 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-19T16:05:47.044 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-19T16:05:47.044 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-19T16:05:47.044 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-13.11-1.el9.x86_64 2023-12-19T16:05:47.044 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-19T16:05:47.044 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-19T16:05:47.044 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-19T16:05:47.044 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-19T16:05:47.044 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-19T16:05:47.044 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-19T16:05:47.044 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-19T16:05:47.044 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-19T16:05:47.044 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-19T16:05:47.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-19T16:05:47.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-19T16:05:47.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-19T16:05:47.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-19T16:05:47.045 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-19T16:05:47.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-19T16:05:47.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-19T16:05:47.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-19T16:05:47.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-19T16:05:47.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-19T16:05:47.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-19T16:05:47.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-19T16:05:47.046 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-19T16:05:47.047 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-19T16:05:47.047 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-19T16:05:47.047 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-19T16:05:47.047 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-19T16:05:47.047 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-19T16:05:47.047 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-19T16:05:47.047 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-19T16:05:47.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-19T16:05:47.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-19T16:05:47.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-19T16:05:47.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-19T16:05:47.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-19T16:05:47.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-19T16:05:47.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-19T16:05:47.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-19T16:05:47.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2023-12-19T16:05:47.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-19T16:05:47.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-19T16:05:47.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-19T16:05:47.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-19T16:05:47.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-19T16:05:47.048 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-19T16:05:47.049 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-19T16:05:47.049 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-19T16:05:47.049 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.049 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.049 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-19T16:05:47.049 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-19T16:05:47.049 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-19T16:05:47.049 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.049 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-19T16:05:47.049 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-19T16:05:47.049 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-19T16:05:47.050 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-19T16:05:47.050 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-19T16:05:47.050 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-19T16:05:47.050 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-19T16:05:47.050 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-19T16:05:47.050 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-19T16:05:47.050 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-19T16:05:47.050 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-19T16:05:47.050 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-19T16:05:47.050 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.050 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.050 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:47.050 INFO:teuthology.orchestra.run.smithi037.stdout: re2-1:20211101-3.el9.x86_64 2023-12-19T16:05:47.050 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-19T16:05:47.051 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-19T16:05:47.051 INFO:teuthology.orchestra.run.smithi037.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-19T16:05:47.051 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-19T16:05:47.051 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-19T16:05:47.051 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-19T16:05:47.051 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:05:47.051 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-12-19T16:05:47.059 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T16:05:47.306 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T16:05:47.306 INFO:teuthology.orchestra.run.smithi151.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-19T16:05:47.307 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:05:47.590 DEBUG:teuthology.parallel:result is None 2023-12-19T16:05:52.136 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-2:18.2.1-132.g568df92b.el9.x86_64 1/169 2023-12-19T16:05:52.136 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 2/169 2023-12-19T16:05:52.136 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 3/169 2023-12-19T16:05:52.136 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 4/169 2023-12-19T16:05:52.136 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-132.g568df9 5/169 2023-12-19T16:05:52.136 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 6/169 2023-12-19T16:05:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 7/169 2023-12-19T16:05:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-19T16:05:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-19T16:05:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 10/169 2023-12-19T16:05:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 11/169 2023-12-19T16:05:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 12/169 2023-12-19T16:05:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 13/169 2023-12-19T16:05:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-19T16:05:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_6 15/169 2023-12-19T16:05:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 16/169 2023-12-19T16:05:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 17/169 2023-12-19T16:05:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 18/169 2023-12-19T16:05:52.137 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 19/169 2023-12-19T16:05:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librgw2-2:18.2.1-132.g568df92b.el9.x86_64 20/169 2023-12-19T16:05:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-argparse-2:18.2.1-132.g568df92b.el9 21/169 2023-12-19T16:05:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-common-2:18.2.1-132.g568df92b.el9.x 22/169 2023-12-19T16:05:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 23/169 2023-12-19T16:05:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 24/169 2023-12-19T16:05:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 25/169 2023-12-19T16:05:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 26/169 2023-12-19T16:05:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 27/169 2023-12-19T16:05:52.138 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 28/169 2023-12-19T16:05:52.151 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 29/169 2023-12-19T16:05:52.151 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-132.g568df92b.e 30/169 2023-12-19T16:05:52.151 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 31/169 2023-12-19T16:05:52.151 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 32/169 2023-12-19T16:05:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 33/169 2023-12-19T16:05:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9 34/169 2023-12-19T16:05:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 35/169 2023-12-19T16:05:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el 36/169 2023-12-19T16:05:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 37/169 2023-12-19T16:05:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephadm-2:18.2.1-132.g568df92b.el9.noarch 38/169 2023-12-19T16:05:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 39/169 2023-12-19T16:05:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/169 2023-12-19T16:05:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/169 2023-12-19T16:05:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/169 2023-12-19T16:05:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 43/169 2023-12-19T16:05:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/169 2023-12-19T16:05:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/169 2023-12-19T16:05:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/169 2023-12-19T16:05:52.152 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/169 2023-12-19T16:05:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : jq-1.6-16.el9.x86_64 48/169 2023-12-19T16:05:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 49/169 2023-12-19T16:05:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/169 2023-12-19T16:05:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/169 2023-12-19T16:05:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/169 2023-12-19T16:05:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 53/169 2023-12-19T16:05:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 54/169 2023-12-19T16:05:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 55/169 2023-12-19T16:05:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 56/169 2023-12-19T16:05:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/169 2023-12-19T16:05:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/169 2023-12-19T16:05:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/169 2023-12-19T16:05:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/169 2023-12-19T16:05:52.153 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/169 2023-12-19T16:05:52.154 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/169 2023-12-19T16:05:52.154 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/169 2023-12-19T16:05:52.154 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/169 2023-12-19T16:05:52.154 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/169 2023-12-19T16:05:52.154 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/169 2023-12-19T16:05:52.154 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/169 2023-12-19T16:05:52.154 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/169 2023-12-19T16:05:52.154 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/169 2023-12-19T16:05:52.154 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/169 2023-12-19T16:05:52.154 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/169 2023-12-19T16:05:52.154 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/169 2023-12-19T16:05:52.154 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/169 2023-12-19T16:05:52.154 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/169 2023-12-19T16:05:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/169 2023-12-19T16:05:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/169 2023-12-19T16:05:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/169 2023-12-19T16:05:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/169 2023-12-19T16:05:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/169 2023-12-19T16:05:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/169 2023-12-19T16:05:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/169 2023-12-19T16:05:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/169 2023-12-19T16:05:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/169 2023-12-19T16:05:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 84/169 2023-12-19T16:05:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/169 2023-12-19T16:05:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/169 2023-12-19T16:05:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/169 2023-12-19T16:05:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/169 2023-12-19T16:05:52.155 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/169 2023-12-19T16:05:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/169 2023-12-19T16:05:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/169 2023-12-19T16:05:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/169 2023-12-19T16:05:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/169 2023-12-19T16:05:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 94/169 2023-12-19T16:05:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 95/169 2023-12-19T16:05:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 96/169 2023-12-19T16:05:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/169 2023-12-19T16:05:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/169 2023-12-19T16:05:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/169 2023-12-19T16:05:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2023-12-19T16:05:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2023-12-19T16:05:52.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2023-12-19T16:05:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2023-12-19T16:05:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/169 2023-12-19T16:05:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/169 2023-12-19T16:05:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/169 2023-12-19T16:05:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/169 2023-12-19T16:05:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/169 2023-12-19T16:05:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/169 2023-12-19T16:05:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/169 2023-12-19T16:05:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/169 2023-12-19T16:05:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/169 2023-12-19T16:05:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 113/169 2023-12-19T16:05:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/169 2023-12-19T16:05:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/169 2023-12-19T16:05:52.157 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/169 2023-12-19T16:05:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/169 2023-12-19T16:05:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/169 2023-12-19T16:05:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/169 2023-12-19T16:05:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/169 2023-12-19T16:05:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/169 2023-12-19T16:05:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/169 2023-12-19T16:05:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/169 2023-12-19T16:05:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/169 2023-12-19T16:05:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/169 2023-12-19T16:05:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/169 2023-12-19T16:05:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/169 2023-12-19T16:05:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/169 2023-12-19T16:05:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/169 2023-12-19T16:05:52.158 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/169 2023-12-19T16:05:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/169 2023-12-19T16:05:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/169 2023-12-19T16:05:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/169 2023-12-19T16:05:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/169 2023-12-19T16:05:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/169 2023-12-19T16:05:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/169 2023-12-19T16:05:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/169 2023-12-19T16:05:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/169 2023-12-19T16:05:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/169 2023-12-19T16:05:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:18.2.1-132.g568df92b.el9.x86_64 140/169 2023-12-19T16:05:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/169 2023-12-19T16:05:52.159 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:18.2.1-132.g568df92b.el9.x86_64 142/169 2023-12-19T16:05:52.160 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/169 2023-12-19T16:05:52.160 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T16:05:52.160 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/169 2023-12-19T16:05:52.160 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : acl-2.3.1-4.el9.x86_64 146/169 2023-12-19T16:05:52.160 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : acl-2.3.1-3.el9.x86_64 147/169 2023-12-19T16:05:52.160 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 148/169 2023-12-19T16:05:52.160 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/169 2023-12-19T16:05:52.160 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 150/169 2023-12-19T16:05:52.160 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 151/169 2023-12-19T16:05:52.160 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 152/169 2023-12-19T16:05:52.161 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 153/169 2023-12-19T16:05:52.161 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 154/169 2023-12-19T16:05:52.161 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 155/169 2023-12-19T16:05:52.161 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 156/169 2023-12-19T16:05:52.161 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 157/169 2023-12-19T16:05:52.161 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 158/169 2023-12-19T16:05:52.161 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 159/169 2023-12-19T16:05:52.161 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 160/169 2023-12-19T16:05:52.161 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/169 2023-12-19T16:05:52.161 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 162/169 2023-12-19T16:05:52.161 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T16:05:52.161 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 164/169 2023-12-19T16:05:52.161 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T16:05:52.162 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 166/169 2023-12-19T16:05:52.162 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 167/169 2023-12-19T16:05:52.162 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 168/169 2023-12-19T16:05:54.310 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 169/169 2023-12-19T16:05:54.310 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:05:54.310 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2023-12-19T16:05:54.310 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-19T16:05:54.310 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-19T16:05:54.310 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-19T16:05:54.311 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-19T16:05:54.311 INFO:teuthology.orchestra.run.smithi151.stdout: acl-2.3.1-4.el9.x86_64 2023-12-19T16:05:54.311 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-19T16:05:54.311 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-19T16:05:54.311 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-19T16:05:54.311 INFO:teuthology.orchestra.run.smithi151.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-19T16:05:54.311 INFO:teuthology.orchestra.run.smithi151.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-19T16:05:54.311 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.311 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.311 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-19T16:05:54.311 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-19T16:05:54.311 INFO:teuthology.orchestra.run.smithi151.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-19T16:05:54.311 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-12-19T16:05:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: automake-1.16.2-8.el9.noarch 2023-12-19T16:05:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: bison-3.7.4-5.el9.x86_64 2023-12-19T16:05:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-19T16:05:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 2023-12-19T16:05:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-19T16:05:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: flex-2.6.4-9.el9.x86_64 2023-12-19T16:05:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-19T16:05:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-19T16:05:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-19T16:05:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-19T16:05:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-19T16:05:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-19T16:05:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: jq-1.6-16.el9.x86_64 2023-12-19T16:05:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-19T16:05:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-19T16:05:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-19T16:05:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.315 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.315 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-19T16:05:54.315 INFO:teuthology.orchestra.run.smithi151.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-19T16:05:54.315 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-19T16:05:54.315 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-19T16:05:54.315 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-19T16:05:54.315 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.315 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.315 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-19T16:05:54.315 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.315 INFO:teuthology.orchestra.run.smithi151.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-19T16:05:54.315 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-19T16:05:54.315 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-19T16:05:54.316 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-19T16:05:54.316 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-19T16:05:54.316 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-19T16:05:54.316 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-19T16:05:54.316 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-19T16:05:54.316 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-19T16:05:54.316 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-19T16:05:54.316 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-13.11-1.el9.x86_64 2023-12-19T16:05:54.316 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-19T16:05:54.316 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-19T16:05:54.316 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-19T16:05:54.316 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-19T16:05:54.316 INFO:teuthology.orchestra.run.smithi151.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-19T16:05:54.316 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-19T16:05:54.317 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-19T16:05:54.317 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-19T16:05:54.317 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.317 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.317 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.317 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-19T16:05:54.317 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-19T16:05:54.317 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-19T16:05:54.317 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-19T16:05:54.317 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-19T16:05:54.317 INFO:teuthology.orchestra.run.smithi151.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-19T16:05:54.317 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-19T16:05:54.317 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-19T16:05:54.318 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-19T16:05:54.318 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-19T16:05:54.318 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-19T16:05:54.318 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-19T16:05:54.318 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-19T16:05:54.318 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-19T16:05:54.318 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-19T16:05:54.318 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-19T16:05:54.318 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-19T16:05:54.318 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-19T16:05:54.318 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-19T16:05:54.318 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-19T16:05:54.318 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-19T16:05:54.319 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-19T16:05:54.319 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-19T16:05:54.319 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-19T16:05:54.319 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-19T16:05:54.319 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-19T16:05:54.319 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-19T16:05:54.319 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-19T16:05:54.319 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-19T16:05:54.319 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply-3.11-14.el9.noarch 2023-12-19T16:05:54.319 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-19T16:05:54.319 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-19T16:05:54.319 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-19T16:05:54.319 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-19T16:05:54.319 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-19T16:05:54.320 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-19T16:05:54.320 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-19T16:05:54.320 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-19T16:05:54.320 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.320 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.320 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-19T16:05:54.320 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-19T16:05:54.320 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-19T16:05:54.320 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.320 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-19T16:05:54.320 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-19T16:05:54.320 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-19T16:05:54.320 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-19T16:05:54.320 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-19T16:05:54.321 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-19T16:05:54.321 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-19T16:05:54.321 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-19T16:05:54.321 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-19T16:05:54.321 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-19T16:05:54.321 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-19T16:05:54.321 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-19T16:05:54.321 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.321 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.321 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-19T16:05:54.321 INFO:teuthology.orchestra.run.smithi151.stdout: re2-1:20211101-3.el9.x86_64 2023-12-19T16:05:54.321 INFO:teuthology.orchestra.run.smithi151.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-19T16:05:54.321 INFO:teuthology.orchestra.run.smithi151.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-19T16:05:54.321 INFO:teuthology.orchestra.run.smithi151.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-19T16:05:54.321 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-19T16:05:54.322 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-19T16:05:54.322 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-19T16:05:54.322 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:05:54.322 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-12-19T16:05:55.054 DEBUG:teuthology.parallel:result is None 2023-12-19T16:05:55.054 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T16:05:55.347 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-19T16:05:55.374 INFO:teuthology.orchestra.run.smithi037.stdout:18.2.1-132.g568df92b.el9 2023-12-19T16:05:55.375 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-132.g568df92b.el9 2023-12-19T16:05:55.375 INFO:teuthology.task.install:The correct ceph version 18.2.1-132.g568df92b is installed. 2023-12-19T16:05:55.376 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T16:05:55.518 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-19T16:05:55.544 INFO:teuthology.orchestra.run.smithi078.stdout:18.2.1-132.g568df92b.el9 2023-12-19T16:05:55.544 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-132.g568df92b.el9 2023-12-19T16:05:55.544 INFO:teuthology.task.install:The correct ceph version 18.2.1-132.g568df92b is installed. 2023-12-19T16:05:55.547 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T16:05:55.690 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-19T16:05:55.747 INFO:teuthology.orchestra.run.smithi151.stdout:18.2.1-132.g568df92b.el9 2023-12-19T16:05:55.747 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-132.g568df92b.el9 2023-12-19T16:05:55.747 INFO:teuthology.task.install:The correct ceph version 18.2.1-132.g568df92b is installed. 2023-12-19T16:05:55.749 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-19T16:05:55.749 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:05:55.749 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T16:05:55.790 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T16:05:55.790 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T16:05:55.825 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T16:05:55.826 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T16:05:55.904 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-19T16:05:55.904 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:05:55.904 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T16:05:55.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T16:05:56.014 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T16:05:56.014 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T16:05:56.045 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T16:05:56.114 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T16:05:56.115 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T16:05:56.198 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T16:05:56.319 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-19T16:05:56.319 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:05:56.319 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T16:05:56.355 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T16:05:56.430 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T16:05:56.430 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T16:05:56.459 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T16:05:56.526 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T16:05:56.526 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T16:05:56.602 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T16:05:56.734 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-19T16:05:56.735 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:05:56.735 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T16:05:56.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T16:05:56.845 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T16:05:56.845 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T16:05:56.871 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T16:05:56.938 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T16:05:56.938 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T16:05:57.020 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T16:05:57.138 INFO:teuthology.run_tasks:Running task ceph... 2023-12-19T16:05:57.206 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-19T16:05:57.206 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2023-12-19T16:05:57.209 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2023-12-19T16:05:57.211 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2023-12-19T16:05:57.288 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-19T16:05:57.288 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T16:05:57.290 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T16:05:57.293 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T16:05:57.364 INFO:tasks.ceph:Creating extra log directories... 2023-12-19T16:05:57.364 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T16:05:57.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T16:05:57.369 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T16:05:57.447 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-19T16:05:57.447 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-19T16:05:57.447 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-19T16:05:57.447 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:05:57.447 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T16:05:57.462 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T16:05:57.591 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-19T16:05:57.624 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T16:05:57.624 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T16:05:57.639 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T16:05:57.756 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-19T16:05:57.783 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T16:05:57.783 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T16:05:57.826 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T16:05:58.033 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-19T16:05:58.111 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-19T16:05:58.111 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-19T16:05:58.111 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066', 'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7497066', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 430, 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'sleep_before_teardown': 0, 'subset': '301/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi037.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLC3HYK0HgfNM7g/c5+f6H1JBDH7l2u8f8+8aghJwChwAt2AwvutoVKH9XH78ofqYTZ77wk3O9OYIWy4cjkSxFY=', 'smithi078.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtnDg9DmOslbC2XB5fDJLZO6QCLpyuPIu+wauED0UaelHaDToCXKE3NYU7OcSn5dX9iwqvGaq++RFWj4tHXcjo=', 'smithi151.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKrNCTuMGC/FXM8yGMmHjs5cvqKWNlrKt8PQhN1FijJ9JMdldr8Mmuq5ja2h962rxxOnvpyTaLyRjpiWWe+V2w8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-19_13:22:41', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-19T16:05:58.112 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T16:05:58.116 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T16:05:58.119 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T16:05:58.162 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T16:05:58.171 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T16:05:58.174 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T16:05:58.281 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:05:58.281 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T16:05:58.296 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T16:05:58.296 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2023-12-19T16:05:58.351 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T16:05:58.351 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:05:58.351 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 661 Links: 1 2023-12-19T16:05:58.351 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:05:58.351 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T16:05:58.351 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-12-19 16:05:40.271983464 +0000 2023-12-19T16:05:58.351 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-12-19 15:59:26.856705903 +0000 2023-12-19T16:05:58.351 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-12-19 15:59:26.856705903 +0000 2023-12-19T16:05:58.351 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-12-19 15:59:26.856705903 +0000 2023-12-19T16:05:58.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T16:05:58.421 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-12-19T16:05:58.421 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-12-19T16:05:58.422 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000210222 s, 2.4 MB/s 2023-12-19T16:05:58.422 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T16:05:58.478 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2023-12-19T16:05:58.535 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T16:05:58.535 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:05:58.535 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-12-19T16:05:58.535 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:05:58.535 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T16:05:58.535 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-12-19 16:05:40.272983449 +0000 2023-12-19T16:05:58.535 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-12-19 15:59:27.385698511 +0000 2023-12-19T16:05:58.535 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-12-19 15:59:27.385698511 +0000 2023-12-19T16:05:58.535 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-12-19 15:59:27.385698511 +0000 2023-12-19T16:05:58.536 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T16:05:58.606 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-12-19T16:05:58.606 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-12-19T16:05:58.606 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000225317 s, 2.3 MB/s 2023-12-19T16:05:58.607 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T16:05:58.663 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2023-12-19T16:05:58.718 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T16:05:58.718 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:05:58.718 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 698 Links: 1 2023-12-19T16:05:58.719 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:05:58.719 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T16:05:58.719 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-12-19 16:05:40.272983449 +0000 2023-12-19T16:05:58.719 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-12-19 15:59:27.916691091 +0000 2023-12-19T16:05:58.719 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-12-19 15:59:27.916691091 +0000 2023-12-19T16:05:58.719 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-12-19 15:59:27.916691091 +0000 2023-12-19T16:05:58.719 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T16:05:58.788 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-12-19T16:05:58.788 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-12-19T16:05:58.788 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000164049 s, 3.1 MB/s 2023-12-19T16:05:58.789 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T16:05:58.845 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2023-12-19T16:05:58.900 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T16:05:58.901 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:05:58.901 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 717 Links: 1 2023-12-19T16:05:58.901 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:05:58.901 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T16:05:58.901 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-12-19 16:05:40.273983434 +0000 2023-12-19T16:05:58.901 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-12-19 15:59:28.423684006 +0000 2023-12-19T16:05:58.901 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-12-19 15:59:28.423684006 +0000 2023-12-19T16:05:58.901 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-12-19 15:59:28.423684006 +0000 2023-12-19T16:05:58.902 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T16:05:58.970 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-12-19T16:05:58.970 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-12-19T16:05:58.970 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000184035 s, 2.8 MB/s 2023-12-19T16:05:58.971 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T16:05:59.027 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T16:05:59.028 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T16:05:59.028 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T16:05:59.044 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T16:05:59.045 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2023-12-19T16:05:59.101 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T16:05:59.101 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:05:59.101 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-12-19T16:05:59.101 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:05:59.101 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T16:05:59.101 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-12-19 16:05:28.179019634 +0000 2023-12-19T16:05:59.101 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-12-19 15:59:16.264596303 +0000 2023-12-19T16:05:59.101 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-12-19 15:59:16.264596303 +0000 2023-12-19T16:05:59.101 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2023-12-19 15:59:16.264596303 +0000 2023-12-19T16:05:59.102 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T16:05:59.167 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-12-19T16:05:59.167 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-12-19T16:05:59.168 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.00019853 s, 2.6 MB/s 2023-12-19T16:05:59.169 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T16:05:59.225 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2023-12-19T16:05:59.281 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T16:05:59.281 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:05:59.281 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-12-19T16:05:59.281 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:05:59.282 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T16:05:59.282 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-12-19 16:05:28.180019616 +0000 2023-12-19T16:05:59.282 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-12-19 15:59:16.820586467 +0000 2023-12-19T16:05:59.282 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-12-19 15:59:16.820586467 +0000 2023-12-19T16:05:59.282 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2023-12-19 15:59:16.820586467 +0000 2023-12-19T16:05:59.282 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T16:05:59.349 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-12-19T16:05:59.349 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-12-19T16:05:59.349 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000192056 s, 2.7 MB/s 2023-12-19T16:05:59.350 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T16:05:59.405 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2023-12-19T16:05:59.460 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T16:05:59.461 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:05:59.461 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 701 Links: 1 2023-12-19T16:05:59.461 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:05:59.461 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T16:05:59.461 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-12-19 16:05:28.180019616 +0000 2023-12-19T16:05:59.461 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-12-19 15:59:17.307577852 +0000 2023-12-19T16:05:59.461 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-12-19 15:59:17.307577852 +0000 2023-12-19T16:05:59.461 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2023-12-19 15:59:17.307577852 +0000 2023-12-19T16:05:59.461 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T16:05:59.526 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-12-19T16:05:59.526 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-12-19T16:05:59.526 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.00023687 s, 2.2 MB/s 2023-12-19T16:05:59.527 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T16:05:59.583 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2023-12-19T16:05:59.637 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T16:05:59.637 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:05:59.638 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-12-19T16:05:59.638 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:05:59.638 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T16:05:59.638 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-12-19 16:05:28.180019616 +0000 2023-12-19T16:05:59.638 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-12-19 15:59:17.798569166 +0000 2023-12-19T16:05:59.638 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-12-19 15:59:17.798569166 +0000 2023-12-19T16:05:59.638 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2023-12-19 15:59:17.798569166 +0000 2023-12-19T16:05:59.638 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T16:05:59.704 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-12-19T16:05:59.704 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-12-19T16:05:59.704 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000261276 s, 2.0 MB/s 2023-12-19T16:05:59.705 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T16:05:59.762 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T16:05:59.762 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-19T16:05:59.762 INFO:tasks.ceph:Generating config... 2023-12-19T16:05:59.763 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-19T16:05:59.763 INFO:tasks.ceph:[client] debug client = 20 2023-12-19T16:05:59.763 INFO:tasks.ceph:[client] debug ms = 1 2023-12-19T16:05:59.763 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-19T16:05:59.763 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-19T16:05:59.764 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-12-19T16:05:59.764 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-19T16:05:59.764 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-19T16:05:59.764 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-19T16:05:59.764 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-19T16:05:59.764 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-19T16:05:59.764 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-19T16:05:59.764 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-19T16:05:59.764 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-19T16:05:59.764 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-19T16:05:59.764 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-19T16:05:59.764 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-19T16:05:59.764 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-19T16:05:59.764 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-19T16:05:59.765 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-19T16:05:59.765 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-19T16:05:59.765 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-19T16:05:59.765 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-19T16:05:59.765 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-19T16:05:59.765 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-19T16:05:59.765 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-19T16:05:59.765 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-19T16:05:59.765 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-19T16:05:59.765 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-19T16:05:59.765 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-19T16:05:59.765 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-19T16:05:59.766 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-19T16:05:59.766 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-19T16:05:59.766 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-19T16:05:59.766 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-19T16:05:59.766 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-19T16:05:59.766 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-19T16:05:59.766 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-19T16:05:59.766 INFO:tasks.ceph:Setting up mon.a... 2023-12-19T16:05:59.766 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-19T16:05:59.832 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.keyring 2023-12-19T16:05:59.835 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-19T16:05:59.886 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T16:05:59.917 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.37'), ('mon.b', '172.21.15.78'), ('mon.c', '[v2:172.21.15.78:3301,v1:172.21.15.78:6790]')] 2023-12-19T16:05:59.918 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.37,172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790]', 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-19T16:05:59.918 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:05:59.919 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T16:05:59.974 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.37 --add b 172.21.15.78 --addv c '[v2:172.21.15.78:3301,v1:172.21.15.78:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:06:00.060 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:06:00.060 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: generated fsid aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2 2023-12-19T16:06:00.060 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = pacific 2023-12-19T16:06:00.060 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 0 2023-12-19T16:06:00.060 INFO:teuthology.orchestra.run.smithi037.stdout:fsid aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2 2023-12-19T16:06:00.060 INFO:teuthology.orchestra.run.smithi037.stdout:last_changed 2023-12-19T16:06:00.058907+0000 2023-12-19T16:06:00.060 INFO:teuthology.orchestra.run.smithi037.stdout:created 2023-12-19T16:06:00.058907+0000 2023-12-19T16:06:00.060 INFO:teuthology.orchestra.run.smithi037.stdout:min_mon_release 16 (pacific) 2023-12-19T16:06:00.060 INFO:teuthology.orchestra.run.smithi037.stdout:election_strategy: 1 2023-12-19T16:06:00.060 INFO:teuthology.orchestra.run.smithi037.stdout:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2023-12-19T16:06:00.061 INFO:teuthology.orchestra.run.smithi037.stdout:1: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.b 2023-12-19T16:06:00.061 INFO:teuthology.orchestra.run.smithi037.stdout:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2023-12-19T16:06:00.061 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-19T16:06:00.062 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T16:06:00.077 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2... 2023-12-19T16:06:00.078 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T16:06:00.119 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T16:06:00.122 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T16:06:00.170 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2023-12-19T16:06:00.170 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2023-12-19T16:06:00.170 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T16:06:00.170 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2023-12-19T16:06:00.170 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.171 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2023-12-19T16:06:00.171 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.171 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2023-12-19T16:06:00.171 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.171 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2023-12-19T16:06:00.171 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2023-12-19T16:06:00.171 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.171 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2023-12-19T16:06:00.171 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2023-12-19T16:06:00.171 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.171 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T16:06:00.171 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2023-12-19T16:06:00.171 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.171 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T16:06:00.171 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T16:06:00.172 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.172 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2023-12-19T16:06:00.172 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.172 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2023-12-19T16:06:00.172 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2023-12-19T16:06:00.172 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2023-12-19T16:06:00.172 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2023-12-19T16:06:00.172 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2023-12-19T16:06:00.172 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2023-12-19T16:06:00.172 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2023-12-19T16:06:00.172 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T16:06:00.172 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T16:06:00.172 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2023-12-19T16:06:00.172 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.172 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T16:06:00.173 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.173 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2023-12-19T16:06:00.173 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.173 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2023-12-19T16:06:00.173 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.173 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2023-12-19T16:06:00.173 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2023-12-19T16:06:00.173 INFO:teuthology.orchestra.run.smithi078.stdout: mon health detail to clog = false 2023-12-19T16:06:00.173 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.37,172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790]" 2023-12-19T16:06:00.173 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn min per osd = 0 2023-12-19T16:06:00.173 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2 2023-12-19T16:06:00.173 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.174 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2023-12-19T16:06:00.174 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2023-12-19T16:06:00.174 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.174 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2023-12-19T16:06:00.174 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2023-12-19T16:06:00.174 INFO:teuthology.orchestra.run.smithi078.stdout: osd mclock profile = high_recovery_ops 2023-12-19T16:06:00.174 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.174 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2023-12-19T16:06:00.174 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2023-12-19T16:06:00.174 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.174 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2023-12-19T16:06:00.174 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2023-12-19T16:06:00.174 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2023-12-19T16:06:00.174 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.175 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2023-12-19T16:06:00.175 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2023-12-19T16:06:00.175 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.175 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2023-12-19T16:06:00.175 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.175 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2023-12-19T16:06:00.175 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.175 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2023-12-19T16:06:00.175 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.175 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2023-12-19T16:06:00.175 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2023-12-19T16:06:00.175 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.175 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2023-12-19T16:06:00.176 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2023-12-19T16:06:00.176 INFO:teuthology.orchestra.run.smithi078.stdout: bdev async discard = True 2023-12-19T16:06:00.176 INFO:teuthology.orchestra.run.smithi078.stdout: bdev enable discard = True 2023-12-19T16:06:00.176 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore allocator = bitmap 2023-12-19T16:06:00.176 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2023-12-19T16:06:00.176 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2023-12-19T16:06:00.176 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 1/20 2023-12-19T16:06:00.176 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 1/20 2023-12-19T16:06:00.176 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-12-19T16:06:00.176 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 20 2023-12-19T16:06:00.176 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 4/10 2023-12-19T16:06:00.176 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T16:06:00.176 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2023-12-19T16:06:00.176 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2023-12-19T16:06:00.177 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2023-12-19T16:06:00.177 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2023-12-19T16:06:00.177 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2023-12-19T16:06:00.177 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.177 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2023-12-19T16:06:00.177 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-12-19T16:06:00.177 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2023-12-19T16:06:00.177 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2023-12-19T16:06:00.177 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2023-12-19T16:06:00.177 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:06:00.177 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:06:00.177 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2023-12-19T16:06:00.177 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.177 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2023-12-19T16:06:00.177 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-12-19T16:06:00.178 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2023-12-19T16:06:00.178 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2023-12-19T16:06:00.178 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2023-12-19T16:06:00.178 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2023-12-19T16:06:00.178 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2023-12-19T16:06:00.178 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:06:00.178 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2023-12-19T16:06:00.179 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2023-12-19T16:06:00.179 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:06:00.179 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.179 INFO:teuthology.orchestra.run.smithi078.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T16:06:00.179 INFO:teuthology.orchestra.run.smithi078.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T16:06:00.179 INFO:teuthology.orchestra.run.smithi078.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T16:06:00.179 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.179 INFO:teuthology.orchestra.run.smithi078.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T16:06:00.179 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T16:06:00.184 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T16:06:00.184 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.184 INFO:teuthology.orchestra.run.smithi078.stdout: # 1m isn't quite enough 2023-12-19T16:06:00.184 INFO:teuthology.orchestra.run.smithi078.stdout: mon_down_mkfs_grace = 2m 2023-12-19T16:06:00.184 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.184 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_filestore_osds = false 2023-12-19T16:06:00.184 INFO:teuthology.orchestra.run.smithi078.stdout: mon op complaint time = 120 2023-12-19T16:06:00.184 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-19T16:06:00.184 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2023-12-19T16:06:00.184 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2023-12-19T16:06:00.184 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = true 2023-12-19T16:06:00.184 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2023-12-19T16:06:00.185 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T16:06:00.185 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T16:06:00.185 INFO:teuthology.orchestra.run.smithi078.stdout: client mount timeout = 600 2023-12-19T16:06:00.185 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2023-12-19T16:06:00.185 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-12-19T16:06:00.185 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2023-12-19T16:06:00.185 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2023-12-19T16:06:00.185 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2023-12-19T16:06:00.185 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2023-12-19T16:06:00.185 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2023-12-19T16:06:00.185 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2023-12-19T16:06:00.185 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2023-12-19T16:06:00.185 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2023-12-19T16:06:00.185 INFO:teuthology.orchestra.run.smithi078.stdout:[mds] 2023-12-19T16:06:00.186 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds = 20 2023-12-19T16:06:00.186 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds balancer = 20 2023-12-19T16:06:00.186 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-12-19T16:06:00.186 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug frag = True 2023-12-19T16:06:00.186 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug scatterstat = True 2023-12-19T16:06:00.186 INFO:teuthology.orchestra.run.smithi078.stdout: mds op complaint time = 180 2023-12-19T16:06:00.186 INFO:teuthology.orchestra.run.smithi078.stdout: mds verify scatter = True 2023-12-19T16:06:00.186 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2023-12-19T16:06:00.186 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2023-12-19T16:06:00.186 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2023-12-19T16:06:00.187 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2023-12-19T16:06:00.187 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2023-12-19T16:06:00.187 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T16:06:00.187 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2023-12-19T16:06:00.188 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.188 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2023-12-19T16:06:00.188 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.188 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2023-12-19T16:06:00.188 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.188 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2023-12-19T16:06:00.188 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2023-12-19T16:06:00.188 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.188 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2023-12-19T16:06:00.188 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2023-12-19T16:06:00.188 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.188 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T16:06:00.188 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2023-12-19T16:06:00.188 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.189 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T16:06:00.189 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T16:06:00.189 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.189 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2023-12-19T16:06:00.189 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.189 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2023-12-19T16:06:00.189 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2023-12-19T16:06:00.189 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2023-12-19T16:06:00.189 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2023-12-19T16:06:00.189 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2023-12-19T16:06:00.189 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2023-12-19T16:06:00.189 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2023-12-19T16:06:00.189 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T16:06:00.189 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T16:06:00.190 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2023-12-19T16:06:00.190 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.190 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T16:06:00.190 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.190 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2023-12-19T16:06:00.190 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.190 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2023-12-19T16:06:00.190 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.190 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2023-12-19T16:06:00.190 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2023-12-19T16:06:00.190 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2023-12-19T16:06:00.190 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790]" 2023-12-19T16:06:00.190 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn min per osd = 0 2023-12-19T16:06:00.190 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2 2023-12-19T16:06:00.190 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.191 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2023-12-19T16:06:00.191 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2023-12-19T16:06:00.191 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.191 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2023-12-19T16:06:00.191 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2023-12-19T16:06:00.191 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2023-12-19T16:06:00.191 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.191 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2023-12-19T16:06:00.191 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2023-12-19T16:06:00.191 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.191 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2023-12-19T16:06:00.191 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2023-12-19T16:06:00.191 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2023-12-19T16:06:00.191 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.191 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2023-12-19T16:06:00.192 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2023-12-19T16:06:00.192 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.192 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2023-12-19T16:06:00.192 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.192 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2023-12-19T16:06:00.192 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.192 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2023-12-19T16:06:00.192 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.192 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2023-12-19T16:06:00.192 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2023-12-19T16:06:00.192 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.192 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2023-12-19T16:06:00.192 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2023-12-19T16:06:00.192 INFO:teuthology.orchestra.run.smithi037.stdout: bdev async discard = True 2023-12-19T16:06:00.192 INFO:teuthology.orchestra.run.smithi037.stdout: bdev enable discard = True 2023-12-19T16:06:00.193 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore allocator = bitmap 2023-12-19T16:06:00.193 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2023-12-19T16:06:00.193 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2023-12-19T16:06:00.193 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 1/20 2023-12-19T16:06:00.193 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 1/20 2023-12-19T16:06:00.193 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-12-19T16:06:00.193 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2023-12-19T16:06:00.193 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 4/10 2023-12-19T16:06:00.193 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T16:06:00.193 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2023-12-19T16:06:00.193 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2023-12-19T16:06:00.193 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2023-12-19T16:06:00.193 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2023-12-19T16:06:00.193 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-12-19T16:06:00.194 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.194 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2023-12-19T16:06:00.194 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-12-19T16:06:00.194 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2023-12-19T16:06:00.194 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-12-19T16:06:00.194 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-12-19T16:06:00.194 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:06:00.194 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:06:00.194 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2023-12-19T16:06:00.194 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.194 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2023-12-19T16:06:00.194 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-12-19T16:06:00.194 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-12-19T16:06:00.194 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2023-12-19T16:06:00.195 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-12-19T16:06:00.195 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2023-12-19T16:06:00.195 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2023-12-19T16:06:00.195 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:06:00.195 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2023-12-19T16:06:00.195 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2023-12-19T16:06:00.195 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:06:00.195 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.195 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T16:06:00.195 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T16:06:00.195 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T16:06:00.195 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.195 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T16:06:00.195 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T16:06:00.195 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T16:06:00.196 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.196 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2023-12-19T16:06:00.196 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2023-12-19T16:06:00.196 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.196 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2023-12-19T16:06:00.196 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2023-12-19T16:06:00.196 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:00.196 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2023-12-19T16:06:00.196 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2023-12-19T16:06:00.196 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2023-12-19T16:06:00.196 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2023-12-19T16:06:00.196 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T16:06:00.196 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T16:06:00.196 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2023-12-19T16:06:00.196 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2023-12-19T16:06:00.196 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-12-19T16:06:00.197 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-12-19T16:06:00.197 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-12-19T16:06:00.197 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2023-12-19T16:06:00.197 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2023-12-19T16:06:00.197 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2023-12-19T16:06:00.197 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-12-19T16:06:00.197 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-12-19T16:06:00.197 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-12-19T16:06:00.197 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2023-12-19T16:06:00.197 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2023-12-19T16:06:00.197 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds balancer = 20 2023-12-19T16:06:00.197 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-12-19T16:06:00.197 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2023-12-19T16:06:00.197 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = True 2023-12-19T16:06:00.198 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2023-12-19T16:06:00.198 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = True 2023-12-19T16:06:00.198 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-12-19T16:06:00.198 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-12-19T16:06:00.198 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-12-19T16:06:00.300 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2023-12-19T16:06:00.300 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2023-12-19T16:06:00.300 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T16:06:00.300 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2023-12-19T16:06:00.300 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.300 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2023-12-19T16:06:00.300 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.300 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2023-12-19T16:06:00.301 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.301 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2023-12-19T16:06:00.301 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2023-12-19T16:06:00.301 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.301 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2023-12-19T16:06:00.301 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2023-12-19T16:06:00.301 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.301 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T16:06:00.301 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2023-12-19T16:06:00.301 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.301 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T16:06:00.302 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T16:06:00.302 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.302 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2023-12-19T16:06:00.302 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.302 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2023-12-19T16:06:00.302 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2023-12-19T16:06:00.302 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2023-12-19T16:06:00.302 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2023-12-19T16:06:00.302 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2023-12-19T16:06:00.302 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2023-12-19T16:06:00.302 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2023-12-19T16:06:00.302 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T16:06:00.302 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T16:06:00.302 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2023-12-19T16:06:00.303 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.303 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T16:06:00.303 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.303 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2023-12-19T16:06:00.303 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.303 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2023-12-19T16:06:00.303 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.303 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2023-12-19T16:06:00.303 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2023-12-19T16:06:00.303 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2023-12-19T16:06:00.303 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.37,172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790]" 2023-12-19T16:06:00.303 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn min per osd = 0 2023-12-19T16:06:00.303 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2 2023-12-19T16:06:00.303 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.303 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2023-12-19T16:06:00.304 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2023-12-19T16:06:00.304 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.304 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2023-12-19T16:06:00.305 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2023-12-19T16:06:00.305 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2023-12-19T16:06:00.305 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.305 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2023-12-19T16:06:00.305 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2023-12-19T16:06:00.305 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.306 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2023-12-19T16:06:00.306 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2023-12-19T16:06:00.306 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2023-12-19T16:06:00.306 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.306 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2023-12-19T16:06:00.306 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2023-12-19T16:06:00.306 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.306 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2023-12-19T16:06:00.306 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.306 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2023-12-19T16:06:00.306 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.306 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2023-12-19T16:06:00.306 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.306 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2023-12-19T16:06:00.307 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2023-12-19T16:06:00.307 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.307 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2023-12-19T16:06:00.307 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2023-12-19T16:06:00.307 INFO:teuthology.orchestra.run.smithi151.stdout: bdev async discard = True 2023-12-19T16:06:00.307 INFO:teuthology.orchestra.run.smithi151.stdout: bdev enable discard = True 2023-12-19T16:06:00.307 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore allocator = bitmap 2023-12-19T16:06:00.307 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2023-12-19T16:06:00.307 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2023-12-19T16:06:00.307 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 1/20 2023-12-19T16:06:00.307 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 1/20 2023-12-19T16:06:00.307 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-12-19T16:06:00.307 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2023-12-19T16:06:00.307 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 4/10 2023-12-19T16:06:00.307 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T16:06:00.308 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2023-12-19T16:06:00.308 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2023-12-19T16:06:00.308 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2023-12-19T16:06:00.308 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2023-12-19T16:06:00.308 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-12-19T16:06:00.308 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.308 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2023-12-19T16:06:00.308 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-12-19T16:06:00.308 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2023-12-19T16:06:00.308 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-12-19T16:06:00.308 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-12-19T16:06:00.309 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:06:00.309 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:06:00.309 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2023-12-19T16:06:00.309 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.309 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2023-12-19T16:06:00.309 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-12-19T16:06:00.309 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-12-19T16:06:00.309 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2023-12-19T16:06:00.309 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-12-19T16:06:00.309 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2023-12-19T16:06:00.309 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2023-12-19T16:06:00.309 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:06:00.310 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2023-12-19T16:06:00.310 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2023-12-19T16:06:00.310 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:06:00.310 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.310 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T16:06:00.311 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T16:06:00.311 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T16:06:00.311 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.312 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T16:06:00.312 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T16:06:00.312 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T16:06:00.312 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.312 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2023-12-19T16:06:00.312 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2023-12-19T16:06:00.312 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.312 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2023-12-19T16:06:00.312 INFO:teuthology.orchestra.run.smithi151.stdout: mon op complaint time = 120 2023-12-19T16:06:00.312 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:06:00.313 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2023-12-19T16:06:00.313 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2023-12-19T16:06:00.313 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2023-12-19T16:06:00.313 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2023-12-19T16:06:00.313 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T16:06:00.313 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T16:06:00.313 INFO:teuthology.orchestra.run.smithi151.stdout: client mount timeout = 600 2023-12-19T16:06:00.313 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2023-12-19T16:06:00.313 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-12-19T16:06:00.313 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-12-19T16:06:00.314 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-12-19T16:06:00.314 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2023-12-19T16:06:00.314 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2023-12-19T16:06:00.314 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2023-12-19T16:06:00.314 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-12-19T16:06:00.314 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2023-12-19T16:06:00.314 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2023-12-19T16:06:00.314 INFO:teuthology.orchestra.run.smithi151.stdout:[mds] 2023-12-19T16:06:00.314 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds = 20 2023-12-19T16:06:00.314 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds balancer = 20 2023-12-19T16:06:00.314 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-12-19T16:06:00.315 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug frag = True 2023-12-19T16:06:00.315 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug scatterstat = True 2023-12-19T16:06:00.315 INFO:teuthology.orchestra.run.smithi151.stdout: mds op complaint time = 180 2023-12-19T16:06:00.315 INFO:teuthology.orchestra.run.smithi151.stdout: mds verify scatter = True 2023-12-19T16:06:00.315 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-12-19T16:06:00.315 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-12-19T16:06:00.315 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-12-19T16:06:00.346 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-19T16:06:00.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-19T16:06:00.405 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-19T16:06:00.406 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:06:00.406 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-19T16:06:00.420 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:06:00.420 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-19T16:06:00.476 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2023-12-19T16:06:00.476 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:06:00.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T16:06:00.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T16:06:00.563 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:06:00.563 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:06:00.618 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2023-12-19T16:06:00.618 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T16:06:00.618 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T16:06:00.618 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T16:06:00.658 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T16:06:00.659 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:06:00.712 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T16:06:00.712 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T16:06:00.713 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T16:06:00.713 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T16:06:00.845 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T16:06:00.846 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:06:00.935 INFO:tasks.ceph:Setting up mon nodes... 2023-12-19T16:06:00.936 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-19T16:06:00.936 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-19T16:06:00.999 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-19T16:06:01.002 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T16:06:01.076 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T16:06:01.079 INFO:tasks.ceph:Setting up mds nodes... 2023-12-19T16:06:01.079 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-19T16:06:01.142 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-19T16:06:01.145 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-19T16:06:01.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-19T16:06:01.277 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-19T16:06:01.280 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-19T16:06:01.310 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-19T16:06:01.365 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-19T16:06:01.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-19T16:06:01.394 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-19T16:06:01.396 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-19T16:06:01.539 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-19T16:06:01.589 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-19T16:06:01.589 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-19T16:06:01.589 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-19T16:06:01.621 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T16:06:01.621 INFO:tasks.ceph:role: osd.0 2023-12-19T16:06:01.621 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-19T16:06:01.621 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T16:06:01.699 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:06:01.701 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:06:01.701 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:06:01.701 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T16:06:01.702 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:06:01.702 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:06:01.702 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:06:01.702 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T16:06:01.702 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:06:01.702 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:06:02.221 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-12-19T16:06:02.223 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-12-19T16:06:02.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-19T16:06:02.384 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-19T16:06:02.424 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-19T16:06:02.498 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T16:06:02.498 INFO:tasks.ceph:role: osd.1 2023-12-19T16:06:02.498 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-19T16:06:02.498 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T16:06:02.578 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:06:02.578 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:06:02.578 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:06:02.578 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T16:06:02.578 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:06:02.578 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:06:02.578 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:06:02.578 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T16:06:02.578 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:06:02.579 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:06:03.028 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-12-19T16:06:03.030 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-12-19T16:06:03.030 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-19T16:06:03.124 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-19T16:06:03.162 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-19T16:06:03.234 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T16:06:03.235 INFO:tasks.ceph:role: osd.2 2023-12-19T16:06:03.235 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-19T16:06:03.235 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-19T16:06:03.314 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:06:03.315 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:06:03.315 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:06:03.315 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T16:06:03.315 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:06:03.315 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:06:03.315 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:06:03.315 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T16:06:03.315 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:06:03.315 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:06:03.803 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-12-19T16:06:03.805 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-12-19T16:06:03.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-19T16:06:03.938 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-19T16:06:03.979 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-19T16:06:04.053 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T16:06:04.053 INFO:tasks.ceph:role: osd.3 2023-12-19T16:06:04.054 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-19T16:06:04.054 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-19T16:06:04.134 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:06:04.134 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:06:04.134 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:06:04.134 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T16:06:04.134 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:06:04.134 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:06:04.134 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:06:04.135 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T16:06:04.135 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:06:04.135 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:06:04.632 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-12-19T16:06:04.634 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-12-19T16:06:04.634 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-19T16:06:04.766 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-19T16:06:04.807 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:06:04.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:04.908+0000 7f93b8849500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-19T16:06:04.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:04.908+0000 7f93b8849500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-19T16:06:04.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:04.908+0000 7f93b8849500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T16:06:04.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:04.908+0000 7f93b8849500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T16:06:04.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:04.908+0000 7f93b8849500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T16:06:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:04.908+0000 7f93b8849500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-19T16:06:07.768 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-19T16:06:07.804 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:06:07.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:07.898+0000 7f81c40b6500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-19T16:06:07.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:07.899+0000 7f81c40b6500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-19T16:06:07.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:07.899+0000 7f81c40b6500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T16:06:07.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:07.899+0000 7f81c40b6500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T16:06:07.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:07.899+0000 7f81c40b6500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T16:06:07.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:07.899+0000 7f81c40b6500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-19T16:06:10.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-19T16:06:10.782 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:06:10.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:10.878+0000 7f7d9c394500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-19T16:06:10.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:10.879+0000 7f7d9c394500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-19T16:06:10.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:10.879+0000 7f7d9c394500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T16:06:10.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:10.879+0000 7f7d9c394500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T16:06:10.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:10.879+0000 7f7d9c394500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T16:06:10.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:10.879+0000 7f7d9c394500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-19T16:06:13.735 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-19T16:06:13.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:06:13.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:13.865+0000 7f31302f6500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-19T16:06:13.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:13.865+0000 7f31302f6500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-19T16:06:13.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:13.865+0000 7f31302f6500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T16:06:13.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:13.865+0000 7f31302f6500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T16:06:13.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:13.865+0000 7f31302f6500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T16:06:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:13.866+0000 7f31302f6500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-19T16:06:16.713 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-19T16:06:16.749 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-19T16:06:16.781 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T16:06:16.781 INFO:tasks.ceph:role: osd.4 2023-12-19T16:06:16.781 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com 2023-12-19T16:06:16.781 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T16:06:16.860 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:06:16.860 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:06:16.861 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:06:16.861 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T16:06:16.861 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:06:16.861 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:06:16.861 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:06:16.861 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T16:06:16.861 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:06:16.861 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:06:17.357 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-12-19T16:06:17.360 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-12-19T16:06:17.360 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-19T16:06:17.487 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-19T16:06:17.527 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-19T16:06:17.599 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T16:06:17.599 INFO:tasks.ceph:role: osd.5 2023-12-19T16:06:17.599 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com 2023-12-19T16:06:17.599 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T16:06:17.677 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:06:17.677 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:06:17.677 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:06:17.677 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T16:06:17.677 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:06:17.678 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:06:17.678 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:06:17.678 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T16:06:17.678 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:06:17.678 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:06:18.132 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-12-19T16:06:18.134 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-12-19T16:06:18.135 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-19T16:06:18.231 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-19T16:06:18.266 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-19T16:06:18.338 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T16:06:18.338 INFO:tasks.ceph:role: osd.6 2023-12-19T16:06:18.338 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com 2023-12-19T16:06:18.338 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-19T16:06:18.418 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:06:18.418 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:06:18.418 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:06:18.418 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T16:06:18.418 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:06:18.419 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:06:18.419 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:06:18.419 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T16:06:18.419 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:06:18.419 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:06:18.904 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-12-19T16:06:18.906 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-12-19T16:06:18.906 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-19T16:06:19.049 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-19T16:06:19.083 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-19T16:06:19.153 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T16:06:19.153 INFO:tasks.ceph:role: osd.7 2023-12-19T16:06:19.153 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com 2023-12-19T16:06:19.154 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-19T16:06:19.230 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:06:19.230 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:06:19.230 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:06:19.231 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T16:06:19.231 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:06:19.231 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:06:19.231 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:06:19.231 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T16:06:19.231 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:06:19.231 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:06:19.745 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-12-19T16:06:19.747 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-12-19T16:06:19.748 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-19T16:06:19.881 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-19T16:06:19.918 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:06:20.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:20.016+0000 7fed03412500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-19T16:06:20.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:20.016+0000 7fed03412500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-19T16:06:20.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:20.016+0000 7fed03412500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T16:06:20.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:20.016+0000 7fed03412500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T16:06:20.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:20.016+0000 7fed03412500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T16:06:20.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:20.017+0000 7fed03412500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-19T16:06:22.870 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-19T16:06:22.902 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:06:22.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:22.995+0000 7f5a72b4a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-19T16:06:22.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:22.995+0000 7f5a72b4a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-19T16:06:22.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:22.995+0000 7f5a72b4a500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T16:06:22.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:22.995+0000 7f5a72b4a500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T16:06:22.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:22.995+0000 7f5a72b4a500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T16:06:22.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:22.996+0000 7f5a72b4a500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-19T16:06:25.858 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-19T16:06:25.890 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:06:25.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:25.980+0000 7f1a70fad500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-19T16:06:25.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:25.980+0000 7f1a70fad500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-19T16:06:25.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:25.980+0000 7f1a70fad500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T16:06:25.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:25.980+0000 7f1a70fad500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T16:06:25.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:25.980+0000 7f1a70fad500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T16:06:25.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:25.981+0000 7f1a70fad500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-19T16:06:28.114 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:06:28.116 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:06:28.119 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:06:28.829 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-19T16:06:28.858 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:06:28.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:28.942+0000 7f0b0d60c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-19T16:06:28.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:28.943+0000 7f0b0d60c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-19T16:06:28.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:28.943+0000 7f0b0d60c500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T16:06:28.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:28.943+0000 7f0b0d60c500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T16:06:28.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:28.943+0000 7f0b0d60c500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T16:06:28.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:28.943+0000 7f0b0d60c500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-19T16:06:31.799 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-19T16:06:31.831 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-19T16:06:31.831 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:06:31.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-19T16:06:31.867 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:06:31.867 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-19T16:06:31.942 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:06:31.942 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-19T16:06:32.015 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:06:32.015 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-19T16:06:32.087 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:06:32.087 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-19T16:06:32.160 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:06:32.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-19T16:06:32.231 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:06:32.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-19T16:06:32.303 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T16:06:32.303 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-19T16:06:32.334 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T16:06:32.335 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-19T16:06:32.404 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T16:06:32.405 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-19T16:06:32.473 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T16:06:32.473 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-19T16:06:32.540 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T16:06:32.540 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-19T16:06:32.607 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T16:06:32.608 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-19T16:06:32.675 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T16:06:32.675 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-19T16:06:32.735 INFO:tasks.ceph:Adding keys to all mons... 2023-12-19T16:06:32.735 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-19T16:06:32.737 DEBUG:teuthology.orchestra.run.smithi078:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-19T16:06:32.763 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.y] 2023-12-19T16:06:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBov4Flf1CCOxAAzSgCXan9Dmb0qjkyrz6lEw== 2023-12-19T16:06:32.763 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2023-12-19T16:06:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBpv4FlP4BpCBAAgfkUeMmNn8OBM5d35sMCUA== 2023-12-19T16:06:32.763 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2023-12-19T16:06:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBpv4FlzIt8EBAAQvLFBV5luwDu+BiGH6v3CQ== 2023-12-19T16:06:32.763 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.0] 2023-12-19T16:06:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBsv4FlQb0rNhAAEHu+gRZHJKTxweLVUxz5fA== 2023-12-19T16:06:32.763 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.1] 2023-12-19T16:06:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBvv4Fl/UudNRAAOBkK7lIYw6GIgy2xr0fQqg== 2023-12-19T16:06:32.763 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.2] 2023-12-19T16:06:32.763 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQByv4Fly1NtNBAAyP2Kvhf+gKEGWKA0V2H0KA== 2023-12-19T16:06:32.764 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.3] 2023-12-19T16:06:32.764 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQB1v4Fl1/ufMxAArBxLZDYbRU5VjNyyAE7Vrg== 2023-12-19T16:06:32.764 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.x] 2023-12-19T16:06:32.764 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBpv4FlP/OEBBAAFEoxM9gdEIx1ng/cGGi4JQ== 2023-12-19T16:06:32.764 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2023-12-19T16:06:32.764 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBpv4FlTv+1FRAAeNi4yKzHJGBGZAxthW+Dsg== 2023-12-19T16:06:32.764 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.4] 2023-12-19T16:06:32.764 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQB8v4Fl3jYFARAAy0Cb61E3bzk5mJsWBB40rA== 2023-12-19T16:06:32.764 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.5] 2023-12-19T16:06:32.765 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQB+v4FlRD1eOxAAxn6sz6udSIEGAE59ZqrX8w== 2023-12-19T16:06:32.765 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.6] 2023-12-19T16:06:32.765 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCBv4Fl0FyLOhAAMceAAhu1QHvQhsYtpibqaQ== 2023-12-19T16:06:32.765 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.7] 2023-12-19T16:06:32.765 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCEv4FlTH9OOBAApR3uYKIc910/V/QbOrVYwg== 2023-12-19T16:06:32.765 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2023-12-19T16:06:32.765 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBpv4Fl/rMPIBAADjykw74HBVisjFfNFW6Wew== 2023-12-19T16:06:32.767 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.y] 2023-12-19T16:06:32.767 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBov4Flf1CCOxAAzSgCXan9Dmb0qjkyrz6lEw== 2023-12-19T16:06:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-12-19T16:06:32.768 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBpv4FlP4BpCBAAgfkUeMmNn8OBM5d35sMCUA== 2023-12-19T16:06:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-12-19T16:06:32.768 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBpv4FlzIt8EBAAQvLFBV5luwDu+BiGH6v3CQ== 2023-12-19T16:06:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2023-12-19T16:06:32.768 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBsv4FlQb0rNhAAEHu+gRZHJKTxweLVUxz5fA== 2023-12-19T16:06:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2023-12-19T16:06:32.768 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBvv4Fl/UudNRAAOBkK7lIYw6GIgy2xr0fQqg== 2023-12-19T16:06:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2023-12-19T16:06:32.768 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQByv4Fly1NtNBAAyP2Kvhf+gKEGWKA0V2H0KA== 2023-12-19T16:06:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2023-12-19T16:06:32.768 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQB1v4Fl1/ufMxAArBxLZDYbRU5VjNyyAE7Vrg== 2023-12-19T16:06:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2023-12-19T16:06:32.768 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBpv4FlP/OEBBAAFEoxM9gdEIx1ng/cGGi4JQ== 2023-12-19T16:06:32.769 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-12-19T16:06:32.769 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBpv4FlTv+1FRAAeNi4yKzHJGBGZAxthW+Dsg== 2023-12-19T16:06:32.769 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.4] 2023-12-19T16:06:32.769 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQB8v4Fl3jYFARAAy0Cb61E3bzk5mJsWBB40rA== 2023-12-19T16:06:32.769 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.5] 2023-12-19T16:06:32.769 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQB+v4FlRD1eOxAAxn6sz6udSIEGAE59ZqrX8w== 2023-12-19T16:06:32.769 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.6] 2023-12-19T16:06:32.769 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCBv4Fl0FyLOhAAMceAAhu1QHvQhsYtpibqaQ== 2023-12-19T16:06:32.769 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.7] 2023-12-19T16:06:32.769 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCEv4FlTH9OOBAApR3uYKIc910/V/QbOrVYwg== 2023-12-19T16:06:32.769 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-12-19T16:06:32.770 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBpv4Fl/rMPIBAADjykw74HBVisjFfNFW6Wew== 2023-12-19T16:06:32.770 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T16:06:32.814 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T16:06:32.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:06:32.874 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:06:32.932 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:06:32.934 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:06:32.992 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:06:33.006 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:06:33.059 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:06:33.061 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:06:33.114 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:06:33.116 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:06:33.169 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:06:33.172 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:06:33.225 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T16:06:33.227 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T16:06:33.280 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:06:33.282 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:06:33.338 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:06:33.341 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:06:33.394 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:06:33.397 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:06:33.450 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:06:33.452 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:06:33.506 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:06:33.508 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:06:33.561 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T16:06:33.563 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T16:06:33.620 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-19T16:06:33.620 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-19T16:06:33.650 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T16:06:33.751 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-19T16:06:33.782 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-19T16:06:33.808 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T16:06:33.904 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-19T16:06:33.931 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-19T16:06:33.998 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T16:06:34.094 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-19T16:06:34.120 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:06:34.123 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:06:34.175 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-19T16:06:34.176 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-19T16:06:34.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-19T16:06:34.178 INFO:tasks.ceph.mon.a:Started 2023-12-19T16:06:34.178 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-19T16:06:34.178 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-19T16:06:34.218 INFO:tasks.ceph.mon.b:Started 2023-12-19T16:06:34.219 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-19T16:06:34.219 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-19T16:06:34.221 INFO:tasks.ceph.mon.c:Started 2023-12-19T16:06:34.221 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-19T16:06:34.221 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-19T16:06:34.221 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-19T16:06:34.224 INFO:tasks.ceph.mgr.y:Started 2023-12-19T16:06:34.224 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-19T16:06:34.224 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-19T16:06:34.227 INFO:tasks.ceph.mgr.x:Started 2023-12-19T16:06:34.227 INFO:tasks.ceph:Setting crush tunables to default 2023-12-19T16:06:34.227 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd crush tunables default 2023-12-19T16:06:34.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.331+0000 7f37b94af640 1 Processor -- start 2023-12-19T16:06:34.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.332+0000 7f37b94af640 1 -- start start 2023-12-19T16:06:34.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.332+0000 7f37b94af640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f37b4142cb0 0x7f37b4069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:34.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.332+0000 7f37b94af640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b4149180 con 0x7f37b40a16d0 2023-12-19T16:06:34.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.332+0000 7f37b94af640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b414cbd0 con 0x7f37b40a1260 2023-12-19T16:06:34.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.332+0000 7f37b94af640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b40a1ae0 con 0x7f37b4142cb0 2023-12-19T16:06:34.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.332+0000 7f37b2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f37b4142cb0 0x7f37b4069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:34.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.332+0000 7f37b2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f37b4142cb0 0x7f37b4069ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51360/0 (socket says 172.21.15.37:51360) 2023-12-19T16:06:34.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.332+0000 7f37b2ffd640 1 -- 172.21.15.37:0/1278730385 learned_addr learned my addr 172.21.15.37:0/1278730385 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:34.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.332+0000 7f37b37fe640 1 --1- 172.21.15.37:0/1278730385 >> v1:172.21.15.37:6789/0 conn(0x7f37b40a16d0 0x7f37b414c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53442/0 (socket says 172.21.15.37:53442) 2023-12-19T16:06:34.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.332+0000 7f37b2ffd640 1 -- 172.21.15.37:0/1278730385 >> v2:172.21.15.37:3300/0 conn(0x7f37b4142cb0 msgr2=0x7f37b4069ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-19T16:06:34.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.332+0000 7f37b2ffd640 1 -- 172.21.15.37:0/1278730385 >> v2:172.21.15.37:3300/0 conn(0x7f37b4142cb0 msgr2=0x7f37b4069ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T16:06:34.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.332+0000 7f37b2ffd640 1 --2- 172.21.15.37:0/1278730385 >> v2:172.21.15.37:3300/0 conn(0x7f37b4142cb0 0x7f37b4069ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T16:06:34.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.332+0000 7f37b2ffd640 1 --2- 172.21.15.37:0/1278730385 >> v2:172.21.15.37:3300/0 conn(0x7f37b4142cb0 0x7f37b4069ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T16:06:34.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.521+0000 7f37b1ffb640 1 -- 172.21.15.37:0/1278730385 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009133896 0 0) 0x7f37b4149180 con 0x7f37b40a16d0 2023-12-19T16:06:34.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.521+0000 7f37b1ffb640 1 -- 172.21.15.37:0/1278730385 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37a0003520 con 0x7f37b40a16d0 2023-12-19T16:06:34.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b1ffb640 1 -- 172.21.15.37:0/1278730385 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934761343 0 0) 0x7f37b414cbd0 con 0x7f37b40a1260 2023-12-19T16:06:34.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b1ffb640 1 -- 172.21.15.37:0/1278730385 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37b4149180 con 0x7f37b40a1260 2023-12-19T16:06:34.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b1ffb640 1 -- 172.21.15.37:0/1278730385 <== mon.1 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3386144893 0 0) 0x7f37b4149180 con 0x7f37b40a1260 2023-12-19T16:06:34.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b1ffb640 1 -- 172.21.15.37:0/1278730385 >> v2:172.21.15.37:3300/0 conn(0x7f37b4142cb0 msgr2=0x7f37b4069ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T16:06:34.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b1ffb640 1 --2- 172.21.15.37:0/1278730385 >> v2:172.21.15.37:3300/0 conn(0x7f37b4142cb0 0x7f37b4069ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:34.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b1ffb640 1 -- 172.21.15.37:0/1278730385 >> v1:172.21.15.37:6789/0 conn(0x7f37b40a16d0 legacy=0x7f37b414c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:34.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b1ffb640 1 -- 172.21.15.37:0/1278730385 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b4148b30 con 0x7f37b40a1260 2023-12-19T16:06:34.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b1ffb640 1 -- 172.21.15.37:0/1278730385 <== mon.1 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f37a4001670 con 0x7f37b40a1260 2023-12-19T16:06:34.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b1ffb640 1 -- 172.21.15.37:0/1278730385 >> v1:172.21.15.78:6789/0 conn(0x7f37b40a1260 legacy=0x7f37b414bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:34.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b1ffb640 1 --2- 172.21.15.37:0/1278730385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37a0003b50 0x7f37a0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:34.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b1ffb640 1 --2- 172.21.15.37:0/1278730385 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37a00047c0 0x7f37a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:34.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b1ffb640 1 --2- 172.21.15.37:0/1278730385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a00051d0 0x7f37a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:34.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b1ffb640 1 -- 172.21.15.37:0/1278730385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40a1ae0 con 0x7f37a00051d0 2023-12-19T16:06:34.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b1ffb640 1 -- 172.21.15.37:0/1278730385 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a000c050 con 0x7f37a0003b50 2023-12-19T16:06:34.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b1ffb640 1 -- 172.21.15.37:0/1278730385 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a000c210 con 0x7f37a00047c0 2023-12-19T16:06:34.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b37fe640 1 --2- 172.21.15.37:0/1278730385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a00051d0 0x7f37a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:34.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b2ffd640 1 --2- 172.21.15.37:0/1278730385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37a0003b50 0x7f37a0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:34.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b27fc640 1 --2- 172.21.15.37:0/1278730385 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37a00047c0 0x7f37a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:34.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b37fe640 1 -- 172.21.15.37:0/1278730385 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37a00047c0 msgr2=0x7f37a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:34.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b37fe640 1 --2- 172.21.15.37:0/1278730385 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37a00047c0 0x7f37a0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:34.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b37fe640 1 -- 172.21.15.37:0/1278730385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37a0003b50 msgr2=0x7f37a0003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:34.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b37fe640 1 --2- 172.21.15.37:0/1278730385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37a0003b50 0x7f37a0003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:34.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.522+0000 7f37b37fe640 1 -- 172.21.15.37:0/1278730385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b4149180 con 0x7f37a00051d0 2023-12-19T16:06:34.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.523+0000 7f37b37fe640 1 -- 172.21.15.37:0/1278730385 reap_dead start 2023-12-19T16:06:34.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.523+0000 7f37b37fe640 1 --2- 172.21.15.37:0/1278730385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a00051d0 0x7f37a000b980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00c320 tx=0x7f37a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb917d6d8b4acc9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:34.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.524+0000 7f37b1ffb640 1 -- 172.21.15.37:0/1278730385 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac02cb90 con 0x7f37a00051d0 2023-12-19T16:06:34.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.524+0000 7f37b1ffb640 1 -- 172.21.15.37:0/1278730385 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac02ccf0 con 0x7f37a00051d0 2023-12-19T16:06:34.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.524+0000 7f37b1ffb640 1 -- 172.21.15.37:0/1278730385 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac0072b0 con 0x7f37a00051d0 2023-12-19T16:06:34.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.525+0000 7f37b94af640 1 -- 172.21.15.37:0/1278730385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a00051d0 msgr2=0x7f37a000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:34.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.525+0000 7f37b94af640 1 --2- 172.21.15.37:0/1278730385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a00051d0 0x7f37a000b980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00c320 tx=0x7f37a00057f0 comp rx=0 tx=0).stop 2023-12-19T16:06:34.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.525+0000 7f37b94af640 1 -- 172.21.15.37:0/1278730385 shutdown_connections 2023-12-19T16:06:34.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.525+0000 7f37b94af640 1 --2- 172.21.15.37:0/1278730385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a00051d0 0x7f37a000b980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:34.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.525+0000 7f37b94af640 1 -- 172.21.15.37:0/1278730385 >> 172.21.15.37:0/1278730385 conn(0x7f37b40b9150 msgr2=0x7f37b40b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.525+0000 7f37b94af640 1 -- 172.21.15.37:0/1278730385 shutdown_connections 2023-12-19T16:06:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.525+0000 7f37b94af640 1 -- 172.21.15.37:0/1278730385 wait complete. 2023-12-19T16:06:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.527+0000 7f37b94af640 1 Processor -- start 2023-12-19T16:06:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.527+0000 7f37b94af640 1 -- start start 2023-12-19T16:06:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.527+0000 7f37b94af640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37a00051d0 0x7f37b4071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.528+0000 7f37b94af640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37b40bbab0 0x7f37b40b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.528+0000 7f37b94af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37b40b2c10 0x7f37b413ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.528+0000 7f37b94af640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40b1fd0 con 0x7f37b40b2c10 2023-12-19T16:06:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.528+0000 7f37b94af640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40b45e0 con 0x7f37a00051d0 2023-12-19T16:06:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.528+0000 7f37b94af640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40b3090 con 0x7f37b40bbab0 2023-12-19T16:06:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.528+0000 7f37b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37b40b2c10 0x7f37b413ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.528+0000 7f37b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37b40b2c10 0x7f37b413ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51414/0 (socket says 172.21.15.37:51414) 2023-12-19T16:06:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.528+0000 7f37b27fc640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37b40bbab0 0x7f37b40b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:34.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.528+0000 7f37b37fe640 1 -- 172.21.15.37:0/481946981 learned_addr learned my addr 172.21.15.37:0/481946981 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:34.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.528+0000 7f37b2ffd640 1 --2- 172.21.15.37:0/481946981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37a00051d0 0x7f37b4071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:34.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.528+0000 7f37b37fe640 1 -- 172.21.15.37:0/481946981 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37b40bbab0 msgr2=0x7f37b40b26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:34.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.528+0000 7f37b37fe640 1 --2- 172.21.15.37:0/481946981 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37b40bbab0 0x7f37b40b26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:34.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.528+0000 7f37b37fe640 1 -- 172.21.15.37:0/481946981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37a00051d0 msgr2=0x7f37b4071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:34.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.528+0000 7f37b37fe640 1 --2- 172.21.15.37:0/481946981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37a00051d0 0x7f37b4071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:34.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.528+0000 7f37b37fe640 1 -- 172.21.15.37:0/481946981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b40b6850 con 0x7f37b40b2c10 2023-12-19T16:06:34.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.528+0000 7f37b2ffd640 1 --2- 172.21.15.37:0/481946981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37a00051d0 0x7f37b4071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:06:34.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.528+0000 7f37b37fe640 1 --2- 172.21.15.37:0/481946981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37b40b2c10 0x7f37b413ac10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0072a0 tx=0x7f37ac0016a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:34.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.528+0000 7f37ab7fe640 1 -- 172.21.15.37:0/481946981 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac03a070 con 0x7f37b40b2c10 2023-12-19T16:06:34.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.529+0000 7f37ab7fe640 1 -- 172.21.15.37:0/481946981 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac0019b0 con 0x7f37b40b2c10 2023-12-19T16:06:34.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.529+0000 7f37b94af640 1 -- 172.21.15.37:0/481946981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b40bbf30 con 0x7f37b40b2c10 2023-12-19T16:06:34.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.529+0000 7f37ab7fe640 1 -- 172.21.15.37:0/481946981 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac007830 con 0x7f37b40b2c10 2023-12-19T16:06:34.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.529+0000 7f37b94af640 1 -- 172.21.15.37:0/481946981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b40b1980 con 0x7f37b40b2c10 2023-12-19T16:06:34.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.529+0000 7f37ab7fe640 1 -- 172.21.15.37:0/481946981 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f37ac03f420 con 0x7f37b40b2c10 2023-12-19T16:06:34.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.529+0000 7f37ab7fe640 1 -- 172.21.15.37:0/481946981 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f37ac0079d0 con 0x7f37b40b2c10 2023-12-19T16:06:34.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.530+0000 7f37b94af640 1 -- 172.21.15.37:0/481946981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b40b2490 con 0x7f37b40b2c10 2023-12-19T16:06:34.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.534+0000 7f37ab7fe640 1 -- 172.21.15.37:0/481946981 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f37ac045060 con 0x7f37b40b2c10 2023-12-19T16:06:34.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.600+0000 7f37b94af640 1 -- 172.21.15.37:0/481946981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f37b4148dc0 con 0x7f37b40b2c10 2023-12-19T16:06:34.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.602+0000 7f37ab7fe640 1 -- 172.21.15.37:0/481946981 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f37ac02ce60 con 0x7f37b40b2c10 2023-12-19T16:06:34.606 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2023-12-19T16:06:34.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.603+0000 7f37b94af640 1 -- 172.21.15.37:0/481946981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37b40b2c10 msgr2=0x7f37b413ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:34.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.603+0000 7f37b94af640 1 --2- 172.21.15.37:0/481946981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37b40b2c10 0x7f37b413ac10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0072a0 tx=0x7f37ac0016a0 comp rx=0 tx=0).stop 2023-12-19T16:06:34.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.603+0000 7f37b94af640 1 -- 172.21.15.37:0/481946981 shutdown_connections 2023-12-19T16:06:34.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.603+0000 7f37b94af640 1 --2- 172.21.15.37:0/481946981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37b40b2c10 0x7f37b413ac10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:34.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.603+0000 7f37b94af640 1 --2- 172.21.15.37:0/481946981 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37b40bbab0 0x7f37b40b26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:34.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.603+0000 7f37b94af640 1 --2- 172.21.15.37:0/481946981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37a00051d0 0x7f37b4071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.603+0000 7f37b94af640 1 -- 172.21.15.37:0/481946981 >> 172.21.15.37:0/481946981 conn(0x7f37b40b9150 msgr2=0x7f37b41400e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.604+0000 7f37b94af640 1 -- 172.21.15.37:0/481946981 shutdown_connections 2023-12-19T16:06:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:34.604+0000 7f37b94af640 1 -- 172.21.15.37:0/481946981 wait complete. 2023-12-19T16:06:34.616 INFO:tasks.ceph:check_enable_crimson: False 2023-12-19T16:06:34.616 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-19T16:06:34.617 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:06:34.617 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-19T16:06:34.647 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:06:34.647 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-19T16:06:34.719 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:06:34.719 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-19T16:06:34.789 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-19T16:06:34.789 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-19T16:06:34.860 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T16:06:34.860 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-19T16:06:34.888 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T16:06:34.888 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-19T16:06:34.955 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T16:06:34.955 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-19T16:06:34.966 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:34.964+0000 7f050742e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-19T16:06:34.992 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-19T16:06:34.992 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-19T16:06:34.994 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:34.992+0000 7f9d37c49040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-19T16:06:35.029 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:35.027+0000 7f050742e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-19T16:06:35.048 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:35.046+0000 7f9d37c49040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-19T16:06:35.055 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 4687a5c4-7def-4ade-b067-ffa35f54f414 0 2023-12-19T16:06:35.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.195+0000 7f4975916640 1 Processor -- start 2023-12-19T16:06:35.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.195+0000 7f4975916640 1 -- start start 2023-12-19T16:06:35.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.195+0000 7f4975916640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4970148340 0x7f497006d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.195+0000 7f4975916640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4970070890 con 0x7f49701533e0 2023-12-19T16:06:35.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.195+0000 7f4975916640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49700b0940 con 0x7f4970071960 2023-12-19T16:06:35.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.196+0000 7f4975916640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49700b80d0 con 0x7f4970148340 2023-12-19T16:06:35.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.196+0000 7f496effd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4970148340 0x7f497006d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.196+0000 7f496e7fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4970071960 0x7f497006fd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45352/0 (socket says 172.21.15.78:45352) 2023-12-19T16:06:35.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.196+0000 7f496e7fc640 1 -- 172.21.15.78:0/55473513 learned_addr learned my addr 172.21.15.78:0/55473513 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-19T16:06:35.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.196+0000 7f496dffb640 1 -- 172.21.15.78:0/55473513 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3040270136 0 0) 0x7f49700b0940 con 0x7f4970071960 2023-12-19T16:06:35.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.196+0000 7f496dffb640 1 -- 172.21.15.78:0/55473513 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4958003520 con 0x7f4970071960 2023-12-19T16:06:35.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.196+0000 7f496effd640 1 -- 172.21.15.78:0/55473513 >> v1:172.21.15.78:6789/0 conn(0x7f4970071960 legacy=0x7f497006fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.196+0000 7f496effd640 1 -- 172.21.15.78:0/55473513 >> v1:172.21.15.37:6789/0 conn(0x7f49701533e0 legacy=0x7f49701557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.196+0000 7f496effd640 1 -- 172.21.15.78:0/55473513 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4970071540 con 0x7f4970148340 2023-12-19T16:06:35.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.197+0000 7f496effd640 1 --2- 172.21.15.78:0/55473513 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4970148340 0x7f497006d520 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f49600097d0 tx=0x7f496002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af8e202af98e0eb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:35.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.197+0000 7f496dffb640 1 -- 172.21.15.78:0/55473513 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960031800 con 0x7f4970148340 2023-12-19T16:06:35.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.197+0000 7f496dffb640 1 -- 172.21.15.78:0/55473513 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4960031960 con 0x7f4970148340 2023-12-19T16:06:35.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.197+0000 7f496dffb640 1 -- 172.21.15.78:0/55473513 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960031cf0 con 0x7f4970148340 2023-12-19T16:06:35.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.197+0000 7f4975916640 1 -- 172.21.15.78:0/55473513 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4970148340 msgr2=0x7f497006d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.197+0000 7f4975916640 1 --2- 172.21.15.78:0/55473513 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4970148340 0x7f497006d520 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f49600097d0 tx=0x7f496002b8a0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.197+0000 7f4975916640 1 -- 172.21.15.78:0/55473513 shutdown_connections 2023-12-19T16:06:35.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.197+0000 7f4975916640 1 --2- 172.21.15.78:0/55473513 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4970148340 0x7f497006d520 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.197+0000 7f4975916640 1 -- 172.21.15.78:0/55473513 >> 172.21.15.78:0/55473513 conn(0x7f49700b99c0 msgr2=0x7f49700b9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:35.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.197+0000 7f4975916640 1 -- 172.21.15.78:0/55473513 shutdown_connections 2023-12-19T16:06:35.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.197+0000 7f4975916640 1 -- 172.21.15.78:0/55473513 wait complete. 2023-12-19T16:06:35.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.198+0000 7f4975916640 1 Processor -- start 2023-12-19T16:06:35.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.199+0000 7f4975916640 1 -- start start 2023-12-19T16:06:35.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.199+0000 7f4975916640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4970071960 0x7f49701dfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.199+0000 7f4975916640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4970148340 0x7f49700bc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.199+0000 7f4975916640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49701533e0 0x7f49700b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.199+0000 7f4975916640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49700bcac0 con 0x7f49701533e0 2023-12-19T16:06:35.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.199+0000 7f4975916640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49700b4a90 con 0x7f4970071960 2023-12-19T16:06:35.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.199+0000 7f4975916640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49700b5cc0 con 0x7f4970148340 2023-12-19T16:06:35.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.199+0000 7f496effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4970071960 0x7f49701dfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.199+0000 7f496e7fc640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4970148340 0x7f49700bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.199+0000 7f496effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4970071960 0x7f49701dfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49268/0 (socket says 172.21.15.78:49268) 2023-12-19T16:06:35.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.199+0000 7f496effd640 1 -- 172.21.15.78:0/852206118 learned_addr learned my addr 172.21.15.78:0/852206118 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-19T16:06:35.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.199+0000 7f496f7fe640 1 --2- 172.21.15.78:0/852206118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49701533e0 0x7f49700b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.200+0000 7f496effd640 1 -- 172.21.15.78:0/852206118 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4970148340 msgr2=0x7f49700bc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.200+0000 7f496effd640 1 --2- 172.21.15.78:0/852206118 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4970148340 0x7f49700bc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.200+0000 7f496effd640 1 -- 172.21.15.78:0/852206118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49701533e0 msgr2=0x7f49700b5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.200+0000 7f496effd640 1 --2- 172.21.15.78:0/852206118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49701533e0 0x7f49700b5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.200+0000 7f496effd640 1 -- 172.21.15.78:0/852206118 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4960009400 con 0x7f4970071960 2023-12-19T16:06:35.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.200+0000 7f496e7fc640 1 --2- 172.21.15.78:0/852206118 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4970148340 0x7f49700bc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:06:35.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.200+0000 7f496effd640 1 --2- 172.21.15.78:0/852206118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4970071960 0x7f49701dfa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f49600098f0 tx=0x7f49600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:35.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.200+0000 7f4957fff640 1 -- 172.21.15.78:0/852206118 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496003bc70 con 0x7f4970071960 2023-12-19T16:06:35.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.200+0000 7f4957fff640 1 -- 172.21.15.78:0/852206118 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496003be10 con 0x7f4970071960 2023-12-19T16:06:35.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.200+0000 7f4975916640 1 -- 172.21.15.78:0/852206118 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497014d6a0 con 0x7f4970071960 2023-12-19T16:06:35.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.200+0000 7f4957fff640 1 -- 172.21.15.78:0/852206118 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960045630 con 0x7f4970071960 2023-12-19T16:06:35.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.200+0000 7f4975916640 1 -- 172.21.15.78:0/852206118 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49700b4fc0 con 0x7f4970071960 2023-12-19T16:06:35.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.200+0000 7f4957fff640 1 -- 172.21.15.78:0/852206118 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4960045a90 con 0x7f4970071960 2023-12-19T16:06:35.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.200+0000 7f4957fff640 1 -- 172.21.15.78:0/852206118 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f496002e070 con 0x7f4970071960 2023-12-19T16:06:35.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.201+0000 7f4975916640 1 -- 172.21.15.78:0/852206118 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49700b51b0 con 0x7f4970071960 2023-12-19T16:06:35.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.203+0000 7f4957fff640 1 -- 172.21.15.78:0/852206118 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f4960035020 con 0x7f4970071960 2023-12-19T16:06:35.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.274+0000 7f4975916640 1 -- 172.21.15.78:0/852206118 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4687a5c4-7def-4ade-b067-ffa35f54f414", "id": 0} v 0) v1 -- 0x7f497004e840 con 0x7f4970071960 2023-12-19T16:06:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.280+0000 7f4957fff640 1 -- 172.21.15.78:0/852206118 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4687a5c4-7def-4ade-b067-ffa35f54f414", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f496004e450 con 0x7f4970071960 2023-12-19T16:06:35.282 INFO:teuthology.orchestra.run.smithi078.stdout:0 2023-12-19T16:06:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.281+0000 7f4975916640 1 -- 172.21.15.78:0/852206118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4970071960 msgr2=0x7f49701dfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.281+0000 7f4975916640 1 --2- 172.21.15.78:0/852206118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4970071960 0x7f49701dfa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f49600098f0 tx=0x7f49600046c0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.281+0000 7f4975916640 1 -- 172.21.15.78:0/852206118 shutdown_connections 2023-12-19T16:06:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.281+0000 7f4975916640 1 --2- 172.21.15.78:0/852206118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49701533e0 0x7f49700b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.281+0000 7f4975916640 1 --2- 172.21.15.78:0/852206118 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4970148340 0x7f49700bc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.281+0000 7f4975916640 1 --2- 172.21.15.78:0/852206118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4970071960 0x7f49701dfa30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.281+0000 7f4975916640 1 -- 172.21.15.78:0/852206118 >> 172.21.15.78:0/852206118 conn(0x7f49700b99c0 msgr2=0x7f49700b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.281+0000 7f4975916640 1 -- 172.21.15.78:0/852206118 shutdown_connections 2023-12-19T16:06:35.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.281+0000 7f4975916640 1 -- 172.21.15.78:0/852206118 wait complete. 2023-12-19T16:06:35.294 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 1151a5ea-542d-4c1b-b047-9b99a1308257 1 2023-12-19T16:06:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.392+0000 7f7eba700640 1 Processor -- start 2023-12-19T16:06:35.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.392+0000 7f7eba700640 1 -- start start 2023-12-19T16:06:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.393+0000 7f7eba700640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7eb414b2f0 0x7f7eb4156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.393+0000 7f7eba700640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb40b2ee0 con 0x7f7eb4144c40 2023-12-19T16:06:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.393+0000 7f7eba700640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb40b1630 con 0x7f7eb40b3290 2023-12-19T16:06:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.393+0000 7f7eba700640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb40b7bb0 con 0x7f7eb414b2f0 2023-12-19T16:06:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.393+0000 7f7eb37fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7eb40b3290 0x7f7eb414abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45362/0 (socket says 172.21.15.78:45362) 2023-12-19T16:06:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.393+0000 7f7eb37fe640 1 -- 172.21.15.78:0/1152258546 learned_addr learned my addr 172.21.15.78:0/1152258546 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-19T16:06:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.393+0000 7f7eb8c9d640 1 --2- 172.21.15.78:0/1152258546 >> v2:172.21.15.37:3300/0 conn(0x7f7eb414b2f0 0x7f7eb4156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.393+0000 7f7eb2ffd640 1 -- 172.21.15.78:0/1152258546 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2915966248 0 0) 0x7f7eb40b1630 con 0x7f7eb40b3290 2023-12-19T16:06:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.393+0000 7f7eb2ffd640 1 -- 172.21.15.78:0/1152258546 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e9c003520 con 0x7f7eb40b3290 2023-12-19T16:06:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.393+0000 7f7eb8c9d640 1 -- 172.21.15.78:0/1152258546 >> v1:172.21.15.78:6789/0 conn(0x7f7eb40b3290 legacy=0x7f7eb414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.393+0000 7f7eb8c9d640 1 -- 172.21.15.78:0/1152258546 >> v1:172.21.15.37:6789/0 conn(0x7f7eb4144c40 legacy=0x7f7eb40b74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.393+0000 7f7eb8c9d640 1 -- 172.21.15.78:0/1152258546 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb40b18d0 con 0x7f7eb414b2f0 2023-12-19T16:06:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.394+0000 7f7eb8c9d640 1 --2- 172.21.15.78:0/1152258546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb414b2f0 0x7f7eb4156350 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7eac009d90 tx=0x7f7eac02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e159815c711531e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.394+0000 7f7eb2ffd640 1 -- 172.21.15.78:0/1152258546 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac02cd80 con 0x7f7eb414b2f0 2023-12-19T16:06:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.394+0000 7f7eb2ffd640 1 -- 172.21.15.78:0/1152258546 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac034440 con 0x7f7eb414b2f0 2023-12-19T16:06:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.394+0000 7f7eb2ffd640 1 -- 172.21.15.78:0/1152258546 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0347d0 con 0x7f7eb414b2f0 2023-12-19T16:06:35.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.395+0000 7f7eba700640 1 -- 172.21.15.78:0/1152258546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb414b2f0 msgr2=0x7f7eb4156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.395+0000 7f7eba700640 1 --2- 172.21.15.78:0/1152258546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb414b2f0 0x7f7eb4156350 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7eac009d90 tx=0x7f7eac02bfd0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.395+0000 7f7eba700640 1 -- 172.21.15.78:0/1152258546 shutdown_connections 2023-12-19T16:06:35.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.395+0000 7f7eba700640 1 --2- 172.21.15.78:0/1152258546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb414b2f0 0x7f7eb4156350 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.395+0000 7f7eba700640 1 -- 172.21.15.78:0/1152258546 >> 172.21.15.78:0/1152258546 conn(0x7f7eb40b9150 msgr2=0x7f7eb40b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:35.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.395+0000 7f7eba700640 1 -- 172.21.15.78:0/1152258546 shutdown_connections 2023-12-19T16:06:35.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.395+0000 7f7eba700640 1 -- 172.21.15.78:0/1152258546 wait complete. 2023-12-19T16:06:35.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.396+0000 7f7eba700640 1 Processor -- start 2023-12-19T16:06:35.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.396+0000 7f7eba700640 1 -- start start 2023-12-19T16:06:35.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eba700640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb40b3290 0x7f7eb409d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eba700640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7eb4144c40 0x7f7eb4071560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eba700640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7eb414b2f0 0x7f7eb406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eba700640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb409d9e0 con 0x7f7eb40b3290 2023-12-19T16:06:35.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eba700640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40708c0 con 0x7f7eb414b2f0 2023-12-19T16:06:35.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eba700640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb4071aa0 con 0x7f7eb4144c40 2023-12-19T16:06:35.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eb37fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7eb4144c40 0x7f7eb4071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eb8c9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7eb414b2f0 0x7f7eb406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eb37fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7eb4144c40 0x7f7eb4071560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:47764/0 (socket says 172.21.15.78:47764) 2023-12-19T16:06:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eb37fe640 1 -- 172.21.15.78:0/2462530655 learned_addr learned my addr 172.21.15.78:0/2462530655 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-19T16:06:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eb3fff640 1 --2- 172.21.15.78:0/2462530655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb40b3290 0x7f7eb409d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eb37fe640 1 -- 172.21.15.78:0/2462530655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7eb414b2f0 msgr2=0x7f7eb406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eb37fe640 1 --2- 172.21.15.78:0/2462530655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7eb414b2f0 0x7f7eb406f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eb37fe640 1 -- 172.21.15.78:0/2462530655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb40b3290 msgr2=0x7f7eb409d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eb37fe640 1 --2- 172.21.15.78:0/2462530655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb40b3290 0x7f7eb409d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eb37fe640 1 -- 172.21.15.78:0/2462530655 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac009a70 con 0x7f7eb4144c40 2023-12-19T16:06:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eb37fe640 1 --2- 172.21.15.78:0/2462530655 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7eb4144c40 0x7f7eb4071560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7ea800c3e0 tx=0x7f7ea800c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eb0ff9640 1 -- 172.21.15.78:0/2462530655 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea8005ce0 con 0x7f7eb4144c40 2023-12-19T16:06:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eb0ff9640 1 -- 172.21.15.78:0/2462530655 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea8005e40 con 0x7f7eb4144c40 2023-12-19T16:06:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eba700640 1 -- 172.21.15.78:0/2462530655 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb40a16b0 con 0x7f7eb4144c40 2023-12-19T16:06:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.397+0000 7f7eb0ff9640 1 -- 172.21.15.78:0/2462530655 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea80072d0 con 0x7f7eb4144c40 2023-12-19T16:06:35.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.398+0000 7f7eba700640 1 -- 172.21.15.78:0/2462530655 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb40a1060 con 0x7f7eb4144c40 2023-12-19T16:06:35.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.398+0000 7f7eb0ff9640 1 -- 172.21.15.78:0/2462530655 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7ea801c440 con 0x7f7eb4144c40 2023-12-19T16:06:35.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.398+0000 7f7eb0ff9640 1 -- 172.21.15.78:0/2462530655 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f7ea8012910 con 0x7f7eb4144c40 2023-12-19T16:06:35.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.398+0000 7f7eba700640 1 -- 172.21.15.78:0/2462530655 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb40b8640 con 0x7f7eb4144c40 2023-12-19T16:06:35.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.401+0000 7f7eb0ff9640 1 -- 172.21.15.78:0/2462530655 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f7ea8021060 con 0x7f7eb4144c40 2023-12-19T16:06:35.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.471+0000 7f7eba700640 1 -- 172.21.15.78:0/2462530655 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1151a5ea-542d-4c1b-b047-9b99a1308257", "id": 1} v 0) v1 -- 0x7f7eb404e840 con 0x7f7eb4144c40 2023-12-19T16:06:35.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.475+0000 7f7eb0ff9640 1 -- 172.21.15.78:0/2462530655 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1151a5ea-542d-4c1b-b047-9b99a1308257", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7ea8017070 con 0x7f7eb4144c40 2023-12-19T16:06:35.477 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-12-19T16:06:35.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.476+0000 7f7eba700640 1 -- 172.21.15.78:0/2462530655 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7eb4144c40 msgr2=0x7f7eb4071560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.476+0000 7f7eba700640 1 --2- 172.21.15.78:0/2462530655 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7eb4144c40 0x7f7eb4071560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7ea800c3e0 tx=0x7f7ea800c8a0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.476+0000 7f7eba700640 1 -- 172.21.15.78:0/2462530655 shutdown_connections 2023-12-19T16:06:35.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.476+0000 7f7eba700640 1 --2- 172.21.15.78:0/2462530655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7eb414b2f0 0x7f7eb406f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.476+0000 7f7eba700640 1 --2- 172.21.15.78:0/2462530655 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7eb4144c40 0x7f7eb4071560 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.476+0000 7f7eba700640 1 --2- 172.21.15.78:0/2462530655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7eb40b3290 0x7f7eb409d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.476+0000 7f7eba700640 1 -- 172.21.15.78:0/2462530655 >> 172.21.15.78:0/2462530655 conn(0x7f7eb40b9150 msgr2=0x7f7eb40b7260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:35.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.476+0000 7f7eba700640 1 -- 172.21.15.78:0/2462530655 shutdown_connections 2023-12-19T16:06:35.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.476+0000 7f7eba700640 1 -- 172.21.15.78:0/2462530655 wait complete. 2023-12-19T16:06:35.488 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 58273304-6bf0-4f88-a97f-73cda58509bd 2 2023-12-19T16:06:35.580 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:35.578+0000 7f9d37c49040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-19T16:06:35.580 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:35.578+0000 7f050742e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-19T16:06:35.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.586+0000 7f194bb55640 1 Processor -- start 2023-12-19T16:06:35.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.587+0000 7f194bb55640 1 -- start start 2023-12-19T16:06:35.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.587+0000 7f194bb55640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1944142cb0 0x7f1944069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.587+0000 7f194bb55640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19440a1260 0x7f19440a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.587+0000 7f194bb55640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1944149180 con 0x7f194414bdb0 2023-12-19T16:06:35.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.587+0000 7f194bb55640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1944148b30 con 0x7f1944142cb0 2023-12-19T16:06:35.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.587+0000 7f194bb55640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1944148e10 con 0x7f19440a1260 2023-12-19T16:06:35.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.588+0000 7f19490f0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19440a1260 0x7f19440a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.588+0000 7f19490f0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19440a1260 0x7f19440a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:47768/0 (socket says 172.21.15.78:47768) 2023-12-19T16:06:35.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.588+0000 7f19490f0640 1 -- 172.21.15.78:0/1575261111 learned_addr learned my addr 172.21.15.78:0/1575261111 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-19T16:06:35.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.588+0000 7f19498f1640 1 --2- 172.21.15.78:0/1575261111 >> v2:172.21.15.37:3300/0 conn(0x7f1944142cb0 0x7f1944069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.588+0000 7f19490f0640 1 -- 172.21.15.78:0/1575261111 >> v2:172.21.15.37:3300/0 conn(0x7f1944142cb0 msgr2=0x7f1944069ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:35.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.588+0000 7f19490f0640 1 --2- 172.21.15.78:0/1575261111 >> v2:172.21.15.37:3300/0 conn(0x7f1944142cb0 0x7f1944069ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.588+0000 7f19490f0640 1 -- 172.21.15.78:0/1575261111 >> v1:172.21.15.37:6789/0 conn(0x7f194414bdb0 legacy=0x7f194414c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.588+0000 7f19490f0640 1 -- 172.21.15.78:0/1575261111 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194409f190 con 0x7f19440a1260 2023-12-19T16:06:35.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.589+0000 7f19490f0640 1 --2- 172.21.15.78:0/1575261111 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19440a1260 0x7f19440a16a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1934009870 tx=0x7f193402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=486efc113b12e0cf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:35.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.589+0000 7f19488ef640 1 -- 172.21.15.78:0/1575261111 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193402f840 con 0x7f19440a1260 2023-12-19T16:06:35.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.589+0000 7f19488ef640 1 -- 172.21.15.78:0/1575261111 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193402f9a0 con 0x7f19440a1260 2023-12-19T16:06:35.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.589+0000 7f19488ef640 1 -- 172.21.15.78:0/1575261111 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193402fd30 con 0x7f19440a1260 2023-12-19T16:06:35.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.590+0000 7f194bb55640 1 -- 172.21.15.78:0/1575261111 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19440a1260 msgr2=0x7f19440a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.590+0000 7f194bb55640 1 --2- 172.21.15.78:0/1575261111 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19440a1260 0x7f19440a16a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1934009870 tx=0x7f193402ba20 comp rx=0 tx=0).stop 2023-12-19T16:06:35.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.590+0000 7f194bb55640 1 -- 172.21.15.78:0/1575261111 shutdown_connections 2023-12-19T16:06:35.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.590+0000 7f194bb55640 1 --2- 172.21.15.78:0/1575261111 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f19440a1260 0x7f19440a16a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.590+0000 7f194bb55640 1 --2- 172.21.15.78:0/1575261111 >> v2:172.21.15.37:3300/0 conn(0x7f1944142cb0 0x7f1944069ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.590+0000 7f194bb55640 1 -- 172.21.15.78:0/1575261111 >> 172.21.15.78:0/1575261111 conn(0x7f19440b9150 msgr2=0x7f19440b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:35.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.590+0000 7f194bb55640 1 -- 172.21.15.78:0/1575261111 shutdown_connections 2023-12-19T16:06:35.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.590+0000 7f194bb55640 1 -- 172.21.15.78:0/1575261111 wait complete. 2023-12-19T16:06:35.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.591+0000 7f194bb55640 1 Processor -- start 2023-12-19T16:06:35.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.591+0000 7f194bb55640 1 -- start start 2023-12-19T16:06:35.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.591+0000 7f194bb55640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19440a1260 0x7f19441ddde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.591+0000 7f194bb55640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1944142cb0 0x7f19441e1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.591+0000 7f194bb55640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f194414bdb0 0x7f1944070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.591+0000 7f194bb55640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1944071020 con 0x7f194414bdb0 2023-12-19T16:06:35.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.591+0000 7f194bb55640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1944143670 con 0x7f19440a1260 2023-12-19T16:06:35.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.591+0000 7f194bb55640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19441e19e0 con 0x7f1944142cb0 2023-12-19T16:06:35.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f19490f0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1944142cb0 0x7f19441e1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f19498f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19440a1260 0x7f19441ddde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f19490f0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1944142cb0 0x7f19441e1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:47774/0 (socket says 172.21.15.78:47774) 2023-12-19T16:06:35.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f19498f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19440a1260 0x7f19441ddde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49294/0 (socket says 172.21.15.78:49294) 2023-12-19T16:06:35.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f19490f0640 1 -- 172.21.15.78:0/1685407598 learned_addr learned my addr 172.21.15.78:0/1685407598 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-19T16:06:35.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f194a0f2640 1 --2- 172.21.15.78:0/1685407598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f194414bdb0 0x7f1944070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f19490f0640 1 -- 172.21.15.78:0/1685407598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19440a1260 msgr2=0x7f19441ddde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f19490f0640 1 --2- 172.21.15.78:0/1685407598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19440a1260 0x7f19441ddde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f19490f0640 1 -- 172.21.15.78:0/1685407598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f194414bdb0 msgr2=0x7f1944070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f19490f0640 1 --2- 172.21.15.78:0/1685407598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f194414bdb0 0x7f1944070ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f19490f0640 1 -- 172.21.15.78:0/1685407598 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19340094d0 con 0x7f1944142cb0 2023-12-19T16:06:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f19498f1640 1 --2- 172.21.15.78:0/1685407598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19440a1260 0x7f19441ddde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:06:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f194a0f2640 1 --2- 172.21.15.78:0/1685407598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f194414bdb0 0x7f1944070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:06:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f19490f0640 1 --2- 172.21.15.78:0/1685407598 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1944142cb0 0x7f19441e1e70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f193402ba60 tx=0x7f19340046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f193a7fc640 1 -- 172.21.15.78:0/1685407598 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193403b040 con 0x7f1944142cb0 2023-12-19T16:06:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f193a7fc640 1 -- 172.21.15.78:0/1685407598 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1934037c40 con 0x7f1944142cb0 2023-12-19T16:06:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f194bb55640 1 -- 172.21.15.78:0/1685407598 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194409ed20 con 0x7f1944142cb0 2023-12-19T16:06:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f193a7fc640 1 -- 172.21.15.78:0/1685407598 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1934041400 con 0x7f1944142cb0 2023-12-19T16:06:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f194bb55640 1 -- 172.21.15.78:0/1685407598 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19441e1390 con 0x7f1944142cb0 2023-12-19T16:06:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.592+0000 7f193a7fc640 1 -- 172.21.15.78:0/1685407598 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1934041860 con 0x7f1944142cb0 2023-12-19T16:06:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.593+0000 7f193a7fc640 1 -- 172.21.15.78:0/1685407598 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f193404bce0 con 0x7f1944142cb0 2023-12-19T16:06:35.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.593+0000 7f194bb55640 1 -- 172.21.15.78:0/1685407598 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194404e840 con 0x7f1944142cb0 2023-12-19T16:06:35.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.597+0000 7f193a7fc640 1 -- 172.21.15.78:0/1685407598 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f193404b460 con 0x7f1944142cb0 2023-12-19T16:06:35.637 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:35.633+0000 7f9d37c49040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-19T16:06:35.637 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:35.634+0000 7f050742e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-19T16:06:35.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.668+0000 7f194bb55640 1 -- 172.21.15.78:0/1685407598 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "58273304-6bf0-4f88-a97f-73cda58509bd", "id": 2} v 0) v1 -- 0x7f19440b6b00 con 0x7f1944142cb0 2023-12-19T16:06:35.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.672+0000 7f193a7fc640 1 -- 172.21.15.78:0/1685407598 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "58273304-6bf0-4f88-a97f-73cda58509bd", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f193404b8c0 con 0x7f1944142cb0 2023-12-19T16:06:35.674 INFO:teuthology.orchestra.run.smithi078.stdout:2 2023-12-19T16:06:35.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.673+0000 7f194bb55640 1 -- 172.21.15.78:0/1685407598 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1944142cb0 msgr2=0x7f19441e1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.673+0000 7f194bb55640 1 --2- 172.21.15.78:0/1685407598 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1944142cb0 0x7f19441e1e70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f193402ba60 tx=0x7f19340046c0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.673+0000 7f194bb55640 1 -- 172.21.15.78:0/1685407598 shutdown_connections 2023-12-19T16:06:35.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.673+0000 7f194bb55640 1 --2- 172.21.15.78:0/1685407598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f194414bdb0 0x7f1944070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.673+0000 7f194bb55640 1 --2- 172.21.15.78:0/1685407598 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1944142cb0 0x7f19441e1e70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.673+0000 7f194bb55640 1 --2- 172.21.15.78:0/1685407598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19440a1260 0x7f19441ddde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.673+0000 7f194bb55640 1 -- 172.21.15.78:0/1685407598 >> 172.21.15.78:0/1685407598 conn(0x7f19440b9150 msgr2=0x7f19440b7210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:35.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.673+0000 7f194bb55640 1 -- 172.21.15.78:0/1685407598 shutdown_connections 2023-12-19T16:06:35.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.673+0000 7f194bb55640 1 -- 172.21.15.78:0/1685407598 wait complete. 2023-12-19T16:06:35.682 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:35.680+0000 7f9d37c49040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-19T16:06:35.684 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:35.682+0000 7f050742e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-19T16:06:35.685 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 7f241bf4-8b56-480f-9922-d2a453ce5e24 3 2023-12-19T16:06:35.741 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:35.736+0000 7f9d37c49040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-19T16:06:35.742 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:35.740+0000 7f050742e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-19T16:06:35.782 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:35.780+0000 7f9d37c49040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-19T16:06:35.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.782+0000 7f5b0c25f640 1 Processor -- start 2023-12-19T16:06:35.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.783+0000 7f5b0c25f640 1 -- start start 2023-12-19T16:06:35.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.783+0000 7f5b0c25f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5b0406a240 0x7f5b0414ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.783+0000 7f5b0c25f640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b040a5b60 0x7f5b0414e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.783+0000 7f5b0c25f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b040b3c10 con 0x7f5b040bb3c0 2023-12-19T16:06:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.783+0000 7f5b0c25f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b040bc3d0 con 0x7f5b0406a240 2023-12-19T16:06:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.783+0000 7f5b0c25f640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b040baf30 con 0x7f5b040a5b60 2023-12-19T16:06:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.783+0000 7f5b0a7fc640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b040a5b60 0x7f5b0414e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.783+0000 7f5b0a7fc640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b040a5b60 0x7f5b0414e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:47780/0 (socket says 172.21.15.78:47780) 2023-12-19T16:06:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.783+0000 7f5b0a7fc640 1 -- 172.21.15.78:0/1052949379 learned_addr learned my addr 172.21.15.78:0/1052949379 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-19T16:06:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.783+0000 7f5b09ffb640 1 --2- 172.21.15.78:0/1052949379 >> v2:172.21.15.37:3300/0 conn(0x7f5b0406a240 0x7f5b0414ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.784+0000 7f5b0a7fc640 1 -- 172.21.15.78:0/1052949379 >> v2:172.21.15.37:3300/0 conn(0x7f5b0406a240 msgr2=0x7f5b0414ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.784+0000 7f5b0a7fc640 1 --2- 172.21.15.78:0/1052949379 >> v2:172.21.15.37:3300/0 conn(0x7f5b0406a240 0x7f5b0414ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.784+0000 7f5b0a7fc640 1 -- 172.21.15.78:0/1052949379 >> v1:172.21.15.37:6789/0 conn(0x7f5b040bb3c0 legacy=0x7f5b0414e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.784+0000 7f5b0a7fc640 1 -- 172.21.15.78:0/1052949379 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b040bac00 con 0x7f5b040a5b60 2023-12-19T16:06:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.784+0000 7f5b0a7fc640 1 --2- 172.21.15.78:0/1052949379 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b040a5b60 0x7f5b0414e710 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009e50 tx=0x7f5afc02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec498533ec6de18a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:35.788 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:35.784+0000 7f050742e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-19T16:06:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.784+0000 7f5b08ff9640 1 -- 172.21.15.78:0/1052949379 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc02cb00 con 0x7f5b040a5b60 2023-12-19T16:06:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.784+0000 7f5b08ff9640 1 -- 172.21.15.78:0/1052949379 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc02cc60 con 0x7f5b040a5b60 2023-12-19T16:06:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.784+0000 7f5b08ff9640 1 -- 172.21.15.78:0/1052949379 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0343f0 con 0x7f5b040a5b60 2023-12-19T16:06:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.785+0000 7f5b0c25f640 1 -- 172.21.15.78:0/1052949379 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b040a5b60 msgr2=0x7f5b0414e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.785+0000 7f5b0c25f640 1 --2- 172.21.15.78:0/1052949379 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b040a5b60 0x7f5b0414e710 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009e50 tx=0x7f5afc02bf60 comp rx=0 tx=0).stop 2023-12-19T16:06:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.785+0000 7f5b0c25f640 1 -- 172.21.15.78:0/1052949379 shutdown_connections 2023-12-19T16:06:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.785+0000 7f5b0c25f640 1 --2- 172.21.15.78:0/1052949379 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b040a5b60 0x7f5b0414e710 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.785+0000 7f5b0c25f640 1 --2- 172.21.15.78:0/1052949379 >> v2:172.21.15.37:3300/0 conn(0x7f5b0406a240 0x7f5b0414ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.785+0000 7f5b0c25f640 1 -- 172.21.15.78:0/1052949379 >> 172.21.15.78:0/1052949379 conn(0x7f5b040c0280 msgr2=0x7f5b040c0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.785+0000 7f5b0c25f640 1 -- 172.21.15.78:0/1052949379 shutdown_connections 2023-12-19T16:06:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.785+0000 7f5b0c25f640 1 -- 172.21.15.78:0/1052949379 wait complete. 2023-12-19T16:06:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.786+0000 7f5b0c25f640 1 Processor -- start 2023-12-19T16:06:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.786+0000 7f5b0c25f640 1 -- start start 2023-12-19T16:06:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.787+0000 7f5b0c25f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b0406a240 0x7f5b040b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.787+0000 7f5b0c25f640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b040a5b60 0x7f5b041e0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.787+0000 7f5b0c25f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b040bb3c0 0x7f5b040b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.787+0000 7f5b0c25f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b040b42f0 con 0x7f5b040bb3c0 2023-12-19T16:06:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.787+0000 7f5b0c25f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b041e0aa0 con 0x7f5b0406a240 2023-12-19T16:06:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.787+0000 7f5b0c25f640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b040b4ff0 con 0x7f5b040a5b60 2023-12-19T16:06:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.787+0000 7f5b097fa640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b040a5b60 0x7f5b041e0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.787+0000 7f5b09ffb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b0406a240 0x7f5b040b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.787+0000 7f5b097fa640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b040a5b60 0x7f5b041e0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:47784/0 (socket says 172.21.15.78:47784) 2023-12-19T16:06:35.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.787+0000 7f5b097fa640 1 -- 172.21.15.78:0/1703342350 learned_addr learned my addr 172.21.15.78:0/1703342350 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-19T16:06:35.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.787+0000 7f5b0a7fc640 1 --2- 172.21.15.78:0/1703342350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b040bb3c0 0x7f5b040b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.787+0000 7f5b097fa640 1 -- 172.21.15.78:0/1703342350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b0406a240 msgr2=0x7f5b040b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.787+0000 7f5b097fa640 1 --2- 172.21.15.78:0/1703342350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b0406a240 0x7f5b040b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.787+0000 7f5b097fa640 1 -- 172.21.15.78:0/1703342350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b040bb3c0 msgr2=0x7f5b040b8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.787+0000 7f5b097fa640 1 --2- 172.21.15.78:0/1703342350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b040bb3c0 0x7f5b040b8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.787+0000 7f5b097fa640 1 -- 172.21.15.78:0/1703342350 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc009b30 con 0x7f5b040a5b60 2023-12-19T16:06:35.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.787+0000 7f5b09ffb640 1 --2- 172.21.15.78:0/1703342350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b0406a240 0x7f5b040b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:06:35.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.787+0000 7f5b097fa640 1 --2- 172.21.15.78:0/1703342350 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b040a5b60 0x7f5b041e0f30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000c430 tx=0x7f5b0000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:35.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.788+0000 7f5af67fc640 1 -- 172.21.15.78:0/1703342350 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b000052d0 con 0x7f5b040a5b60 2023-12-19T16:06:35.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.788+0000 7f5af67fc640 1 -- 172.21.15.78:0/1703342350 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b00005430 con 0x7f5b040a5b60 2023-12-19T16:06:35.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.788+0000 7f5b0c25f640 1 -- 172.21.15.78:0/1703342350 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b041e0770 con 0x7f5b040a5b60 2023-12-19T16:06:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.788+0000 7f5af67fc640 1 -- 172.21.15.78:0/1703342350 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00003830 con 0x7f5b040a5b60 2023-12-19T16:06:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.788+0000 7f5b0c25f640 1 -- 172.21.15.78:0/1703342350 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b04149a40 con 0x7f5b040a5b60 2023-12-19T16:06:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.788+0000 7f5af67fc640 1 -- 172.21.15.78:0/1703342350 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5b00003c90 con 0x7f5b040a5b60 2023-12-19T16:06:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.788+0000 7f5af67fc640 1 -- 172.21.15.78:0/1703342350 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f5b00011e00 con 0x7f5b040a5b60 2023-12-19T16:06:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.789+0000 7f5b0c25f640 1 -- 172.21.15.78:0/1703342350 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b040b3910 con 0x7f5b040a5b60 2023-12-19T16:06:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.792+0000 7f5af67fc640 1 -- 172.21.15.78:0/1703342350 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f5b040b3910 con 0x7f5b040a5b60 2023-12-19T16:06:35.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.863+0000 7f5b0c25f640 1 -- 172.21.15.78:0/1703342350 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7f241bf4-8b56-480f-9922-d2a453ce5e24", "id": 3} v 0) v1 -- 0x7f5b0404e840 con 0x7f5b040a5b60 2023-12-19T16:06:35.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.871+0000 7f5af67fc640 1 -- 172.21.15.78:0/1703342350 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7f241bf4-8b56-480f-9922-d2a453ce5e24", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5b00017070 con 0x7f5b040a5b60 2023-12-19T16:06:35.874 INFO:teuthology.orchestra.run.smithi078.stdout:3 2023-12-19T16:06:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.872+0000 7f5b0c25f640 1 -- 172.21.15.78:0/1703342350 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b040a5b60 msgr2=0x7f5b041e0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.872+0000 7f5b0c25f640 1 --2- 172.21.15.78:0/1703342350 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b040a5b60 0x7f5b041e0f30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000c430 tx=0x7f5b0000c8f0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.872+0000 7f5b0c25f640 1 -- 172.21.15.78:0/1703342350 shutdown_connections 2023-12-19T16:06:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.872+0000 7f5b0c25f640 1 --2- 172.21.15.78:0/1703342350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b040bb3c0 0x7f5b040b8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.872+0000 7f5b0c25f640 1 --2- 172.21.15.78:0/1703342350 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5b040a5b60 0x7f5b041e0f30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.872+0000 7f5b0c25f640 1 --2- 172.21.15.78:0/1703342350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5b0406a240 0x7f5b040b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.872+0000 7f5b0c25f640 1 -- 172.21.15.78:0/1703342350 >> 172.21.15.78:0/1703342350 conn(0x7f5b040c0280 msgr2=0x7f5b0409fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.872+0000 7f5b0c25f640 1 -- 172.21.15.78:0/1703342350 shutdown_connections 2023-12-19T16:06:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.872+0000 7f5b0c25f640 1 -- 172.21.15.78:0/1703342350 wait complete. 2023-12-19T16:06:35.885 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 59a4c9b9-1339-4f72-9c0c-092183afe07b 4 2023-12-19T16:06:35.887 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:35.885+0000 7f9d37c49040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-19T16:06:35.894 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:35.892+0000 7f050742e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-19T16:06:35.960 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:35.958+0000 7f9d37c49040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-19T16:06:35.967 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:35.965+0000 7f050742e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-19T16:06:35.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.981+0000 7fce94d18640 1 Processor -- start 2023-12-19T16:06:35.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.982+0000 7fce94d18640 1 -- start start 2023-12-19T16:06:35.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.982+0000 7fce94d18640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fce900b83f0 0x7fce90144b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.982+0000 7fce94d18640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce900b4d70 con 0x7fce9006d790 2023-12-19T16:06:35.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.982+0000 7fce94d18640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce900a2cf0 con 0x7fce90145090 2023-12-19T16:06:35.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.982+0000 7fce94d18640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce901482a0 con 0x7fce900b83f0 2023-12-19T16:06:35.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.982+0000 7fce8dd9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fce900b83f0 0x7fce90144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.982+0000 7fce8dd9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fce900b83f0 0x7fce90144b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49308/0 (socket says 172.21.15.78:49308) 2023-12-19T16:06:35.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.982+0000 7fce8dd9b640 1 -- 172.21.15.78:0/2206785284 learned_addr learned my addr 172.21.15.78:0/2206785284 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-19T16:06:35.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.982+0000 7fce8ed9d640 1 --1- 172.21.15.78:0/2206785284 >> v1:172.21.15.78:6789/0 conn(0x7fce90145090 0x7fce901522e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45364/0 (socket says 172.21.15.78:45364) 2023-12-19T16:06:35.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.983+0000 7fce8dd9b640 1 -- 172.21.15.78:0/2206785284 >> v1:172.21.15.78:6789/0 conn(0x7fce90145090 legacy=0x7fce901522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.983+0000 7fce8dd9b640 1 -- 172.21.15.78:0/2206785284 >> v1:172.21.15.37:6789/0 conn(0x7fce9006d790 legacy=0x7fce900b7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.983+0000 7fce8dd9b640 1 -- 172.21.15.78:0/2206785284 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce90148580 con 0x7fce900b83f0 2023-12-19T16:06:35.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.983+0000 7fce8d59a640 1 -- 172.21.15.78:0/2206785284 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835799467 0 0) 0x7fce900a2cf0 con 0x7fce90145090 2023-12-19T16:06:35.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.984+0000 7fce8dd9b640 1 --2- 172.21.15.78:0/2206785284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce900b83f0 0x7fce90144b50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fce84009870 tx=0x7fce8402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f7614b904bd4c0c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:35.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.984+0000 7fce8d59a640 1 -- 172.21.15.78:0/2206785284 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84030860 con 0x7fce900b83f0 2023-12-19T16:06:35.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.984+0000 7fce8d59a640 1 -- 172.21.15.78:0/2206785284 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce840309c0 con 0x7fce900b83f0 2023-12-19T16:06:35.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.984+0000 7fce8d59a640 1 -- 172.21.15.78:0/2206785284 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84030d50 con 0x7fce900b83f0 2023-12-19T16:06:35.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.985+0000 7fce94d18640 1 -- 172.21.15.78:0/2206785284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce900b83f0 msgr2=0x7fce90144b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.985+0000 7fce94d18640 1 --2- 172.21.15.78:0/2206785284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce900b83f0 0x7fce90144b50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fce84009870 tx=0x7fce8402b9a0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.985+0000 7fce94d18640 1 -- 172.21.15.78:0/2206785284 shutdown_connections 2023-12-19T16:06:35.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.985+0000 7fce94d18640 1 --2- 172.21.15.78:0/2206785284 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce900b83f0 0x7fce90144b50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.985+0000 7fce94d18640 1 -- 172.21.15.78:0/2206785284 >> 172.21.15.78:0/2206785284 conn(0x7fce900b99c0 msgr2=0x7fce900b9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:35.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.985+0000 7fce94d18640 1 -- 172.21.15.78:0/2206785284 shutdown_connections 2023-12-19T16:06:35.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.985+0000 7fce94d18640 1 -- 172.21.15.78:0/2206785284 wait complete. 2023-12-19T16:06:35.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.986+0000 7fce94d18640 1 Processor -- start 2023-12-19T16:06:35.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.986+0000 7fce94d18640 1 -- start start 2023-12-19T16:06:35.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce94d18640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce9006d790 0x7fce9014b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce94d18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce900b83f0 0x7fce901d23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce94d18640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce90145090 0x7fce901de3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:35.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce94d18640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce901d28f0 con 0x7fce900b83f0 2023-12-19T16:06:35.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce94d18640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce900b1730 con 0x7fce90145090 2023-12-19T16:06:35.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce94d18640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce901ddf30 con 0x7fce9006d790 2023-12-19T16:06:35.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce8e59c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce9006d790 0x7fce9014b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce8ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce90145090 0x7fce901de3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce8e59c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce9006d790 0x7fce9014b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:47798/0 (socket says 172.21.15.78:47798) 2023-12-19T16:06:35.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce8ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce90145090 0x7fce901de3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49312/0 (socket says 172.21.15.78:49312) 2023-12-19T16:06:35.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce8e59c640 1 -- 172.21.15.78:0/2717129321 learned_addr learned my addr 172.21.15.78:0/2717129321 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-19T16:06:35.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce8dd9b640 1 --2- 172.21.15.78:0/2717129321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce900b83f0 0x7fce901d23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:35.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce8ed9d640 1 -- 172.21.15.78:0/2717129321 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce9006d790 msgr2=0x7fce9014b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce8ed9d640 1 --2- 172.21.15.78:0/2717129321 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce9006d790 0x7fce9014b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce8ed9d640 1 -- 172.21.15.78:0/2717129321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce900b83f0 msgr2=0x7fce901d23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:35.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce8ed9d640 1 --2- 172.21.15.78:0/2717129321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce900b83f0 0x7fce901d23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:35.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce8ed9d640 1 -- 172.21.15.78:0/2717129321 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce840094d0 con 0x7fce90145090 2023-12-19T16:06:35.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce8e59c640 1 --2- 172.21.15.78:0/2717129321 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce9006d790 0x7fce9014b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:06:35.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce8ed9d640 1 --2- 172.21.15.78:0/2717129321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce90145090 0x7fce901de3c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fce8800c780 tx=0x7fce8800cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:35.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce7effd640 1 -- 172.21.15.78:0/2717129321 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8800ce30 con 0x7fce90145090 2023-12-19T16:06:35.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce7effd640 1 -- 172.21.15.78:0/2717129321 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8800a5e0 con 0x7fce90145090 2023-12-19T16:06:35.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce94d18640 1 -- 172.21.15.78:0/2717129321 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce900b0d10 con 0x7fce90145090 2023-12-19T16:06:35.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.987+0000 7fce7effd640 1 -- 172.21.15.78:0/2717129321 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8800a990 con 0x7fce90145090 2023-12-19T16:06:35.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.988+0000 7fce94d18640 1 -- 172.21.15.78:0/2717129321 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce901ddbc0 con 0x7fce90145090 2023-12-19T16:06:35.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.988+0000 7fce7effd640 1 -- 172.21.15.78:0/2717129321 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fce880070d0 con 0x7fce90145090 2023-12-19T16:06:35.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.988+0000 7fce7effd640 1 -- 172.21.15.78:0/2717129321 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fce88012910 con 0x7fce90145090 2023-12-19T16:06:35.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.988+0000 7fce94d18640 1 -- 172.21.15.78:0/2717129321 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce900b77a0 con 0x7fce90145090 2023-12-19T16:06:35.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:35.992+0000 7fce7effd640 1 -- 172.21.15.78:0/2717129321 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fce900b77a0 con 0x7fce90145090 2023-12-19T16:06:36.008 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:36.006+0000 7f9d37c49040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-19T16:06:36.018 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:36.016+0000 7f050742e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-19T16:06:36.062 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:36.060+0000 7f9d37c49040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-19T16:06:36.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.063+0000 7fce94d18640 1 -- 172.21.15.78:0/2717129321 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "59a4c9b9-1339-4f72-9c0c-092183afe07b", "id": 4} v 0) v1 -- 0x7fce901de0a0 con 0x7fce90145090 2023-12-19T16:06:36.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.069+0000 7fce7effd640 1 -- 172.21.15.78:0/2717129321 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "59a4c9b9-1339-4f72-9c0c-092183afe07b", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fce88018070 con 0x7fce90145090 2023-12-19T16:06:36.072 INFO:teuthology.orchestra.run.smithi078.stdout:4 2023-12-19T16:06:36.072 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:36.070+0000 7f050742e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-19T16:06:36.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.070+0000 7fce94d18640 1 -- 172.21.15.78:0/2717129321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce90145090 msgr2=0x7fce901de3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.070+0000 7fce94d18640 1 --2- 172.21.15.78:0/2717129321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce90145090 0x7fce901de3c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fce8800c780 tx=0x7fce8800cc40 comp rx=0 tx=0).stop 2023-12-19T16:06:36.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.070+0000 7fce94d18640 1 -- 172.21.15.78:0/2717129321 shutdown_connections 2023-12-19T16:06:36.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.070+0000 7fce94d18640 1 --2- 172.21.15.78:0/2717129321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce90145090 0x7fce901de3c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.070+0000 7fce94d18640 1 --2- 172.21.15.78:0/2717129321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce900b83f0 0x7fce901d23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.070+0000 7fce94d18640 1 --2- 172.21.15.78:0/2717129321 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce9006d790 0x7fce9014b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.070+0000 7fce94d18640 1 -- 172.21.15.78:0/2717129321 >> 172.21.15.78:0/2717129321 conn(0x7fce900b99c0 msgr2=0x7fce90072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:36.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.070+0000 7fce94d18640 1 -- 172.21.15.78:0/2717129321 shutdown_connections 2023-12-19T16:06:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.070+0000 7fce94d18640 1 -- 172.21.15.78:0/2717129321 wait complete. 2023-12-19T16:06:36.083 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f 5 2023-12-19T16:06:36.112 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:36.110+0000 7f9d37c49040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-19T16:06:36.121 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:36.119+0000 7f050742e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-19T16:06:36.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.218+0000 7f5a310bd640 1 Processor -- start 2023-12-19T16:06:36.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.218+0000 7f5a310bd640 1 -- start start 2023-12-19T16:06:36.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.219+0000 7f5a310bd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5a2c144c40 0x7f5a2c0b74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:36.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.219+0000 7f5a310bd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5a2c0b3290 0x7f5a2c155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:36.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.219+0000 7f5a310bd640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a2c0b2ee0 con 0x7f5a2c0b79e0 2023-12-19T16:06:36.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.219+0000 7f5a310bd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2c0b1630 con 0x7f5a2c144c40 2023-12-19T16:06:36.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.219+0000 7f5a310bd640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2c0b18d0 con 0x7f5a2c0b3290 2023-12-19T16:06:36.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.219+0000 7f5a2b59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5a2c0b3290 0x7f5a2c155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:36.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.219+0000 7f5a2a59c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5a2c0b79e0 0x7f5a2c14abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45370/0 (socket says 172.21.15.78:45370) 2023-12-19T16:06:36.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.219+0000 7f5a2a59c640 1 -- 172.21.15.78:0/1639072593 learned_addr learned my addr 172.21.15.78:0/1639072593 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-19T16:06:36.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.219+0000 7f5a2ad9d640 1 --2- 172.21.15.78:0/1639072593 >> v2:172.21.15.37:3300/0 conn(0x7f5a2c144c40 0x7f5a2c0b74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:36.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.219+0000 7f5a2b59e640 1 -- 172.21.15.78:0/1639072593 >> v2:172.21.15.37:3300/0 conn(0x7f5a2c144c40 msgr2=0x7f5a2c0b74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:36.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.219+0000 7f5a2b59e640 1 --2- 172.21.15.78:0/1639072593 >> v2:172.21.15.37:3300/0 conn(0x7f5a2c144c40 0x7f5a2c0b74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.219+0000 7f5a2b59e640 1 -- 172.21.15.78:0/1639072593 >> v1:172.21.15.78:6789/0 conn(0x7f5a2c0b79e0 legacy=0x7f5a2c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.219+0000 7f5a29d9b640 1 -- 172.21.15.78:0/1639072593 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625259066 0 0) 0x7f5a2c0b2ee0 con 0x7f5a2c0b79e0 2023-12-19T16:06:36.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.219+0000 7f5a2b59e640 1 -- 172.21.15.78:0/1639072593 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c0b1bb0 con 0x7f5a2c0b3290 2023-12-19T16:06:36.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.220+0000 7f5a2b59e640 1 --2- 172.21.15.78:0/1639072593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a2c0b3290 0x7f5a2c155340 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5a24009d90 tx=0x7f5a2402bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98e8ad0943d049a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:36.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.220+0000 7f5a29d9b640 1 -- 172.21.15.78:0/1639072593 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2402cd00 con 0x7f5a2c0b3290 2023-12-19T16:06:36.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.220+0000 7f5a29d9b640 1 -- 172.21.15.78:0/1639072593 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2402ce60 con 0x7f5a2c0b3290 2023-12-19T16:06:36.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.220+0000 7f5a29d9b640 1 -- 172.21.15.78:0/1639072593 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a24034660 con 0x7f5a2c0b3290 2023-12-19T16:06:36.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.221+0000 7f5a310bd640 1 -- 172.21.15.78:0/1639072593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a2c0b3290 msgr2=0x7f5a2c155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.221+0000 7f5a310bd640 1 --2- 172.21.15.78:0/1639072593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a2c0b3290 0x7f5a2c155340 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5a24009d90 tx=0x7f5a2402bf50 comp rx=0 tx=0).stop 2023-12-19T16:06:36.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.221+0000 7f5a310bd640 1 -- 172.21.15.78:0/1639072593 shutdown_connections 2023-12-19T16:06:36.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.221+0000 7f5a310bd640 1 --2- 172.21.15.78:0/1639072593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a2c0b3290 0x7f5a2c155340 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.221+0000 7f5a310bd640 1 --2- 172.21.15.78:0/1639072593 >> v2:172.21.15.37:3300/0 conn(0x7f5a2c144c40 0x7f5a2c0b74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.221+0000 7f5a310bd640 1 -- 172.21.15.78:0/1639072593 >> 172.21.15.78:0/1639072593 conn(0x7f5a2c0b9150 msgr2=0x7f5a2c0b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:36.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.221+0000 7f5a310bd640 1 -- 172.21.15.78:0/1639072593 shutdown_connections 2023-12-19T16:06:36.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.221+0000 7f5a310bd640 1 -- 172.21.15.78:0/1639072593 wait complete. 2023-12-19T16:06:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.222+0000 7f5a310bd640 1 Processor -- start 2023-12-19T16:06:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.222+0000 7f5a310bd640 1 -- start start 2023-12-19T16:06:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a310bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a2c0b3290 0x7f5a2c0a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a310bd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a2c0b79e0 0x7f5a2c06f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a310bd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5a2c144c40 0x7f5a2c140fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a310bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c0a0fb0 con 0x7f5a2c0b3290 2023-12-19T16:06:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a310bd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c0713a0 con 0x7f5a2c0b79e0 2023-12-19T16:06:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a310bd640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c071e70 con 0x7f5a2c144c40 2023-12-19T16:06:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a2a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a2c0b79e0 0x7f5a2c06f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a2b59e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5a2c144c40 0x7f5a2c140fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a2a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a2c0b79e0 0x7f5a2c06f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49326/0 (socket says 172.21.15.78:49326) 2023-12-19T16:06:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a2a59c640 1 -- 172.21.15.78:0/2483219217 learned_addr learned my addr 172.21.15.78:0/2483219217 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-19T16:06:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a2ad9d640 1 --2- 172.21.15.78:0/2483219217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a2c0b3290 0x7f5a2c0a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a2a59c640 1 -- 172.21.15.78:0/2483219217 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5a2c144c40 msgr2=0x7f5a2c140fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a2a59c640 1 --2- 172.21.15.78:0/2483219217 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5a2c144c40 0x7f5a2c140fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a2a59c640 1 -- 172.21.15.78:0/2483219217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a2c0b3290 msgr2=0x7f5a2c0a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a2a59c640 1 --2- 172.21.15.78:0/2483219217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a2c0b3290 0x7f5a2c0a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a2a59c640 1 -- 172.21.15.78:0/2483219217 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a24009a70 con 0x7f5a2c0b79e0 2023-12-19T16:06:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a2ad9d640 1 --2- 172.21.15.78:0/2483219217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a2c0b3290 0x7f5a2c0a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:06:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a2a59c640 1 --2- 172.21.15.78:0/2483219217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a2c0b79e0 0x7f5a2c06f740 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c00c4b0 tx=0x7f5a1c00c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a237fe640 1 -- 172.21.15.78:0/2483219217 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c0074e0 con 0x7f5a2c0b79e0 2023-12-19T16:06:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a237fe640 1 -- 172.21.15.78:0/2483219217 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1c007660 con 0x7f5a2c0b79e0 2023-12-19T16:06:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a310bd640 1 -- 172.21.15.78:0/2483219217 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a2c070f80 con 0x7f5a2c0b79e0 2023-12-19T16:06:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a237fe640 1 -- 172.21.15.78:0/2483219217 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c004a20 con 0x7f5a2c0b79e0 2023-12-19T16:06:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.223+0000 7f5a310bd640 1 -- 172.21.15.78:0/2483219217 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a2c071680 con 0x7f5a2c0b79e0 2023-12-19T16:06:36.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.224+0000 7f5a237fe640 1 -- 172.21.15.78:0/2483219217 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5a1c01d440 con 0x7f5a2c0b79e0 2023-12-19T16:06:36.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.224+0000 7f5a237fe640 1 -- 172.21.15.78:0/2483219217 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f5a1c0129d0 con 0x7f5a2c0b79e0 2023-12-19T16:06:36.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.224+0000 7f5a310bd640 1 -- 172.21.15.78:0/2483219217 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a2c0b8640 con 0x7f5a2c0b79e0 2023-12-19T16:06:36.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.226+0000 7f5a237fe640 1 -- 172.21.15.78:0/2483219217 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f5a1c018070 con 0x7f5a2c0b79e0 2023-12-19T16:06:36.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.297+0000 7f5a310bd640 1 -- 172.21.15.78:0/2483219217 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f", "id": 5} v 0) v1 -- 0x7f5a2c04e840 con 0x7f5a2c0b79e0 2023-12-19T16:06:36.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.303+0000 7f5a237fe640 1 -- 172.21.15.78:0/2483219217 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5a1c012580 con 0x7f5a2c0b79e0 2023-12-19T16:06:36.306 INFO:teuthology.orchestra.run.smithi078.stdout:5 2023-12-19T16:06:36.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.303+0000 7f5a310bd640 1 -- 172.21.15.78:0/2483219217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a2c0b79e0 msgr2=0x7f5a2c06f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.303+0000 7f5a310bd640 1 --2- 172.21.15.78:0/2483219217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a2c0b79e0 0x7f5a2c06f740 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c00c4b0 tx=0x7f5a1c00c970 comp rx=0 tx=0).stop 2023-12-19T16:06:36.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.303+0000 7f5a310bd640 1 -- 172.21.15.78:0/2483219217 shutdown_connections 2023-12-19T16:06:36.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.303+0000 7f5a310bd640 1 --2- 172.21.15.78:0/2483219217 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5a2c144c40 0x7f5a2c140fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.303+0000 7f5a310bd640 1 --2- 172.21.15.78:0/2483219217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a2c0b79e0 0x7f5a2c06f740 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.303+0000 7f5a310bd640 1 --2- 172.21.15.78:0/2483219217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a2c0b3290 0x7f5a2c0a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.303+0000 7f5a310bd640 1 -- 172.21.15.78:0/2483219217 >> 172.21.15.78:0/2483219217 conn(0x7f5a2c0b9150 msgr2=0x7f5a2c143950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:36.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.304+0000 7f5a310bd640 1 -- 172.21.15.78:0/2483219217 shutdown_connections 2023-12-19T16:06:36.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.304+0000 7f5a310bd640 1 -- 172.21.15.78:0/2483219217 wait complete. 2023-12-19T16:06:36.316 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45 6 2023-12-19T16:06:36.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.413+0000 7f994f799640 1 Processor -- start 2023-12-19T16:06:36.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.413+0000 7f994f799640 1 -- start start 2023-12-19T16:06:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.414+0000 7f994f799640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f994806d790 0x7f99480b7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.414+0000 7f994f799640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99480b4d70 con 0x7f9948145260 2023-12-19T16:06:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.414+0000 7f994f799640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99480b8680 con 0x7f99480b8220 2023-12-19T16:06:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.414+0000 7f994f799640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99480a2cf0 con 0x7f994806d790 2023-12-19T16:06:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.414+0000 7f994d535640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f994806d790 0x7f99480b7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.414+0000 7f994d535640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f994806d790 0x7f99480b7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:47816/0 (socket says 172.21.15.78:47816) 2023-12-19T16:06:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.414+0000 7f994cd34640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f99480b8220 0x7f9948144b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45386/0 (socket says 172.21.15.78:45386) 2023-12-19T16:06:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.414+0000 7f994d535640 1 -- 172.21.15.78:0/513530571 learned_addr learned my addr 172.21.15.78:0/513530571 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-19T16:06:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.414+0000 7f994d535640 1 -- 172.21.15.78:0/513530571 >> v1:172.21.15.78:6789/0 conn(0x7f99480b8220 legacy=0x7f9948144b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.414+0000 7f994d535640 1 -- 172.21.15.78:0/513530571 >> v1:172.21.15.37:6789/0 conn(0x7f9948145260 legacy=0x7f99481522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.414+0000 7f993bfff640 1 -- 172.21.15.78:0/513530571 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051984895 0 0) 0x7f99480b8680 con 0x7f99480b8220 2023-12-19T16:06:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.414+0000 7f994d535640 1 -- 172.21.15.78:0/513530571 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99481482a0 con 0x7f994806d790 2023-12-19T16:06:36.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.415+0000 7f994d535640 1 --2- 172.21.15.78:0/513530571 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f994806d790 0x7f99480b7ce0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f993c00bb40 tx=0x7f993c02e140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d92979957f3814f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:36.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.415+0000 7f993bfff640 1 -- 172.21.15.78:0/513530571 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c036440 con 0x7f994806d790 2023-12-19T16:06:36.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.415+0000 7f993bfff640 1 -- 172.21.15.78:0/513530571 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c0365a0 con 0x7f994806d790 2023-12-19T16:06:36.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.415+0000 7f993bfff640 1 -- 172.21.15.78:0/513530571 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c036930 con 0x7f994806d790 2023-12-19T16:06:36.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.416+0000 7f994f799640 1 -- 172.21.15.78:0/513530571 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f994806d790 msgr2=0x7f99480b7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.416+0000 7f994f799640 1 --2- 172.21.15.78:0/513530571 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f994806d790 0x7f99480b7ce0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f993c00bb40 tx=0x7f993c02e140 comp rx=0 tx=0).stop 2023-12-19T16:06:36.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.416+0000 7f994f799640 1 -- 172.21.15.78:0/513530571 shutdown_connections 2023-12-19T16:06:36.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.416+0000 7f994f799640 1 --2- 172.21.15.78:0/513530571 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f994806d790 0x7f99480b7ce0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.416+0000 7f994f799640 1 -- 172.21.15.78:0/513530571 >> 172.21.15.78:0/513530571 conn(0x7f99480b99c0 msgr2=0x7f99480b9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:36.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.416+0000 7f994f799640 1 -- 172.21.15.78:0/513530571 shutdown_connections 2023-12-19T16:06:36.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.416+0000 7f994f799640 1 -- 172.21.15.78:0/513530571 wait complete. 2023-12-19T16:06:36.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.417+0000 7f994f799640 1 Processor -- start 2023-12-19T16:06:36.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.417+0000 7f994f799640 1 -- start start 2023-12-19T16:06:36.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f994f799640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f994806d790 0x7f9948098cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f994f799640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99480b8220 0x7f994814af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f994f799640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9948145260 0x7f9948143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f994f799640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99480991f0 con 0x7f994806d790 2023-12-19T16:06:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f994f799640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9948099f40 con 0x7f99480b8220 2023-12-19T16:06:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f994f799640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99480b2640 con 0x7f9948145260 2023-12-19T16:06:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f994cd34640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99480b8220 0x7f994814af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f994dd36640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9948145260 0x7f9948143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f994cd34640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99480b8220 0x7f994814af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49336/0 (socket says 172.21.15.78:49336) 2023-12-19T16:06:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f994cd34640 1 -- 172.21.15.78:0/2102343289 learned_addr learned my addr 172.21.15.78:0/2102343289 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-19T16:06:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f994d535640 1 --2- 172.21.15.78:0/2102343289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f994806d790 0x7f9948098cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f994cd34640 1 -- 172.21.15.78:0/2102343289 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9948145260 msgr2=0x7f9948143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f994cd34640 1 --2- 172.21.15.78:0/2102343289 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9948145260 0x7f9948143bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f994cd34640 1 -- 172.21.15.78:0/2102343289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f994806d790 msgr2=0x7f9948098cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f994cd34640 1 --2- 172.21.15.78:0/2102343289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f994806d790 0x7f9948098cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f994cd34640 1 -- 172.21.15.78:0/2102343289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c00b770 con 0x7f99480b8220 2023-12-19T16:06:36.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f994dd36640 1 --2- 172.21.15.78:0/2102343289 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9948145260 0x7f9948143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:06:36.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f994cd34640 1 --2- 172.21.15.78:0/2102343289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99480b8220 0x7f994814af80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f994400c4d0 tx=0x7f994400c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:36.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f9939ffb640 1 -- 172.21.15.78:0/2102343289 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99440074e0 con 0x7f99480b8220 2023-12-19T16:06:36.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f9939ffb640 1 -- 172.21.15.78:0/2102343289 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9944007640 con 0x7f99480b8220 2023-12-19T16:06:36.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f994f799640 1 -- 172.21.15.78:0/2102343289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994809a420 con 0x7f99480b8220 2023-12-19T16:06:36.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.418+0000 7f9939ffb640 1 -- 172.21.15.78:0/2102343289 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9944004a20 con 0x7f99480b8220 2023-12-19T16:06:36.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.419+0000 7f994f799640 1 -- 172.21.15.78:0/2102343289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99480b39e0 con 0x7f99480b8220 2023-12-19T16:06:36.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.419+0000 7f9939ffb640 1 -- 172.21.15.78:0/2102343289 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f994401d440 con 0x7f99480b8220 2023-12-19T16:06:36.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.419+0000 7f9939ffb640 1 -- 172.21.15.78:0/2102343289 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f99440129f0 con 0x7f99480b8220 2023-12-19T16:06:36.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.419+0000 7f994f799640 1 -- 172.21.15.78:0/2102343289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9948066d80 con 0x7f99480b8220 2023-12-19T16:06:36.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.421+0000 7f9939ffb640 1 -- 172.21.15.78:0/2102343289 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f9944018070 con 0x7f99480b8220 2023-12-19T16:06:36.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.493+0000 7f994f799640 1 -- 172.21.15.78:0/2102343289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45", "id": 6} v 0) v1 -- 0x7f994804e840 con 0x7f99480b8220 2023-12-19T16:06:36.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.501+0000 7f9939ffb640 1 -- 172.21.15.78:0/2102343289 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9944012590 con 0x7f99480b8220 2023-12-19T16:06:36.503 INFO:teuthology.orchestra.run.smithi078.stdout:6 2023-12-19T16:06:36.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.502+0000 7f994f799640 1 -- 172.21.15.78:0/2102343289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99480b8220 msgr2=0x7f994814af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.502+0000 7f994f799640 1 --2- 172.21.15.78:0/2102343289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99480b8220 0x7f994814af80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f994400c4d0 tx=0x7f994400c990 comp rx=0 tx=0).stop 2023-12-19T16:06:36.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.502+0000 7f994f799640 1 -- 172.21.15.78:0/2102343289 shutdown_connections 2023-12-19T16:06:36.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.502+0000 7f994f799640 1 --2- 172.21.15.78:0/2102343289 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9948145260 0x7f9948143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.502+0000 7f994f799640 1 --2- 172.21.15.78:0/2102343289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99480b8220 0x7f994814af80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.502+0000 7f994f799640 1 --2- 172.21.15.78:0/2102343289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f994806d790 0x7f9948098cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.502+0000 7f994f799640 1 -- 172.21.15.78:0/2102343289 >> 172.21.15.78:0/2102343289 conn(0x7f99480b99c0 msgr2=0x7f99481478e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:36.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.502+0000 7f994f799640 1 -- 172.21.15.78:0/2102343289 shutdown_connections 2023-12-19T16:06:36.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.502+0000 7f994f799640 1 -- 172.21.15.78:0/2102343289 wait complete. 2023-12-19T16:06:36.511 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:36.509+0000 7f9d37c49040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-19T16:06:36.514 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 3c606e1d-1356-455e-b592-b1787e696b73 7 2023-12-19T16:06:36.522 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:36.520+0000 7f050742e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-19T16:06:36.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.613+0000 7fde3e139640 1 Processor -- start 2023-12-19T16:06:36.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.613+0000 7fde3e139640 1 -- start start 2023-12-19T16:06:36.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.614+0000 7fde3e139640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde380b83f0 0x7fde38144b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:36.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.614+0000 7fde3e139640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fde38145090 0x7fde381522e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.614+0000 7fde3e139640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde380b4d70 con 0x7fde3806d790 2023-12-19T16:06:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.614+0000 7fde3e139640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde38145500 con 0x7fde38145090 2023-12-19T16:06:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.614+0000 7fde3e139640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde380a2cf0 con 0x7fde380b83f0 2023-12-19T16:06:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.614+0000 7fde2ffff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde380b83f0 0x7fde38144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.614+0000 7fde37fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fde38145090 0x7fde381522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.614+0000 7fde2ffff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde380b83f0 0x7fde38144b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:47158/0 (socket says 172.21.15.78:47158) 2023-12-19T16:06:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.614+0000 7fde2ffff640 1 -- 172.21.15.78:0/11977764 learned_addr learned my addr 172.21.15.78:0/11977764 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-19T16:06:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.614+0000 7fde2ffff640 1 -- 172.21.15.78:0/11977764 >> v2:172.21.15.78:3300/0 conn(0x7fde38145090 msgr2=0x7fde381522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.614+0000 7fde2ffff640 1 --2- 172.21.15.78:0/11977764 >> v2:172.21.15.78:3300/0 conn(0x7fde38145090 0x7fde381522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.614+0000 7fde2ffff640 1 -- 172.21.15.78:0/11977764 >> v1:172.21.15.37:6789/0 conn(0x7fde3806d790 legacy=0x7fde380b7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.614+0000 7fde2ffff640 1 -- 172.21.15.78:0/11977764 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde381482a0 con 0x7fde380b83f0 2023-12-19T16:06:36.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.614+0000 7fde37fff640 1 --2- 172.21.15.78:0/11977764 >> v2:172.21.15.78:3300/0 conn(0x7fde38145090 0x7fde381522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:06:36.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.615+0000 7fde2ffff640 1 --2- 172.21.15.78:0/11977764 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde380b83f0 0x7fde38144b50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fde380b4f00 tx=0x7fde2002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29e9c456bd0bb2cb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:36.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.615+0000 7fde36ffd640 1 -- 172.21.15.78:0/11977764 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde20031640 con 0x7fde380b83f0 2023-12-19T16:06:36.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.615+0000 7fde36ffd640 1 -- 172.21.15.78:0/11977764 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde200317a0 con 0x7fde380b83f0 2023-12-19T16:06:36.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.615+0000 7fde36ffd640 1 -- 172.21.15.78:0/11977764 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde20031b30 con 0x7fde380b83f0 2023-12-19T16:06:36.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.616+0000 7fde3e139640 1 -- 172.21.15.78:0/11977764 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde380b83f0 msgr2=0x7fde38144b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.616+0000 7fde3e139640 1 --2- 172.21.15.78:0/11977764 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde380b83f0 0x7fde38144b50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fde380b4f00 tx=0x7fde2002b8f0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.616+0000 7fde3e139640 1 -- 172.21.15.78:0/11977764 shutdown_connections 2023-12-19T16:06:36.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.616+0000 7fde3e139640 1 --2- 172.21.15.78:0/11977764 >> v2:172.21.15.78:3300/0 conn(0x7fde38145090 0x7fde381522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.616+0000 7fde3e139640 1 --2- 172.21.15.78:0/11977764 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde380b83f0 0x7fde38144b50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.616+0000 7fde3e139640 1 -- 172.21.15.78:0/11977764 >> 172.21.15.78:0/11977764 conn(0x7fde380b99c0 msgr2=0x7fde380b9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:36.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.616+0000 7fde3e139640 1 -- 172.21.15.78:0/11977764 shutdown_connections 2023-12-19T16:06:36.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.616+0000 7fde3e139640 1 -- 172.21.15.78:0/11977764 wait complete. 2023-12-19T16:06:36.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.617+0000 7fde3e139640 1 Processor -- start 2023-12-19T16:06:36.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.617+0000 7fde3e139640 1 -- start start 2023-12-19T16:06:36.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde3e139640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde3806d790 0x7fde380b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:36.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde3e139640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde380b83f0 0x7fde38149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:36.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde3e139640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde38145090 0x7fde3814a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:36.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde3e139640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde380b34c0 con 0x7fde38145090 2023-12-19T16:06:36.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde3e139640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3814bac0 con 0x7fde380b83f0 2023-12-19T16:06:36.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde3e139640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3814bd10 con 0x7fde3806d790 2023-12-19T16:06:36.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde2ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde380b83f0 0x7fde38149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:36.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde377fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde3806d790 0x7fde380b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:36.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde2ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde380b83f0 0x7fde38149fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52914/0 (socket says 172.21.15.78:52914) 2023-12-19T16:06:36.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde2ffff640 1 -- 172.21.15.78:0/1952025197 learned_addr learned my addr 172.21.15.78:0/1952025197 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-19T16:06:36.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde37fff640 1 --2- 172.21.15.78:0/1952025197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde38145090 0x7fde3814a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:36.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde377fe640 1 -- 172.21.15.78:0/1952025197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde380b83f0 msgr2=0x7fde38149fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde377fe640 1 --2- 172.21.15.78:0/1952025197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde380b83f0 0x7fde38149fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde377fe640 1 -- 172.21.15.78:0/1952025197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde38145090 msgr2=0x7fde3814a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde377fe640 1 --2- 172.21.15.78:0/1952025197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde38145090 0x7fde3814a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde377fe640 1 -- 172.21.15.78:0/1952025197 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3000bc80 con 0x7fde3806d790 2023-12-19T16:06:36.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde2ffff640 1 --2- 172.21.15.78:0/1952025197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde380b83f0 0x7fde38149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:06:36.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde377fe640 1 --2- 172.21.15.78:0/1952025197 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde3806d790 0x7fde380b2f80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fde2800c340 tx=0x7fde2800c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:36.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde34ff9640 1 -- 172.21.15.78:0/1952025197 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde280052d0 con 0x7fde3806d790 2023-12-19T16:06:36.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde34ff9640 1 -- 172.21.15.78:0/1952025197 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde28005450 con 0x7fde3806d790 2023-12-19T16:06:36.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde3e139640 1 -- 172.21.15.78:0/1952025197 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde200094d0 con 0x7fde3806d790 2023-12-19T16:06:36.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde34ff9640 1 -- 172.21.15.78:0/1952025197 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde28007260 con 0x7fde3806d790 2023-12-19T16:06:36.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.618+0000 7fde3e139640 1 -- 172.21.15.78:0/1952025197 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde380a2420 con 0x7fde3806d790 2023-12-19T16:06:36.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.619+0000 7fde34ff9640 1 -- 172.21.15.78:0/1952025197 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fde280067d0 con 0x7fde3806d790 2023-12-19T16:06:36.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.619+0000 7fde34ff9640 1 -- 172.21.15.78:0/1952025197 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fde28011590 con 0x7fde3806d790 2023-12-19T16:06:36.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.619+0000 7fde3e139640 1 -- 172.21.15.78:0/1952025197 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde380b77a0 con 0x7fde3806d790 2023-12-19T16:06:36.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.623+0000 7fde34ff9640 1 -- 172.21.15.78:0/1952025197 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fde380b77a0 con 0x7fde3806d790 2023-12-19T16:06:36.653 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:36.651+0000 7f9d37c49040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-19T16:06:36.665 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:36.663+0000 7f050742e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-19T16:06:36.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.694+0000 7fde3e139640 1 -- 172.21.15.78:0/1952025197 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3c606e1d-1356-455e-b592-b1787e696b73", "id": 7} v 0) v1 -- 0x7fde3804e840 con 0x7fde3806d790 2023-12-19T16:06:36.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.702+0000 7fde34ff9640 1 -- 172.21.15.78:0/1952025197 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3c606e1d-1356-455e-b592-b1787e696b73", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fde28020060 con 0x7fde3806d790 2023-12-19T16:06:36.705 INFO:teuthology.orchestra.run.smithi078.stdout:7 2023-12-19T16:06:36.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.703+0000 7fde3e139640 1 -- 172.21.15.78:0/1952025197 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde3806d790 msgr2=0x7fde380b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.703+0000 7fde3e139640 1 --2- 172.21.15.78:0/1952025197 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde3806d790 0x7fde380b2f80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fde2800c340 tx=0x7fde2800c740 comp rx=0 tx=0).stop 2023-12-19T16:06:36.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.703+0000 7fde3e139640 1 -- 172.21.15.78:0/1952025197 shutdown_connections 2023-12-19T16:06:36.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.703+0000 7fde3e139640 1 --2- 172.21.15.78:0/1952025197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde38145090 0x7fde3814a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.703+0000 7fde3e139640 1 --2- 172.21.15.78:0/1952025197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde380b83f0 0x7fde38149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.703+0000 7fde3e139640 1 --2- 172.21.15.78:0/1952025197 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde3806d790 0x7fde380b2f80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.703+0000 7fde3e139640 1 -- 172.21.15.78:0/1952025197 >> 172.21.15.78:0/1952025197 conn(0x7fde380b99c0 msgr2=0x7fde380bc680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:36.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.703+0000 7fde3e139640 1 -- 172.21.15.78:0/1952025197 shutdown_connections 2023-12-19T16:06:36.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-19T16:06:36.703+0000 7fde3e139640 1 -- 172.21.15.78:0/1952025197 wait complete. 2023-12-19T16:06:36.715 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-19T16:06:36.716 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-19T16:06:36.718 INFO:tasks.ceph.osd.0:Started 2023-12-19T16:06:36.718 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-19T16:06:36.718 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-19T16:06:36.720 INFO:tasks.ceph.osd.1:Started 2023-12-19T16:06:36.720 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-19T16:06:36.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-19T16:06:36.722 INFO:tasks.ceph.osd.2:Started 2023-12-19T16:06:36.723 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-19T16:06:36.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-19T16:06:36.725 INFO:tasks.ceph.osd.3:Started 2023-12-19T16:06:36.725 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-19T16:06:36.725 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-19T16:06:36.758 INFO:tasks.ceph.osd.4:Started 2023-12-19T16:06:36.758 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-19T16:06:36.759 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-19T16:06:36.761 INFO:tasks.ceph.osd.5:Started 2023-12-19T16:06:36.761 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-19T16:06:36.761 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-19T16:06:36.763 INFO:tasks.ceph.osd.6:Started 2023-12-19T16:06:36.763 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-19T16:06:36.763 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-19T16:06:36.765 INFO:tasks.ceph.osd.7:Started 2023-12-19T16:06:36.765 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:06:36.800 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:36.798+0000 7f9d37c49040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-19T16:06:36.807 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:36.805+0000 7f050742e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-19T16:06:36.855 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:36.853+0000 7f9d37c49040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-19T16:06:36.865 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:36.863+0000 7f050742e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-19T16:06:36.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.889+0000 7f962b621640 1 Processor -- start 2023-12-19T16:06:36.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.889+0000 7f962b621640 1 -- start start 2023-12-19T16:06:36.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.890+0000 7f962b621640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96240b68d0 0x7f9624071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:36.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.890+0000 7f962b621640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f962406aca0 0x7f962406b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:36.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.890+0000 7f962b621640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9624070660 con 0x7f96241425b0 2023-12-19T16:06:36.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.890+0000 7f962b621640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962406b640 con 0x7f962406aca0 2023-12-19T16:06:36.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.890+0000 7f962b621640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962406fc10 con 0x7f96240b68d0 2023-12-19T16:06:36.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.890+0000 7f9628bbc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f962406aca0 0x7f962406b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:36.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.890+0000 7f9629bbe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f96241425b0 0x7f96240b7950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53460/0 (socket says 172.21.15.37:53460) 2023-12-19T16:06:36.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.890+0000 7f9628bbc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f962406aca0 0x7f962406b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51438/0 (socket says 172.21.15.37:51438) 2023-12-19T16:06:36.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.890+0000 7f9629bbe640 1 -- 172.21.15.37:0/3426310796 learned_addr learned my addr 172.21.15.37:0/3426310796 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:06:36.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.890+0000 7f96293bd640 1 --2- 172.21.15.37:0/3426310796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96240b68d0 0x7f9624071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:36.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.891+0000 7f9628bbc640 1 -- 172.21.15.37:0/3426310796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96240b68d0 msgr2=0x7f9624071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:36.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.891+0000 7f9628bbc640 1 --2- 172.21.15.37:0/3426310796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96240b68d0 0x7f9624071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.891+0000 7f9628bbc640 1 -- 172.21.15.37:0/3426310796 >> v1:172.21.15.37:6789/0 conn(0x7f96241425b0 legacy=0x7f96240b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.891+0000 7f961bfff640 1 -- 172.21.15.37:0/3426310796 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143305038 0 0) 0x7f961c001490 con 0x7f96241425b0 2023-12-19T16:06:36.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.891+0000 7f9628bbc640 1 -- 172.21.15.37:0/3426310796 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962406a8f0 con 0x7f962406aca0 2023-12-19T16:06:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.892+0000 7f9628bbc640 1 --2- 172.21.15.37:0/3426310796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f962406aca0 0x7f962406b100 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f96200097a0 tx=0x7f962002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e682a17d7a83cd8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.892+0000 7f961bfff640 1 -- 172.21.15.37:0/3426310796 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620031830 con 0x7f962406aca0 2023-12-19T16:06:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.892+0000 7f961bfff640 1 -- 172.21.15.37:0/3426310796 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9620031990 con 0x7f962406aca0 2023-12-19T16:06:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.892+0000 7f961bfff640 1 -- 172.21.15.37:0/3426310796 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620031d20 con 0x7f962406aca0 2023-12-19T16:06:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.893+0000 7f962b621640 1 -- 172.21.15.37:0/3426310796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f962406aca0 msgr2=0x7f962406b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.893+0000 7f962b621640 1 --2- 172.21.15.37:0/3426310796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f962406aca0 0x7f962406b100 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f96200097a0 tx=0x7f962002b8d0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.893+0000 7f962b621640 1 -- 172.21.15.37:0/3426310796 shutdown_connections 2023-12-19T16:06:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.893+0000 7f962b621640 1 --2- 172.21.15.37:0/3426310796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f962406aca0 0x7f962406b100 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.893+0000 7f962b621640 1 --2- 172.21.15.37:0/3426310796 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96240b68d0 0x7f9624071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.893+0000 7f962b621640 1 -- 172.21.15.37:0/3426310796 >> 172.21.15.37:0/3426310796 conn(0x7f96240b9c30 msgr2=0x7f96240ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.893+0000 7f962b621640 1 -- 172.21.15.37:0/3426310796 shutdown_connections 2023-12-19T16:06:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.893+0000 7f962b621640 1 -- 172.21.15.37:0/3426310796 wait complete. 2023-12-19T16:06:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.894+0000 7f962b621640 1 Processor -- start 2023-12-19T16:06:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.894+0000 7f962b621640 1 -- start start 2023-12-19T16:06:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.894+0000 7f962b621640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f962406aca0 0x7f96241de450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.894+0000 7f962b621640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96240b68d0 0x7f96240a79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.894+0000 7f962b621640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96241425b0 0x7f96240a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.894+0000 7f962b621640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96240a7f20 con 0x7f96240b68d0 2023-12-19T16:06:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.894+0000 7f962b621640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96240a9630 con 0x7f962406aca0 2023-12-19T16:06:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.894+0000 7f962b621640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9624145f50 con 0x7f96241425b0 2023-12-19T16:06:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.895+0000 7f9628bbc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96240b68d0 0x7f96240a79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.895+0000 7f9628bbc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96240b68d0 0x7f96240a79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51440/0 (socket says 172.21.15.37:51440) 2023-12-19T16:06:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.895+0000 7f9628bbc640 1 -- 172.21.15.37:0/1471208401 learned_addr learned my addr 172.21.15.37:0/1471208401 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.895+0000 7f9629bbe640 1 --2- 172.21.15.37:0/1471208401 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96241425b0 0x7f96240a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.895+0000 7f96293bd640 1 --2- 172.21.15.37:0/1471208401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f962406aca0 0x7f96241de450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.895+0000 7f9628bbc640 1 -- 172.21.15.37:0/1471208401 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96241425b0 msgr2=0x7f96240a90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.895+0000 7f9628bbc640 1 --2- 172.21.15.37:0/1471208401 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96241425b0 0x7f96240a90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.895+0000 7f9628bbc640 1 -- 172.21.15.37:0/1471208401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f962406aca0 msgr2=0x7f96241de450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.895+0000 7f9628bbc640 1 --2- 172.21.15.37:0/1471208401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f962406aca0 0x7f96241de450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.895+0000 7f9628bbc640 1 -- 172.21.15.37:0/1471208401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9620009400 con 0x7f96240b68d0 2023-12-19T16:06:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.895+0000 7f9628bbc640 1 --2- 172.21.15.37:0/1471208401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96240b68d0 0x7f96240a79e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f96200098c0 tx=0x7f96200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.895+0000 7f9619ffb640 1 -- 172.21.15.37:0/1471208401 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962003a6f0 con 0x7f96240b68d0 2023-12-19T16:06:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.895+0000 7f9619ffb640 1 -- 172.21.15.37:0/1471208401 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962003a870 con 0x7f96240b68d0 2023-12-19T16:06:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.895+0000 7f962b621640 1 -- 172.21.15.37:0/1471208401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96240b33f0 con 0x7f96240b68d0 2023-12-19T16:06:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.895+0000 7f9619ffb640 1 -- 172.21.15.37:0/1471208401 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962003ac20 con 0x7f96240b68d0 2023-12-19T16:06:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.895+0000 7f962b621640 1 -- 172.21.15.37:0/1471208401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96241ddc50 con 0x7f96240b68d0 2023-12-19T16:06:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.896+0000 7f9619ffb640 1 -- 172.21.15.37:0/1471208401 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9620043710 con 0x7f96240b68d0 2023-12-19T16:06:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.896+0000 7f9619ffb640 1 -- 172.21.15.37:0/1471208401 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9620030a50 con 0x7f96240b68d0 2023-12-19T16:06:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.896+0000 7f962b621640 1 -- 172.21.15.37:0/1471208401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962404e840 con 0x7f96240b68d0 2023-12-19T16:06:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.898+0000 7f9619ffb640 1 -- 172.21.15.37:0/1471208401 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f9620048070 con 0x7f96240b68d0 2023-12-19T16:06:36.959 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:36.957+0000 7f9d37c49040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-19T16:06:36.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.959+0000 7f962b621640 1 -- 172.21.15.37:0/1471208401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96240aadc0 con 0x7f96240b68d0 2023-12-19T16:06:36.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.960+0000 7f9619ffb640 1 -- 172.21.15.37:0/1471208401 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9620035020 con 0x7f96240b68d0 2023-12-19T16:06:36.962 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:36.962 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":10,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:36.696773+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:06:36.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.961+0000 7f962b621640 1 -- 172.21.15.37:0/1471208401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96240b68d0 msgr2=0x7f96240a79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:36.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.961+0000 7f962b621640 1 --2- 172.21.15.37:0/1471208401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96240b68d0 0x7f96240a79e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f96200098c0 tx=0x7f96200046c0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.961+0000 7f962b621640 1 -- 172.21.15.37:0/1471208401 shutdown_connections 2023-12-19T16:06:36.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.961+0000 7f962b621640 1 --2- 172.21.15.37:0/1471208401 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96241425b0 0x7f96240a90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.961+0000 7f962b621640 1 --2- 172.21.15.37:0/1471208401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96240b68d0 0x7f96240a79e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.961+0000 7f962b621640 1 --2- 172.21.15.37:0/1471208401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f962406aca0 0x7f96241de450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:36.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.961+0000 7f962b621640 1 -- 172.21.15.37:0/1471208401 >> 172.21.15.37:0/1471208401 conn(0x7f96240b9c30 msgr2=0x7f96240ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:36.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.961+0000 7f962b621640 1 -- 172.21.15.37:0/1471208401 shutdown_connections 2023-12-19T16:06:36.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:36.961+0000 7f962b621640 1 -- 172.21.15.37:0/1471208401 wait complete. 2023-12-19T16:06:36.964 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:36.962+0000 7f050742e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-19T16:06:36.973 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-19T16:06:36.974 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-19T16:06:37.057 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:37.055+0000 7f050742e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-19T16:06:37.059 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:37.057+0000 7f9d37c49040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-19T16:06:37.197 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:37.195+0000 7f050742e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-19T16:06:37.204 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:37.202+0000 7f9d37c49040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-19T16:06:37.239 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:37.237+0000 7f050742e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-19T16:06:37.248 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:37.246+0000 7f9d37c49040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-19T16:06:37.331 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-19T16:06:37.329+0000 7fa294712500 -1 Falling back to public interface 2023-12-19T16:06:37.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-19T16:06:37.334+0000 7f00ed610500 -1 Falling back to public interface 2023-12-19T16:06:37.340 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-19T16:06:37.338+0000 7f3774612500 -1 Falling back to public interface 2023-12-19T16:06:37.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-19T16:06:37.350+0000 7f963af12500 -1 Falling back to public interface 2023-12-19T16:06:37.359 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-12-19T16:06:37.357+0000 7fa399c22500 -1 Falling back to public interface 2023-12-19T16:06:37.360 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-12-19T16:06:37.358+0000 7f2eaf4d6500 -1 Falling back to public interface 2023-12-19T16:06:37.367 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-12-19T16:06:37.365+0000 7f4fb6ac7500 -1 Falling back to public interface 2023-12-19T16:06:37.369 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-12-19T16:06:37.367+0000 7f870ebbc500 -1 Falling back to public interface 2023-12-19T16:06:37.382 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:37.380+0000 7f050742e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-19T16:06:37.399 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:37.397+0000 7f9d37c49040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-19T16:06:37.781 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T16:06:37.873 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.871+0000 7fb2c695c640 1 Processor -- start 2023-12-19T16:06:37.873 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.871+0000 7fb2c695c640 1 -- start start 2023-12-19T16:06:37.874 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.871+0000 7fb2c695c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb2c006ae20 0x7fb2c006f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:37.874 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.872+0000 7fb2c695c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb2c0148400 0x7fb2c01417a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:37.875 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.872+0000 7fb2c695c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c00b69e0 con 0x7fb2c00714a0 2023-12-19T16:06:37.875 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.872+0000 7fb2c695c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c0071ec0 con 0x7fb2c006ae20 2023-12-19T16:06:37.875 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.872+0000 7fb2c695c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c00b8e70 con 0x7fb2c0148400 2023-12-19T16:06:37.875 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.872+0000 7fb2bf7fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb2c0148400 0x7fb2c01417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:37.875 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.872+0000 7fb2bffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb2c006ae20 0x7fb2c006f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:37.875 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.872+0000 7fb2bffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb2c006ae20 0x7fb2c006f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:42832/0 (socket says 172.21.15.37:42832) 2023-12-19T16:06:37.875 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.872+0000 7fb2bffff640 1 -- 172.21.15.37:0/2944066684 learned_addr learned my addr 172.21.15.37:0/2944066684 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:37.875 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.872+0000 7fb2bf7fe640 1 -- 172.21.15.37:0/2944066684 >> v2:172.21.15.78:3300/0 conn(0x7fb2c006ae20 msgr2=0x7fb2c006f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:37.875 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.872+0000 7fb2bf7fe640 1 --2- 172.21.15.37:0/2944066684 >> v2:172.21.15.78:3300/0 conn(0x7fb2c006ae20 0x7fb2c006f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:37.875 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.872+0000 7fb2bf7fe640 1 -- 172.21.15.37:0/2944066684 >> v1:172.21.15.78:6789/0 conn(0x7fb2c00714a0 legacy=0x7fb2c014ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:37.875 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.872+0000 7fb2bf7fe640 1 -- 172.21.15.37:0/2944066684 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c0147920 con 0x7fb2c0148400 2023-12-19T16:06:37.875 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.872+0000 7fb2bffff640 1 --2- 172.21.15.37:0/2944066684 >> v2:172.21.15.78:3300/0 conn(0x7fb2c006ae20 0x7fb2c006f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:06:37.877 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.873+0000 7fb2bf7fe640 1 --2- 172.21.15.37:0/2944066684 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb2c0148400 0x7fb2c01417a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40097a0 tx=0x7fb2b402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e350e228192702b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:37.877 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.873+0000 7fb2beffd640 1 -- 172.21.15.37:0/2944066684 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4031830 con 0x7fb2c0148400 2023-12-19T16:06:37.877 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.873+0000 7fb2beffd640 1 -- 172.21.15.37:0/2944066684 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b4031990 con 0x7fb2c0148400 2023-12-19T16:06:37.877 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.873+0000 7fb2beffd640 1 -- 172.21.15.37:0/2944066684 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4031d20 con 0x7fb2c0148400 2023-12-19T16:06:37.877 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.874+0000 7fb2c695c640 1 -- 172.21.15.37:0/2944066684 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb2c0148400 msgr2=0x7fb2c01417a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:37.877 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.874+0000 7fb2c695c640 1 --2- 172.21.15.37:0/2944066684 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb2c0148400 0x7fb2c01417a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40097a0 tx=0x7fb2b402b8d0 comp rx=0 tx=0).stop 2023-12-19T16:06:37.877 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.874+0000 7fb2c695c640 1 -- 172.21.15.37:0/2944066684 shutdown_connections 2023-12-19T16:06:37.877 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.874+0000 7fb2c695c640 1 --2- 172.21.15.37:0/2944066684 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb2c0148400 0x7fb2c01417a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:37.877 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.874+0000 7fb2c695c640 1 --2- 172.21.15.37:0/2944066684 >> v2:172.21.15.78:3300/0 conn(0x7fb2c006ae20 0x7fb2c006f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:37.877 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.874+0000 7fb2c695c640 1 -- 172.21.15.37:0/2944066684 >> 172.21.15.37:0/2944066684 conn(0x7fb2c00b91e0 msgr2=0x7fb2c00b95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:37.877 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.874+0000 7fb2c695c640 1 -- 172.21.15.37:0/2944066684 shutdown_connections 2023-12-19T16:06:37.878 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.874+0000 7fb2c695c640 1 -- 172.21.15.37:0/2944066684 wait complete. 2023-12-19T16:06:37.878 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.875+0000 7fb2c695c640 1 Processor -- start 2023-12-19T16:06:37.880 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.875+0000 7fb2c695c640 1 -- start start 2023-12-19T16:06:37.880 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.876+0000 7fb2c695c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2c006ae20 0x7fb2c0146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:37.880 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.876+0000 7fb2c695c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2c00714a0 0x7fb2c0145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:37.880 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.876+0000 7fb2c695c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb2c0148400 0x7fb2c01e15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:37.881 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.876+0000 7fb2c695c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c0148e70 con 0x7fb2c006ae20 2023-12-19T16:06:37.881 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.876+0000 7fb2c695c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c0147340 con 0x7fb2c00714a0 2023-12-19T16:06:37.881 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.876+0000 7fb2c695c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c01d4fe0 con 0x7fb2c0148400 2023-12-19T16:06:37.881 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.876+0000 7fb2bffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2c006ae20 0x7fb2c0146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:37.881 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.876+0000 7fb2bffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2c006ae20 0x7fb2c0146e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51442/0 (socket says 172.21.15.37:51442) 2023-12-19T16:06:37.881 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.876+0000 7fb2bf7fe640 1 --2- 172.21.15.37:0/3573871078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2c00714a0 0x7fb2c0145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:37.881 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.876+0000 7fb2bffff640 1 -- 172.21.15.37:0/3573871078 learned_addr learned my addr 172.21.15.37:0/3573871078 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:37.881 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.876+0000 7fb2c4ef9640 1 --2- 172.21.15.37:0/3573871078 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb2c0148400 0x7fb2c01e15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:37.881 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.876+0000 7fb2bffff640 1 -- 172.21.15.37:0/3573871078 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb2c0148400 msgr2=0x7fb2c01e15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:37.881 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.876+0000 7fb2bffff640 1 --2- 172.21.15.37:0/3573871078 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb2c0148400 0x7fb2c01e15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:37.881 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.876+0000 7fb2bffff640 1 -- 172.21.15.37:0/3573871078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2c00714a0 msgr2=0x7fb2c0145880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:37.881 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.876+0000 7fb2bffff640 1 --2- 172.21.15.37:0/3573871078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2c00714a0 0x7fb2c0145880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:37.881 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.876+0000 7fb2bffff640 1 -- 172.21.15.37:0/3573871078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b00094d0 con 0x7fb2c006ae20 2023-12-19T16:06:37.882 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.876+0000 7fb2c4ef9640 1 --2- 172.21.15.37:0/3573871078 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb2c0148400 0x7fb2c01e15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:06:37.882 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.876+0000 7fb2bffff640 1 --2- 172.21.15.37:0/3573871078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2c006ae20 0x7fb2c0146e00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000e9d0 tx=0x7fb2b000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:37.882 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.877+0000 7fb2bcff9640 1 -- 172.21.15.37:0/3573871078 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b000ca60 con 0x7fb2c006ae20 2023-12-19T16:06:37.882 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.877+0000 7fb2bcff9640 1 -- 172.21.15.37:0/3573871078 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b000cbc0 con 0x7fb2c006ae20 2023-12-19T16:06:37.882 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.877+0000 7fb2c695c640 1 -- 172.21.15.37:0/3573871078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b4009400 con 0x7fb2c006ae20 2023-12-19T16:06:37.882 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.877+0000 7fb2bcff9640 1 -- 172.21.15.37:0/3573871078 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0013470 con 0x7fb2c006ae20 2023-12-19T16:06:37.882 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.877+0000 7fb2c695c640 1 -- 172.21.15.37:0/3573871078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c01d54a0 con 0x7fb2c006ae20 2023-12-19T16:06:37.882 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.877+0000 7fb2bcff9640 1 -- 172.21.15.37:0/3573871078 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb2b0005c90 con 0x7fb2c006ae20 2023-12-19T16:06:37.882 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.877+0000 7fb2bcff9640 1 -- 172.21.15.37:0/3573871078 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb2b0013ca0 con 0x7fb2c006ae20 2023-12-19T16:06:37.882 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.878+0000 7fb2c695c640 1 -- 172.21.15.37:0/3573871078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c004e840 con 0x7fb2c006ae20 2023-12-19T16:06:37.882 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.880+0000 7fb2bcff9640 1 -- 172.21.15.37:0/3573871078 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fb2b0021060 con 0x7fb2c006ae20 2023-12-19T16:06:37.943 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.941+0000 7fb2c695c640 1 -- 172.21.15.37:0/3573871078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2c00b6b90 con 0x7fb2c006ae20 2023-12-19T16:06:37.943 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.941+0000 7fb2bcff9640 1 -- 172.21.15.37:0/3573871078 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb2b0017070 con 0x7fb2c006ae20 2023-12-19T16:06:37.944 INFO:teuthology.misc.health.smithi037.stdout: 2023-12-19T16:06:37.944 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":10,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:36.696773+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:06:37.945 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.942+0000 7fb2c695c640 1 -- 172.21.15.37:0/3573871078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2c006ae20 msgr2=0x7fb2c0146e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:37.945 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.942+0000 7fb2c695c640 1 --2- 172.21.15.37:0/3573871078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2c006ae20 0x7fb2c0146e00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000e9d0 tx=0x7fb2b000ee90 comp rx=0 tx=0).stop 2023-12-19T16:06:37.945 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.942+0000 7fb2c695c640 1 -- 172.21.15.37:0/3573871078 shutdown_connections 2023-12-19T16:06:37.945 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.942+0000 7fb2c695c640 1 --2- 172.21.15.37:0/3573871078 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb2c0148400 0x7fb2c01e15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:37.945 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.942+0000 7fb2c695c640 1 --2- 172.21.15.37:0/3573871078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2c00714a0 0x7fb2c0145880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:37.945 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.942+0000 7fb2c695c640 1 --2- 172.21.15.37:0/3573871078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2c006ae20 0x7fb2c0146e00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:37.945 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.942+0000 7fb2c695c640 1 -- 172.21.15.37:0/3573871078 >> 172.21.15.37:0/3573871078 conn(0x7fb2c00b91e0 msgr2=0x7fb2c00b95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:37.945 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.942+0000 7fb2c695c640 1 -- 172.21.15.37:0/3573871078 shutdown_connections 2023-12-19T16:06:37.945 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:37.942+0000 7fb2c695c640 1 -- 172.21.15.37:0/3573871078 wait complete. 2023-12-19T16:06:37.954 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-19T16:06:38.178 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:38.176+0000 7f050742e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-19T16:06:38.210 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:38.208+0000 7f9d37c49040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-19T16:06:38.451 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:38.448+0000 7f050742e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-19T16:06:38.497 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:38.495+0000 7f9d37c49040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-19T16:06:38.503 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:38.501+0000 7f050742e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-19T16:06:38.552 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:38.550+0000 7f9d37c49040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-19T16:06:38.604 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:38.602+0000 7f050742e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-19T16:06:38.657 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-19T16:06:38.655+0000 7f9d37c49040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-19T16:06:39.633 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:39.631+0000 7f04a80eb640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-19T16:06:39.634 INFO:tasks.ceph.mgr.x.smithi078.stderr:2023-12-19T16:06:39.632+0000 7f04a80eb640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-19T16:06:40.815 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-12-19T16:06:40.813+0000 7fa399c22500 -1 osd.7 0 log_to_monitors true 2023-12-19T16:06:40.826 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-19T16:06:40.823+0000 7f3774612500 -1 osd.3 0 log_to_monitors true 2023-12-19T16:06:40.855 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-12-19T16:06:40.852+0000 7f2eaf4d6500 -1 osd.5 0 log_to_monitors true 2023-12-19T16:06:40.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-19T16:06:40.857+0000 7f00ed610500 -1 osd.1 0 log_to_monitors true 2023-12-19T16:06:40.860 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-19T16:06:40.858+0000 7fa294712500 -1 osd.0 0 log_to_monitors true 2023-12-19T16:06:40.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-19T16:06:40.879+0000 7f963af12500 -1 osd.2 0 log_to_monitors true 2023-12-19T16:06:40.889 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-12-19T16:06:40.887+0000 7f4fb6ac7500 -1 osd.6 0 log_to_monitors true 2023-12-19T16:06:40.904 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-12-19T16:06:40.902+0000 7f870ebbc500 -1 osd.4 0 log_to_monitors true 2023-12-19T16:06:44.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-19T16:06:44.701+0000 7f00e870e640 -1 osd.1 0 waiting for initial osdmap 2023-12-19T16:06:44.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-19T16:06:44.717+0000 7f00e0d40640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:06:44.756 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-19T16:06:44.754+0000 7fa28fe7a640 -1 osd.0 0 waiting for initial osdmap 2023-12-19T16:06:44.761 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-12-19T16:06:44.759+0000 7fa394dca640 -1 osd.7 0 waiting for initial osdmap 2023-12-19T16:06:44.763 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T16:06:44.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-19T16:06:44.762+0000 7f963667a640 -1 osd.2 0 waiting for initial osdmap 2023-12-19T16:06:44.764 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-19T16:06:44.763+0000 7fa2884ac640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:06:44.766 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-19T16:06:44.763+0000 7f376f6e3640 -1 osd.3 0 waiting for initial osdmap 2023-12-19T16:06:44.774 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-12-19T16:06:44.772+0000 7fa38d3fc640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:06:44.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-19T16:06:44.776+0000 7f962ecac640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:06:44.779 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-19T16:06:44.777+0000 7f3767d15640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:06:44.787 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-12-19T16:06:44.785+0000 7f870a324640 -1 osd.4 0 waiting for initial osdmap 2023-12-19T16:06:44.799 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-12-19T16:06:44.797+0000 7f8702956640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:06:44.817 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-12-19T16:06:44.815+0000 7f4fb3a6a640 -1 osd.6 0 waiting for initial osdmap 2023-12-19T16:06:44.827 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-12-19T16:06:44.825+0000 7f4faa861640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:06:44.833 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-12-19T16:06:44.831+0000 7f2eaac3e640 -1 osd.5 0 waiting for initial osdmap 2023-12-19T16:06:44.847 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-12-19T16:06:44.845+0000 7f2ea3270640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:06:44.857 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.855+0000 7f5222f5c640 1 Processor -- start 2023-12-19T16:06:44.860 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.855+0000 7f5222f5c640 1 -- start start 2023-12-19T16:06:44.865 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.856+0000 7f5222f5c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f521c14b830 0x7f521c144f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:44.865 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.856+0000 7f5222f5c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f521c14ad50 con 0x7f521c0b6c00 2023-12-19T16:06:44.865 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.856+0000 7f5222f5c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f521c14b030 con 0x7f521c0b8250 2023-12-19T16:06:44.865 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.856+0000 7f5222f5c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521c14ab60 con 0x7f521c14b830 2023-12-19T16:06:44.865 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.856+0000 7f5220cf8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f521c0b6c00 0x7f521c144800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41496/0 (socket says 172.21.15.37:41496) 2023-12-19T16:06:44.865 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.856+0000 7f5220cf8640 1 -- 172.21.15.37:0/2408283970 learned_addr learned my addr 172.21.15.37:0/2408283970 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:06:44.865 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.856+0000 7f52214f9640 1 --2- 172.21.15.37:0/2408283970 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f521c14b830 0x7f521c144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:44.865 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.856+0000 7f521b7fe640 1 -- 172.21.15.37:0/2408283970 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276385535 0 0) 0x7f521c14ad50 con 0x7f521c0b6c00 2023-12-19T16:06:44.866 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.856+0000 7f521b7fe640 1 -- 172.21.15.37:0/2408283970 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5208003520 con 0x7f521c0b6c00 2023-12-19T16:06:44.866 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.856+0000 7f521b7fe640 1 -- 172.21.15.37:0/2408283970 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408190504 0 0) 0x7f521c14b030 con 0x7f521c0b8250 2023-12-19T16:06:44.866 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.856+0000 7f521b7fe640 1 -- 172.21.15.37:0/2408283970 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f521c14ad50 con 0x7f521c0b8250 2023-12-19T16:06:44.866 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.856+0000 7f52214f9640 1 -- 172.21.15.37:0/2408283970 >> v1:172.21.15.78:6789/0 conn(0x7f521c0b8250 legacy=0x7f521c153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:44.866 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.856+0000 7f52214f9640 1 -- 172.21.15.37:0/2408283970 >> v1:172.21.15.37:6789/0 conn(0x7f521c0b6c00 legacy=0x7f521c144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:44.866 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.856+0000 7f521b7fe640 1 -- 172.21.15.37:0/2408283970 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 871059061 0 0) 0x7f5208003520 con 0x7f521c0b6c00 2023-12-19T16:06:44.866 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.856+0000 7f52214f9640 1 -- 172.21.15.37:0/2408283970 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c14b310 con 0x7f521c14b830 2023-12-19T16:06:44.866 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.857+0000 7f52214f9640 1 --2- 172.21.15.37:0/2408283970 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f521c14b830 0x7f521c144f10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5204009800 tx=0x7f520402b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63ad3f7b77923ab0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:44.866 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.857+0000 7f521b7fe640 1 -- 172.21.15.37:0/2408283970 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5214001670 con 0x7f521c14b830 2023-12-19T16:06:44.866 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.857+0000 7f521b7fe640 1 -- 172.21.15.37:0/2408283970 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5204031560 con 0x7f521c14b830 2023-12-19T16:06:44.866 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.857+0000 7f521b7fe640 1 -- 172.21.15.37:0/2408283970 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52040318f0 con 0x7f521c14b830 2023-12-19T16:06:44.866 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.858+0000 7f5222f5c640 1 -- 172.21.15.37:0/2408283970 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f521c14b830 msgr2=0x7f521c144f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:44.866 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.858+0000 7f5222f5c640 1 --2- 172.21.15.37:0/2408283970 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f521c14b830 0x7f521c144f10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5204009800 tx=0x7f520402b880 comp rx=0 tx=0).stop 2023-12-19T16:06:44.866 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.858+0000 7f5222f5c640 1 -- 172.21.15.37:0/2408283970 shutdown_connections 2023-12-19T16:06:44.867 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.858+0000 7f5222f5c640 1 --2- 172.21.15.37:0/2408283970 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f521c14b830 0x7f521c144f10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:44.867 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.858+0000 7f5222f5c640 1 -- 172.21.15.37:0/2408283970 >> 172.21.15.37:0/2408283970 conn(0x7f521c0c03a0 msgr2=0x7f521c0c0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:44.867 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.858+0000 7f5222f5c640 1 -- 172.21.15.37:0/2408283970 shutdown_connections 2023-12-19T16:06:44.867 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.858+0000 7f5222f5c640 1 -- 172.21.15.37:0/2408283970 wait complete. 2023-12-19T16:06:44.867 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.859+0000 7f5222f5c640 1 Processor -- start 2023-12-19T16:06:44.867 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.859+0000 7f5222f5c640 1 -- start start 2023-12-19T16:06:44.867 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.860+0000 7f5222f5c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f521c0b6c00 0x7f521c13e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:44.867 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.860+0000 7f5222f5c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f521c0b8250 0x7f521c0bf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:44.867 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.860+0000 7f5222f5c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f521c14b830 0x7f521c13c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:44.867 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.860+0000 7f5222f5c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c13eb40 con 0x7f521c14b830 2023-12-19T16:06:44.867 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.860+0000 7f5222f5c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c14dbc0 con 0x7f521c0b6c00 2023-12-19T16:06:44.867 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.860+0000 7f5222f5c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521c14d2a0 con 0x7f521c0b8250 2023-12-19T16:06:44.867 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.860+0000 7f52214f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f521c14b830 0x7f521c13c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:44.867 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.860+0000 7f52214f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f521c14b830 0x7f521c13c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34460/0 (socket says 172.21.15.37:34460) 2023-12-19T16:06:44.867 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.860+0000 7f52214f9640 1 -- 172.21.15.37:0/1669293137 learned_addr learned my addr 172.21.15.37:0/1669293137 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:44.868 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.860+0000 7f521bfff640 1 --2- 172.21.15.37:0/1669293137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f521c0b8250 0x7f521c0bf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:44.868 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.860+0000 7f5220cf8640 1 --2- 172.21.15.37:0/1669293137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f521c0b6c00 0x7f521c13e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:44.868 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.860+0000 7f52214f9640 1 -- 172.21.15.37:0/1669293137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f521c0b8250 msgr2=0x7f521c0bf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:44.868 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.860+0000 7f52214f9640 1 --2- 172.21.15.37:0/1669293137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f521c0b8250 0x7f521c0bf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:44.868 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.860+0000 7f52214f9640 1 -- 172.21.15.37:0/1669293137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f521c0b6c00 msgr2=0x7f521c13e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:44.868 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.860+0000 7f52214f9640 1 --2- 172.21.15.37:0/1669293137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f521c0b6c00 0x7f521c13e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:44.868 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.860+0000 7f52214f9640 1 -- 172.21.15.37:0/1669293137 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5204009400 con 0x7f521c14b830 2023-12-19T16:06:44.868 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.860+0000 7f5220cf8640 1 --2- 172.21.15.37:0/1669293137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f521c0b6c00 0x7f521c13e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:06:44.868 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.860+0000 7f52214f9640 1 --2- 172.21.15.37:0/1669293137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f521c14b830 0x7f521c13c930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5204009720 tx=0x7f52040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:44.868 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.861+0000 7f52197fa640 1 -- 172.21.15.37:0/1669293137 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204031ed0 con 0x7f521c14b830 2023-12-19T16:06:44.868 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.861+0000 7f52197fa640 1 -- 172.21.15.37:0/1669293137 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5204004030 con 0x7f521c14b830 2023-12-19T16:06:44.868 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.861+0000 7f5222f5c640 1 -- 172.21.15.37:0/1669293137 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521c14cfa0 con 0x7f521c14b830 2023-12-19T16:06:44.868 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.861+0000 7f52197fa640 1 -- 172.21.15.37:0/1669293137 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52040043c0 con 0x7f521c14b830 2023-12-19T16:06:44.868 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.861+0000 7f5222f5c640 1 -- 172.21.15.37:0/1669293137 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f521c14e820 con 0x7f521c14b830 2023-12-19T16:06:44.869 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.862+0000 7f5222f5c640 1 -- 172.21.15.37:0/1669293137 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521c04e840 con 0x7f521c14b830 2023-12-19T16:06:44.869 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.862+0000 7f52197fa640 1 -- 172.21.15.37:0/1669293137 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 88551+0+0 (secure 0 0 0) 0x7f5204043070 con 0x7f521c14b830 2023-12-19T16:06:44.869 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.862+0000 7f52197fa640 1 --2- 172.21.15.37:0/1669293137 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f51fc06a3a0 0x7f51fc06c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:44.869 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.863+0000 7f52197fa640 1 -- 172.21.15.37:0/1669293137 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f520402f050 con 0x7f521c14b830 2023-12-19T16:06:44.869 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.863+0000 7f5220cf8640 1 --2- 172.21.15.37:0/1669293137 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f51fc06a3a0 0x7f51fc06c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:44.869 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.863+0000 7f5220cf8640 1 --2- 172.21.15.37:0/1669293137 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f51fc06a3a0 0x7f51fc06c860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5214000f60 tx=0x7f5214009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:44.869 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:44.867+0000 7f52197fa640 1 -- 172.21.15.37:0/1669293137 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f52040753c0 con 0x7f521c14b830 2023-12-19T16:06:45.047 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:45.045+0000 7f5222f5c640 1 -- 172.21.15.37:0/1669293137 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f521c14d3e0 con 0x7f521c14b830 2023-12-19T16:06:45.048 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:45.046+0000 7f52197fa640 1 -- 172.21.15.37:0/1669293137 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f52040789e0 con 0x7f521c14b830 2023-12-19T16:06:45.048 INFO:teuthology.misc.health.smithi037.stdout: 2023-12-19T16:06:45.048 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":12,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:42.633496+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:06:45.050 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:45.048+0000 7f5222f5c640 1 -- 172.21.15.37:0/1669293137 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f51fc06a3a0 msgr2=0x7f51fc06c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:45.050 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:45.048+0000 7f5222f5c640 1 --2- 172.21.15.37:0/1669293137 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f51fc06a3a0 0x7f51fc06c860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5214000f60 tx=0x7f5214009040 comp rx=0 tx=0).stop 2023-12-19T16:06:45.050 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:45.048+0000 7f5222f5c640 1 -- 172.21.15.37:0/1669293137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f521c14b830 msgr2=0x7f521c13c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:45.051 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:45.048+0000 7f5222f5c640 1 --2- 172.21.15.37:0/1669293137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f521c14b830 0x7f521c13c930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5204009720 tx=0x7f52040046c0 comp rx=0 tx=0).stop 2023-12-19T16:06:45.051 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:45.048+0000 7f5222f5c640 1 -- 172.21.15.37:0/1669293137 shutdown_connections 2023-12-19T16:06:45.051 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:45.048+0000 7f5222f5c640 1 --2- 172.21.15.37:0/1669293137 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f51fc06a3a0 0x7f51fc06c860 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:45.051 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:45.048+0000 7f5222f5c640 1 --2- 172.21.15.37:0/1669293137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f521c14b830 0x7f521c13c930 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:45.051 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:45.048+0000 7f5222f5c640 1 --2- 172.21.15.37:0/1669293137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f521c0b8250 0x7f521c0bf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:45.051 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:45.048+0000 7f5222f5c640 1 --2- 172.21.15.37:0/1669293137 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f521c0b6c00 0x7f521c13e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:45.051 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:45.048+0000 7f5222f5c640 1 -- 172.21.15.37:0/1669293137 >> 172.21.15.37:0/1669293137 conn(0x7f521c0c03a0 msgr2=0x7f521c0b5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:45.051 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:45.048+0000 7f5222f5c640 1 -- 172.21.15.37:0/1669293137 shutdown_connections 2023-12-19T16:06:45.051 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:45.048+0000 7f5222f5c640 1 -- 172.21.15.37:0/1669293137 wait complete. 2023-12-19T16:06:45.060 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-19T16:06:51.868 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T16:06:51.971 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.968+0000 7f5720ec4640 1 Processor -- start 2023-12-19T16:06:51.971 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.968+0000 7f5720ec4640 1 -- start start 2023-12-19T16:06:51.972 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.968+0000 7f5720ec4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f571c14b830 0x7f571c144f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:51.972 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.968+0000 7f5720ec4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f571c14ad50 con 0x7f571c0b8250 2023-12-19T16:06:51.972 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.969+0000 7f5720ec4640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f571c14b030 con 0x7f571c0b6c00 2023-12-19T16:06:51.972 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.969+0000 7f5720ec4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571c14ab60 con 0x7f571c14b830 2023-12-19T16:06:51.972 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.969+0000 7f571ad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f571c14b830 0x7f571c144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:51.973 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.969+0000 7f5711d9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f571c0b8250 0x7f571c153490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52922/0 (socket says 172.21.15.37:52922) 2023-12-19T16:06:51.973 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.969+0000 7f5711d9b640 1 -- 172.21.15.37:0/3786063437 learned_addr learned my addr 172.21.15.37:0/3786063437 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:06:51.973 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.969+0000 7f571ad9d640 1 -- 172.21.15.37:0/3786063437 >> v1:172.21.15.78:6789/0 conn(0x7f571c0b6c00 legacy=0x7f571c144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:51.973 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.969+0000 7f571ad9d640 1 -- 172.21.15.37:0/3786063437 >> v1:172.21.15.37:6789/0 conn(0x7f571c0b8250 legacy=0x7f571c153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:51.973 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.969+0000 7f5719d9b640 1 -- 172.21.15.37:0/3786063437 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018501222 0 0) 0x7f571c14ad50 con 0x7f571c0b8250 2023-12-19T16:06:51.973 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.969+0000 7f571ad9d640 1 -- 172.21.15.37:0/3786063437 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c14b310 con 0x7f571c14b830 2023-12-19T16:06:51.974 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.970+0000 7f571ad9d640 1 --2- 172.21.15.37:0/3786063437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c14b830 0x7f571c144f10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5714009dc0 tx=0x7f571402be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ddec86ec313632 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:51.974 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.970+0000 7f5719d9b640 1 -- 172.21.15.37:0/3786063437 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571402cc40 con 0x7f571c14b830 2023-12-19T16:06:51.974 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.970+0000 7f5719d9b640 1 -- 172.21.15.37:0/3786063437 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571402cda0 con 0x7f571c14b830 2023-12-19T16:06:51.974 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.970+0000 7f5719d9b640 1 -- 172.21.15.37:0/3786063437 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714034660 con 0x7f571c14b830 2023-12-19T16:06:51.974 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.970+0000 7f5720ec4640 1 -- 172.21.15.37:0/3786063437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c14b830 msgr2=0x7f571c144f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:51.974 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.970+0000 7f5720ec4640 1 --2- 172.21.15.37:0/3786063437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c14b830 0x7f571c144f10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5714009dc0 tx=0x7f571402be90 comp rx=0 tx=0).stop 2023-12-19T16:06:51.974 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.970+0000 7f5720ec4640 1 -- 172.21.15.37:0/3786063437 shutdown_connections 2023-12-19T16:06:51.974 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.970+0000 7f5720ec4640 1 --2- 172.21.15.37:0/3786063437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c14b830 0x7f571c144f10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:51.975 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.970+0000 7f5720ec4640 1 -- 172.21.15.37:0/3786063437 >> 172.21.15.37:0/3786063437 conn(0x7f571c0c03a0 msgr2=0x7f571c0c0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:51.975 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.971+0000 7f5720ec4640 1 -- 172.21.15.37:0/3786063437 shutdown_connections 2023-12-19T16:06:51.975 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.971+0000 7f5720ec4640 1 -- 172.21.15.37:0/3786063437 wait complete. 2023-12-19T16:06:51.977 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.972+0000 7f5720ec4640 1 Processor -- start 2023-12-19T16:06:51.977 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.972+0000 7f5720ec4640 1 -- start start 2023-12-19T16:06:51.977 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.973+0000 7f5720ec4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f571c0b6c00 0x7f571c13e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:51.977 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.973+0000 7f5720ec4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c0b8250 0x7f571c146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:51.977 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.973+0000 7f5720ec4640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f571c14b830 0x7f571c13c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:51.977 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.973+0000 7f5720ec4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c13ecf0 con 0x7f571c0b8250 2023-12-19T16:06:51.977 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.973+0000 7f5720ec4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0c00b0 con 0x7f571c0b6c00 2023-12-19T16:06:51.977 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.973+0000 7f5720ec4640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0bfdd0 con 0x7f571c14b830 2023-12-19T16:06:51.977 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.973+0000 7f5711d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c0b8250 0x7f571c146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:51.977 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.973+0000 7f5711d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c0b8250 0x7f571c146000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44168/0 (socket says 172.21.15.37:44168) 2023-12-19T16:06:51.977 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.973+0000 7f5711d9b640 1 -- 172.21.15.37:0/1881158381 learned_addr learned my addr 172.21.15.37:0/1881158381 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:51.978 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.973+0000 7f571ad9d640 1 --2- 172.21.15.37:0/1881158381 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f571c14b830 0x7f571c13c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:51.978 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.973+0000 7f571a59c640 1 --2- 172.21.15.37:0/1881158381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f571c0b6c00 0x7f571c13e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:51.978 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.973+0000 7f5711d9b640 1 -- 172.21.15.37:0/1881158381 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f571c14b830 msgr2=0x7f571c13c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:51.978 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.973+0000 7f5711d9b640 1 --2- 172.21.15.37:0/1881158381 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f571c14b830 0x7f571c13c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:51.978 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.973+0000 7f5711d9b640 1 -- 172.21.15.37:0/1881158381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f571c0b6c00 msgr2=0x7f571c13e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:51.978 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.973+0000 7f5711d9b640 1 --2- 172.21.15.37:0/1881158381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f571c0b6c00 0x7f571c13e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:51.978 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.973+0000 7f5711d9b640 1 -- 172.21.15.37:0/1881158381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5714009a70 con 0x7f571c0b8250 2023-12-19T16:06:51.979 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.973+0000 7f5711d9b640 1 --2- 172.21.15.37:0/1881158381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c0b8250 0x7f571c146000 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f570400c4b0 tx=0x7f570400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:51.979 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.973+0000 7f57137fe640 1 -- 172.21.15.37:0/1881158381 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57040074e0 con 0x7f571c0b8250 2023-12-19T16:06:51.979 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.974+0000 7f57137fe640 1 -- 172.21.15.37:0/1881158381 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5704007660 con 0x7f571c0b8250 2023-12-19T16:06:51.979 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.974+0000 7f5720ec4640 1 -- 172.21.15.37:0/1881158381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571c147e10 con 0x7f571c0b8250 2023-12-19T16:06:51.979 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.974+0000 7f57137fe640 1 -- 172.21.15.37:0/1881158381 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5704004a20 con 0x7f571c0b8250 2023-12-19T16:06:51.979 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.974+0000 7f5720ec4640 1 -- 172.21.15.37:0/1881158381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571c0bf390 con 0x7f571c0b8250 2023-12-19T16:06:51.980 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.975+0000 7f5720ec4640 1 -- 172.21.15.37:0/1881158381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f571c148330 con 0x7f571c0b8250 2023-12-19T16:06:51.980 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.975+0000 7f57137fe640 1 -- 172.21.15.37:0/1881158381 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5704004b80 con 0x7f571c0b8250 2023-12-19T16:06:51.980 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.975+0000 7f57137fe640 1 --2- 172.21.15.37:0/1881158381 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f56fc06a430 0x7f56fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:51.980 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.976+0000 7f57137fe640 1 -- 172.21.15.37:0/1881158381 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f57040878b0 con 0x7f571c0b8250 2023-12-19T16:06:51.980 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.976+0000 7f571a59c640 1 --2- 172.21.15.37:0/1881158381 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f56fc06a430 0x7f56fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:51.981 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.976+0000 7f571a59c640 1 --2- 172.21.15.37:0/1881158381 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f56fc06a430 0x7f56fc06c8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f570c004ea0 tx=0x7f570c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:51.983 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:51.980+0000 7f57137fe640 1 -- 172.21.15.37:0/1881158381 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f571c148330 con 0x7f571c0b8250 2023-12-19T16:06:52.161 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:52.158+0000 7f5720ec4640 1 -- 172.21.15.37:0/1881158381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f571c148330 con 0x7f571c0b8250 2023-12-19T16:06:52.162 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:52.159+0000 7f57137fe640 1 -- 172.21.15.37:0/1881158381 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12334 (secure 0 0 0) 0x7f571c148330 con 0x7f571c0b8250 2023-12-19T16:06:52.163 INFO:teuthology.misc.health.smithi037.stdout: 2023-12-19T16:06:52.163 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":16,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:48.709852+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:06:52.164 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:52.161+0000 7f5720ec4640 1 -- 172.21.15.37:0/1881158381 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f56fc06a430 msgr2=0x7f56fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.164 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:52.161+0000 7f5720ec4640 1 --2- 172.21.15.37:0/1881158381 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f56fc06a430 0x7f56fc06c8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f570c004ea0 tx=0x7f570c009040 comp rx=0 tx=0).stop 2023-12-19T16:06:52.164 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:52.161+0000 7f5720ec4640 1 -- 172.21.15.37:0/1881158381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c0b8250 msgr2=0x7f571c146000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.164 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:52.161+0000 7f5720ec4640 1 --2- 172.21.15.37:0/1881158381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c0b8250 0x7f571c146000 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f570400c4b0 tx=0x7f570400c970 comp rx=0 tx=0).stop 2023-12-19T16:06:52.164 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:52.161+0000 7f5720ec4640 1 -- 172.21.15.37:0/1881158381 shutdown_connections 2023-12-19T16:06:52.164 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:52.161+0000 7f5720ec4640 1 --2- 172.21.15.37:0/1881158381 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f56fc06a430 0x7f56fc06c8f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.164 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:52.161+0000 7f5720ec4640 1 --2- 172.21.15.37:0/1881158381 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f571c14b830 0x7f571c13c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.164 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:52.161+0000 7f5720ec4640 1 --2- 172.21.15.37:0/1881158381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c0b8250 0x7f571c146000 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.164 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:52.161+0000 7f5720ec4640 1 --2- 172.21.15.37:0/1881158381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f571c0b6c00 0x7f571c13e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.165 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:52.161+0000 7f5720ec4640 1 -- 172.21.15.37:0/1881158381 >> 172.21.15.37:0/1881158381 conn(0x7f571c0c03a0 msgr2=0x7f571c0b8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:52.165 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:52.161+0000 7f5720ec4640 1 -- 172.21.15.37:0/1881158381 shutdown_connections 2023-12-19T16:06:52.165 INFO:teuthology.misc.health.smithi037.stderr:2023-12-19T16:06:52.161+0000 7f5720ec4640 1 -- 172.21.15.37:0/1881158381 wait complete. 2023-12-19T16:06:52.174 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-19T16:06:52.174 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-19T16:06:52.174 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T16:06:52.174 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T16:06:52.177 INFO:tasks.ceph.mds.a:Started 2023-12-19T16:06:52.177 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T16:06:52.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T16:06:52.179 INFO:tasks.ceph.mds.c:Started 2023-12-19T16:06:52.179 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T16:06:52.179 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T16:06:52.182 INFO:tasks.ceph.mds.b:Started 2023-12-19T16:06:52.182 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-19T16:06:52.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:06:52.258 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-12-19T16:06:52.258 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-12-19T16:06:52.262 INFO:tasks.ceph.mds.b.smithi078.stdout:starting mds.b at 2023-12-19T16:06:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.290+0000 7f4566615640 1 Processor -- start 2023-12-19T16:06:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.290+0000 7f4566615640 1 -- start start 2023-12-19T16:06:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.291+0000 7f4566615640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f456006a470 0x7f45600bb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.291+0000 7f4566615640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45600bae20 con 0x7f45600b3900 2023-12-19T16:06:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.291+0000 7f455ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f456006a470 0x7f45600bb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.291+0000 7f455ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f456006a470 0x7f45600bb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44212/0 (socket says 172.21.15.37:44212) 2023-12-19T16:06:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.291+0000 7f455f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f45600b3900 0x7f4560148040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52934/0 (socket says 172.21.15.37:52934) 2023-12-19T16:06:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.291+0000 7f455ffff640 1 -- 172.21.15.37:0/4016588758 learned_addr learned my addr 172.21.15.37:0/4016588758 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.291+0000 7f4566615640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45600bf900 con 0x7f456014abd0 2023-12-19T16:06:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.291+0000 7f4566615640 1 -- 172.21.15.37:0/4016588758 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45600c1220 con 0x7f456006a470 2023-12-19T16:06:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.291+0000 7f455effd640 1 -- 172.21.15.37:0/4016588758 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780799153 0 0) 0x7f45600bae20 con 0x7f45600b3900 2023-12-19T16:06:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.291+0000 7f455effd640 1 -- 172.21.15.37:0/4016588758 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4548003520 con 0x7f45600b3900 2023-12-19T16:06:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.291+0000 7f455ffff640 1 -- 172.21.15.37:0/4016588758 >> v1:172.21.15.78:6789/0 conn(0x7f456014abd0 legacy=0x7f4560155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.291+0000 7f455ffff640 1 -- 172.21.15.37:0/4016588758 >> v1:172.21.15.37:6789/0 conn(0x7f45600b3900 legacy=0x7f4560148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.291+0000 7f455ffff640 1 -- 172.21.15.37:0/4016588758 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456014b080 con 0x7f456006a470 2023-12-19T16:06:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.292+0000 7f455ffff640 1 --2- 172.21.15.37:0/4016588758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f456006a470 0x7f45600bb2b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4554009870 tx=0x7f455402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa59bfec4b2b52cc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.292+0000 7f455effd640 1 -- 172.21.15.37:0/4016588758 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455402f850 con 0x7f456006a470 2023-12-19T16:06:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.292+0000 7f455effd640 1 -- 172.21.15.37:0/4016588758 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455402f9b0 con 0x7f456006a470 2023-12-19T16:06:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.292+0000 7f455effd640 1 -- 172.21.15.37:0/4016588758 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455402fd40 con 0x7f456006a470 2023-12-19T16:06:52.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.293+0000 7f4566615640 1 -- 172.21.15.37:0/4016588758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f456006a470 msgr2=0x7f45600bb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.293+0000 7f4566615640 1 --2- 172.21.15.37:0/4016588758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f456006a470 0x7f45600bb2b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4554009870 tx=0x7f455402ba30 comp rx=0 tx=0).stop 2023-12-19T16:06:52.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.293+0000 7f4566615640 1 -- 172.21.15.37:0/4016588758 shutdown_connections 2023-12-19T16:06:52.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.293+0000 7f4566615640 1 --2- 172.21.15.37:0/4016588758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f456006a470 0x7f45600bb2b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.293+0000 7f4566615640 1 -- 172.21.15.37:0/4016588758 >> 172.21.15.37:0/4016588758 conn(0x7f45600c0270 msgr2=0x7f45600c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:52.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.293+0000 7f4566615640 1 -- 172.21.15.37:0/4016588758 shutdown_connections 2023-12-19T16:06:52.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.293+0000 7f4566615640 1 -- 172.21.15.37:0/4016588758 wait complete. 2023-12-19T16:06:52.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.294+0000 7f4566615640 1 Processor -- start 2023-12-19T16:06:52.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.294+0000 7f4566615640 1 -- start start 2023-12-19T16:06:52.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.295+0000 7f4566615640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f456006a470 0x7f456014e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:52.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.295+0000 7f4566615640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45600b3900 0x7f45600a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:52.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.295+0000 7f4566615640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f456014abd0 0x7f45600a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:52.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.295+0000 7f4566615640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456014eda0 con 0x7f456014abd0 2023-12-19T16:06:52.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.295+0000 7f4566615640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4560142380 con 0x7f456006a470 2023-12-19T16:06:52.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.295+0000 7f4566615640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4560141c10 con 0x7f45600b3900 2023-12-19T16:06:52.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.295+0000 7f4564bb2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f456014abd0 0x7f45600a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:52.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.295+0000 7f4564bb2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f456014abd0 0x7f45600a5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44226/0 (socket says 172.21.15.37:44226) 2023-12-19T16:06:52.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.295+0000 7f4564bb2640 1 -- 172.21.15.37:0/2795765591 learned_addr learned my addr 172.21.15.37:0/2795765591 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:52.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.295+0000 7f455ffff640 1 --2- 172.21.15.37:0/2795765591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f456006a470 0x7f456014e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:52.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.295+0000 7f455f7fe640 1 --2- 172.21.15.37:0/2795765591 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45600b3900 0x7f45600a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:52.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.295+0000 7f4564bb2640 1 -- 172.21.15.37:0/2795765591 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45600b3900 msgr2=0x7f45600a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.295+0000 7f4564bb2640 1 --2- 172.21.15.37:0/2795765591 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45600b3900 0x7f45600a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.295+0000 7f4564bb2640 1 -- 172.21.15.37:0/2795765591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f456006a470 msgr2=0x7f456014e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.295+0000 7f4564bb2640 1 --2- 172.21.15.37:0/2795765591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f456006a470 0x7f456014e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.295+0000 7f4564bb2640 1 -- 172.21.15.37:0/2795765591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45540094d0 con 0x7f456014abd0 2023-12-19T16:06:52.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.296+0000 7f4564bb2640 1 --2- 172.21.15.37:0/2795765591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f456014abd0 0x7f45600a5200 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f455800c710 tx=0x7f455800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:52.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.296+0000 7f455cff9640 1 -- 172.21.15.37:0/2795765591 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558003b70 con 0x7f456014abd0 2023-12-19T16:06:52.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.296+0000 7f455cff9640 1 -- 172.21.15.37:0/2795765591 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4558003cf0 con 0x7f456014abd0 2023-12-19T16:06:52.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.296+0000 7f4566615640 1 -- 172.21.15.37:0/2795765591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45601425f0 con 0x7f456014abd0 2023-12-19T16:06:52.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.296+0000 7f455cff9640 1 -- 172.21.15.37:0/2795765591 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455800aa90 con 0x7f456014abd0 2023-12-19T16:06:52.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.296+0000 7f4566615640 1 -- 172.21.15.37:0/2795765591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4560142bb0 con 0x7f456014abd0 2023-12-19T16:06:52.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.297+0000 7f4566615640 1 -- 172.21.15.37:0/2795765591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456004e840 con 0x7f456014abd0 2023-12-19T16:06:52.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.297+0000 7f455cff9640 1 -- 172.21.15.37:0/2795765591 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f455800abf0 con 0x7f456014abd0 2023-12-19T16:06:52.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.298+0000 7f455cff9640 1 --2- 172.21.15.37:0/2795765591 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f454c06a430 0x7f454c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:52.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.298+0000 7f455cff9640 1 -- 172.21.15.37:0/2795765591 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f45580882c0 con 0x7f456014abd0 2023-12-19T16:06:52.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.298+0000 7f455ffff640 1 --2- 172.21.15.37:0/2795765591 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f454c06a430 0x7f454c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:52.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.298+0000 7f455ffff640 1 --2- 172.21.15.37:0/2795765591 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f454c06a430 0x7f454c06c8f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4554036000 tx=0x7f4554008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.302+0000 7f455cff9640 1 -- 172.21.15.37:0/2795765591 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4558053c90 con 0x7f456014abd0 2023-12-19T16:06:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.478+0000 7f4566615640 1 -- 172.21.15.37:0/2795765591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45600a61f0 con 0x7f456014abd0 2023-12-19T16:06:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.479+0000 7f455cff9640 1 -- 172.21.15.37:0/2795765591 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12334 (secure 0 0 0) 0x7f4558003e60 con 0x7f456014abd0 2023-12-19T16:06:52.482 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:52.483 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:48.709852+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:06:52.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.481+0000 7f4566615640 1 -- 172.21.15.37:0/2795765591 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f454c06a430 msgr2=0x7f454c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.481+0000 7f4566615640 1 --2- 172.21.15.37:0/2795765591 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f454c06a430 0x7f454c06c8f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4554036000 tx=0x7f4554008030 comp rx=0 tx=0).stop 2023-12-19T16:06:52.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.481+0000 7f4566615640 1 -- 172.21.15.37:0/2795765591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f456014abd0 msgr2=0x7f45600a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.481+0000 7f4566615640 1 --2- 172.21.15.37:0/2795765591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f456014abd0 0x7f45600a5200 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f455800c710 tx=0x7f455800cbd0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.481+0000 7f4566615640 1 -- 172.21.15.37:0/2795765591 shutdown_connections 2023-12-19T16:06:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.481+0000 7f4566615640 1 --2- 172.21.15.37:0/2795765591 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f454c06a430 0x7f454c06c8f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.481+0000 7f4566615640 1 --2- 172.21.15.37:0/2795765591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f456014abd0 0x7f45600a5200 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.481+0000 7f4566615640 1 --2- 172.21.15.37:0/2795765591 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45600b3900 0x7f45600a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.481+0000 7f4566615640 1 --2- 172.21.15.37:0/2795765591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f456006a470 0x7f456014e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.481+0000 7f4566615640 1 -- 172.21.15.37:0/2795765591 >> 172.21.15.37:0/2795765591 conn(0x7f45600c0270 msgr2=0x7f45601490e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.481+0000 7f4566615640 1 -- 172.21.15.37:0/2795765591 shutdown_connections 2023-12-19T16:06:52.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.481+0000 7f4566615640 1 -- 172.21.15.37:0/2795765591 wait complete. 2023-12-19T16:06:52.495 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:06:46.684027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:06:52.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:06:52.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.600+0000 7f62faeb6640 1 Processor -- start 2023-12-19T16:06:52.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.600+0000 7f62faeb6640 1 -- start start 2023-12-19T16:06:52.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.601+0000 7f62faeb6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f62f40baad0 0x7f62f40b9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:52.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.601+0000 7f62faeb6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f40b4430 con 0x7f62f40b9570 2023-12-19T16:06:52.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.601+0000 7f62faeb6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f40b99e0 con 0x7f62f4142d90 2023-12-19T16:06:52.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.601+0000 7f62faeb6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f40b3bd0 con 0x7f62f40baad0 2023-12-19T16:06:52.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.601+0000 7f62f9453640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f62f40b9570 0x7f62f4153260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52938/0 (socket says 172.21.15.37:52938) 2023-12-19T16:06:52.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.601+0000 7f62f9453640 1 -- 172.21.15.37:0/1498632233 learned_addr learned my addr 172.21.15.37:0/1498632233 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:06:52.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.601+0000 7f62f3fff640 1 --2- 172.21.15.37:0/1498632233 >> v2:172.21.15.78:3300/0 conn(0x7f62f40baad0 0x7f62f40b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:52.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.602+0000 7f62f37fe640 1 -- 172.21.15.37:0/1498632233 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718679765 0 0) 0x7f62f40b4430 con 0x7f62f40b9570 2023-12-19T16:06:52.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.602+0000 7f62f37fe640 1 -- 172.21.15.37:0/1498632233 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62dc003520 con 0x7f62f40b9570 2023-12-19T16:06:52.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.602+0000 7f62f3fff640 1 -- 172.21.15.37:0/1498632233 >> v1:172.21.15.78:6789/0 conn(0x7f62f4142d90 legacy=0x7f62f40b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.602+0000 7f62f3fff640 1 -- 172.21.15.37:0/1498632233 >> v1:172.21.15.37:6789/0 conn(0x7f62f40b9570 legacy=0x7f62f4153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.602+0000 7f62f3fff640 1 -- 172.21.15.37:0/1498632233 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f4143170 con 0x7f62f40baad0 2023-12-19T16:06:52.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.602+0000 7f62f3fff640 1 --2- 172.21.15.37:0/1498632233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62f40baad0 0x7f62f40b9030 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f62e80097a0 tx=0x7f62e802b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbea1db9dee637d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:52.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.603+0000 7f62f37fe640 1 -- 172.21.15.37:0/1498632233 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e802f810 con 0x7f62f40baad0 2023-12-19T16:06:52.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.603+0000 7f62f37fe640 1 -- 172.21.15.37:0/1498632233 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e802f970 con 0x7f62f40baad0 2023-12-19T16:06:52.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.603+0000 7f62f37fe640 1 -- 172.21.15.37:0/1498632233 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e802fce0 con 0x7f62f40baad0 2023-12-19T16:06:52.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.603+0000 7f62faeb6640 1 -- 172.21.15.37:0/1498632233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62f40baad0 msgr2=0x7f62f40b9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.603+0000 7f62faeb6640 1 --2- 172.21.15.37:0/1498632233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62f40baad0 0x7f62f40b9030 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f62e80097a0 tx=0x7f62e802b9f0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.603+0000 7f62faeb6640 1 -- 172.21.15.37:0/1498632233 shutdown_connections 2023-12-19T16:06:52.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.603+0000 7f62faeb6640 1 --2- 172.21.15.37:0/1498632233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62f40baad0 0x7f62f40b9030 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.603+0000 7f62faeb6640 1 -- 172.21.15.37:0/1498632233 >> 172.21.15.37:0/1498632233 conn(0x7f62f40be0c0 msgr2=0x7f62f40be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:52.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.603+0000 7f62faeb6640 1 -- 172.21.15.37:0/1498632233 shutdown_connections 2023-12-19T16:06:52.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.603+0000 7f62faeb6640 1 -- 172.21.15.37:0/1498632233 wait complete. 2023-12-19T16:06:52.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.604+0000 7f62faeb6640 1 Processor -- start 2023-12-19T16:06:52.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.604+0000 7f62faeb6640 1 -- start start 2023-12-19T16:06:52.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.605+0000 7f62faeb6640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f62f40b9570 0x7f62f41e1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:52.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.605+0000 7f62faeb6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62f40baad0 0x7f62f40b7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:52.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.605+0000 7f62faeb6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62f4142d90 0x7f62f40b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:52.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.605+0000 7f62faeb6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40b6350 con 0x7f62f40baad0 2023-12-19T16:06:52.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.605+0000 7f62faeb6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40b53c0 con 0x7f62f4142d90 2023-12-19T16:06:52.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.605+0000 7f62faeb6640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40b7b10 con 0x7f62f40b9570 2023-12-19T16:06:52.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.605+0000 7f62f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62f40baad0 0x7f62f40b7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:52.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.605+0000 7f62f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62f40baad0 0x7f62f40b7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44234/0 (socket says 172.21.15.37:44234) 2023-12-19T16:06:52.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.605+0000 7f62f3fff640 1 -- 172.21.15.37:0/1528522789 learned_addr learned my addr 172.21.15.37:0/1528522789 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:52.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.605+0000 7f62f9453640 1 --2- 172.21.15.37:0/1528522789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62f4142d90 0x7f62f40b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.605+0000 7f62f8c52640 1 --2- 172.21.15.37:0/1528522789 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f62f40b9570 0x7f62f41e1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.605+0000 7f62f3fff640 1 -- 172.21.15.37:0/1528522789 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f62f40b9570 msgr2=0x7f62f41e1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.605+0000 7f62f3fff640 1 --2- 172.21.15.37:0/1528522789 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f62f40b9570 0x7f62f41e1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.605+0000 7f62f3fff640 1 -- 172.21.15.37:0/1528522789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62f4142d90 msgr2=0x7f62f40b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.605+0000 7f62f3fff640 1 --2- 172.21.15.37:0/1528522789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62f4142d90 0x7f62f40b6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.606+0000 7f62f3fff640 1 -- 172.21.15.37:0/1528522789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e8009400 con 0x7f62f40baad0 2023-12-19T16:06:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.606+0000 7f62f8c52640 1 --2- 172.21.15.37:0/1528522789 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f62f40b9570 0x7f62f41e1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:06:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.606+0000 7f62f9453640 1 --2- 172.21.15.37:0/1528522789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62f4142d90 0x7f62f40b6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:06:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.606+0000 7f62f3fff640 1 --2- 172.21.15.37:0/1528522789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62f40baad0 0x7f62f40b7fa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f62e80098c0 tx=0x7f62e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.606+0000 7f62f17fa640 1 -- 172.21.15.37:0/1528522789 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e803b040 con 0x7f62f40baad0 2023-12-19T16:06:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.606+0000 7f62f17fa640 1 -- 172.21.15.37:0/1528522789 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e8004230 con 0x7f62f40baad0 2023-12-19T16:06:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.606+0000 7f62faeb6640 1 -- 172.21.15.37:0/1528522789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f40b77e0 con 0x7f62f40baad0 2023-12-19T16:06:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.606+0000 7f62f17fa640 1 -- 172.21.15.37:0/1528522789 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e8041640 con 0x7f62f40baad0 2023-12-19T16:06:52.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.606+0000 7f62faeb6640 1 -- 172.21.15.37:0/1528522789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f40b73c0 con 0x7f62f40baad0 2023-12-19T16:06:52.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.607+0000 7f62faeb6640 1 -- 172.21.15.37:0/1528522789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f40740a0 con 0x7f62f40baad0 2023-12-19T16:06:52.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.607+0000 7f62f17fa640 1 -- 172.21.15.37:0/1528522789 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f62e80417a0 con 0x7f62f40baad0 2023-12-19T16:06:52.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.608+0000 7f62f17fa640 1 --2- 172.21.15.37:0/1528522789 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f62e006a430 0x7f62e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:52.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.608+0000 7f62f17fa640 1 -- 172.21.15.37:0/1528522789 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f62e80aabb0 con 0x7f62f40baad0 2023-12-19T16:06:52.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.608+0000 7f62f8c52640 1 --2- 172.21.15.37:0/1528522789 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f62e006a430 0x7f62e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:52.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.608+0000 7f62f8c52640 1 --2- 172.21.15.37:0/1528522789 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f62e006a430 0x7f62e006c8f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f62e4001680 tx=0x7f62e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:52.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.612+0000 7f62f17fa640 1 -- 172.21.15.37:0/1528522789 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f62e80766f0 con 0x7f62f40baad0 2023-12-19T16:06:52.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.791+0000 7f62faeb6640 1 -- 172.21.15.37:0/1528522789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62f40b7c50 con 0x7f62f40baad0 2023-12-19T16:06:52.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.791+0000 7f62f17fa640 1 -- 172.21.15.37:0/1528522789 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f62e8048020 con 0x7f62f40baad0 2023-12-19T16:06:52.795 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-19T16:06:52.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.793+0000 7f62faeb6640 1 -- 172.21.15.37:0/1528522789 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f62e006a430 msgr2=0x7f62e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.793+0000 7f62faeb6640 1 --2- 172.21.15.37:0/1528522789 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f62e006a430 0x7f62e006c8f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f62e4001680 tx=0x7f62e4009040 comp rx=0 tx=0).stop 2023-12-19T16:06:52.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.793+0000 7f62faeb6640 1 -- 172.21.15.37:0/1528522789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62f40baad0 msgr2=0x7f62f40b7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.793+0000 7f62faeb6640 1 --2- 172.21.15.37:0/1528522789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62f40baad0 0x7f62f40b7fa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f62e80098c0 tx=0x7f62e80046c0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.793+0000 7f62faeb6640 1 -- 172.21.15.37:0/1528522789 shutdown_connections 2023-12-19T16:06:52.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.793+0000 7f62faeb6640 1 --2- 172.21.15.37:0/1528522789 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f62e006a430 0x7f62e006c8f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.793+0000 7f62faeb6640 1 --2- 172.21.15.37:0/1528522789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62f4142d90 0x7f62f40b6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.793+0000 7f62faeb6640 1 --2- 172.21.15.37:0/1528522789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62f40baad0 0x7f62f40b7fa0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.793+0000 7f62faeb6640 1 --2- 172.21.15.37:0/1528522789 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f62f40b9570 0x7f62f41e1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.793+0000 7f62faeb6640 1 -- 172.21.15.37:0/1528522789 >> 172.21.15.37:0/1528522789 conn(0x7f62f40be0c0 msgr2=0x7f62f413d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:52.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.793+0000 7f62faeb6640 1 -- 172.21.15.37:0/1528522789 shutdown_connections 2023-12-19T16:06:52.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.793+0000 7f62faeb6640 1 -- 172.21.15.37:0/1528522789 wait complete. 2023-12-19T16:06:52.807 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:06:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.910+0000 7f8364c28640 1 Processor -- start 2023-12-19T16:06:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.910+0000 7f8364c28640 1 -- start start 2023-12-19T16:06:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.910+0000 7f8364c28640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83600bcdd0 0x7f83600b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.910+0000 7f8364c28640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f83600b64c0 0x7f8360144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.910+0000 7f8364c28640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83600bc6b0 con 0x7f8360144cd0 2023-12-19T16:06:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.910+0000 7f8364c28640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83600b6900 con 0x7f83600b64c0 2023-12-19T16:06:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.910+0000 7f8364c28640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83600a59f0 con 0x7f83600bcdd0 2023-12-19T16:06:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835ed9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8360144cd0 0x7f836014e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52948/0 (socket says 172.21.15.37:52948) 2023-12-19T16:06:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835ed9d640 1 -- 172.21.15.37:0/596490553 learned_addr learned my addr 172.21.15.37:0/596490553 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:06:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f8355d9b640 1 --2- 172.21.15.37:0/596490553 >> v2:172.21.15.78:3300/0 conn(0x7f83600b64c0 0x7f8360144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835e59c640 1 --2- 172.21.15.37:0/596490553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83600bcdd0 0x7f83600b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835dd9b640 1 -- 172.21.15.37:0/596490553 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887978530 0 0) 0x7f83600bc6b0 con 0x7f8360144cd0 2023-12-19T16:06:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835dd9b640 1 -- 172.21.15.37:0/596490553 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f834c003520 con 0x7f8360144cd0 2023-12-19T16:06:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835dd9b640 1 -- 172.21.15.37:0/596490553 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2071525508 0 0) 0x7f834c003520 con 0x7f8360144cd0 2023-12-19T16:06:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835dd9b640 1 -- 172.21.15.37:0/596490553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83600bcdd0 msgr2=0x7f83600b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835dd9b640 1 --2- 172.21.15.37:0/596490553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83600bcdd0 0x7f83600b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835dd9b640 1 -- 172.21.15.37:0/596490553 >> v2:172.21.15.78:3300/0 conn(0x7f83600b64c0 msgr2=0x7f8360144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835dd9b640 1 --2- 172.21.15.37:0/596490553 >> v2:172.21.15.78:3300/0 conn(0x7f83600b64c0 0x7f8360144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835dd9b640 1 -- 172.21.15.37:0/596490553 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83600bc0a0 con 0x7f8360144cd0 2023-12-19T16:06:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835dd9b640 1 -- 172.21.15.37:0/596490553 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f83580019f0 con 0x7f8360144cd0 2023-12-19T16:06:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835dd9b640 1 -- 172.21.15.37:0/596490553 >> v1:172.21.15.37:6789/0 conn(0x7f8360144cd0 legacy=0x7f836014e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835dd9b640 1 --2- 172.21.15.37:0/596490553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83600bcdd0 0x7f834c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835dd9b640 1 --2- 172.21.15.37:0/596490553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f834c003ef0 0x7f834c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835dd9b640 1 --2- 172.21.15.37:0/596490553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f834c004d00 0x7f834c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835dd9b640 1 -- 172.21.15.37:0/596490553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83600b6900 con 0x7f834c003ef0 2023-12-19T16:06:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835dd9b640 1 -- 172.21.15.37:0/596490553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83600a59f0 con 0x7f834c004d00 2023-12-19T16:06:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835dd9b640 1 -- 172.21.15.37:0/596490553 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834c00b9b0 con 0x7f83600bcdd0 2023-12-19T16:06:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f8355d9b640 1 --2- 172.21.15.37:0/596490553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f834c003ef0 0x7f834c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835e59c640 1 --2- 172.21.15.37:0/596490553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83600bcdd0 0x7f834c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.911+0000 7f835ed9d640 1 --2- 172.21.15.37:0/596490553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f834c004d00 0x7f834c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.912+0000 7f8355d9b640 1 -- 172.21.15.37:0/596490553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83600bcdd0 msgr2=0x7f834c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.912+0000 7f8355d9b640 1 --2- 172.21.15.37:0/596490553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83600bcdd0 0x7f834c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.912+0000 7f8355d9b640 1 -- 172.21.15.37:0/596490553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f834c004d00 msgr2=0x7f834c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.912+0000 7f8355d9b640 1 --2- 172.21.15.37:0/596490553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f834c004d00 0x7f834c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.912+0000 7f8355d9b640 1 -- 172.21.15.37:0/596490553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c003520 con 0x7f834c003ef0 2023-12-19T16:06:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.912+0000 7f835e59c640 1 --2- 172.21.15.37:0/596490553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83600bcdd0 0x7f834c003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:06:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.912+0000 7f8355d9b640 1 --2- 172.21.15.37:0/596490553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f834c003ef0 0x7f834c0047c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8348009ac0 tx=0x7f834c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f9aa97ca788202 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:52.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.912+0000 7f835dd9b640 1 -- 172.21.15.37:0/596490553 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834802c710 con 0x7f834c003ef0 2023-12-19T16:06:52.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.912+0000 7f835dd9b640 1 -- 172.21.15.37:0/596490553 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834802c870 con 0x7f834c003ef0 2023-12-19T16:06:52.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.912+0000 7f835dd9b640 1 -- 172.21.15.37:0/596490553 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834802cc00 con 0x7f834c003ef0 2023-12-19T16:06:52.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.913+0000 7f8364c28640 1 -- 172.21.15.37:0/596490553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f834c003ef0 msgr2=0x7f834c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.913+0000 7f8364c28640 1 --2- 172.21.15.37:0/596490553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f834c003ef0 0x7f834c0047c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8348009ac0 tx=0x7f834c0057f0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.913+0000 7f835ed9d640 1 -- 172.21.15.37:0/596490553 reap_dead start 2023-12-19T16:06:52.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.913+0000 7f8364c28640 1 -- 172.21.15.37:0/596490553 shutdown_connections 2023-12-19T16:06:52.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.913+0000 7f8364c28640 1 -- 172.21.15.37:0/596490553 >> 172.21.15.37:0/596490553 conn(0x7f8360071e60 msgr2=0x7f83600c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:52.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.913+0000 7f8364c28640 1 -- 172.21.15.37:0/596490553 shutdown_connections 2023-12-19T16:06:52.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.913+0000 7f8364c28640 1 -- 172.21.15.37:0/596490553 wait complete. 2023-12-19T16:06:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.914+0000 7f8364c28640 1 Processor -- start 2023-12-19T16:06:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.914+0000 7f8364c28640 1 -- start start 2023-12-19T16:06:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.915+0000 7f8364c28640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f834c003ef0 0x7f83601d41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.915+0000 7f8364c28640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83600bfca0 0x7f83601e31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.915+0000 7f8364c28640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83601e3700 0x7f836013e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.915+0000 7f8364c28640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83601d46f0 con 0x7f834c003ef0 2023-12-19T16:06:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.915+0000 7f8364c28640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83601469d0 con 0x7f83600bfca0 2023-12-19T16:06:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.915+0000 7f8364c28640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83601e3b80 con 0x7f83601e3700 2023-12-19T16:06:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.915+0000 7f835e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f834c003ef0 0x7f83601d41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.915+0000 7f835e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f834c003ef0 0x7f83601d41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44246/0 (socket says 172.21.15.37:44246) 2023-12-19T16:06:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.915+0000 7f835e59c640 1 -- 172.21.15.37:0/4246783481 learned_addr learned my addr 172.21.15.37:0/4246783481 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.915+0000 7f8355d9b640 1 --2- 172.21.15.37:0/4246783481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83600bfca0 0x7f83601e31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.915+0000 7f835e59c640 1 -- 172.21.15.37:0/4246783481 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83601e3700 msgr2=0x7f836013e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.915+0000 7f835ed9d640 1 --2- 172.21.15.37:0/4246783481 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83601e3700 0x7f836013e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.915+0000 7f835e59c640 1 --2- 172.21.15.37:0/4246783481 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83601e3700 0x7f836013e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.916+0000 7f835e59c640 1 -- 172.21.15.37:0/4246783481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83600bfca0 msgr2=0x7f83601e31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.916+0000 7f835e59c640 1 --2- 172.21.15.37:0/4246783481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83600bfca0 0x7f83601e31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.916+0000 7f835e59c640 1 -- 172.21.15.37:0/4246783481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8360145590 con 0x7f834c003ef0 2023-12-19T16:06:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.916+0000 7f8355d9b640 1 --2- 172.21.15.37:0/4246783481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83600bfca0 0x7f83601e31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:06:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.916+0000 7f835e59c640 1 --2- 172.21.15.37:0/4246783481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f834c003ef0 0x7f83601d41b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8350011ca0 tx=0x7f835000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.916+0000 7f83577fe640 1 -- 172.21.15.37:0/4246783481 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835000fd20 con 0x7f834c003ef0 2023-12-19T16:06:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.916+0000 7f83577fe640 1 -- 172.21.15.37:0/4246783481 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835000fe80 con 0x7f834c003ef0 2023-12-19T16:06:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.916+0000 7f8364c28640 1 -- 172.21.15.37:0/4246783481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8360145870 con 0x7f834c003ef0 2023-12-19T16:06:52.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.916+0000 7f83577fe640 1 -- 172.21.15.37:0/4246783481 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8350014680 con 0x7f834c003ef0 2023-12-19T16:06:52.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.916+0000 7f8364c28640 1 -- 172.21.15.37:0/4246783481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8360145b50 con 0x7f834c003ef0 2023-12-19T16:06:52.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.917+0000 7f8364c28640 1 -- 172.21.15.37:0/4246783481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83601453f0 con 0x7f834c003ef0 2023-12-19T16:06:52.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.917+0000 7f83577fe640 1 -- 172.21.15.37:0/4246783481 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f83500147e0 con 0x7f834c003ef0 2023-12-19T16:06:52.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.918+0000 7f83577fe640 1 --2- 172.21.15.37:0/4246783481 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f834006a430 0x7f834006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:52.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.918+0000 7f83577fe640 1 -- 172.21.15.37:0/4246783481 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8350088fb0 con 0x7f834c003ef0 2023-12-19T16:06:52.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.918+0000 7f8355d9b640 1 --2- 172.21.15.37:0/4246783481 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f834006a430 0x7f834006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:52.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.918+0000 7f8355d9b640 1 --2- 172.21.15.37:0/4246783481 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f834006a430 0x7f834006c8f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8348036000 tx=0x7f8348030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:52.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:52.922+0000 7f83577fe640 1 -- 172.21.15.37:0/4246783481 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f83601453f0 con 0x7f834c003ef0 2023-12-19T16:06:53.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:53.134+0000 7f8364c28640 1 -- 172.21.15.37:0/4246783481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83601453f0 con 0x7f834c003ef0 2023-12-19T16:06:53.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:53.134+0000 7f83577fe640 1 -- 172.21.15.37:0/4246783481 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f83601453f0 con 0x7f834c003ef0 2023-12-19T16:06:53.137 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:53.138 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4079311036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4079311036},{"type":"v1","addr":"172.21.15.37:6834","nonce":4079311036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-12-19T16:06:53.138 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 2 2023-12-19T16:06:53.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:53.136+0000 7f8364c28640 1 -- 172.21.15.37:0/4246783481 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f834006a430 msgr2=0x7f834006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:53.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:53.136+0000 7f8364c28640 1 --2- 172.21.15.37:0/4246783481 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f834006a430 0x7f834006c8f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8348036000 tx=0x7f8348030000 comp rx=0 tx=0).stop 2023-12-19T16:06:53.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:53.136+0000 7f8364c28640 1 -- 172.21.15.37:0/4246783481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f834c003ef0 msgr2=0x7f83601d41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:53.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:53.136+0000 7f8364c28640 1 --2- 172.21.15.37:0/4246783481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f834c003ef0 0x7f83601d41b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8350011ca0 tx=0x7f835000f610 comp rx=0 tx=0).stop 2023-12-19T16:06:53.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:53.136+0000 7f8364c28640 1 -- 172.21.15.37:0/4246783481 shutdown_connections 2023-12-19T16:06:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:53.136+0000 7f8364c28640 1 --2- 172.21.15.37:0/4246783481 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f834006a430 0x7f834006c8f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:53.136+0000 7f8364c28640 1 --2- 172.21.15.37:0/4246783481 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f83601e3700 0x7f836013e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:53.136+0000 7f8364c28640 1 --2- 172.21.15.37:0/4246783481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83600bfca0 0x7f83601e31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:53.136+0000 7f8364c28640 1 --2- 172.21.15.37:0/4246783481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f834c003ef0 0x7f83601d41b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:53.136+0000 7f8364c28640 1 -- 172.21.15.37:0/4246783481 >> 172.21.15.37:0/4246783481 conn(0x7f8360071e60 msgr2=0x7f83600b90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:53.136+0000 7f8364c28640 1 -- 172.21.15.37:0/4246783481 shutdown_connections 2023-12-19T16:06:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:53.136+0000 7f8364c28640 1 -- 172.21.15.37:0/4246783481 wait complete. 2023-12-19T16:06:55.150 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:06:55.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.265+0000 7f90f6afb640 1 Processor -- start 2023-12-19T16:06:55.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.265+0000 7f90f6afb640 1 -- start start 2023-12-19T16:06:55.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.266+0000 7f90f6afb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f90f00bcdd0 0x7f90f00b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:55.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.266+0000 7f90f6afb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90f0144ea0 0x7f90f0155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:55.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.266+0000 7f90f6afb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f00bc6b0 con 0x7f90f00b64c0 2023-12-19T16:06:55.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.266+0000 7f90f6afb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f00b6900 con 0x7f90f0144ea0 2023-12-19T16:06:55.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.266+0000 7f90f6afb640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00a59f0 con 0x7f90f00bcdd0 2023-12-19T16:06:55.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.266+0000 7f90f5098640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90f0144ea0 0x7f90f0155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:55.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.266+0000 7f90f5098640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90f0144ea0 0x7f90f0155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44250/0 (socket says 172.21.15.37:44250) 2023-12-19T16:06:55.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.266+0000 7f90f5098640 1 -- 172.21.15.37:0/4171957527 learned_addr learned my addr 172.21.15.37:0/4171957527 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:55.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.266+0000 7f90f4897640 1 --2- 172.21.15.37:0/4171957527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f90f00bcdd0 0x7f90f00b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:55.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.267+0000 7f90f5098640 1 -- 172.21.15.37:0/4171957527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f90f00bcdd0 msgr2=0x7f90f00b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:55.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.267+0000 7f90f5098640 1 --2- 172.21.15.37:0/4171957527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f90f00bcdd0 0x7f90f00b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.267+0000 7f90f5098640 1 -- 172.21.15.37:0/4171957527 >> v1:172.21.15.78:6789/0 conn(0x7f90f00b64c0 legacy=0x7f90f0144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:55.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.267+0000 7f90f5098640 1 -- 172.21.15.37:0/4171957527 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f00bc0a0 con 0x7f90f0144ea0 2023-12-19T16:06:55.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.267+0000 7f90f5098640 1 --2- 172.21.15.37:0/4171957527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f0144ea0 0x7f90f0155340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009e50 tx=0x7f90e802bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b0cd075c08e54e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:55.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.267+0000 7f90ef7fe640 1 -- 172.21.15.37:0/4171957527 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e802cb90 con 0x7f90f0144ea0 2023-12-19T16:06:55.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.268+0000 7f90ef7fe640 1 -- 172.21.15.37:0/4171957527 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e802ccf0 con 0x7f90f0144ea0 2023-12-19T16:06:55.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.268+0000 7f90ef7fe640 1 -- 172.21.15.37:0/4171957527 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e8034610 con 0x7f90f0144ea0 2023-12-19T16:06:55.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.268+0000 7f90f6afb640 1 -- 172.21.15.37:0/4171957527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f0144ea0 msgr2=0x7f90f0155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:55.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.268+0000 7f90f6afb640 1 --2- 172.21.15.37:0/4171957527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f0144ea0 0x7f90f0155340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009e50 tx=0x7f90e802bff0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.268+0000 7f90f6afb640 1 -- 172.21.15.37:0/4171957527 shutdown_connections 2023-12-19T16:06:55.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.268+0000 7f90f6afb640 1 --2- 172.21.15.37:0/4171957527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f0144ea0 0x7f90f0155340 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.268+0000 7f90f6afb640 1 --2- 172.21.15.37:0/4171957527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f90f00bcdd0 0x7f90f00b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.268+0000 7f90f6afb640 1 -- 172.21.15.37:0/4171957527 >> 172.21.15.37:0/4171957527 conn(0x7f90f0071e60 msgr2=0x7f90f00c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:55.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.268+0000 7f90f6afb640 1 -- 172.21.15.37:0/4171957527 shutdown_connections 2023-12-19T16:06:55.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.268+0000 7f90f6afb640 1 -- 172.21.15.37:0/4171957527 wait complete. 2023-12-19T16:06:55.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.269+0000 7f90f6afb640 1 Processor -- start 2023-12-19T16:06:55.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.269+0000 7f90f6afb640 1 -- start start 2023-12-19T16:06:55.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.270+0000 7f90f6afb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f00b64c0 0x7f90f01e2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:55.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.270+0000 7f90f6afb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90f00bcdd0 0x7f90f014a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:55.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.270+0000 7f90f6afb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f90f0144ea0 0x7f90f0147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:55.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.270+0000 7f90f6afb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f0147d70 con 0x7f90f00b64c0 2023-12-19T16:06:55.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.270+0000 7f90f6afb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f014a530 con 0x7f90f00bcdd0 2023-12-19T16:06:55.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.270+0000 7f90f6afb640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f009a0a0 con 0x7f90f0144ea0 2023-12-19T16:06:55.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.270+0000 7f90f4897640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f00b64c0 0x7f90f01e2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:55.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.270+0000 7f90f4897640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f00b64c0 0x7f90f01e2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44264/0 (socket says 172.21.15.37:44264) 2023-12-19T16:06:55.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.270+0000 7f90f4897640 1 -- 172.21.15.37:0/2851829202 learned_addr learned my addr 172.21.15.37:0/2851829202 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:55.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.270+0000 7f90effff640 1 --2- 172.21.15.37:0/2851829202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90f00bcdd0 0x7f90f014a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:55.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.270+0000 7f90f5098640 1 --2- 172.21.15.37:0/2851829202 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f90f0144ea0 0x7f90f0147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:55.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.271+0000 7f90f4897640 1 -- 172.21.15.37:0/2851829202 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f90f0144ea0 msgr2=0x7f90f0147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:55.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.271+0000 7f90f4897640 1 --2- 172.21.15.37:0/2851829202 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f90f0144ea0 0x7f90f0147830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.271+0000 7f90f4897640 1 -- 172.21.15.37:0/2851829202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90f00bcdd0 msgr2=0x7f90f014a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:55.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.271+0000 7f90f4897640 1 --2- 172.21.15.37:0/2851829202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90f00bcdd0 0x7f90f014a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.271+0000 7f90f4897640 1 -- 172.21.15.37:0/2851829202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e8009b30 con 0x7f90f00b64c0 2023-12-19T16:06:55.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.271+0000 7f90f4897640 1 --2- 172.21.15.37:0/2851829202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f00b64c0 0x7f90f01e2e90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f90e000e9b0 tx=0x7f90e000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:55.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.271+0000 7f90ed7fa640 1 -- 172.21.15.37:0/2851829202 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e0009670 con 0x7f90f00b64c0 2023-12-19T16:06:55.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.271+0000 7f90ed7fa640 1 -- 172.21.15.37:0/2851829202 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e000c9a0 con 0x7f90f00b64c0 2023-12-19T16:06:55.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.271+0000 7f90f6afb640 1 -- 172.21.15.37:0/2851829202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f0099ae0 con 0x7f90f00b64c0 2023-12-19T16:06:55.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.271+0000 7f90ed7fa640 1 -- 172.21.15.37:0/2851829202 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e000cd50 con 0x7f90f00b64c0 2023-12-19T16:06:55.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.271+0000 7f90f6afb640 1 -- 172.21.15.37:0/2851829202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f0099450 con 0x7f90f00b64c0 2023-12-19T16:06:55.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.272+0000 7f90f6afb640 1 -- 172.21.15.37:0/2851829202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f014a320 con 0x7f90f00b64c0 2023-12-19T16:06:55.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.273+0000 7f90ed7fa640 1 -- 172.21.15.37:0/2851829202 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f90e0013470 con 0x7f90f00b64c0 2023-12-19T16:06:55.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.273+0000 7f90ed7fa640 1 --2- 172.21.15.37:0/2851829202 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f90dc06a430 0x7f90dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:55.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.273+0000 7f90ed7fa640 1 -- 172.21.15.37:0/2851829202 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f90e0088a30 con 0x7f90f00b64c0 2023-12-19T16:06:55.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.273+0000 7f90effff640 1 --2- 172.21.15.37:0/2851829202 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f90dc06a430 0x7f90dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:55.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.274+0000 7f90effff640 1 --2- 172.21.15.37:0/2851829202 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f90dc06a430 0x7f90dc06c8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f90f00bab70 tx=0x7f90e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:55.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.278+0000 7f90ed7fa640 1 -- 172.21.15.37:0/2851829202 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f90e0054420 con 0x7f90f00b64c0 2023-12-19T16:06:55.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.488+0000 7f90f6afb640 1 -- 172.21.15.37:0/2851829202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90f004e840 con 0x7f90f00b64c0 2023-12-19T16:06:55.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.489+0000 7f90ed7fa640 1 -- 172.21.15.37:0/2851829202 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2768 (secure 0 0 0) 0x7f90e0017ae0 con 0x7f90f00b64c0 2023-12-19T16:06:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:55.492 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4079311036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4079311036},{"type":"v1","addr":"172.21.15.37:6834","nonce":4079311036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1300485428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1300485428},{"type":"v1","addr":"172.21.15.37:6835","nonce":1300485428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3319636422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3319636422},{"type":"v1","addr":"172.21.15.78:6835","nonce":3319636422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-19T16:06:55.492 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 3 2023-12-19T16:06:55.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.491+0000 7f90f6afb640 1 -- 172.21.15.37:0/2851829202 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f90dc06a430 msgr2=0x7f90dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:55.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.491+0000 7f90f6afb640 1 --2- 172.21.15.37:0/2851829202 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f90dc06a430 0x7f90dc06c8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f90f00bab70 tx=0x7f90e4009040 comp rx=0 tx=0).stop 2023-12-19T16:06:55.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.491+0000 7f90f6afb640 1 -- 172.21.15.37:0/2851829202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f00b64c0 msgr2=0x7f90f01e2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:55.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.491+0000 7f90f6afb640 1 --2- 172.21.15.37:0/2851829202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f00b64c0 0x7f90f01e2e90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f90e000e9b0 tx=0x7f90e000ee70 comp rx=0 tx=0).stop 2023-12-19T16:06:55.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.491+0000 7f90f6afb640 1 -- 172.21.15.37:0/2851829202 shutdown_connections 2023-12-19T16:06:55.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.491+0000 7f90f6afb640 1 --2- 172.21.15.37:0/2851829202 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f90dc06a430 0x7f90dc06c8f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.491+0000 7f90f6afb640 1 --2- 172.21.15.37:0/2851829202 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f90f0144ea0 0x7f90f0147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.491+0000 7f90f6afb640 1 --2- 172.21.15.37:0/2851829202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90f00bcdd0 0x7f90f014a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.491+0000 7f90f6afb640 1 --2- 172.21.15.37:0/2851829202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90f00b64c0 0x7f90f01e2e90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.491+0000 7f90f6afb640 1 -- 172.21.15.37:0/2851829202 >> 172.21.15.37:0/2851829202 conn(0x7f90f0071e60 msgr2=0x7f90f00b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.491+0000 7f90f6afb640 1 -- 172.21.15.37:0/2851829202 shutdown_connections 2023-12-19T16:06:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.491+0000 7f90f6afb640 1 -- 172.21.15.37:0/2851829202 wait complete. 2023-12-19T16:06:55.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:06:55.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.608+0000 7f139c9f0640 1 Processor -- start 2023-12-19T16:06:55.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.608+0000 7f139c9f0640 1 -- start start 2023-12-19T16:06:55.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.608+0000 7f139c9f0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13980bcdd0 0x7f13980b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:55.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.609+0000 7f139c9f0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13980b64c0 0x7f1398144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:55.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.609+0000 7f139c9f0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1398144cd0 0x7f139814e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:55.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.609+0000 7f139c9f0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13980bc6b0 con 0x7f13980bcdd0 2023-12-19T16:06:55.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.609+0000 7f139c9f0640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13980b6900 con 0x7f1398144cd0 2023-12-19T16:06:55.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.609+0000 7f139c9f0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13980a59f0 con 0x7f13980b64c0 2023-12-19T16:06:55.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.609+0000 7f139659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13980bcdd0 0x7f13980b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:55.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.609+0000 7f139659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13980bcdd0 0x7f13980b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44278/0 (socket says 172.21.15.37:44278) 2023-12-19T16:06:55.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.609+0000 7f139659c640 1 -- 172.21.15.37:0/1236565437 learned_addr learned my addr 172.21.15.37:0/1236565437 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:55.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.609+0000 7f138ffff640 1 --2- 172.21.15.37:0/1236565437 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13980b64c0 0x7f1398144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:55.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.609+0000 7f1396d9d640 1 --2- 172.21.15.37:0/1236565437 >> v2:172.21.15.78:3300/0 conn(0x7f1398144cd0 0x7f139814e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:55.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.609+0000 7f139659c640 1 -- 172.21.15.37:0/1236565437 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13980b64c0 msgr2=0x7f1398144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:55.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.609+0000 7f139659c640 1 --2- 172.21.15.37:0/1236565437 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13980b64c0 0x7f1398144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.609+0000 7f139659c640 1 -- 172.21.15.37:0/1236565437 >> v2:172.21.15.78:3300/0 conn(0x7f1398144cd0 msgr2=0x7f139814e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:55.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.609+0000 7f139659c640 1 --2- 172.21.15.37:0/1236565437 >> v2:172.21.15.78:3300/0 conn(0x7f1398144cd0 0x7f139814e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.609+0000 7f139659c640 1 -- 172.21.15.37:0/1236565437 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13980bc0a0 con 0x7f13980bcdd0 2023-12-19T16:06:55.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.609+0000 7f1396d9d640 1 --2- 172.21.15.37:0/1236565437 >> v2:172.21.15.78:3300/0 conn(0x7f1398144cd0 0x7f139814e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:06:55.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.610+0000 7f139659c640 1 --2- 172.21.15.37:0/1236565437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13980bcdd0 0x7f13980b5f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f13981486d0 tx=0x7f138802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f602cd480bdefd4b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:55.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.610+0000 7f1395d9b640 1 -- 172.21.15.37:0/1236565437 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388030860 con 0x7f13980bcdd0 2023-12-19T16:06:55.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.610+0000 7f1395d9b640 1 -- 172.21.15.37:0/1236565437 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13880309c0 con 0x7f13980bcdd0 2023-12-19T16:06:55.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.610+0000 7f1395d9b640 1 -- 172.21.15.37:0/1236565437 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388030d50 con 0x7f13980bcdd0 2023-12-19T16:06:55.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.610+0000 7f139c9f0640 1 -- 172.21.15.37:0/1236565437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13980bcdd0 msgr2=0x7f13980b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:55.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.610+0000 7f139c9f0640 1 --2- 172.21.15.37:0/1236565437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13980bcdd0 0x7f13980b5f80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f13981486d0 tx=0x7f138802b9a0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.610+0000 7f139c9f0640 1 -- 172.21.15.37:0/1236565437 shutdown_connections 2023-12-19T16:06:55.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.610+0000 7f139c9f0640 1 --2- 172.21.15.37:0/1236565437 >> v2:172.21.15.78:3300/0 conn(0x7f1398144cd0 0x7f139814e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.610+0000 7f139c9f0640 1 --2- 172.21.15.37:0/1236565437 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13980b64c0 0x7f1398144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.610+0000 7f139c9f0640 1 --2- 172.21.15.37:0/1236565437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13980bcdd0 0x7f13980b5f80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.610+0000 7f139c9f0640 1 -- 172.21.15.37:0/1236565437 >> 172.21.15.37:0/1236565437 conn(0x7f1398071e60 msgr2=0x7f13980c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:55.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.611+0000 7f139c9f0640 1 -- 172.21.15.37:0/1236565437 shutdown_connections 2023-12-19T16:06:55.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.611+0000 7f139c9f0640 1 -- 172.21.15.37:0/1236565437 wait complete. 2023-12-19T16:06:55.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.612+0000 7f139c9f0640 1 Processor -- start 2023-12-19T16:06:55.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.612+0000 7f139c9f0640 1 -- start start 2023-12-19T16:06:55.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.612+0000 7f139c9f0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13980b64c0 0x7f139813e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:55.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.612+0000 7f139c9f0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13980bcdd0 0x7f13981d3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:55.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.612+0000 7f139c9f0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1398144cd0 0x7f139813b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:55.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.612+0000 7f139c9f0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139813e8f0 con 0x7f13980b64c0 2023-12-19T16:06:55.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.612+0000 7f139c9f0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13981e3010 con 0x7f1398144cd0 2023-12-19T16:06:55.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.612+0000 7f139c9f0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13981d39e0 con 0x7f13980bcdd0 2023-12-19T16:06:55.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.612+0000 7f139659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13980b64c0 0x7f139813e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:55.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.612+0000 7f139659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13980b64c0 0x7f139813e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44290/0 (socket says 172.21.15.37:44290) 2023-12-19T16:06:55.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.612+0000 7f139659c640 1 -- 172.21.15.37:0/1324477448 learned_addr learned my addr 172.21.15.37:0/1324477448 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:55.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.613+0000 7f138ffff640 1 --2- 172.21.15.37:0/1324477448 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13980bcdd0 0x7f13981d3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:55.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.613+0000 7f1396d9d640 1 --2- 172.21.15.37:0/1324477448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1398144cd0 0x7f139813b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:55.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.613+0000 7f139659c640 1 -- 172.21.15.37:0/1324477448 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13980bcdd0 msgr2=0x7f13981d3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:55.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.613+0000 7f139659c640 1 --2- 172.21.15.37:0/1324477448 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13980bcdd0 0x7f13981d3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.613+0000 7f139659c640 1 -- 172.21.15.37:0/1324477448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1398144cd0 msgr2=0x7f139813b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:55.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.613+0000 7f139659c640 1 --2- 172.21.15.37:0/1324477448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1398144cd0 0x7f139813b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.613+0000 7f139659c640 1 -- 172.21.15.37:0/1324477448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13880094d0 con 0x7f13980b64c0 2023-12-19T16:06:55.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.613+0000 7f139659c640 1 --2- 172.21.15.37:0/1324477448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13980b64c0 0x7f139813e3b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1388000c00 tx=0x7f1388004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:55.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.613+0000 7f138effd640 1 -- 172.21.15.37:0/1324477448 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388039c90 con 0x7f13980b64c0 2023-12-19T16:06:55.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.613+0000 7f138effd640 1 -- 172.21.15.37:0/1324477448 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1388039df0 con 0x7f13980b64c0 2023-12-19T16:06:55.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.613+0000 7f139c9f0640 1 -- 172.21.15.37:0/1324477448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13980bf8d0 con 0x7f13980b64c0 2023-12-19T16:06:55.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.613+0000 7f138effd640 1 -- 172.21.15.37:0/1324477448 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388043640 con 0x7f13980b64c0 2023-12-19T16:06:55.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.613+0000 7f139c9f0640 1 -- 172.21.15.37:0/1324477448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13980bfe90 con 0x7f13980b64c0 2023-12-19T16:06:55.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.614+0000 7f139c9f0640 1 -- 172.21.15.37:0/1324477448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13981d3be0 con 0x7f13980b64c0 2023-12-19T16:06:55.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.615+0000 7f138effd640 1 -- 172.21.15.37:0/1324477448 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f13880437a0 con 0x7f13980b64c0 2023-12-19T16:06:55.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.615+0000 7f138effd640 1 --2- 172.21.15.37:0/1324477448 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f137806a430 0x7f137806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:55.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.615+0000 7f138effd640 1 -- 172.21.15.37:0/1324477448 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f138803e070 con 0x7f13980b64c0 2023-12-19T16:06:55.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.615+0000 7f138ffff640 1 --2- 172.21.15.37:0/1324477448 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f137806a430 0x7f137806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:55.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.616+0000 7f138ffff640 1 --2- 172.21.15.37:0/1324477448 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f137806a430 0x7f137806c8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f13980bf2f0 tx=0x7f1380009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:55.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.619+0000 7f138effd640 1 -- 172.21.15.37:0/1324477448 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1388076fe0 con 0x7f13980b64c0 2023-12-19T16:06:55.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.796+0000 7f139c9f0640 1 -- 172.21.15.37:0/1324477448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f139804e840 con 0x7f13980b64c0 2023-12-19T16:06:55.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.797+0000 7f138effd640 1 -- 172.21.15.37:0/1324477448 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12334 (secure 0 0 0) 0x7f138807a600 con 0x7f13980b64c0 2023-12-19T16:06:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:55.800 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:48.709852+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:06:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.799+0000 7f139c9f0640 1 -- 172.21.15.37:0/1324477448 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f137806a430 msgr2=0x7f137806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.799+0000 7f139c9f0640 1 --2- 172.21.15.37:0/1324477448 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f137806a430 0x7f137806c8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f13980bf2f0 tx=0x7f1380009190 comp rx=0 tx=0).stop 2023-12-19T16:06:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.799+0000 7f139c9f0640 1 -- 172.21.15.37:0/1324477448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13980b64c0 msgr2=0x7f139813e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.799+0000 7f139c9f0640 1 --2- 172.21.15.37:0/1324477448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13980b64c0 0x7f139813e3b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1388000c00 tx=0x7f1388004730 comp rx=0 tx=0).stop 2023-12-19T16:06:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.799+0000 7f139c9f0640 1 -- 172.21.15.37:0/1324477448 shutdown_connections 2023-12-19T16:06:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.799+0000 7f139c9f0640 1 --2- 172.21.15.37:0/1324477448 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f137806a430 0x7f137806c8f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.799+0000 7f139c9f0640 1 --2- 172.21.15.37:0/1324477448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1398144cd0 0x7f139813b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.799+0000 7f139c9f0640 1 --2- 172.21.15.37:0/1324477448 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13980bcdd0 0x7f13981d3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.799+0000 7f139c9f0640 1 --2- 172.21.15.37:0/1324477448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13980b64c0 0x7f139813e3b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.799+0000 7f139c9f0640 1 -- 172.21.15.37:0/1324477448 >> 172.21.15.37:0/1324477448 conn(0x7f1398071e60 msgr2=0x7f13980b8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.799+0000 7f139c9f0640 1 -- 172.21.15.37:0/1324477448 shutdown_connections 2023-12-19T16:06:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.799+0000 7f139c9f0640 1 -- 172.21.15.37:0/1324477448 wait complete. 2023-12-19T16:06:55.812 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:06:46.684027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:06:55.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:06:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.918+0000 7f33f94a1640 1 Processor -- start 2023-12-19T16:06:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.918+0000 7f33f94a1640 1 -- start start 2023-12-19T16:06:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.919+0000 7f33f94a1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f33f40bf510 0x7f33f40be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.919+0000 7f33f94a1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f40bfa50 con 0x7f33f406a950 2023-12-19T16:06:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.919+0000 7f33f94a1640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f406b040 con 0x7f33f40bb140 2023-12-19T16:06:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.919+0000 7f33f94a1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f40bbda0 con 0x7f33f40bf510 2023-12-19T16:06:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.919+0000 7f33f27fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f33f40bf510 0x7f33f40be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.919+0000 7f33f37fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f33f406a950 0x7f33f4155500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52964/0 (socket says 172.21.15.37:52964) 2023-12-19T16:06:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.919+0000 7f33f37fe640 1 -- 172.21.15.37:0/1002602236 learned_addr learned my addr 172.21.15.37:0/1002602236 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:06:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.919+0000 7f33f27fc640 1 -- 172.21.15.37:0/1002602236 >> v1:172.21.15.78:6789/0 conn(0x7f33f40bb140 legacy=0x7f33f40bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.919+0000 7f33f27fc640 1 -- 172.21.15.37:0/1002602236 >> v1:172.21.15.37:6789/0 conn(0x7f33f406a950 legacy=0x7f33f4155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.919+0000 7f33f1ffb640 1 -- 172.21.15.37:0/1002602236 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165508438 0 0) 0x7f33f40bfa50 con 0x7f33f406a950 2023-12-19T16:06:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.919+0000 7f33f27fc640 1 -- 172.21.15.37:0/1002602236 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f40bb520 con 0x7f33f40bf510 2023-12-19T16:06:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.920+0000 7f33f27fc640 1 --2- 172.21.15.37:0/1002602236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f40bf510 0x7f33f40be350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0097a0 tx=0x7f33dc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc52395a834d928 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.920+0000 7f33f1ffb640 1 -- 172.21.15.37:0/1002602236 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc031830 con 0x7f33f40bf510 2023-12-19T16:06:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.920+0000 7f33f1ffb640 1 -- 172.21.15.37:0/1002602236 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc031990 con 0x7f33f40bf510 2023-12-19T16:06:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.920+0000 7f33f1ffb640 1 -- 172.21.15.37:0/1002602236 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc031d20 con 0x7f33f40bf510 2023-12-19T16:06:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.920+0000 7f33f94a1640 1 -- 172.21.15.37:0/1002602236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f40bf510 msgr2=0x7f33f40be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.920+0000 7f33f94a1640 1 --2- 172.21.15.37:0/1002602236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f40bf510 0x7f33f40be350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0097a0 tx=0x7f33dc02b8d0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.920+0000 7f33f94a1640 1 -- 172.21.15.37:0/1002602236 shutdown_connections 2023-12-19T16:06:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.920+0000 7f33f94a1640 1 --2- 172.21.15.37:0/1002602236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f40bf510 0x7f33f40be350 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.920+0000 7f33f94a1640 1 -- 172.21.15.37:0/1002602236 >> 172.21.15.37:0/1002602236 conn(0x7f33f40bcfd0 msgr2=0x7f33f40bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.921+0000 7f33f94a1640 1 -- 172.21.15.37:0/1002602236 shutdown_connections 2023-12-19T16:06:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.921+0000 7f33f94a1640 1 -- 172.21.15.37:0/1002602236 wait complete. 2023-12-19T16:06:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.922+0000 7f33f94a1640 1 Processor -- start 2023-12-19T16:06:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.922+0000 7f33f94a1640 1 -- start start 2023-12-19T16:06:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.922+0000 7f33f94a1640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33f406a950 0x7f33f41465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.922+0000 7f33f94a1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33f40bb140 0x7f33f414d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.922+0000 7f33f94a1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f40bf510 0x7f33f414dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.922+0000 7f33f94a1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40a2cb0 con 0x7f33f40bf510 2023-12-19T16:06:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.922+0000 7f33f94a1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f4146b30 con 0x7f33f40bb140 2023-12-19T16:06:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.922+0000 7f33f94a1640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f414e9f0 con 0x7f33f406a950 2023-12-19T16:06:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.922+0000 7f33f37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f40bf510 0x7f33f414dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.922+0000 7f33f37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f40bf510 0x7f33f414dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44296/0 (socket says 172.21.15.37:44296) 2023-12-19T16:06:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.922+0000 7f33f37fe640 1 -- 172.21.15.37:0/643009809 learned_addr learned my addr 172.21.15.37:0/643009809 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.923+0000 7f33f2ffd640 1 --2- 172.21.15.37:0/643009809 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33f406a950 0x7f33f41465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.923+0000 7f33f27fc640 1 --2- 172.21.15.37:0/643009809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33f40bb140 0x7f33f414d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.923+0000 7f33f37fe640 1 -- 172.21.15.37:0/643009809 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33f406a950 msgr2=0x7f33f41465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.923+0000 7f33f37fe640 1 --2- 172.21.15.37:0/643009809 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33f406a950 0x7f33f41465f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.923+0000 7f33f37fe640 1 -- 172.21.15.37:0/643009809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33f40bb140 msgr2=0x7f33f414d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.923+0000 7f33f37fe640 1 --2- 172.21.15.37:0/643009809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33f40bb140 0x7f33f414d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.923+0000 7f33f37fe640 1 -- 172.21.15.37:0/643009809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc009400 con 0x7f33f40bf510 2023-12-19T16:06:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.923+0000 7f33f37fe640 1 --2- 172.21.15.37:0/643009809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f40bf510 0x7f33f414dec0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f33ec001eb0 tx=0x7f33ec00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.923+0000 7f33eb7fe640 1 -- 172.21.15.37:0/643009809 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec0074e0 con 0x7f33f40bf510 2023-12-19T16:06:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.923+0000 7f33eb7fe640 1 -- 172.21.15.37:0/643009809 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec007640 con 0x7f33f40bf510 2023-12-19T16:06:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.923+0000 7f33f94a1640 1 -- 172.21.15.37:0/643009809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f40a09d0 con 0x7f33f40bf510 2023-12-19T16:06:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.923+0000 7f33eb7fe640 1 -- 172.21.15.37:0/643009809 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec004a00 con 0x7f33f40bf510 2023-12-19T16:06:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.923+0000 7f33f94a1640 1 -- 172.21.15.37:0/643009809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f40a0660 con 0x7f33f40bf510 2023-12-19T16:06:55.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.924+0000 7f33f94a1640 1 -- 172.21.15.37:0/643009809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f40a0b60 con 0x7f33f40bf510 2023-12-19T16:06:55.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.924+0000 7f33eb7fe640 1 -- 172.21.15.37:0/643009809 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f33ec004b60 con 0x7f33f40bf510 2023-12-19T16:06:55.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.925+0000 7f33eb7fe640 1 --2- 172.21.15.37:0/643009809 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f33d406a430 0x7f33d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:55.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.925+0000 7f33eb7fe640 1 -- 172.21.15.37:0/643009809 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f33ec088480 con 0x7f33f40bf510 2023-12-19T16:06:55.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.925+0000 7f33f2ffd640 1 --2- 172.21.15.37:0/643009809 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f33d406a430 0x7f33d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:55.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.925+0000 7f33f2ffd640 1 --2- 172.21.15.37:0/643009809 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f33d406a430 0x7f33d406c8f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f33e4007fd0 tx=0x7f33e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:55.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:55.929+0000 7f33eb7fe640 1 -- 172.21.15.37:0/643009809 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f33ec053d30 con 0x7f33f40bf510 2023-12-19T16:06:56.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.104+0000 7f33f94a1640 1 -- 172.21.15.37:0/643009809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33f40a3dd0 con 0x7f33f40bf510 2023-12-19T16:06:56.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.104+0000 7f33eb7fe640 1 -- 172.21.15.37:0/643009809 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33ec057350 con 0x7f33f40bf510 2023-12-19T16:06:56.108 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-19T16:06:56.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.106+0000 7f33f94a1640 1 -- 172.21.15.37:0/643009809 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f33d406a430 msgr2=0x7f33d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:56.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.106+0000 7f33f94a1640 1 --2- 172.21.15.37:0/643009809 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f33d406a430 0x7f33d406c8f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f33e4007fd0 tx=0x7f33e4009040 comp rx=0 tx=0).stop 2023-12-19T16:06:56.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.106+0000 7f33f94a1640 1 -- 172.21.15.37:0/643009809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f40bf510 msgr2=0x7f33f414dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:56.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.106+0000 7f33f94a1640 1 --2- 172.21.15.37:0/643009809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f40bf510 0x7f33f414dec0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f33ec001eb0 tx=0x7f33ec00c870 comp rx=0 tx=0).stop 2023-12-19T16:06:56.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.106+0000 7f33f94a1640 1 -- 172.21.15.37:0/643009809 shutdown_connections 2023-12-19T16:06:56.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.106+0000 7f33f94a1640 1 --2- 172.21.15.37:0/643009809 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f33d406a430 0x7f33d406c8f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:56.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.106+0000 7f33f94a1640 1 --2- 172.21.15.37:0/643009809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f40bf510 0x7f33f414dec0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:56.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.106+0000 7f33f94a1640 1 --2- 172.21.15.37:0/643009809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33f40bb140 0x7f33f414d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:56.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.106+0000 7f33f94a1640 1 --2- 172.21.15.37:0/643009809 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33f406a950 0x7f33f41465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:56.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.106+0000 7f33f94a1640 1 -- 172.21.15.37:0/643009809 >> 172.21.15.37:0/643009809 conn(0x7f33f40bcfd0 msgr2=0x7f33f40a36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:56.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.106+0000 7f33f94a1640 1 -- 172.21.15.37:0/643009809 shutdown_connections 2023-12-19T16:06:56.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.106+0000 7f33f94a1640 1 -- 172.21.15.37:0/643009809 wait complete. 2023-12-19T16:06:56.120 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T16:06:56.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.222+0000 7f1fcc8f7640 1 Processor -- start 2023-12-19T16:06:56.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.222+0000 7f1fcc8f7640 1 -- start start 2023-12-19T16:06:56.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.223+0000 7f1fcc8f7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1fc8144e30 0x7f1fc80b7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:56.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.223+0000 7f1fcc8f7640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1fc80b8b40 0x7f1fc8155320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:56.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.223+0000 7f1fcc8f7640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc80b6da0 con 0x7f1fc80bab80 2023-12-19T16:06:56.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.223+0000 7f1fcc8f7640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc80b8090 con 0x7f1fc8144e30 2023-12-19T16:06:56.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.223+0000 7f1fcc8f7640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc814afe0 con 0x7f1fc80b8b40 2023-12-19T16:06:56.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.223+0000 7f1fc659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1fc8144e30 0x7f1fc80b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:56.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.223+0000 7f1fc659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1fc8144e30 0x7f1fc80b7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44300/0 (socket says 172.21.15.37:44300) 2023-12-19T16:06:56.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.223+0000 7f1fc659c640 1 -- 172.21.15.37:0/2444865471 learned_addr learned my addr 172.21.15.37:0/2444865471 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:56.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.223+0000 7f1fc6d9d640 1 --2- 172.21.15.37:0/2444865471 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1fc80b8b40 0x7f1fc8155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:56.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.223+0000 7f1fc659c640 1 -- 172.21.15.37:0/2444865471 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1fc80b8b40 msgr2=0x7f1fc8155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:56.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.223+0000 7f1fc659c640 1 --2- 172.21.15.37:0/2444865471 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1fc80b8b40 0x7f1fc8155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:56.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.223+0000 7f1fc659c640 1 -- 172.21.15.37:0/2444865471 >> v1:172.21.15.78:6789/0 conn(0x7f1fc80bab80 legacy=0x7f1fc814b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:56.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.223+0000 7f1fc659c640 1 -- 172.21.15.37:0/2444865471 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc8145210 con 0x7f1fc8144e30 2023-12-19T16:06:56.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.224+0000 7f1fc659c640 1 --2- 172.21.15.37:0/2444865471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc8144e30 0x7f1fc80b7600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00098a0 tx=0x7f1fc002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76e9dee00ce3053 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:56.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.224+0000 7f1fc559a640 1 -- 172.21.15.37:0/2444865471 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0030840 con 0x7f1fc8144e30 2023-12-19T16:06:56.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.224+0000 7f1fc559a640 1 -- 172.21.15.37:0/2444865471 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc00309a0 con 0x7f1fc8144e30 2023-12-19T16:06:56.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.224+0000 7f1fc559a640 1 -- 172.21.15.37:0/2444865471 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0030d30 con 0x7f1fc8144e30 2023-12-19T16:06:56.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.225+0000 7f1fcc8f7640 1 -- 172.21.15.37:0/2444865471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc8144e30 msgr2=0x7f1fc80b7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:56.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.225+0000 7f1fcc8f7640 1 --2- 172.21.15.37:0/2444865471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc8144e30 0x7f1fc80b7600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00098a0 tx=0x7f1fc002b980 comp rx=0 tx=0).stop 2023-12-19T16:06:56.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.225+0000 7f1fcc8f7640 1 -- 172.21.15.37:0/2444865471 shutdown_connections 2023-12-19T16:06:56.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.225+0000 7f1fcc8f7640 1 --2- 172.21.15.37:0/2444865471 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1fc80b8b40 0x7f1fc8155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:56.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.225+0000 7f1fcc8f7640 1 --2- 172.21.15.37:0/2444865471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc8144e30 0x7f1fc80b7600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:56.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.225+0000 7f1fcc8f7640 1 -- 172.21.15.37:0/2444865471 >> 172.21.15.37:0/2444865471 conn(0x7f1fc80c0200 msgr2=0x7f1fc80c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:56.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.225+0000 7f1fcc8f7640 1 -- 172.21.15.37:0/2444865471 shutdown_connections 2023-12-19T16:06:56.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.225+0000 7f1fcc8f7640 1 -- 172.21.15.37:0/2444865471 wait complete. 2023-12-19T16:06:56.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.226+0000 7f1fcc8f7640 1 Processor -- start 2023-12-19T16:06:56.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.226+0000 7f1fcc8f7640 1 -- start start 2023-12-19T16:06:56.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fcc8f7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc80b8b40 0x7f1fc814d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:56.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fcc8f7640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1fc80bab80 0x7f1fc8147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:56.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fcc8f7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fc8144e30 0x7f1fc80bf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:56.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fcc8f7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc80bf7e0 con 0x7f1fc80b8b40 2023-12-19T16:06:56.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fcc8f7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc81470f0 con 0x7f1fc8144e30 2023-12-19T16:06:56.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fcc8f7640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc81453d0 con 0x7f1fc80bab80 2023-12-19T16:06:56.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fc659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc80b8b40 0x7f1fc814d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:56.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fc659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc80b8b40 0x7f1fc814d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44310/0 (socket says 172.21.15.37:44310) 2023-12-19T16:06:56.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fc659c640 1 -- 172.21.15.37:0/3589842553 learned_addr learned my addr 172.21.15.37:0/3589842553 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:56.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fc5d9b640 1 --2- 172.21.15.37:0/3589842553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1fc80bab80 0x7f1fc8147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:56.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fc6d9d640 1 --2- 172.21.15.37:0/3589842553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fc8144e30 0x7f1fc80bf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:56.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fc659c640 1 -- 172.21.15.37:0/3589842553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1fc80bab80 msgr2=0x7f1fc8147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:56.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fc659c640 1 --2- 172.21.15.37:0/3589842553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1fc80bab80 0x7f1fc8147800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:56.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fc659c640 1 -- 172.21.15.37:0/3589842553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fc8144e30 msgr2=0x7f1fc80bf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:56.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fc659c640 1 --2- 172.21.15.37:0/3589842553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fc8144e30 0x7f1fc80bf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:56.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fc659c640 1 -- 172.21.15.37:0/3589842553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc00094d0 con 0x7f1fc80b8b40 2023-12-19T16:06:56.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fc5d9b640 1 --2- 172.21.15.37:0/3589842553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1fc80bab80 0x7f1fc8147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:06:56.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fc6d9d640 1 --2- 172.21.15.37:0/3589842553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fc8144e30 0x7f1fc80bf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:06:56.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fc659c640 1 --2- 172.21.15.37:0/3589842553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc80b8b40 0x7f1fc814d3a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00098a0 tx=0x7f1fc0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:56.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fbeffd640 1 -- 172.21.15.37:0/3589842553 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0039a90 con 0x7f1fc80b8b40 2023-12-19T16:06:56.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fbeffd640 1 -- 172.21.15.37:0/3589842553 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc0039bf0 con 0x7f1fc80b8b40 2023-12-19T16:06:56.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fcc8f7640 1 -- 172.21.15.37:0/3589842553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc8147320 con 0x7f1fc80b8b40 2023-12-19T16:06:56.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fbeffd640 1 -- 172.21.15.37:0/3589842553 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc00433f0 con 0x7f1fc80b8b40 2023-12-19T16:06:56.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.227+0000 7f1fcc8f7640 1 -- 172.21.15.37:0/3589842553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc8145900 con 0x7f1fc80b8b40 2023-12-19T16:06:56.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.228+0000 7f1fcc8f7640 1 -- 172.21.15.37:0/3589842553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc804e840 con 0x7f1fc80b8b40 2023-12-19T16:06:56.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.229+0000 7f1fbeffd640 1 -- 172.21.15.37:0/3589842553 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1fc004c3b0 con 0x7f1fc80b8b40 2023-12-19T16:06:56.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.229+0000 7f1fbeffd640 1 --2- 172.21.15.37:0/3589842553 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f1fa806a430 0x7f1fa806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:56.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.229+0000 7f1fbeffd640 1 -- 172.21.15.37:0/3589842553 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1fc00aa940 con 0x7f1fc80b8b40 2023-12-19T16:06:56.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.229+0000 7f1fc5d9b640 1 --2- 172.21.15.37:0/3589842553 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f1fa806a430 0x7f1fa806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:56.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.230+0000 7f1fc5d9b640 1 --2- 172.21.15.37:0/3589842553 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f1fa806a430 0x7f1fa806c8f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1fc80b64a0 tx=0x7f1fb0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:56.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.233+0000 7f1fbeffd640 1 -- 172.21.15.37:0/3589842553 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1fc0076150 con 0x7f1fc80b8b40 2023-12-19T16:06:56.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.413+0000 7f1fcc8f7640 1 -- 172.21.15.37:0/3589842553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1fc80b6d80 con 0x7f1fc80b8b40 2023-12-19T16:06:56.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.413+0000 7f1fbeffd640 1 -- 172.21.15.37:0/3589842553 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1fc0034090 con 0x7f1fc80b8b40 2023-12-19T16:06:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:56.416 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-12-19T16:06:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:06:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-12-19T16:06:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-12-19T16:06:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:06:56.417 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-12-19T16:06:56.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.415+0000 7f1fcc8f7640 1 -- 172.21.15.37:0/3589842553 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f1fa806a430 msgr2=0x7f1fa806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:56.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.415+0000 7f1fcc8f7640 1 --2- 172.21.15.37:0/3589842553 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f1fa806a430 0x7f1fa806c8f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1fc80b64a0 tx=0x7f1fb0009040 comp rx=0 tx=0).stop 2023-12-19T16:06:56.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.415+0000 7f1fcc8f7640 1 -- 172.21.15.37:0/3589842553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc80b8b40 msgr2=0x7f1fc814d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:56.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.415+0000 7f1fcc8f7640 1 --2- 172.21.15.37:0/3589842553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc80b8b40 0x7f1fc814d3a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00098a0 tx=0x7f1fc0004730 comp rx=0 tx=0).stop 2023-12-19T16:06:56.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.415+0000 7f1fcc8f7640 1 -- 172.21.15.37:0/3589842553 shutdown_connections 2023-12-19T16:06:56.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.415+0000 7f1fcc8f7640 1 --2- 172.21.15.37:0/3589842553 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f1fa806a430 0x7f1fa806c8f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:56.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.415+0000 7f1fcc8f7640 1 --2- 172.21.15.37:0/3589842553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fc8144e30 0x7f1fc80bf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:56.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.415+0000 7f1fcc8f7640 1 --2- 172.21.15.37:0/3589842553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1fc80bab80 0x7f1fc8147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:56.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.415+0000 7f1fcc8f7640 1 --2- 172.21.15.37:0/3589842553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fc80b8b40 0x7f1fc814d3a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:56.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.415+0000 7f1fcc8f7640 1 -- 172.21.15.37:0/3589842553 >> 172.21.15.37:0/3589842553 conn(0x7f1fc80c0200 msgr2=0x7f1fc8148d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:56.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.415+0000 7f1fcc8f7640 1 -- 172.21.15.37:0/3589842553 shutdown_connections 2023-12-19T16:06:56.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.415+0000 7f1fcc8f7640 1 -- 172.21.15.37:0/3589842553 wait complete. 2023-12-19T16:06:56.428 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T16:06:56.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T16:06:56.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.535+0000 7f84dc969640 1 Processor -- start 2023-12-19T16:06:56.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.535+0000 7f84dc969640 1 -- start start 2023-12-19T16:06:56.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.536+0000 7f84dc969640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84d80b79a0 0x7f84d80bc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:56.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.536+0000 7f84dc969640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f84d80b64a0 0x7f84d80b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:56.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.536+0000 7f84dc969640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d80b8ba0 con 0x7f84d814ad50 2023-12-19T16:06:56.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.536+0000 7f84dc969640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d806cd70 con 0x7f84d80b64a0 2023-12-19T16:06:56.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.536+0000 7f84dc969640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d80b8e80 con 0x7f84d80b79a0 2023-12-19T16:06:56.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.536+0000 7f84d659c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84d80b79a0 0x7f84d80bc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:56.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.537+0000 7f84d5d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f84d80b64a0 0x7f84d80b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:56.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.537+0000 7f84d659c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84d80b79a0 0x7f84d80bc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:40804/0 (socket says 172.21.15.37:40804) 2023-12-19T16:06:56.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.537+0000 7f84d6d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f84d814ad50 0x7f84d814b1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.37:34788/0 (socket says 172.21.15.37:34788) 2023-12-19T16:06:56.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.537+0000 7f84d659c640 1 -- 172.21.15.37:0/538764603 learned_addr learned my addr 172.21.15.37:0/538764603 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:56.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.537+0000 7f84d659c640 1 -- 172.21.15.37:0/538764603 >> v2:172.21.15.78:3300/0 conn(0x7f84d80b64a0 msgr2=0x7f84d80b68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:56.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.537+0000 7f84d659c640 1 --2- 172.21.15.37:0/538764603 >> v2:172.21.15.78:3300/0 conn(0x7f84d80b64a0 0x7f84d80b68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:56.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.537+0000 7f84d659c640 1 -- 172.21.15.37:0/538764603 >> v1:172.21.15.78:6789/0 conn(0x7f84d814ad50 legacy=0x7f84d814b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:56.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.537+0000 7f84d659c640 1 -- 172.21.15.37:0/538764603 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d80b9160 con 0x7f84d80b79a0 2023-12-19T16:06:56.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.537+0000 7f84d5d9b640 1 --2- 172.21.15.37:0/538764603 >> v2:172.21.15.78:3300/0 conn(0x7f84d80b64a0 0x7f84d80b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:06:56.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.538+0000 7f84d659c640 1 --2- 172.21.15.37:0/538764603 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84d80b79a0 0x7f84d80bc660 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009870 tx=0x7f84d002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f83fc83265e586e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:56.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.538+0000 7f84d559a640 1 -- 172.21.15.37:0/538764603 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d002f840 con 0x7f84d80b79a0 2023-12-19T16:06:56.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.538+0000 7f84d559a640 1 -- 172.21.15.37:0/538764603 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d002f9a0 con 0x7f84d80b79a0 2023-12-19T16:06:56.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.538+0000 7f84d559a640 1 -- 172.21.15.37:0/538764603 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d002fd30 con 0x7f84d80b79a0 2023-12-19T16:06:56.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.538+0000 7f84dc969640 1 -- 172.21.15.37:0/538764603 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84d80b79a0 msgr2=0x7f84d80bc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:56.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.538+0000 7f84dc969640 1 --2- 172.21.15.37:0/538764603 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84d80b79a0 0x7f84d80bc660 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009870 tx=0x7f84d002ba20 comp rx=0 tx=0).stop 2023-12-19T16:06:56.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.539+0000 7f84dc969640 1 -- 172.21.15.37:0/538764603 shutdown_connections 2023-12-19T16:06:56.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.539+0000 7f84dc969640 1 --2- 172.21.15.37:0/538764603 >> v2:172.21.15.78:3300/0 conn(0x7f84d80b64a0 0x7f84d80b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:56.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.539+0000 7f84dc969640 1 --2- 172.21.15.37:0/538764603 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84d80b79a0 0x7f84d80bc660 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:56.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.539+0000 7f84dc969640 1 -- 172.21.15.37:0/538764603 >> 172.21.15.37:0/538764603 conn(0x7f84d80c0330 msgr2=0x7f84d80c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:56.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.539+0000 7f84dc969640 1 -- 172.21.15.37:0/538764603 shutdown_connections 2023-12-19T16:06:56.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.539+0000 7f84dc969640 1 -- 172.21.15.37:0/538764603 wait complete. 2023-12-19T16:06:56.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.540+0000 7f84dc969640 1 Processor -- start 2023-12-19T16:06:56.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.540+0000 7f84dc969640 1 -- start start 2023-12-19T16:06:56.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.540+0000 7f84dc969640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84d80b64a0 0x7f84d80b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:56.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.540+0000 7f84dc969640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84d80b79a0 0x7f84d81e0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:56.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.540+0000 7f84dc969640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d814ad50 0x7f84d81e0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:56.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.540+0000 7f84dc969640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d80b6030 con 0x7f84d814ad50 2023-12-19T16:06:56.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.540+0000 7f84dc969640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d81dfbb0 con 0x7f84d80b79a0 2023-12-19T16:06:56.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.540+0000 7f84dc969640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d814eb40 con 0x7f84d80b64a0 2023-12-19T16:06:56.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.540+0000 7f84d6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d814ad50 0x7f84d81e0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:56.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.541+0000 7f84d6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d814ad50 0x7f84d81e0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44316/0 (socket says 172.21.15.37:44316) 2023-12-19T16:06:56.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.541+0000 7f84d6d9d640 1 -- 172.21.15.37:0/1892021020 learned_addr learned my addr 172.21.15.37:0/1892021020 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:56.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.541+0000 7f84d659c640 1 --2- 172.21.15.37:0/1892021020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84d80b64a0 0x7f84d80b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:56.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.541+0000 7f84d5d9b640 1 --2- 172.21.15.37:0/1892021020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84d80b79a0 0x7f84d81e0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:56.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.541+0000 7f84d6d9d640 1 -- 172.21.15.37:0/1892021020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84d80b64a0 msgr2=0x7f84d80b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:56.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.541+0000 7f84d6d9d640 1 --2- 172.21.15.37:0/1892021020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84d80b64a0 0x7f84d80b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:56.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.541+0000 7f84d6d9d640 1 -- 172.21.15.37:0/1892021020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84d80b79a0 msgr2=0x7f84d81e0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:56.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.541+0000 7f84d6d9d640 1 --2- 172.21.15.37:0/1892021020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84d80b79a0 0x7f84d81e0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:56.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.541+0000 7f84d6d9d640 1 -- 172.21.15.37:0/1892021020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84cc009400 con 0x7f84d814ad50 2023-12-19T16:06:56.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.541+0000 7f84d659c640 1 --2- 172.21.15.37:0/1892021020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84d80b64a0 0x7f84d80b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:06:56.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.541+0000 7f84d6d9d640 1 --2- 172.21.15.37:0/1892021020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d814ad50 0x7f84d81e0540 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f84c800c730 tx=0x7f84c800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:56.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.541+0000 7f84c6ffd640 1 -- 172.21.15.37:0/1892021020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c800ce40 con 0x7f84d814ad50 2023-12-19T16:06:56.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.541+0000 7f84c6ffd640 1 -- 172.21.15.37:0/1892021020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c800a640 con 0x7f84d814ad50 2023-12-19T16:06:56.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.541+0000 7f84c6ffd640 1 -- 172.21.15.37:0/1892021020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c800a9b0 con 0x7f84d814ad50 2023-12-19T16:06:56.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.541+0000 7f84dc969640 1 -- 172.21.15.37:0/1892021020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d00094d0 con 0x7f84d814ad50 2023-12-19T16:06:56.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.541+0000 7f84dc969640 1 -- 172.21.15.37:0/1892021020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d814bea0 con 0x7f84d814ad50 2023-12-19T16:06:56.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.542+0000 7f84dc969640 1 -- 172.21.15.37:0/1892021020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d81dfd20 con 0x7f84d814ad50 2023-12-19T16:06:56.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.543+0000 7f84c6ffd640 1 -- 172.21.15.37:0/1892021020 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f84c800ab10 con 0x7f84d814ad50 2023-12-19T16:06:56.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.543+0000 7f84c6ffd640 1 --2- 172.21.15.37:0/1892021020 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f84b806a430 0x7f84b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:56.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.543+0000 7f84c6ffd640 1 -- 172.21.15.37:0/1892021020 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f84c8087ba0 con 0x7f84d814ad50 2023-12-19T16:06:56.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.543+0000 7f84d659c640 1 --2- 172.21.15.37:0/1892021020 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f84b806a430 0x7f84b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:56.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.544+0000 7f84d659c640 1 --2- 172.21.15.37:0/1892021020 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f84b806a430 0x7f84b806c8f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f84d0036000 tx=0x7f84d0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:56.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.548+0000 7f84c6ffd640 1 -- 172.21.15.37:0/1892021020 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f84d81dfd20 con 0x7f84d814ad50 2023-12-19T16:06:56.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:56.725+0000 7f84dc969640 1 -- 172.21.15.37:0/1892021020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f84d81dfd20 con 0x7f84d814ad50 2023-12-19T16:06:57.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.277+0000 7f84c6ffd640 1 -- 172.21.15.37:0/1892021020 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f84d81dfd20 con 0x7f84d814ad50 2023-12-19T16:06:57.280 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-12-19T16:06:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.280+0000 7f84dc969640 1 -- 172.21.15.37:0/1892021020 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f84b806a430 msgr2=0x7f84b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.280+0000 7f84dc969640 1 --2- 172.21.15.37:0/1892021020 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f84b806a430 0x7f84b806c8f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f84d0036000 tx=0x7f84d0008030 comp rx=0 tx=0).stop 2023-12-19T16:06:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.280+0000 7f84dc969640 1 -- 172.21.15.37:0/1892021020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d814ad50 msgr2=0x7f84d81e0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.280+0000 7f84dc969640 1 --2- 172.21.15.37:0/1892021020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d814ad50 0x7f84d81e0540 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f84c800c730 tx=0x7f84c800cbf0 comp rx=0 tx=0).stop 2023-12-19T16:06:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.280+0000 7f84dc969640 1 -- 172.21.15.37:0/1892021020 shutdown_connections 2023-12-19T16:06:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.280+0000 7f84dc969640 1 --2- 172.21.15.37:0/1892021020 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f84b806a430 0x7f84b806c8f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.280+0000 7f84dc969640 1 --2- 172.21.15.37:0/1892021020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d814ad50 0x7f84d81e0540 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.280+0000 7f84dc969640 1 --2- 172.21.15.37:0/1892021020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84d80b79a0 0x7f84d81e0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.280+0000 7f84dc969640 1 --2- 172.21.15.37:0/1892021020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f84d80b64a0 0x7f84d80b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.280+0000 7f84dc969640 1 -- 172.21.15.37:0/1892021020 >> 172.21.15.37:0/1892021020 conn(0x7f84d80c0330 msgr2=0x7f84d80beab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.281+0000 7f84dc969640 1 -- 172.21.15.37:0/1892021020 shutdown_connections 2023-12-19T16:06:57.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.281+0000 7f84dc969640 1 -- 172.21.15.37:0/1892021020 wait complete. 2023-12-19T16:06:57.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T16:06:57.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.414+0000 7fadbd7ab640 1 Processor -- start 2023-12-19T16:06:57.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.414+0000 7fadbd7ab640 1 -- start start 2023-12-19T16:06:57.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.415+0000 7fadbd7ab640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fadb8144ae0 0x7fadb80bc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:57.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.415+0000 7fadbd7ab640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb80bd820 con 0x7fadb814dfc0 2023-12-19T16:06:57.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.415+0000 7fadbd7ab640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb814e4b0 con 0x7fadb8144ec0 2023-12-19T16:06:57.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.415+0000 7fadbd7ab640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb80b8f80 con 0x7fadb8144ae0 2023-12-19T16:06:57.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.415+0000 7fadb6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fadb8144ae0 0x7fadb80bc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:57.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.415+0000 7fadb6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fadb8144ae0 0x7fadb80bc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44326/0 (socket says 172.21.15.37:44326) 2023-12-19T16:06:57.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.415+0000 7fadb6ffd640 1 -- 172.21.15.37:0/829320678 learned_addr learned my addr 172.21.15.37:0/829320678 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:57.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.415+0000 7fadb77fe640 1 --1- 172.21.15.37:0/829320678 >> v1:172.21.15.37:6789/0 conn(0x7fadb814dfc0 0x7fadb8155350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52972/0 (socket says 172.21.15.37:52972) 2023-12-19T16:06:57.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.415+0000 7fadb6ffd640 1 -- 172.21.15.37:0/829320678 >> v1:172.21.15.78:6789/0 conn(0x7fadb8144ec0 legacy=0x7fadb80bd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:57.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.415+0000 7fadb6ffd640 1 -- 172.21.15.37:0/829320678 >> v1:172.21.15.37:6789/0 conn(0x7fadb814dfc0 legacy=0x7fadb8155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:57.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.415+0000 7fadb6ffd640 1 -- 172.21.15.37:0/829320678 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb80b9260 con 0x7fadb8144ae0 2023-12-19T16:06:57.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.415+0000 7fadb5ffb640 1 -- 172.21.15.37:0/829320678 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557728833 0 0) 0x7fadb80bd820 con 0x7fadb814dfc0 2023-12-19T16:06:57.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.416+0000 7fadb6ffd640 1 --2- 172.21.15.37:0/829320678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8144ae0 0x7fadb80bc680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009870 tx=0x7fadb002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6739e77cf8339343 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:57.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.416+0000 7fadb5ffb640 1 -- 172.21.15.37:0/829320678 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb0030860 con 0x7fadb8144ae0 2023-12-19T16:06:57.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.416+0000 7fadb5ffb640 1 -- 172.21.15.37:0/829320678 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb00309c0 con 0x7fadb8144ae0 2023-12-19T16:06:57.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.416+0000 7fadb5ffb640 1 -- 172.21.15.37:0/829320678 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb0030d50 con 0x7fadb8144ae0 2023-12-19T16:06:57.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.417+0000 7fadbd7ab640 1 -- 172.21.15.37:0/829320678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8144ae0 msgr2=0x7fadb80bc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:57.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.417+0000 7fadbd7ab640 1 --2- 172.21.15.37:0/829320678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8144ae0 0x7fadb80bc680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009870 tx=0x7fadb002b9a0 comp rx=0 tx=0).stop 2023-12-19T16:06:57.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.417+0000 7fadbd7ab640 1 -- 172.21.15.37:0/829320678 shutdown_connections 2023-12-19T16:06:57.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.417+0000 7fadbd7ab640 1 --2- 172.21.15.37:0/829320678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8144ae0 0x7fadb80bc680 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:57.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.417+0000 7fadbd7ab640 1 -- 172.21.15.37:0/829320678 >> 172.21.15.37:0/829320678 conn(0x7fadb80714b0 msgr2=0x7fadb80718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:57.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.417+0000 7fadbd7ab640 1 -- 172.21.15.37:0/829320678 shutdown_connections 2023-12-19T16:06:57.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.417+0000 7fadbd7ab640 1 -- 172.21.15.37:0/829320678 wait complete. 2023-12-19T16:06:57.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.418+0000 7fadbd7ab640 1 Processor -- start 2023-12-19T16:06:57.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.418+0000 7fadbd7ab640 1 -- start start 2023-12-19T16:06:57.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadbd7ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb8144ae0 0x7fadb80c0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:57.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadbd7ab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8144ec0 0x7fadb81e0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:57.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadbd7ab640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadb814dfc0 0x7fadb81e0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadbd7ab640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb80c0b60 con 0x7fadb8144ec0 2023-12-19T16:06:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadbd7ab640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb814cfe0 con 0x7fadb8144ae0 2023-12-19T16:06:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadbd7ab640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb80af3d0 con 0x7fadb814dfc0 2023-12-19T16:06:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadb67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8144ec0 0x7fadb81e0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadb67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8144ec0 0x7fadb81e0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44332/0 (socket says 172.21.15.37:44332) 2023-12-19T16:06:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadb67fc640 1 -- 172.21.15.37:0/2845774030 learned_addr learned my addr 172.21.15.37:0/2845774030 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadb6ffd640 1 --2- 172.21.15.37:0/2845774030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb8144ae0 0x7fadb80c0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadb77fe640 1 --2- 172.21.15.37:0/2845774030 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadb814dfc0 0x7fadb81e0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadb67fc640 1 -- 172.21.15.37:0/2845774030 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadb814dfc0 msgr2=0x7fadb81e0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadb67fc640 1 --2- 172.21.15.37:0/2845774030 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadb814dfc0 0x7fadb81e0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadb67fc640 1 -- 172.21.15.37:0/2845774030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb8144ae0 msgr2=0x7fadb80c0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadb67fc640 1 --2- 172.21.15.37:0/2845774030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb8144ae0 0x7fadb80c0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadb67fc640 1 -- 172.21.15.37:0/2845774030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb00094d0 con 0x7fadb8144ec0 2023-12-19T16:06:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadb67fc640 1 --2- 172.21.15.37:0/2845774030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8144ec0 0x7fadb81e0000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fada000c430 tx=0x7fada000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:57.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadaf7fe640 1 -- 172.21.15.37:0/2845774030 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada0011790 con 0x7fadb8144ec0 2023-12-19T16:06:57.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadaf7fe640 1 -- 172.21.15.37:0/2845774030 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada00118f0 con 0x7fadb8144ec0 2023-12-19T16:06:57.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadaf7fe640 1 -- 172.21.15.37:0/2845774030 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada0011ce0 con 0x7fadb8144ec0 2023-12-19T16:06:57.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadbd7ab640 1 -- 172.21.15.37:0/2845774030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb80b0590 con 0x7fadb8144ec0 2023-12-19T16:06:57.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.419+0000 7fadbd7ab640 1 -- 172.21.15.37:0/2845774030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb814cb90 con 0x7fadb8144ec0 2023-12-19T16:06:57.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.420+0000 7fadbd7ab640 1 -- 172.21.15.37:0/2845774030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb80af5d0 con 0x7fadb8144ec0 2023-12-19T16:06:57.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.421+0000 7fadaf7fe640 1 -- 172.21.15.37:0/2845774030 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fada001c460 con 0x7fadb8144ec0 2023-12-19T16:06:57.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.421+0000 7fadaf7fe640 1 --2- 172.21.15.37:0/2845774030 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fad9806a430 0x7fad9806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:57.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.421+0000 7fadaf7fe640 1 -- 172.21.15.37:0/2845774030 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fada00885b0 con 0x7fadb8144ec0 2023-12-19T16:06:57.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.421+0000 7fadb6ffd640 1 --2- 172.21.15.37:0/2845774030 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fad9806a430 0x7fad9806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:57.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.422+0000 7fadb6ffd640 1 --2- 172.21.15.37:0/2845774030 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fad9806a430 0x7fad9806c8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fadb0036000 tx=0x7fadb0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:57.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.426+0000 7fadaf7fe640 1 -- 172.21.15.37:0/2845774030 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fadb80af5d0 con 0x7fadb8144ec0 2023-12-19T16:06:57.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:57.603+0000 7fadbd7ab640 1 -- 172.21.15.37:0/2845774030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fadb80b03f0 con 0x7fadb8144ec0 2023-12-19T16:06:58.278 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:06:58.281 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:06:58.283 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:06:58.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.285+0000 7fadaf7fe640 1 -- 172.21.15.37:0/2845774030 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fadb80b03f0 con 0x7fadb8144ec0 2023-12-19T16:06:58.288 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-12-19T16:06:58.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.290+0000 7fadbd7ab640 1 -- 172.21.15.37:0/2845774030 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fad9806a430 msgr2=0x7fad9806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:58.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.290+0000 7fadbd7ab640 1 --2- 172.21.15.37:0/2845774030 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fad9806a430 0x7fad9806c8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fadb0036000 tx=0x7fadb0008030 comp rx=0 tx=0).stop 2023-12-19T16:06:58.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.290+0000 7fadbd7ab640 1 -- 172.21.15.37:0/2845774030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8144ec0 msgr2=0x7fadb81e0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:58.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.290+0000 7fadbd7ab640 1 --2- 172.21.15.37:0/2845774030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8144ec0 0x7fadb81e0000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fada000c430 tx=0x7fada000c8f0 comp rx=0 tx=0).stop 2023-12-19T16:06:58.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.290+0000 7fadbd7ab640 1 -- 172.21.15.37:0/2845774030 shutdown_connections 2023-12-19T16:06:58.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.291+0000 7fadbd7ab640 1 --2- 172.21.15.37:0/2845774030 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fad9806a430 0x7fad9806c8f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:58.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.291+0000 7fadbd7ab640 1 --2- 172.21.15.37:0/2845774030 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fadb814dfc0 0x7fadb81e0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:58.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.291+0000 7fadbd7ab640 1 --2- 172.21.15.37:0/2845774030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadb8144ec0 0x7fadb81e0000 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:58.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.291+0000 7fadbd7ab640 1 --2- 172.21.15.37:0/2845774030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb8144ae0 0x7fadb80c0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:58.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.291+0000 7fadbd7ab640 1 -- 172.21.15.37:0/2845774030 >> 172.21.15.37:0/2845774030 conn(0x7fadb80714b0 msgr2=0x7fadb80bd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:58.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.291+0000 7fadbd7ab640 1 -- 172.21.15.37:0/2845774030 shutdown_connections 2023-12-19T16:06:58.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.291+0000 7fadbd7ab640 1 -- 172.21.15.37:0/2845774030 wait complete. 2023-12-19T16:06:58.315 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T16:06:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.501+0000 7fbffc322640 1 Processor -- start 2023-12-19T16:06:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.501+0000 7fbffc322640 1 -- start start 2023-12-19T16:06:58.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.501+0000 7fbffc322640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbff4142d90 0x7fbff40baad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.501+0000 7fbffc322640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbff40b9740 0x7fbff4153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.502+0000 7fbffc322640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff40b4430 con 0x7fbff40b1f60 2023-12-19T16:06:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.502+0000 7fbffc322640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff40b3bd0 con 0x7fbff4142d90 2023-12-19T16:06:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.502+0000 7fbffc322640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff40bb010 con 0x7fbff40b9740 2023-12-19T16:06:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.502+0000 7fbffa0be640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbff4142d90 0x7fbff40baad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.502+0000 7fbffa0be640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbff4142d90 0x7fbff40baad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44348/0 (socket says 172.21.15.37:44348) 2023-12-19T16:06:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.502+0000 7fbffa0be640 1 -- 172.21.15.37:0/3077719560 learned_addr learned my addr 172.21.15.37:0/3077719560 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.502+0000 7fbff98bd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbff40b1f60 0x7fbff40b9030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52978/0 (socket says 172.21.15.37:52978) 2023-12-19T16:06:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.502+0000 7fbffa8bf640 1 --2- 172.21.15.37:0/3077719560 >> v2:172.21.15.78:3300/0 conn(0x7fbff40b9740 0x7fbff4153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.502+0000 7fbffa0be640 1 -- 172.21.15.37:0/3077719560 >> v2:172.21.15.78:3300/0 conn(0x7fbff40b9740 msgr2=0x7fbff4153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.502+0000 7fbffa0be640 1 --2- 172.21.15.37:0/3077719560 >> v2:172.21.15.78:3300/0 conn(0x7fbff40b9740 0x7fbff4153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.502+0000 7fbffa0be640 1 -- 172.21.15.37:0/3077719560 >> v1:172.21.15.37:6789/0 conn(0x7fbff40b1f60 legacy=0x7fbff40b9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.502+0000 7fbffa0be640 1 -- 172.21.15.37:0/3077719560 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff4143170 con 0x7fbff4142d90 2023-12-19T16:06:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.502+0000 7fbff90bc640 1 -- 172.21.15.37:0/3077719560 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810831903 0 0) 0x7fbff40b4430 con 0x7fbff40b1f60 2023-12-19T16:06:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.502+0000 7fbffa8bf640 1 --2- 172.21.15.37:0/3077719560 >> v2:172.21.15.78:3300/0 conn(0x7fbff40b9740 0x7fbff4153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:06:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.503+0000 7fbffa0be640 1 --2- 172.21.15.37:0/3077719560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff4142d90 0x7fbff40baad0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbff414cfd0 tx=0x7fbff002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfde01da113980b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.503+0000 7fbff90bc640 1 -- 172.21.15.37:0/3077719560 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff002f850 con 0x7fbff4142d90 2023-12-19T16:06:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.503+0000 7fbff90bc640 1 -- 172.21.15.37:0/3077719560 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff002f9b0 con 0x7fbff4142d90 2023-12-19T16:06:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.503+0000 7fbff90bc640 1 -- 172.21.15.37:0/3077719560 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff002fd40 con 0x7fbff4142d90 2023-12-19T16:06:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.503+0000 7fbffc322640 1 -- 172.21.15.37:0/3077719560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff4142d90 msgr2=0x7fbff40baad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.503+0000 7fbffc322640 1 --2- 172.21.15.37:0/3077719560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff4142d90 0x7fbff40baad0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbff414cfd0 tx=0x7fbff002ba30 comp rx=0 tx=0).stop 2023-12-19T16:06:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.503+0000 7fbffc322640 1 -- 172.21.15.37:0/3077719560 shutdown_connections 2023-12-19T16:06:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.503+0000 7fbffc322640 1 --2- 172.21.15.37:0/3077719560 >> v2:172.21.15.78:3300/0 conn(0x7fbff40b9740 0x7fbff4153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.503+0000 7fbffc322640 1 --2- 172.21.15.37:0/3077719560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff4142d90 0x7fbff40baad0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.503+0000 7fbffc322640 1 -- 172.21.15.37:0/3077719560 >> 172.21.15.37:0/3077719560 conn(0x7fbff40be0c0 msgr2=0x7fbff40be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.504+0000 7fbffc322640 1 -- 172.21.15.37:0/3077719560 shutdown_connections 2023-12-19T16:06:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.504+0000 7fbffc322640 1 -- 172.21.15.37:0/3077719560 wait complete. 2023-12-19T16:06:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.505+0000 7fbffc322640 1 Processor -- start 2023-12-19T16:06:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.505+0000 7fbffc322640 1 -- start start 2023-12-19T16:06:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.505+0000 7fbffc322640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff40b1f60 0x7fbff413ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.505+0000 7fbffc322640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbff40b9740 0x7fbff40b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.505+0000 7fbffc322640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff4142d90 0x7fbff41e1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.505+0000 7fbffc322640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff413b0c0 con 0x7fbff4142d90 2023-12-19T16:06:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.505+0000 7fbffc322640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff4145660 con 0x7fbff40b1f60 2023-12-19T16:06:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.505+0000 7fbffc322640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff41461a0 con 0x7fbff40b9740 2023-12-19T16:06:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.505+0000 7fbffa8bf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff4142d90 0x7fbff41e1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.505+0000 7fbffa8bf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff4142d90 0x7fbff41e1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44358/0 (socket says 172.21.15.37:44358) 2023-12-19T16:06:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.505+0000 7fbffa8bf640 1 -- 172.21.15.37:0/3543685993 learned_addr learned my addr 172.21.15.37:0/3543685993 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.505+0000 7fbffa0be640 1 --2- 172.21.15.37:0/3543685993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff40b1f60 0x7fbff413ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.505+0000 7fbff98bd640 1 --2- 172.21.15.37:0/3543685993 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbff40b9740 0x7fbff40b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.506+0000 7fbffa8bf640 1 -- 172.21.15.37:0/3543685993 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbff40b9740 msgr2=0x7fbff40b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.506+0000 7fbffa8bf640 1 --2- 172.21.15.37:0/3543685993 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbff40b9740 0x7fbff40b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.506+0000 7fbffa8bf640 1 -- 172.21.15.37:0/3543685993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff40b1f60 msgr2=0x7fbff413ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.506+0000 7fbffa8bf640 1 --2- 172.21.15.37:0/3543685993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff40b1f60 0x7fbff413ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.506+0000 7fbffa8bf640 1 -- 172.21.15.37:0/3543685993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff00094d0 con 0x7fbff4142d90 2023-12-19T16:06:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.506+0000 7fbffa8bf640 1 --2- 172.21.15.37:0/3543685993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff4142d90 0x7fbff41e1500 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00cea0 tx=0x7fbfec00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.506+0000 7fbfeaffd640 1 -- 172.21.15.37:0/3543685993 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec003b90 con 0x7fbff4142d90 2023-12-19T16:06:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.506+0000 7fbfeaffd640 1 -- 172.21.15.37:0/3543685993 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec003d10 con 0x7fbff4142d90 2023-12-19T16:06:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.506+0000 7fbffc322640 1 -- 172.21.15.37:0/3543685993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff40b6230 con 0x7fbff4142d90 2023-12-19T16:06:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.506+0000 7fbfeaffd640 1 -- 172.21.15.37:0/3543685993 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec004260 con 0x7fbff4142d90 2023-12-19T16:06:58.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.506+0000 7fbffc322640 1 -- 172.21.15.37:0/3543685993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff4145e30 con 0x7fbff4142d90 2023-12-19T16:06:58.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.507+0000 7fbffc322640 1 -- 172.21.15.37:0/3543685993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff40b2fc0 con 0x7fbff4142d90 2023-12-19T16:06:58.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.508+0000 7fbfeaffd640 1 -- 172.21.15.37:0/3543685993 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbfec0043c0 con 0x7fbff4142d90 2023-12-19T16:06:58.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.508+0000 7fbfeaffd640 1 --2- 172.21.15.37:0/3543685993 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbfd806a430 0x7fbfd806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:58.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.508+0000 7fbfeaffd640 1 -- 172.21.15.37:0/3543685993 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fbfec088f50 con 0x7fbff4142d90 2023-12-19T16:06:58.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.508+0000 7fbffa0be640 1 --2- 172.21.15.37:0/3543685993 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbfd806a430 0x7fbfd806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:58.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.509+0000 7fbffa0be640 1 --2- 172.21.15.37:0/3543685993 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbfd806a430 0x7fbfd806c8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbff0036000 tx=0x7fbff0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:58.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.513+0000 7fbfeaffd640 1 -- 172.21.15.37:0/3543685993 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbfec054650 con 0x7fbff4142d90 2023-12-19T16:06:58.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.725+0000 7fbffc322640 1 -- 172.21.15.37:0/3543685993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbff4146350 con 0x7fbff4142d90 2023-12-19T16:06:58.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.730+0000 7fbfeaffd640 1 -- 172.21.15.37:0/3543685993 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbff4146350 con 0x7fbff4142d90 2023-12-19T16:06:58.733 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 2 and data pool 3 2023-12-19T16:06:58.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.734+0000 7fbffc322640 1 -- 172.21.15.37:0/3543685993 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbfd806a430 msgr2=0x7fbfd806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:58.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.734+0000 7fbffc322640 1 --2- 172.21.15.37:0/3543685993 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbfd806a430 0x7fbfd806c8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbff0036000 tx=0x7fbff0008030 comp rx=0 tx=0).stop 2023-12-19T16:06:58.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.734+0000 7fbffc322640 1 -- 172.21.15.37:0/3543685993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff4142d90 msgr2=0x7fbff41e1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:58.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.734+0000 7fbffc322640 1 --2- 172.21.15.37:0/3543685993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff4142d90 0x7fbff41e1500 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00cea0 tx=0x7fbfec00cf90 comp rx=0 tx=0).stop 2023-12-19T16:06:58.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.735+0000 7fbffc322640 1 -- 172.21.15.37:0/3543685993 shutdown_connections 2023-12-19T16:06:58.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.735+0000 7fbffc322640 1 --2- 172.21.15.37:0/3543685993 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbfd806a430 0x7fbfd806c8f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:58.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.735+0000 7fbffc322640 1 --2- 172.21.15.37:0/3543685993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff4142d90 0x7fbff41e1500 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:58.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.735+0000 7fbffc322640 1 --2- 172.21.15.37:0/3543685993 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbff40b9740 0x7fbff40b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:58.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.735+0000 7fbffc322640 1 --2- 172.21.15.37:0/3543685993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff40b1f60 0x7fbff413ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:58.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.735+0000 7fbffc322640 1 -- 172.21.15.37:0/3543685993 >> 172.21.15.37:0/3543685993 conn(0x7fbff40be0c0 msgr2=0x7fbff413b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:58.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.735+0000 7fbffc322640 1 -- 172.21.15.37:0/3543685993 shutdown_connections 2023-12-19T16:06:58.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.735+0000 7fbffc322640 1 -- 172.21.15.37:0/3543685993 wait complete. 2023-12-19T16:06:58.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:06:58.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.862+0000 7f15c73fb640 1 Processor -- start 2023-12-19T16:06:58.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.862+0000 7f15c73fb640 1 -- start start 2023-12-19T16:06:58.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.863+0000 7f15c73fb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15c00bcdd0 0x7f15c00b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.863+0000 7f15c73fb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c00bc6b0 con 0x7f15c0144ea0 2023-12-19T16:06:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.863+0000 7f15c73fb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c00b6900 con 0x7f15c00b64c0 2023-12-19T16:06:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.863+0000 7f15c73fb640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c00a59f0 con 0x7f15c00bcdd0 2023-12-19T16:06:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.863+0000 7f15c5998640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f15c0144ea0 0x7f15c0155340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52994/0 (socket says 172.21.15.37:52994) 2023-12-19T16:06:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.863+0000 7f15c5998640 1 -- 172.21.15.37:0/1808468272 learned_addr learned my addr 172.21.15.37:0/1808468272 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:06:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.863+0000 7f15c5197640 1 --2- 172.21.15.37:0/1808468272 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15c00bcdd0 0x7f15c00b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.863+0000 7f15b7fff640 1 -- 172.21.15.37:0/1808468272 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457682511 0 0) 0x7f15c00bc6b0 con 0x7f15c0144ea0 2023-12-19T16:06:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.863+0000 7f15b7fff640 1 -- 172.21.15.37:0/1808468272 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15ac003520 con 0x7f15c0144ea0 2023-12-19T16:06:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.863+0000 7f15b7fff640 1 -- 172.21.15.37:0/1808468272 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363674465 0 0) 0x7f15c00b6900 con 0x7f15c00b64c0 2023-12-19T16:06:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.863+0000 7f15b7fff640 1 -- 172.21.15.37:0/1808468272 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15c00bc6b0 con 0x7f15c00b64c0 2023-12-19T16:06:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.863+0000 7f15c5197640 1 -- 172.21.15.37:0/1808468272 >> v1:172.21.15.78:6789/0 conn(0x7f15c00b64c0 legacy=0x7f15c0144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.863+0000 7f15c5197640 1 -- 172.21.15.37:0/1808468272 >> v1:172.21.15.37:6789/0 conn(0x7f15c0144ea0 legacy=0x7f15c0155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.863+0000 7f15b7fff640 1 -- 172.21.15.37:0/1808468272 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 985826564 0 0) 0x7f15ac003520 con 0x7f15c0144ea0 2023-12-19T16:06:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.863+0000 7f15c5197640 1 -- 172.21.15.37:0/1808468272 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c00bc0a0 con 0x7f15c00bcdd0 2023-12-19T16:06:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.864+0000 7f15c5197640 1 --2- 172.21.15.37:0/1808468272 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15c00bcdd0 0x7f15c00b5f80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0097d0 tx=0x7f15bc02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfd7c5ab7e894bc2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.864+0000 7f15b7fff640 1 -- 172.21.15.37:0/1808468272 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b80019f0 con 0x7f15c00bcdd0 2023-12-19T16:06:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.864+0000 7f15b7fff640 1 -- 172.21.15.37:0/1808468272 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc031580 con 0x7f15c00bcdd0 2023-12-19T16:06:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.864+0000 7f15b7fff640 1 -- 172.21.15.37:0/1808468272 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc031910 con 0x7f15c00bcdd0 2023-12-19T16:06:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.865+0000 7f15c73fb640 1 -- 172.21.15.37:0/1808468272 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15c00bcdd0 msgr2=0x7f15c00b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.865+0000 7f15c73fb640 1 --2- 172.21.15.37:0/1808468272 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15c00bcdd0 0x7f15c00b5f80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0097d0 tx=0x7f15bc02b8a0 comp rx=0 tx=0).stop 2023-12-19T16:06:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.865+0000 7f15c73fb640 1 -- 172.21.15.37:0/1808468272 shutdown_connections 2023-12-19T16:06:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.865+0000 7f15c73fb640 1 --2- 172.21.15.37:0/1808468272 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15c00bcdd0 0x7f15c00b5f80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.865+0000 7f15c73fb640 1 -- 172.21.15.37:0/1808468272 >> 172.21.15.37:0/1808468272 conn(0x7f15c0071e60 msgr2=0x7f15c00c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:58.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.865+0000 7f15c73fb640 1 -- 172.21.15.37:0/1808468272 shutdown_connections 2023-12-19T16:06:58.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.865+0000 7f15c73fb640 1 -- 172.21.15.37:0/1808468272 wait complete. 2023-12-19T16:06:58.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.866+0000 7f15c73fb640 1 Processor -- start 2023-12-19T16:06:58.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.866+0000 7f15c73fb640 1 -- start start 2023-12-19T16:06:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15c73fb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15c00b64c0 0x7f15c01d2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15c73fb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15c00bcdd0 0x7f15c013e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15c73fb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15c0144ea0 0x7f15c013b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15c73fb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c013e8f0 con 0x7f15c00b64c0 2023-12-19T16:06:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15c73fb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c01d3fe0 con 0x7f15c00bcdd0 2023-12-19T16:06:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15c73fb640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c01d4a90 con 0x7f15c0144ea0 2023-12-19T16:06:58.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15c5197640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15c00b64c0 0x7f15c01d2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15c5197640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15c00b64c0 0x7f15c01d2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44360/0 (socket says 172.21.15.37:44360) 2023-12-19T16:06:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15c5197640 1 -- 172.21.15.37:0/165869535 learned_addr learned my addr 172.21.15.37:0/165869535 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15c4996640 1 --2- 172.21.15.37:0/165869535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15c00bcdd0 0x7f15c013e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15c5998640 1 --2- 172.21.15.37:0/165869535 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15c0144ea0 0x7f15c013b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15c5197640 1 -- 172.21.15.37:0/165869535 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15c0144ea0 msgr2=0x7f15c013b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15c5197640 1 --2- 172.21.15.37:0/165869535 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15c0144ea0 0x7f15c013b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15c5197640 1 -- 172.21.15.37:0/165869535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15c00bcdd0 msgr2=0x7f15c013e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15c5197640 1 --2- 172.21.15.37:0/165869535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15c00bcdd0 0x7f15c013e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15c5197640 1 -- 172.21.15.37:0/165869535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc009400 con 0x7f15c00b64c0 2023-12-19T16:06:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15c5197640 1 --2- 172.21.15.37:0/165869535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15c00b64c0 0x7f15c01d2550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0097d0 tx=0x7f15bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15b5ffb640 1 -- 172.21.15.37:0/165869535 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc004030 con 0x7f15c00b64c0 2023-12-19T16:06:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15b5ffb640 1 -- 172.21.15.37:0/165869535 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc0041b0 con 0x7f15c00b64c0 2023-12-19T16:06:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15c73fb640 1 -- 172.21.15.37:0/165869535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c00bfba0 con 0x7f15c00b64c0 2023-12-19T16:06:58.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.867+0000 7f15b5ffb640 1 -- 172.21.15.37:0/165869535 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc003610 con 0x7f15c00b64c0 2023-12-19T16:06:58.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.868+0000 7f15c73fb640 1 -- 172.21.15.37:0/165869535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c01d41f0 con 0x7f15c00b64c0 2023-12-19T16:06:58.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.868+0000 7f15c73fb640 1 -- 172.21.15.37:0/165869535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c004e840 con 0x7f15c00b64c0 2023-12-19T16:06:58.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.869+0000 7f15b5ffb640 1 -- 172.21.15.37:0/165869535 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f15bc043070 con 0x7f15c00b64c0 2023-12-19T16:06:58.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.869+0000 7f15b5ffb640 1 --2- 172.21.15.37:0/165869535 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f15a406a430 0x7f15a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:58.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.869+0000 7f15b5ffb640 1 -- 172.21.15.37:0/165869535 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15bc0aa3e0 con 0x7f15c00b64c0 2023-12-19T16:06:58.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.870+0000 7f15c4996640 1 --2- 172.21.15.37:0/165869535 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f15a406a430 0x7f15a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:58.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.870+0000 7f15c4996640 1 --2- 172.21.15.37:0/165869535 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f15a406a430 0x7f15a406c8f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f15c01486a0 tx=0x7f15b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:58.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:58.874+0000 7f15b5ffb640 1 -- 172.21.15.37:0/165869535 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f15bc075ae0 con 0x7f15c00b64c0 2023-12-19T16:06:59.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.053+0000 7f15c73fb640 1 -- 172.21.15.37:0/165869535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15c01e0250 con 0x7f15c00b64c0 2023-12-19T16:06:59.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.054+0000 7f15b5ffb640 1 -- 172.21.15.37:0/165869535 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16002 (secure 0 0 0) 0x7f15bc04a090 con 0x7f15c00b64c0 2023-12-19T16:06:59.058 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:59.058 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:58.727432+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:06:56.758166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:06:57.635291+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:06:59.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.056+0000 7f15c73fb640 1 -- 172.21.15.37:0/165869535 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f15a406a430 msgr2=0x7f15a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:59.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.056+0000 7f15c73fb640 1 --2- 172.21.15.37:0/165869535 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f15a406a430 0x7f15a406c8f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f15c01486a0 tx=0x7f15b0009040 comp rx=0 tx=0).stop 2023-12-19T16:06:59.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.056+0000 7f15c73fb640 1 -- 172.21.15.37:0/165869535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15c00b64c0 msgr2=0x7f15c01d2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:59.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.056+0000 7f15c73fb640 1 --2- 172.21.15.37:0/165869535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15c00b64c0 0x7f15c01d2550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0097d0 tx=0x7f15bc0046c0 comp rx=0 tx=0).stop 2023-12-19T16:06:59.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.056+0000 7f15c73fb640 1 -- 172.21.15.37:0/165869535 shutdown_connections 2023-12-19T16:06:59.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.056+0000 7f15c73fb640 1 --2- 172.21.15.37:0/165869535 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f15a406a430 0x7f15a406c8f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:59.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.056+0000 7f15c73fb640 1 --2- 172.21.15.37:0/165869535 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15c0144ea0 0x7f15c013b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:59.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.056+0000 7f15c73fb640 1 --2- 172.21.15.37:0/165869535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15c00bcdd0 0x7f15c013e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:59.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.056+0000 7f15c73fb640 1 --2- 172.21.15.37:0/165869535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15c00b64c0 0x7f15c01d2550 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:59.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.056+0000 7f15c73fb640 1 -- 172.21.15.37:0/165869535 >> 172.21.15.37:0/165869535 conn(0x7f15c0071e60 msgr2=0x7f15c00b8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:59.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.056+0000 7f15c73fb640 1 -- 172.21.15.37:0/165869535 shutdown_connections 2023-12-19T16:06:59.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.056+0000 7f15c73fb640 1 -- 172.21.15.37:0/165869535 wait complete. 2023-12-19T16:06:59.070 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:06:59.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.172+0000 7f5c68e51640 1 Processor -- start 2023-12-19T16:06:59.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.172+0000 7f5c68e51640 1 -- start start 2023-12-19T16:06:59.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.173+0000 7f5c68e51640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5c640b6690 0x7f5c64144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:59.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.173+0000 7f5c68e51640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c640bc6b0 con 0x7f5c64144cd0 2023-12-19T16:06:59.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.173+0000 7f5c68e51640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c640a59f0 con 0x7f5c640bcdd0 2023-12-19T16:06:59.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.173+0000 7f5c68e51640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c640bc0a0 con 0x7f5c640b6690 2023-12-19T16:06:59.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.173+0000 7f5c61d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5c640b6690 0x7f5c64144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:59.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.173+0000 7f5c62d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5c64144cd0 0x7f5c64155340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53004/0 (socket says 172.21.15.37:53004) 2023-12-19T16:06:59.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.173+0000 7f5c62d9d640 1 -- 172.21.15.37:0/952285917 learned_addr learned my addr 172.21.15.37:0/952285917 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:06:59.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.173+0000 7f5c6159a640 1 -- 172.21.15.37:0/952285917 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643312860 0 0) 0x7f5c640bc6b0 con 0x7f5c64144cd0 2023-12-19T16:06:59.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.173+0000 7f5c6159a640 1 -- 172.21.15.37:0/952285917 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c4c003520 con 0x7f5c64144cd0 2023-12-19T16:06:59.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.173+0000 7f5c61d9b640 1 -- 172.21.15.37:0/952285917 >> v1:172.21.15.78:6789/0 conn(0x7f5c640bcdd0 legacy=0x7f5c640b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:59.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.173+0000 7f5c61d9b640 1 -- 172.21.15.37:0/952285917 >> v1:172.21.15.37:6789/0 conn(0x7f5c64144cd0 legacy=0x7f5c64155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:59.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.173+0000 7f5c61d9b640 1 -- 172.21.15.37:0/952285917 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c640bc340 con 0x7f5c640b6690 2023-12-19T16:06:59.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.174+0000 7f5c61d9b640 1 --2- 172.21.15.37:0/952285917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c640b6690 0x7f5c64144790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5c640a5b80 tx=0x7f5c5802b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31ef34ffd76f9a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:59.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.174+0000 7f5c6159a640 1 -- 172.21.15.37:0/952285917 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c58030890 con 0x7f5c640b6690 2023-12-19T16:06:59.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.174+0000 7f5c6159a640 1 -- 172.21.15.37:0/952285917 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c580309f0 con 0x7f5c640b6690 2023-12-19T16:06:59.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.174+0000 7f5c6159a640 1 -- 172.21.15.37:0/952285917 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c58030d80 con 0x7f5c640b6690 2023-12-19T16:06:59.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.175+0000 7f5c68e51640 1 -- 172.21.15.37:0/952285917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c640b6690 msgr2=0x7f5c64144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:59.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.175+0000 7f5c68e51640 1 --2- 172.21.15.37:0/952285917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c640b6690 0x7f5c64144790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5c640a5b80 tx=0x7f5c5802b9d0 comp rx=0 tx=0).stop 2023-12-19T16:06:59.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.175+0000 7f5c68e51640 1 -- 172.21.15.37:0/952285917 shutdown_connections 2023-12-19T16:06:59.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.175+0000 7f5c68e51640 1 --2- 172.21.15.37:0/952285917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c640b6690 0x7f5c64144790 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:59.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.175+0000 7f5c68e51640 1 -- 172.21.15.37:0/952285917 >> 172.21.15.37:0/952285917 conn(0x7f5c64071e60 msgr2=0x7f5c640c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:59.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.175+0000 7f5c68e51640 1 -- 172.21.15.37:0/952285917 shutdown_connections 2023-12-19T16:06:59.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.175+0000 7f5c68e51640 1 -- 172.21.15.37:0/952285917 wait complete. 2023-12-19T16:06:59.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.176+0000 7f5c68e51640 1 Processor -- start 2023-12-19T16:06:59.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.176+0000 7f5c68e51640 1 -- start start 2023-12-19T16:06:59.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c68e51640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5c640b6690 0x7f5c6413f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:59.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c68e51640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c640bcdd0 0x7f5c64149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:59.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c68e51640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c64144cd0 0x7f5c641dfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:59.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c68e51640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6413fa10 con 0x7f5c64144cd0 2023-12-19T16:06:59.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c68e51640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c641d4650 con 0x7f5c640bcdd0 2023-12-19T16:06:59.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c68e51640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c641d4ef0 con 0x7f5c640b6690 2023-12-19T16:06:59.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c62d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c64144cd0 0x7f5c641dfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:59.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c62d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c64144cd0 0x7f5c641dfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44388/0 (socket says 172.21.15.37:44388) 2023-12-19T16:06:59.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c62d9d640 1 -- 172.21.15.37:0/1771500334 learned_addr learned my addr 172.21.15.37:0/1771500334 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:59.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c61d9b640 1 --2- 172.21.15.37:0/1771500334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c640bcdd0 0x7f5c64149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:59.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c6259c640 1 --2- 172.21.15.37:0/1771500334 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5c640b6690 0x7f5c6413f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:59.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c62d9d640 1 -- 172.21.15.37:0/1771500334 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5c640b6690 msgr2=0x7f5c6413f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:59.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c62d9d640 1 --2- 172.21.15.37:0/1771500334 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5c640b6690 0x7f5c6413f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:59.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c62d9d640 1 -- 172.21.15.37:0/1771500334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c640bcdd0 msgr2=0x7f5c64149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:59.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c62d9d640 1 --2- 172.21.15.37:0/1771500334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c640bcdd0 0x7f5c64149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:59.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c62d9d640 1 -- 172.21.15.37:0/1771500334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c58009400 con 0x7f5c64144cd0 2023-12-19T16:06:59.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c6259c640 1 --2- 172.21.15.37:0/1771500334 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5c640b6690 0x7f5c6413f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:06:59.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c62d9d640 1 --2- 172.21.15.37:0/1771500334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c64144cd0 0x7f5c641dfb00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400caa0 tx=0x7f5c5400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:59.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c52ffd640 1 -- 172.21.15.37:0/1771500334 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5400ac00 con 0x7f5c64144cd0 2023-12-19T16:06:59.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c52ffd640 1 -- 172.21.15.37:0/1771500334 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5400ad60 con 0x7f5c64144cd0 2023-12-19T16:06:59.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c68e51640 1 -- 172.21.15.37:0/1771500334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c64149870 con 0x7f5c64144cd0 2023-12-19T16:06:59.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c52ffd640 1 -- 172.21.15.37:0/1771500334 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c54012620 con 0x7f5c64144cd0 2023-12-19T16:06:59.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.177+0000 7f5c68e51640 1 -- 172.21.15.37:0/1771500334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6413fbe0 con 0x7f5c64144cd0 2023-12-19T16:06:59.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.179+0000 7f5c68e51640 1 -- 172.21.15.37:0/1771500334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c641df820 con 0x7f5c64144cd0 2023-12-19T16:06:59.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.179+0000 7f5c52ffd640 1 -- 172.21.15.37:0/1771500334 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5c54007070 con 0x7f5c64144cd0 2023-12-19T16:06:59.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.179+0000 7f5c52ffd640 1 --2- 172.21.15.37:0/1771500334 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5c4406a430 0x7f5c4406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:59.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.179+0000 7f5c52ffd640 1 -- 172.21.15.37:0/1771500334 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c54088880 con 0x7f5c64144cd0 2023-12-19T16:06:59.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.179+0000 7f5c6259c640 1 --2- 172.21.15.37:0/1771500334 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5c4406a430 0x7f5c4406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:59.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.180+0000 7f5c6259c640 1 --2- 172.21.15.37:0/1771500334 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5c4406a430 0x7f5c4406c8f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c000f60 tx=0x7f5c5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:59.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.183+0000 7f5c52ffd640 1 -- 172.21.15.37:0/1771500334 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5c641df820 con 0x7f5c64144cd0 2023-12-19T16:06:59.289 INFO:tasks.ceph.mds.b.smithi078.stderr:2023-12-19T16:06:59.286+0000 7f9319e50640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T16:06:59.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.365+0000 7f5c68e51640 1 -- 172.21.15.37:0/1771500334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c641df820 con 0x7f5c64144cd0 2023-12-19T16:06:59.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.366+0000 7f5c52ffd640 1 -- 172.21.15.37:0/1771500334 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16002 (secure 0 0 0) 0x7f5c641df820 con 0x7f5c64144cd0 2023-12-19T16:06:59.369 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:06:59.369 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:58.727432+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:06:56.758166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:06:57.635291+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:06:59.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.368+0000 7f5c68e51640 1 -- 172.21.15.37:0/1771500334 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5c4406a430 msgr2=0x7f5c4406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:59.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.368+0000 7f5c68e51640 1 --2- 172.21.15.37:0/1771500334 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5c4406a430 0x7f5c4406c8f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c000f60 tx=0x7f5c5c009040 comp rx=0 tx=0).stop 2023-12-19T16:06:59.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.368+0000 7f5c68e51640 1 -- 172.21.15.37:0/1771500334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c64144cd0 msgr2=0x7f5c641dfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:59.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.368+0000 7f5c68e51640 1 --2- 172.21.15.37:0/1771500334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c64144cd0 0x7f5c641dfb00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400caa0 tx=0x7f5c5400cf60 comp rx=0 tx=0).stop 2023-12-19T16:06:59.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.368+0000 7f5c68e51640 1 -- 172.21.15.37:0/1771500334 shutdown_connections 2023-12-19T16:06:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.368+0000 7f5c68e51640 1 --2- 172.21.15.37:0/1771500334 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5c4406a430 0x7f5c4406c8f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.368+0000 7f5c68e51640 1 --2- 172.21.15.37:0/1771500334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c64144cd0 0x7f5c641dfb00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.368+0000 7f5c68e51640 1 --2- 172.21.15.37:0/1771500334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c640bcdd0 0x7f5c64149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.368+0000 7f5c68e51640 1 --2- 172.21.15.37:0/1771500334 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5c640b6690 0x7f5c6413f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.368+0000 7f5c68e51640 1 -- 172.21.15.37:0/1771500334 >> 172.21.15.37:0/1771500334 conn(0x7f5c64071e60 msgr2=0x7f5c641d5110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.368+0000 7f5c68e51640 1 -- 172.21.15.37:0/1771500334 shutdown_connections 2023-12-19T16:06:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.368+0000 7f5c68e51640 1 -- 172.21.15.37:0/1771500334 wait complete. 2023-12-19T16:06:59.382 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T16:06:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.488+0000 7f7309ee9640 1 Processor -- start 2023-12-19T16:06:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.488+0000 7f7309ee9640 1 -- start start 2023-12-19T16:06:59.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.488+0000 7f7309ee9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f73040bf510 0x7f73040be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:59.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.488+0000 7f7309ee9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f730406a950 0x7f73040bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:59.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.488+0000 7f7309ee9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73040bfa50 con 0x7f73040bb140 2023-12-19T16:06:59.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.488+0000 7f7309ee9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73040bbda0 con 0x7f730406a950 2023-12-19T16:06:59.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.488+0000 7f7309ee9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730406b040 con 0x7f73040bf510 2023-12-19T16:06:59.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.488+0000 7f7303fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f730406a950 0x7f73040bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.489+0000 7f7303fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f730406a950 0x7f73040bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44398/0 (socket says 172.21.15.37:44398) 2023-12-19T16:06:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.489+0000 7f7303fff640 1 -- 172.21.15.37:0/1179452883 learned_addr learned my addr 172.21.15.37:0/1179452883 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.489+0000 7f73037fe640 1 --1- 172.21.15.37:0/1179452883 >> v1:172.21.15.37:6789/0 conn(0x7f73040bb140 0x7f73040bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53008/0 (socket says 172.21.15.37:53008) 2023-12-19T16:06:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.489+0000 7f7302ffd640 1 --2- 172.21.15.37:0/1179452883 >> v2:172.21.15.78:3300/0 conn(0x7f73040bf510 0x7f73040be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.489+0000 7f7303fff640 1 -- 172.21.15.37:0/1179452883 >> v2:172.21.15.78:3300/0 conn(0x7f73040bf510 msgr2=0x7f73040be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:06:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.489+0000 7f7303fff640 1 --2- 172.21.15.37:0/1179452883 >> v2:172.21.15.78:3300/0 conn(0x7f73040bf510 0x7f73040be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.489+0000 7f7303fff640 1 -- 172.21.15.37:0/1179452883 >> v1:172.21.15.37:6789/0 conn(0x7f73040bb140 legacy=0x7f73040bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.489+0000 7f7303fff640 1 -- 172.21.15.37:0/1179452883 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73040bb520 con 0x7f730406a950 2023-12-19T16:06:59.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.490+0000 7f7303fff640 1 --2- 172.21.15.37:0/1179452883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730406a950 0x7f73040bfee0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f730406b650 tx=0x7f72fc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb77aa5decc92d40 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:59.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.490+0000 7f73027fc640 1 -- 172.21.15.37:0/1179452883 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc02ca80 con 0x7f730406a950 2023-12-19T16:06:59.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.490+0000 7f73027fc640 1 -- 172.21.15.37:0/1179452883 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc02cbe0 con 0x7f730406a950 2023-12-19T16:06:59.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.490+0000 7f73027fc640 1 -- 172.21.15.37:0/1179452883 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc0343f0 con 0x7f730406a950 2023-12-19T16:06:59.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.490+0000 7f7309ee9640 1 -- 172.21.15.37:0/1179452883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730406a950 msgr2=0x7f73040bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:59.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.490+0000 7f7309ee9640 1 --2- 172.21.15.37:0/1179452883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730406a950 0x7f73040bfee0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f730406b650 tx=0x7f72fc02bee0 comp rx=0 tx=0).stop 2023-12-19T16:06:59.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.490+0000 7f7309ee9640 1 -- 172.21.15.37:0/1179452883 shutdown_connections 2023-12-19T16:06:59.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.490+0000 7f7309ee9640 1 --2- 172.21.15.37:0/1179452883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730406a950 0x7f73040bfee0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:59.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.490+0000 7f7309ee9640 1 --2- 172.21.15.37:0/1179452883 >> v2:172.21.15.78:3300/0 conn(0x7f73040bf510 0x7f73040be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:59.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.490+0000 7f7309ee9640 1 -- 172.21.15.37:0/1179452883 >> 172.21.15.37:0/1179452883 conn(0x7f73040bcfd0 msgr2=0x7f73040bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:06:59.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.490+0000 7f7309ee9640 1 -- 172.21.15.37:0/1179452883 shutdown_connections 2023-12-19T16:06:59.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.490+0000 7f7309ee9640 1 -- 172.21.15.37:0/1179452883 wait complete. 2023-12-19T16:06:59.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.491+0000 7f7309ee9640 1 Processor -- start 2023-12-19T16:06:59.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.492+0000 7f7309ee9640 1 -- start start 2023-12-19T16:06:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.492+0000 7f7309ee9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730406a950 0x7f73040a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.492+0000 7f7309ee9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73040bb140 0x7f7304147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.492+0000 7f7309ee9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f73040bf510 0x7f7304148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.492+0000 7f7309ee9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730414aed0 con 0x7f730406a950 2023-12-19T16:06:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.492+0000 7f7309ee9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73040a2ef0 con 0x7f73040bb140 2023-12-19T16:06:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.492+0000 7f7309ee9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730414eda0 con 0x7f73040bf510 2023-12-19T16:06:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.492+0000 7f73037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730406a950 0x7f73040a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.492+0000 7f73037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730406a950 0x7f73040a29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44414/0 (socket says 172.21.15.37:44414) 2023-12-19T16:06:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.492+0000 7f73037fe640 1 -- 172.21.15.37:0/2495086484 learned_addr learned my addr 172.21.15.37:0/2495086484 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:06:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.492+0000 7f7303fff640 1 --2- 172.21.15.37:0/2495086484 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f73040bf510 0x7f7304148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.492+0000 7f7302ffd640 1 --2- 172.21.15.37:0/2495086484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73040bb140 0x7f7304147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.493+0000 7f73037fe640 1 -- 172.21.15.37:0/2495086484 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f73040bf510 msgr2=0x7f7304148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.493+0000 7f73037fe640 1 --2- 172.21.15.37:0/2495086484 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f73040bf510 0x7f7304148250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.493+0000 7f73037fe640 1 -- 172.21.15.37:0/2495086484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73040bb140 msgr2=0x7f7304147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:06:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.493+0000 7f73037fe640 1 --2- 172.21.15.37:0/2495086484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73040bb140 0x7f7304147d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:06:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.493+0000 7f73037fe640 1 -- 172.21.15.37:0/2495086484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc009b30 con 0x7f730406a950 2023-12-19T16:06:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.493+0000 7f73037fe640 1 --2- 172.21.15.37:0/2495086484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730406a950 0x7f73040a29b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f72f400c3e0 tx=0x7f72f400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.493+0000 7f72ebfff640 1 -- 172.21.15.37:0/2495086484 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f40074e0 con 0x7f730406a950 2023-12-19T16:06:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.493+0000 7f72ebfff640 1 -- 172.21.15.37:0/2495086484 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f4007640 con 0x7f730406a950 2023-12-19T16:06:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.493+0000 7f7309ee9640 1 -- 172.21.15.37:0/2495086484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730414e790 con 0x7f730406a950 2023-12-19T16:06:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.493+0000 7f72ebfff640 1 -- 172.21.15.37:0/2495086484 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f40049e0 con 0x7f730406a950 2023-12-19T16:06:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.493+0000 7f7309ee9640 1 -- 172.21.15.37:0/2495086484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730414ea30 con 0x7f730406a950 2023-12-19T16:06:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.494+0000 7f7309ee9640 1 -- 172.21.15.37:0/2495086484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730406b330 con 0x7f730406a950 2023-12-19T16:06:59.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.494+0000 7f72ebfff640 1 -- 172.21.15.37:0/2495086484 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f72f4004b40 con 0x7f730406a950 2023-12-19T16:06:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.495+0000 7f72ebfff640 1 --2- 172.21.15.37:0/2495086484 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f72f006a430 0x7f72f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:06:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.495+0000 7f72ebfff640 1 -- 172.21.15.37:0/2495086484 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72f40883b0 con 0x7f730406a950 2023-12-19T16:06:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.495+0000 7f7302ffd640 1 --2- 172.21.15.37:0/2495086484 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f72f006a430 0x7f72f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:06:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.495+0000 7f7302ffd640 1 --2- 172.21.15.37:0/2495086484 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f72f006a430 0x7f72f006c8f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f73041499c0 tx=0x7f72f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:06:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.499+0000 7f72ebfff640 1 -- 172.21.15.37:0/2495086484 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f72f4053890 con 0x7f730406a950 2023-12-19T16:06:59.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:06:59.712+0000 7f7309ee9640 1 -- 172.21.15.37:0/2495086484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f73040740a0 con 0x7f730406a950 2023-12-19T16:07:00.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.299+0000 7f72ebfff640 1 -- 172.21.15.37:0/2495086484 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f72f4056eb0 con 0x7f730406a950 2023-12-19T16:07:00.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.301+0000 7f7309ee9640 1 -- 172.21.15.37:0/2495086484 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f72f006a430 msgr2=0x7f72f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:00.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.301+0000 7f7309ee9640 1 --2- 172.21.15.37:0/2495086484 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f72f006a430 0x7f72f006c8f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f73041499c0 tx=0x7f72f8008040 comp rx=0 tx=0).stop 2023-12-19T16:07:00.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.301+0000 7f7309ee9640 1 -- 172.21.15.37:0/2495086484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730406a950 msgr2=0x7f73040a29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:00.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.301+0000 7f7309ee9640 1 --2- 172.21.15.37:0/2495086484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730406a950 0x7f73040a29b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f72f400c3e0 tx=0x7f72f400c8a0 comp rx=0 tx=0).stop 2023-12-19T16:07:00.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.302+0000 7f7309ee9640 1 -- 172.21.15.37:0/2495086484 shutdown_connections 2023-12-19T16:07:00.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.302+0000 7f7309ee9640 1 --2- 172.21.15.37:0/2495086484 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f72f006a430 0x7f72f006c8f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:00.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.302+0000 7f7309ee9640 1 --2- 172.21.15.37:0/2495086484 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f73040bf510 0x7f7304148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.302+0000 7f7309ee9640 1 --2- 172.21.15.37:0/2495086484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73040bb140 0x7f7304147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.302+0000 7f7309ee9640 1 --2- 172.21.15.37:0/2495086484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f730406a950 0x7f73040a29b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.302+0000 7f7309ee9640 1 -- 172.21.15.37:0/2495086484 >> 172.21.15.37:0/2495086484 conn(0x7f73040bcfd0 msgr2=0x7f73040a5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.302+0000 7f7309ee9640 1 -- 172.21.15.37:0/2495086484 shutdown_connections 2023-12-19T16:07:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.302+0000 7f7309ee9640 1 -- 172.21.15.37:0/2495086484 wait complete. 2023-12-19T16:07:00.318 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T16:07:00.318 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T16:07:00.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.430+0000 7f1ccb7ae640 1 Processor -- start 2023-12-19T16:07:00.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.430+0000 7f1ccb7ae640 1 -- start start 2023-12-19T16:07:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.431+0000 7f1ccb7ae640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1cc40bb140 0x7f1cc40be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.431+0000 7f1ccb7ae640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1cc406a950 0x7f1cc40bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.431+0000 7f1ccb7ae640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc40bfa50 con 0x7f1cc40bee00 2023-12-19T16:07:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.431+0000 7f1ccb7ae640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc40bbda0 con 0x7f1cc406a950 2023-12-19T16:07:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.431+0000 7f1ccb7ae640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc406b040 con 0x7f1cc40bb140 2023-12-19T16:07:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.431+0000 7f1cc8d49640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1cc406a950 0x7f1cc40bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.431+0000 7f1cc8d49640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1cc406a950 0x7f1cc40bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49310/0 (socket says 172.21.15.37:49310) 2023-12-19T16:07:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.431+0000 7f1cc8d49640 1 -- 172.21.15.37:0/4152603893 learned_addr learned my addr 172.21.15.37:0/4152603893 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.431+0000 7f1cc9d4b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1cc40bee00 0x7f1cc40bf210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36996/0 (socket says 172.21.15.37:36996) 2023-12-19T16:07:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.431+0000 7f1cc954a640 1 --2- 172.21.15.37:0/4152603893 >> v2:172.21.15.78:3300/0 conn(0x7f1cc40bb140 0x7f1cc40be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.431+0000 7f1cc8d49640 1 -- 172.21.15.37:0/4152603893 >> v2:172.21.15.78:3300/0 conn(0x7f1cc40bb140 msgr2=0x7f1cc40be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.431+0000 7f1cc8d49640 1 --2- 172.21.15.37:0/4152603893 >> v2:172.21.15.78:3300/0 conn(0x7f1cc40bb140 0x7f1cc40be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.431+0000 7f1cc8d49640 1 -- 172.21.15.37:0/4152603893 >> v1:172.21.15.37:6789/0 conn(0x7f1cc40bee00 legacy=0x7f1cc40bf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:00.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.431+0000 7f1cc8d49640 1 -- 172.21.15.37:0/4152603893 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc40bb520 con 0x7f1cc406a950 2023-12-19T16:07:00.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.431+0000 7f1cb7fff640 1 -- 172.21.15.37:0/4152603893 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254888637 0 0) 0x7f1cc40bfa50 con 0x7f1cc40bee00 2023-12-19T16:07:00.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.432+0000 7f1cc8d49640 1 --2- 172.21.15.37:0/4152603893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc406a950 0x7f1cc40bfee0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4067620 tx=0x7f1cc002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ab6794f98e8e8b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:00.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.432+0000 7f1cb7fff640 1 -- 172.21.15.37:0/4152603893 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0031870 con 0x7f1cc406a950 2023-12-19T16:07:00.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.432+0000 7f1cb7fff640 1 -- 172.21.15.37:0/4152603893 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc00319d0 con 0x7f1cc406a950 2023-12-19T16:07:00.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.432+0000 7f1cb7fff640 1 -- 172.21.15.37:0/4152603893 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0031d60 con 0x7f1cc406a950 2023-12-19T16:07:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.433+0000 7f1ccb7ae640 1 -- 172.21.15.37:0/4152603893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc406a950 msgr2=0x7f1cc40bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.433+0000 7f1ccb7ae640 1 --2- 172.21.15.37:0/4152603893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc406a950 0x7f1cc40bfee0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4067620 tx=0x7f1cc002b910 comp rx=0 tx=0).stop 2023-12-19T16:07:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.433+0000 7f1ccb7ae640 1 -- 172.21.15.37:0/4152603893 shutdown_connections 2023-12-19T16:07:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.433+0000 7f1ccb7ae640 1 --2- 172.21.15.37:0/4152603893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc406a950 0x7f1cc40bfee0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.433+0000 7f1ccb7ae640 1 --2- 172.21.15.37:0/4152603893 >> v2:172.21.15.78:3300/0 conn(0x7f1cc40bb140 0x7f1cc40be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.433+0000 7f1ccb7ae640 1 -- 172.21.15.37:0/4152603893 >> 172.21.15.37:0/4152603893 conn(0x7f1cc40bcfd0 msgr2=0x7f1cc40bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.433+0000 7f1ccb7ae640 1 -- 172.21.15.37:0/4152603893 shutdown_connections 2023-12-19T16:07:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.433+0000 7f1ccb7ae640 1 -- 172.21.15.37:0/4152603893 wait complete. 2023-12-19T16:07:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.434+0000 7f1ccb7ae640 1 Processor -- start 2023-12-19T16:07:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.434+0000 7f1ccb7ae640 1 -- start start 2023-12-19T16:07:00.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.434+0000 7f1ccb7ae640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cc406a950 0x7f1cc40a2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:00.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.434+0000 7f1ccb7ae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc40bb140 0x7f1cc41e33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:00.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.435+0000 7f1ccb7ae640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1cc40bee00 0x7f1cc414e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:00.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.435+0000 7f1ccb7ae640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40a2e60 con 0x7f1cc40bb140 2023-12-19T16:07:00.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.435+0000 7f1ccb7ae640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc414c300 con 0x7f1cc406a950 2023-12-19T16:07:00.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.435+0000 7f1ccb7ae640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40b62d0 con 0x7f1cc40bee00 2023-12-19T16:07:00.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.435+0000 7f1cc8d49640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc40bb140 0x7f1cc41e33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:00.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.435+0000 7f1cc8d49640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc40bb140 0x7f1cc41e33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49316/0 (socket says 172.21.15.37:49316) 2023-12-19T16:07:00.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.435+0000 7f1cc8d49640 1 -- 172.21.15.37:0/1605077173 learned_addr learned my addr 172.21.15.37:0/1605077173 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:00.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.435+0000 7f1cc954a640 1 --2- 172.21.15.37:0/1605077173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cc406a950 0x7f1cc40a2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:00.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.435+0000 7f1cc9d4b640 1 --2- 172.21.15.37:0/1605077173 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1cc40bee00 0x7f1cc414e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:00.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.435+0000 7f1cc8d49640 1 -- 172.21.15.37:0/1605077173 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1cc40bee00 msgr2=0x7f1cc414e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:00.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.435+0000 7f1cc8d49640 1 --2- 172.21.15.37:0/1605077173 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1cc40bee00 0x7f1cc414e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:00.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.435+0000 7f1cc8d49640 1 -- 172.21.15.37:0/1605077173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cc406a950 msgr2=0x7f1cc40a2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:00.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.435+0000 7f1cc8d49640 1 --2- 172.21.15.37:0/1605077173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cc406a950 0x7f1cc40a2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:00.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.435+0000 7f1cc8d49640 1 -- 172.21.15.37:0/1605077173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc00094d0 con 0x7f1cc40bb140 2023-12-19T16:07:00.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.435+0000 7f1cc8d49640 1 --2- 172.21.15.37:0/1605077173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc40bb140 0x7f1cc41e33a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1cc002b950 tx=0x7f1cc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:00.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.435+0000 7f1cb5ffb640 1 -- 172.21.15.37:0/1605077173 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc003ad30 con 0x7f1cc40bb140 2023-12-19T16:07:00.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.435+0000 7f1cb5ffb640 1 -- 172.21.15.37:0/1605077173 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc00443f0 con 0x7f1cc40bb140 2023-12-19T16:07:00.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.435+0000 7f1ccb7ae640 1 -- 172.21.15.37:0/1605077173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc40b7000 con 0x7f1cc40bb140 2023-12-19T16:07:00.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.435+0000 7f1cb5ffb640 1 -- 172.21.15.37:0/1605077173 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc00447a0 con 0x7f1cc40bb140 2023-12-19T16:07:00.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.436+0000 7f1ccb7ae640 1 -- 172.21.15.37:0/1605077173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc40b6800 con 0x7f1cc40bb140 2023-12-19T16:07:00.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.436+0000 7f1ccb7ae640 1 -- 172.21.15.37:0/1605077173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc406b3a0 con 0x7f1cc40bb140 2023-12-19T16:07:00.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.437+0000 7f1cb5ffb640 1 -- 172.21.15.37:0/1605077173 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1cc004d450 con 0x7f1cc40bb140 2023-12-19T16:07:00.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.437+0000 7f1cb5ffb640 1 --2- 172.21.15.37:0/1605077173 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f1ca806a430 0x7f1ca806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:00.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.437+0000 7f1cb5ffb640 1 -- 172.21.15.37:0/1605077173 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cc002d040 con 0x7f1cc40bb140 2023-12-19T16:07:00.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.438+0000 7f1cc954a640 1 --2- 172.21.15.37:0/1605077173 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f1ca806a430 0x7f1ca806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:00.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.438+0000 7f1cc954a640 1 --2- 172.21.15.37:0/1605077173 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f1ca806a430 0x7f1ca806c8f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80079a0 tx=0x7f1cb8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:00.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.442+0000 7f1cb5ffb640 1 -- 172.21.15.37:0/1605077173 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1cc0076420 con 0x7f1cc40bb140 2023-12-19T16:07:00.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:00.655+0000 7f1ccb7ae640 1 -- 172.21.15.37:0/1605077173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1cc409fbe0 con 0x7f1cc40bb140 2023-12-19T16:07:01.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.304+0000 7f1cb5ffb640 1 -- 172.21.15.37:0/1605077173 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1cc0035020 con 0x7f1cc40bb140 2023-12-19T16:07:01.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.307+0000 7f1ccb7ae640 1 -- 172.21.15.37:0/1605077173 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f1ca806a430 msgr2=0x7f1ca806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:01.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.307+0000 7f1ccb7ae640 1 --2- 172.21.15.37:0/1605077173 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f1ca806a430 0x7f1ca806c8f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80079a0 tx=0x7f1cb8008040 comp rx=0 tx=0).stop 2023-12-19T16:07:01.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.307+0000 7f1ccb7ae640 1 -- 172.21.15.37:0/1605077173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc40bb140 msgr2=0x7f1cc41e33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:01.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.307+0000 7f1ccb7ae640 1 --2- 172.21.15.37:0/1605077173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc40bb140 0x7f1cc41e33a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1cc002b950 tx=0x7f1cc00046c0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.307+0000 7f1ccb7ae640 1 -- 172.21.15.37:0/1605077173 shutdown_connections 2023-12-19T16:07:01.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.307+0000 7f1ccb7ae640 1 --2- 172.21.15.37:0/1605077173 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f1ca806a430 0x7f1ca806c8f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.307+0000 7f1ccb7ae640 1 --2- 172.21.15.37:0/1605077173 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1cc40bee00 0x7f1cc414e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.307+0000 7f1ccb7ae640 1 --2- 172.21.15.37:0/1605077173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc40bb140 0x7f1cc41e33a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.307+0000 7f1ccb7ae640 1 --2- 172.21.15.37:0/1605077173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cc406a950 0x7f1cc40a2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.307+0000 7f1ccb7ae640 1 -- 172.21.15.37:0/1605077173 >> 172.21.15.37:0/1605077173 conn(0x7f1cc40bcfd0 msgr2=0x7f1cc40a5680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:01.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.307+0000 7f1ccb7ae640 1 -- 172.21.15.37:0/1605077173 shutdown_connections 2023-12-19T16:07:01.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.307+0000 7f1ccb7ae640 1 -- 172.21.15.37:0/1605077173 wait complete. 2023-12-19T16:07:01.323 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T16:07:01.323 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:07:01.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.432+0000 7f8f80b2e640 1 Processor -- start 2023-12-19T16:07:01.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.432+0000 7f8f80b2e640 1 -- start start 2023-12-19T16:07:01.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.432+0000 7f8f80b2e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8f7c0b6690 0x7f8f7c144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:01.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.432+0000 7f8f80b2e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f7c144cd0 0x7f8f7c155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:01.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.433+0000 7f8f80b2e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f7c0bc6b0 con 0x7f8f7c0bcdd0 2023-12-19T16:07:01.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.433+0000 7f8f80b2e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f7c0a59f0 con 0x7f8f7c0b6690 2023-12-19T16:07:01.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.433+0000 7f8f80b2e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c0bc0a0 con 0x7f8f7c144cd0 2023-12-19T16:07:01.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.433+0000 7f8f79d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8f7c0b6690 0x7f8f7c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:01.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.433+0000 7f8f79d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8f7c0b6690 0x7f8f7c144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49332/0 (socket says 172.21.15.37:49332) 2023-12-19T16:07:01.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.433+0000 7f8f79d9b640 1 -- 172.21.15.37:0/1287961997 learned_addr learned my addr 172.21.15.37:0/1287961997 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:01.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.433+0000 7f8f7ad9d640 1 --2- 172.21.15.37:0/1287961997 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f7c144cd0 0x7f8f7c155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:01.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.433+0000 7f8f79d9b640 1 -- 172.21.15.37:0/1287961997 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f7c144cd0 msgr2=0x7f8f7c155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:01.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.433+0000 7f8f79d9b640 1 --2- 172.21.15.37:0/1287961997 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f7c144cd0 0x7f8f7c155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.433+0000 7f8f79d9b640 1 -- 172.21.15.37:0/1287961997 >> v1:172.21.15.78:6789/0 conn(0x7f8f7c0bcdd0 legacy=0x7f8f7c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:01.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.433+0000 7f8f79d9b640 1 -- 172.21.15.37:0/1287961997 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c0bc340 con 0x7f8f7c0b6690 2023-12-19T16:07:01.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.434+0000 7f8f79d9b640 1 --2- 172.21.15.37:0/1287961997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f7c0b6690 0x7f8f7c144790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009870 tx=0x7f8f7002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88632ebc2d980dc9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:01.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.434+0000 7f8f7959a640 1 -- 172.21.15.37:0/1287961997 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7002f840 con 0x7f8f7c0b6690 2023-12-19T16:07:01.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.434+0000 7f8f7959a640 1 -- 172.21.15.37:0/1287961997 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7002f9a0 con 0x7f8f7c0b6690 2023-12-19T16:07:01.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.434+0000 7f8f7959a640 1 -- 172.21.15.37:0/1287961997 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7002fd30 con 0x7f8f7c0b6690 2023-12-19T16:07:01.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.434+0000 7f8f80b2e640 1 -- 172.21.15.37:0/1287961997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f7c0b6690 msgr2=0x7f8f7c144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:01.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.434+0000 7f8f80b2e640 1 --2- 172.21.15.37:0/1287961997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f7c0b6690 0x7f8f7c144790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009870 tx=0x7f8f7002ba20 comp rx=0 tx=0).stop 2023-12-19T16:07:01.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.434+0000 7f8f80b2e640 1 -- 172.21.15.37:0/1287961997 shutdown_connections 2023-12-19T16:07:01.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.434+0000 7f8f80b2e640 1 --2- 172.21.15.37:0/1287961997 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f7c144cd0 0x7f8f7c155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.434+0000 7f8f80b2e640 1 --2- 172.21.15.37:0/1287961997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f7c0b6690 0x7f8f7c144790 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.434+0000 7f8f80b2e640 1 -- 172.21.15.37:0/1287961997 >> 172.21.15.37:0/1287961997 conn(0x7f8f7c071e60 msgr2=0x7f8f7c0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:01.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.435+0000 7f8f80b2e640 1 -- 172.21.15.37:0/1287961997 shutdown_connections 2023-12-19T16:07:01.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.435+0000 7f8f80b2e640 1 -- 172.21.15.37:0/1287961997 wait complete. 2023-12-19T16:07:01.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.436+0000 7f8f80b2e640 1 Processor -- start 2023-12-19T16:07:01.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.436+0000 7f8f80b2e640 1 -- start start 2023-12-19T16:07:01.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.436+0000 7f8f80b2e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f7c0b6690 0x7f8f7c14ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:01.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.436+0000 7f8f80b2e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f7c0bcdd0 0x7f8f7c1e0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:01.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.436+0000 7f8f80b2e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f7c144cd0 0x7f8f7c13b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.436+0000 7f8f80b2e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c14b220 con 0x7f8f7c144cd0 2023-12-19T16:07:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.436+0000 7f8f80b2e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c1d0b20 con 0x7f8f7c0bcdd0 2023-12-19T16:07:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.436+0000 7f8f80b2e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c1d70f0 con 0x7f8f7c0b6690 2023-12-19T16:07:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.436+0000 7f8f7ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f7c144cd0 0x7f8f7c13b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.437+0000 7f8f7ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f7c144cd0 0x7f8f7c13b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49340/0 (socket says 172.21.15.37:49340) 2023-12-19T16:07:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.437+0000 7f8f7ad9d640 1 -- 172.21.15.37:0/872919622 learned_addr learned my addr 172.21.15.37:0/872919622 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.437+0000 7f8f79d9b640 1 --2- 172.21.15.37:0/872919622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f7c0bcdd0 0x7f8f7c1e0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.437+0000 7f8f7a59c640 1 --2- 172.21.15.37:0/872919622 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f7c0b6690 0x7f8f7c14ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.437+0000 7f8f7ad9d640 1 -- 172.21.15.37:0/872919622 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f7c0b6690 msgr2=0x7f8f7c14ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.437+0000 7f8f7ad9d640 1 --2- 172.21.15.37:0/872919622 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f7c0b6690 0x7f8f7c14ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.437+0000 7f8f7ad9d640 1 -- 172.21.15.37:0/872919622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f7c0bcdd0 msgr2=0x7f8f7c1e0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.437+0000 7f8f7ad9d640 1 --2- 172.21.15.37:0/872919622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f7c0bcdd0 0x7f8f7c1e0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.437+0000 7f8f7ad9d640 1 -- 172.21.15.37:0/872919622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f700094d0 con 0x7f8f7c144cd0 2023-12-19T16:07:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.437+0000 7f8f7ad9d640 1 --2- 172.21.15.37:0/872919622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f7c144cd0 0x7f8f7c13b010 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400efc0 tx=0x7f8f7400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:01.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.437+0000 7f8f6affd640 1 -- 172.21.15.37:0/872919622 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74009ba0 con 0x7f8f7c144cd0 2023-12-19T16:07:01.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.437+0000 7f8f6affd640 1 -- 172.21.15.37:0/872919622 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7400f040 con 0x7f8f7c144cd0 2023-12-19T16:07:01.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.437+0000 7f8f80b2e640 1 -- 172.21.15.37:0/872919622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f7c1dfb90 con 0x7f8f7c144cd0 2023-12-19T16:07:01.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.437+0000 7f8f6affd640 1 -- 172.21.15.37:0/872919622 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f740146c0 con 0x7f8f7c144cd0 2023-12-19T16:07:01.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.437+0000 7f8f80b2e640 1 -- 172.21.15.37:0/872919622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7c1d1010 con 0x7f8f7c144cd0 2023-12-19T16:07:01.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.438+0000 7f8f80b2e640 1 -- 172.21.15.37:0/872919622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f7c1dfd20 con 0x7f8f7c144cd0 2023-12-19T16:07:01.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.439+0000 7f8f6affd640 1 -- 172.21.15.37:0/872919622 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8f74014820 con 0x7f8f7c144cd0 2023-12-19T16:07:01.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.439+0000 7f8f6affd640 1 --2- 172.21.15.37:0/872919622 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8f5c06a430 0x7f8f5c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:01.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.439+0000 7f8f6affd640 1 -- 172.21.15.37:0/872919622 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f74089220 con 0x7f8f7c144cd0 2023-12-19T16:07:01.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.439+0000 7f8f7a59c640 1 --2- 172.21.15.37:0/872919622 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8f5c06a430 0x7f8f5c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:01.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.440+0000 7f8f7a59c640 1 --2- 172.21.15.37:0/872919622 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8f5c06a430 0x7f8f5c06c8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c000f60 tx=0x7f8f6c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:01.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.443+0000 7f8f6affd640 1 -- 172.21.15.37:0/872919622 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8f74054950 con 0x7f8f7c144cd0 2023-12-19T16:07:01.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.658+0000 7f8f80b2e640 1 -- 172.21.15.37:0/872919622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f7c04e840 con 0x7f8f7c144cd0 2023-12-19T16:07:01.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.658+0000 7f8f6affd640 1 -- 172.21.15.37:0/872919622 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3947 (secure 0 0 0) 0x7f8f74057f70 con 0x7f8f7c144cd0 2023-12-19T16:07:01.661 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:01.662 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4079311036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4079311036},{"type":"v1","addr":"172.21.15.37:6834","nonce":4079311036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1300485428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1300485428},{"type":"v1","addr":"172.21.15.37:6835","nonce":1300485428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:06:58.727746+0000","modified":"2023-12-19T16:07:01.300113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/3319636422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3319636422},{"type":"v1","addr":"172.21.15.78:6835","nonce":3319636422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:07:01.662 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-12-19T16:07:01.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.660+0000 7f8f80b2e640 1 -- 172.21.15.37:0/872919622 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8f5c06a430 msgr2=0x7f8f5c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:01.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.660+0000 7f8f80b2e640 1 --2- 172.21.15.37:0/872919622 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8f5c06a430 0x7f8f5c06c8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c000f60 tx=0x7f8f6c009040 comp rx=0 tx=0).stop 2023-12-19T16:07:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.660+0000 7f8f80b2e640 1 -- 172.21.15.37:0/872919622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f7c144cd0 msgr2=0x7f8f7c13b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.660+0000 7f8f80b2e640 1 --2- 172.21.15.37:0/872919622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f7c144cd0 0x7f8f7c13b010 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400efc0 tx=0x7f8f7400c490 comp rx=0 tx=0).stop 2023-12-19T16:07:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.660+0000 7f8f80b2e640 1 -- 172.21.15.37:0/872919622 shutdown_connections 2023-12-19T16:07:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.660+0000 7f8f80b2e640 1 --2- 172.21.15.37:0/872919622 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8f5c06a430 0x7f8f5c06c8f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.660+0000 7f8f80b2e640 1 --2- 172.21.15.37:0/872919622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f7c144cd0 0x7f8f7c13b010 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.660+0000 7f8f80b2e640 1 --2- 172.21.15.37:0/872919622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f7c0bcdd0 0x7f8f7c1e0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.660+0000 7f8f80b2e640 1 --2- 172.21.15.37:0/872919622 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f7c0b6690 0x7f8f7c14ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.660+0000 7f8f80b2e640 1 -- 172.21.15.37:0/872919622 >> 172.21.15.37:0/872919622 conn(0x7f8f7c071e60 msgr2=0x7f8f7c0b5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.660+0000 7f8f80b2e640 1 -- 172.21.15.37:0/872919622 shutdown_connections 2023-12-19T16:07:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.660+0000 7f8f80b2e640 1 -- 172.21.15.37:0/872919622 wait complete. 2023-12-19T16:07:01.674 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:07:01.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.776+0000 7ffb1002c640 1 Processor -- start 2023-12-19T16:07:01.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.777+0000 7ffb1002c640 1 -- start start 2023-12-19T16:07:01.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.777+0000 7ffb1002c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffb080b6690 0x7ffb08144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:01.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.777+0000 7ffb1002c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffb08144cd0 0x7ffb08155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:01.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.777+0000 7ffb1002c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb080bc6b0 con 0x7ffb080bcdd0 2023-12-19T16:07:01.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.777+0000 7ffb1002c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb080a59f0 con 0x7ffb08144cd0 2023-12-19T16:07:01.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.777+0000 7ffb1002c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb080bc0a0 con 0x7ffb080b6690 2023-12-19T16:07:01.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.777+0000 7ffb0e5c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffb08144cd0 0x7ffb08155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:01.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.777+0000 7ffb0e5c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffb08144cd0 0x7ffb08155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49346/0 (socket says 172.21.15.37:49346) 2023-12-19T16:07:01.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.777+0000 7ffb0e5c9640 1 -- 172.21.15.37:0/4127030012 learned_addr learned my addr 172.21.15.37:0/4127030012 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:01.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.778+0000 7ffb0d5c7640 1 --2- 172.21.15.37:0/4127030012 >> v2:172.21.15.78:3300/0 conn(0x7ffb080b6690 0x7ffb08144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:01.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.778+0000 7ffb0e5c9640 1 -- 172.21.15.37:0/4127030012 >> v2:172.21.15.78:3300/0 conn(0x7ffb080b6690 msgr2=0x7ffb08144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:01.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.778+0000 7ffb0e5c9640 1 --2- 172.21.15.37:0/4127030012 >> v2:172.21.15.78:3300/0 conn(0x7ffb080b6690 0x7ffb08144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.778+0000 7ffb0e5c9640 1 -- 172.21.15.37:0/4127030012 >> v1:172.21.15.78:6789/0 conn(0x7ffb080bcdd0 legacy=0x7ffb080b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:01.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.778+0000 7ffb0e5c9640 1 -- 172.21.15.37:0/4127030012 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb080bc340 con 0x7ffb08144cd0 2023-12-19T16:07:01.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.778+0000 7ffb0e5c9640 1 --2- 172.21.15.37:0/4127030012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb08144cd0 0x7ffb08155340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffb080b72e0 tx=0x7ffaf802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72259db2be93ec13 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:01.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.779+0000 7ffb0cdc6640 1 -- 172.21.15.37:0/4127030012 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf802cb20 con 0x7ffb08144cd0 2023-12-19T16:07:01.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.779+0000 7ffb0cdc6640 1 -- 172.21.15.37:0/4127030012 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf802cc80 con 0x7ffb08144cd0 2023-12-19T16:07:01.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.779+0000 7ffb0cdc6640 1 -- 172.21.15.37:0/4127030012 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf80343f0 con 0x7ffb08144cd0 2023-12-19T16:07:01.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.779+0000 7ffb1002c640 1 -- 172.21.15.37:0/4127030012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb08144cd0 msgr2=0x7ffb08155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:01.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.779+0000 7ffb1002c640 1 --2- 172.21.15.37:0/4127030012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb08144cd0 0x7ffb08155340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffb080b72e0 tx=0x7ffaf802bf80 comp rx=0 tx=0).stop 2023-12-19T16:07:01.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.779+0000 7ffb1002c640 1 -- 172.21.15.37:0/4127030012 shutdown_connections 2023-12-19T16:07:01.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.779+0000 7ffb1002c640 1 --2- 172.21.15.37:0/4127030012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb08144cd0 0x7ffb08155340 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.779+0000 7ffb1002c640 1 --2- 172.21.15.37:0/4127030012 >> v2:172.21.15.78:3300/0 conn(0x7ffb080b6690 0x7ffb08144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.779+0000 7ffb1002c640 1 -- 172.21.15.37:0/4127030012 >> 172.21.15.37:0/4127030012 conn(0x7ffb08071e60 msgr2=0x7ffb080c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:01.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.779+0000 7ffb1002c640 1 -- 172.21.15.37:0/4127030012 shutdown_connections 2023-12-19T16:07:01.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.779+0000 7ffb1002c640 1 -- 172.21.15.37:0/4127030012 wait complete. 2023-12-19T16:07:01.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.780+0000 7ffb1002c640 1 Processor -- start 2023-12-19T16:07:01.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.780+0000 7ffb1002c640 1 -- start start 2023-12-19T16:07:01.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.781+0000 7ffb1002c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb080b6690 0x7ffb0813e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:01.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.781+0000 7ffb1002c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffb080bcdd0 0x7ffb08148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:01.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.781+0000 7ffb1002c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb08144cd0 0x7ffb0813c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:01.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.781+0000 7ffb1002c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb081497a0 con 0x7ffb08144cd0 2023-12-19T16:07:01.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.781+0000 7ffb1002c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0813e930 con 0x7ffb080b6690 2023-12-19T16:07:01.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.781+0000 7ffb1002c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0814a9a0 con 0x7ffb080bcdd0 2023-12-19T16:07:01.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.781+0000 7ffb0e5c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb08144cd0 0x7ffb0813c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:01.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.781+0000 7ffb0e5c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb08144cd0 0x7ffb0813c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49354/0 (socket says 172.21.15.37:49354) 2023-12-19T16:07:01.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.781+0000 7ffb0e5c9640 1 -- 172.21.15.37:0/3562709486 learned_addr learned my addr 172.21.15.37:0/3562709486 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:01.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.781+0000 7ffb0d5c7640 1 --2- 172.21.15.37:0/3562709486 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffb080bcdd0 0x7ffb08148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:01.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.781+0000 7ffb0ddc8640 1 --2- 172.21.15.37:0/3562709486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb080b6690 0x7ffb0813e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:01.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.781+0000 7ffb0e5c9640 1 -- 172.21.15.37:0/3562709486 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffb080bcdd0 msgr2=0x7ffb08148b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:01.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.781+0000 7ffb0e5c9640 1 --2- 172.21.15.37:0/3562709486 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffb080bcdd0 0x7ffb08148b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.781+0000 7ffb0e5c9640 1 -- 172.21.15.37:0/3562709486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb080b6690 msgr2=0x7ffb0813e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:01.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.781+0000 7ffb0e5c9640 1 --2- 172.21.15.37:0/3562709486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb080b6690 0x7ffb0813e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.781+0000 7ffb0e5c9640 1 -- 172.21.15.37:0/3562709486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf8009b30 con 0x7ffb08144cd0 2023-12-19T16:07:01.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.782+0000 7ffb0e5c9640 1 --2- 172.21.15.37:0/3562709486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb08144cd0 0x7ffb0813c3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8036040 tx=0x7ffaf8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:01.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.782+0000 7ffb067fc640 1 -- 172.21.15.37:0/3562709486 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8009510 con 0x7ffb08144cd0 2023-12-19T16:07:01.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.782+0000 7ffb067fc640 1 -- 172.21.15.37:0/3562709486 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf8007e50 con 0x7ffb08144cd0 2023-12-19T16:07:01.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.782+0000 7ffb067fc640 1 -- 172.21.15.37:0/3562709486 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf803e670 con 0x7ffb08144cd0 2023-12-19T16:07:01.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.782+0000 7ffb1002c640 1 -- 172.21.15.37:0/3562709486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0814ac80 con 0x7ffb08144cd0 2023-12-19T16:07:01.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.782+0000 7ffb1002c640 1 -- 172.21.15.37:0/3562709486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb081485f0 con 0x7ffb08144cd0 2023-12-19T16:07:01.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.783+0000 7ffb1002c640 1 -- 172.21.15.37:0/3562709486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0804e840 con 0x7ffb08144cd0 2023-12-19T16:07:01.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.784+0000 7ffb067fc640 1 -- 172.21.15.37:0/3562709486 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffaf803e7d0 con 0x7ffb08144cd0 2023-12-19T16:07:01.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.784+0000 7ffb067fc640 1 --2- 172.21.15.37:0/3562709486 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ffaf406a430 0x7ffaf406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:01.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.784+0000 7ffb067fc640 1 -- 172.21.15.37:0/3562709486 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffaf80ab2d0 con 0x7ffb08144cd0 2023-12-19T16:07:01.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.784+0000 7ffb0ddc8640 1 --2- 172.21.15.37:0/3562709486 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ffaf406a430 0x7ffaf406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:01.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.785+0000 7ffb0ddc8640 1 --2- 172.21.15.37:0/3562709486 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ffaf406a430 0x7ffaf406c8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffb0813eae0 tx=0x7ffb00007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:01.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.788+0000 7ffb067fc640 1 -- 172.21.15.37:0/3562709486 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ffaf8076a00 con 0x7ffb08144cd0 2023-12-19T16:07:01.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.967+0000 7ffb1002c640 1 -- 172.21.15.37:0/3562709486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb080b61c0 con 0x7ffb08144cd0 2023-12-19T16:07:01.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.968+0000 7ffb067fc640 1 -- 172.21.15.37:0/3562709486 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7ffaf807a020 con 0x7ffb08144cd0 2023-12-19T16:07:01.972 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:01.972 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:59.728935+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:06:56.758166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:06:57.635291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:07:01.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.970+0000 7ffb1002c640 1 -- 172.21.15.37:0/3562709486 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ffaf406a430 msgr2=0x7ffaf406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:01.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.970+0000 7ffb1002c640 1 --2- 172.21.15.37:0/3562709486 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ffaf406a430 0x7ffaf406c8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffb0813eae0 tx=0x7ffb00007e30 comp rx=0 tx=0).stop 2023-12-19T16:07:01.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.970+0000 7ffb1002c640 1 -- 172.21.15.37:0/3562709486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb08144cd0 msgr2=0x7ffb0813c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:01.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.970+0000 7ffb1002c640 1 --2- 172.21.15.37:0/3562709486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb08144cd0 0x7ffb0813c3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8036040 tx=0x7ffaf8004a40 comp rx=0 tx=0).stop 2023-12-19T16:07:01.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.970+0000 7ffb1002c640 1 -- 172.21.15.37:0/3562709486 shutdown_connections 2023-12-19T16:07:01.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.970+0000 7ffb1002c640 1 --2- 172.21.15.37:0/3562709486 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ffaf406a430 0x7ffaf406c8f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.970+0000 7ffb1002c640 1 --2- 172.21.15.37:0/3562709486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb08144cd0 0x7ffb0813c3e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.970+0000 7ffb1002c640 1 --2- 172.21.15.37:0/3562709486 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffb080bcdd0 0x7ffb08148b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.970+0000 7ffb1002c640 1 --2- 172.21.15.37:0/3562709486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb080b6690 0x7ffb0813e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:01.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.970+0000 7ffb1002c640 1 -- 172.21.15.37:0/3562709486 >> 172.21.15.37:0/3562709486 conn(0x7ffb08071e60 msgr2=0x7ffb081434a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:01.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.970+0000 7ffb1002c640 1 -- 172.21.15.37:0/3562709486 shutdown_connections 2023-12-19T16:07:01.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:01.970+0000 7ffb1002c640 1 -- 172.21.15.37:0/3562709486 wait complete. 2023-12-19T16:07:01.984 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T16:07:01.984 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:07:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.087+0000 7fdac64c7640 1 Processor -- start 2023-12-19T16:07:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.087+0000 7fdac64c7640 1 -- start start 2023-12-19T16:07:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.088+0000 7fdac64c7640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdac00bcdd0 0x7fdac00b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.088+0000 7fdac64c7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdac0144ea0 0x7fdac0155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.088+0000 7fdac64c7640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac00bc6b0 con 0x7fdac00b64c0 2023-12-19T16:07:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.088+0000 7fdac64c7640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac00b6900 con 0x7fdac0144ea0 2023-12-19T16:07:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.088+0000 7fdac64c7640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac00a59f0 con 0x7fdac00bcdd0 2023-12-19T16:07:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.088+0000 7fdac4a64640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdac0144ea0 0x7fdac0155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:02.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.088+0000 7fdabffff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdac00bcdd0 0x7fdac00b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:02.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.088+0000 7fdac4a64640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdac0144ea0 0x7fdac0155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:40596/0 (socket says 172.21.15.37:40596) 2023-12-19T16:07:02.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.088+0000 7fdac4a64640 1 -- 172.21.15.37:0/42738393 learned_addr learned my addr 172.21.15.37:0/42738393 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:02.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.088+0000 7fdabf7fe640 1 --1- 172.21.15.37:0/42738393 >> v1:172.21.15.78:6789/0 conn(0x7fdac00b64c0 0x7fdac0144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.37:50702/0 (socket says 172.21.15.37:50702) 2023-12-19T16:07:02.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.089+0000 7fdac4a64640 1 -- 172.21.15.37:0/42738393 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdac00bcdd0 msgr2=0x7fdac00b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:02.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.089+0000 7fdac4a64640 1 --2- 172.21.15.37:0/42738393 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdac00bcdd0 0x7fdac00b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.089+0000 7fdac4a64640 1 -- 172.21.15.37:0/42738393 >> v1:172.21.15.78:6789/0 conn(0x7fdac00b64c0 legacy=0x7fdac0144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:02.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.089+0000 7fdac4a64640 1 -- 172.21.15.37:0/42738393 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac00bc0a0 con 0x7fdac0144ea0 2023-12-19T16:07:02.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.089+0000 7fdabeffd640 1 -- 172.21.15.37:0/42738393 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287522550 0 0) 0x7fdac00bc6b0 con 0x7fdac00b64c0 2023-12-19T16:07:02.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.090+0000 7fdac4a64640 1 --2- 172.21.15.37:0/42738393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdac0144ea0 0x7fdac0155340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdab8009e50 tx=0x7fdab802bff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed18286e65b000c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:02.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.090+0000 7fdabeffd640 1 -- 172.21.15.37:0/42738393 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab802cb90 con 0x7fdac0144ea0 2023-12-19T16:07:02.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.090+0000 7fdabeffd640 1 -- 172.21.15.37:0/42738393 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab802ccf0 con 0x7fdac0144ea0 2023-12-19T16:07:02.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.090+0000 7fdabeffd640 1 -- 172.21.15.37:0/42738393 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab8034610 con 0x7fdac0144ea0 2023-12-19T16:07:02.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.090+0000 7fdac64c7640 1 -- 172.21.15.37:0/42738393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdac0144ea0 msgr2=0x7fdac0155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:02.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.090+0000 7fdac64c7640 1 --2- 172.21.15.37:0/42738393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdac0144ea0 0x7fdac0155340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdab8009e50 tx=0x7fdab802bff0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.090+0000 7fdac64c7640 1 -- 172.21.15.37:0/42738393 shutdown_connections 2023-12-19T16:07:02.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.090+0000 7fdac64c7640 1 --2- 172.21.15.37:0/42738393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdac0144ea0 0x7fdac0155340 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.090+0000 7fdac64c7640 1 --2- 172.21.15.37:0/42738393 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdac00bcdd0 0x7fdac00b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.090+0000 7fdac64c7640 1 -- 172.21.15.37:0/42738393 >> 172.21.15.37:0/42738393 conn(0x7fdac0071e60 msgr2=0x7fdac00c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:02.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.090+0000 7fdac64c7640 1 -- 172.21.15.37:0/42738393 shutdown_connections 2023-12-19T16:07:02.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.090+0000 7fdac64c7640 1 -- 172.21.15.37:0/42738393 wait complete. 2023-12-19T16:07:02.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.091+0000 7fdac64c7640 1 Processor -- start 2023-12-19T16:07:02.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.091+0000 7fdac64c7640 1 -- start start 2023-12-19T16:07:02.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.092+0000 7fdac64c7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdac00b64c0 0x7fdac01455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:02.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.092+0000 7fdac64c7640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdac00bcdd0 0x7fdac01dfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:02.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.092+0000 7fdac64c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdac0144ea0 0x7fdac014a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.092+0000 7fdac64c7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac0145ae0 con 0x7fdac00b64c0 2023-12-19T16:07:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.092+0000 7fdac64c7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac0145dd0 con 0x7fdac0144ea0 2023-12-19T16:07:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.092+0000 7fdac64c7640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac00bfc10 con 0x7fdac00bcdd0 2023-12-19T16:07:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.092+0000 7fdabffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdac00b64c0 0x7fdac01455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.092+0000 7fdabffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdac00b64c0 0x7fdac01455a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49364/0 (socket says 172.21.15.37:49364) 2023-12-19T16:07:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.092+0000 7fdabffff640 1 -- 172.21.15.37:0/3129436947 learned_addr learned my addr 172.21.15.37:0/3129436947 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.092+0000 7fdac4a64640 1 --2- 172.21.15.37:0/3129436947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdac0144ea0 0x7fdac014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.092+0000 7fdabf7fe640 1 --2- 172.21.15.37:0/3129436947 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdac00bcdd0 0x7fdac01dfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.093+0000 7fdabffff640 1 -- 172.21.15.37:0/3129436947 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdac00bcdd0 msgr2=0x7fdac01dfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.093+0000 7fdabffff640 1 --2- 172.21.15.37:0/3129436947 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdac00bcdd0 0x7fdac01dfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.093+0000 7fdabffff640 1 -- 172.21.15.37:0/3129436947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdac0144ea0 msgr2=0x7fdac014a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.093+0000 7fdabffff640 1 --2- 172.21.15.37:0/3129436947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdac0144ea0 0x7fdac014a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.093+0000 7fdabffff640 1 -- 172.21.15.37:0/3129436947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab8009b30 con 0x7fdac00b64c0 2023-12-19T16:07:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.093+0000 7fdabffff640 1 --2- 172.21.15.37:0/3129436947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdac00b64c0 0x7fdac01455a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdab400e9e0 tx=0x7fdab400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.093+0000 7fdabcff9640 1 -- 172.21.15.37:0/3129436947 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4009670 con 0x7fdac00b64c0 2023-12-19T16:07:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.093+0000 7fdabcff9640 1 -- 172.21.15.37:0/3129436947 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab400c9d0 con 0x7fdac00b64c0 2023-12-19T16:07:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.093+0000 7fdac64c7640 1 -- 172.21.15.37:0/3129436947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac0146aa0 con 0x7fdac00b64c0 2023-12-19T16:07:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.093+0000 7fdabcff9640 1 -- 172.21.15.37:0/3129436947 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab400cd80 con 0x7fdac00b64c0 2023-12-19T16:07:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.093+0000 7fdac64c7640 1 -- 172.21.15.37:0/3129436947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac014b230 con 0x7fdac00b64c0 2023-12-19T16:07:02.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.094+0000 7fdac64c7640 1 -- 172.21.15.37:0/3129436947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac00bd4b0 con 0x7fdac00b64c0 2023-12-19T16:07:02.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.094+0000 7fdabcff9640 1 -- 172.21.15.37:0/3129436947 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdab4013470 con 0x7fdac00b64c0 2023-12-19T16:07:02.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.095+0000 7fdabcff9640 1 --2- 172.21.15.37:0/3129436947 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fdaac06a430 0x7fdaac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:02.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.095+0000 7fdabcff9640 1 -- 172.21.15.37:0/3129436947 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdab4088b20 con 0x7fdac00b64c0 2023-12-19T16:07:02.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.095+0000 7fdabf7fe640 1 --2- 172.21.15.37:0/3129436947 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fdaac06a430 0x7fdaac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:02.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.095+0000 7fdabf7fe640 1 --2- 172.21.15.37:0/3129436947 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fdaac06a430 0x7fdaac06c8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdac01d5c10 tx=0x7fdab0007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:02.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.099+0000 7fdabcff9640 1 -- 172.21.15.37:0/3129436947 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdab4054140 con 0x7fdac00b64c0 2023-12-19T16:07:02.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.270+0000 7fdac64c7640 1 -- 172.21.15.37:0/3129436947 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdac00b5500 con 0x7fdaac06a430 2023-12-19T16:07:02.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.278+0000 7fdabcff9640 1 -- 172.21.15.37:0/3129436947 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249747 (secure 0 0 0) 0x7fdab0004c70 con 0x7fdaac06a430 2023-12-19T16:07:02.284 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-19T16:07:02.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.280+0000 7fdac64c7640 1 -- 172.21.15.37:0/3129436947 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fdaac06a430 msgr2=0x7fdaac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:02.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.280+0000 7fdac64c7640 1 --2- 172.21.15.37:0/3129436947 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fdaac06a430 0x7fdaac06c8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdac01d5c10 tx=0x7fdab0007de0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.280+0000 7fdac64c7640 1 -- 172.21.15.37:0/3129436947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdac00b64c0 msgr2=0x7fdac01455a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:02.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.280+0000 7fdac64c7640 1 --2- 172.21.15.37:0/3129436947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdac00b64c0 0x7fdac01455a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdab400e9e0 tx=0x7fdab400eea0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.280+0000 7fdac64c7640 1 -- 172.21.15.37:0/3129436947 shutdown_connections 2023-12-19T16:07:02.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.280+0000 7fdac64c7640 1 --2- 172.21.15.37:0/3129436947 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fdaac06a430 0x7fdaac06c8f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.280+0000 7fdac64c7640 1 --2- 172.21.15.37:0/3129436947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdac0144ea0 0x7fdac014a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.280+0000 7fdac64c7640 1 --2- 172.21.15.37:0/3129436947 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdac00bcdd0 0x7fdac01dfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.280+0000 7fdac64c7640 1 --2- 172.21.15.37:0/3129436947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdac00b64c0 0x7fdac01455a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.281+0000 7fdac64c7640 1 -- 172.21.15.37:0/3129436947 >> 172.21.15.37:0/3129436947 conn(0x7fdac0071e60 msgr2=0x7fdac00b5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:02.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.281+0000 7fdac64c7640 1 -- 172.21.15.37:0/3129436947 shutdown_connections 2023-12-19T16:07:02.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.281+0000 7fdac64c7640 1 -- 172.21.15.37:0/3129436947 wait complete. 2023-12-19T16:07:02.297 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-12-19T16:07:00.628299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218120,"kb_used_data":2376,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756600,"statfs":{"total":773094113280,"available":772870758400,"internally_reserved":0,"allocated":2433024,"data_stored":1546584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000987"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-19T16:06:49.313668+0000","last_change":"2023-12-19T16:06:47.761389+0000","last_active":"2023-12-19T16:06:49.313668+0000","last_peered":"2023-12-19T16:06:49.313668+0000","last_clean":"2023-12-19T16:06:49.313668+0000","last_became_active":"2023-12-19T16:06:47.760252+0000","last_became_peered":"2023-12-19T16:06:47.760252+0000","last_unstale":"2023-12-19T16:06:49.313668+0000","last_undegraded":"2023-12-19T16:06:49.313668+0000","last_fullsized":"2023-12-19T16:06:49.313668+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_clean_scrub_stamp":"2023-12-19T16:06:46.706871+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:09.167979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.214}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:07:02.302 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:07:02.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.440+0000 7f7b384d5640 1 Processor -- start 2023-12-19T16:07:02.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.440+0000 7f7b384d5640 1 -- start start 2023-12-19T16:07:02.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.440+0000 7f7b384d5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b300b6690 0x7f7b30144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:02.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.440+0000 7f7b384d5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7b30144cd0 0x7f7b30155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:02.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.440+0000 7f7b384d5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b300bc6b0 con 0x7f7b300bcdd0 2023-12-19T16:07:02.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.440+0000 7f7b384d5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b300a59f0 con 0x7f7b300b6690 2023-12-19T16:07:02.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.440+0000 7f7b384d5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b300bc0a0 con 0x7f7b30144cd0 2023-12-19T16:07:02.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.441+0000 7f7b35a70640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b300b6690 0x7f7b30144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:02.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.441+0000 7f7b35a70640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b300b6690 0x7f7b30144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49370/0 (socket says 172.21.15.37:49370) 2023-12-19T16:07:02.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.441+0000 7f7b35a70640 1 -- 172.21.15.37:0/66556553 learned_addr learned my addr 172.21.15.37:0/66556553 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:02.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.441+0000 7f7b36a72640 1 --2- 172.21.15.37:0/66556553 >> v2:172.21.15.78:3300/0 conn(0x7f7b30144cd0 0x7f7b30155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:02.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.441+0000 7f7b35a70640 1 -- 172.21.15.37:0/66556553 >> v2:172.21.15.78:3300/0 conn(0x7f7b30144cd0 msgr2=0x7f7b30155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:02.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.441+0000 7f7b35a70640 1 --2- 172.21.15.37:0/66556553 >> v2:172.21.15.78:3300/0 conn(0x7f7b30144cd0 0x7f7b30155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.441+0000 7f7b35a70640 1 -- 172.21.15.37:0/66556553 >> v1:172.21.15.78:6789/0 conn(0x7f7b300bcdd0 legacy=0x7f7b300b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:02.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.441+0000 7f7b35a70640 1 -- 172.21.15.37:0/66556553 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b300bc340 con 0x7f7b300b6690 2023-12-19T16:07:02.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.442+0000 7f7b35a70640 1 --2- 172.21.15.37:0/66556553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300b6690 0x7f7b30144790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7b3006a090 tx=0x7f7b2002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daae05f6c35e8f33 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:02.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.442+0000 7f7b3526f640 1 -- 172.21.15.37:0/66556553 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20030860 con 0x7f7b300b6690 2023-12-19T16:07:02.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.442+0000 7f7b3526f640 1 -- 172.21.15.37:0/66556553 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b200309c0 con 0x7f7b300b6690 2023-12-19T16:07:02.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.442+0000 7f7b3526f640 1 -- 172.21.15.37:0/66556553 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20030d50 con 0x7f7b300b6690 2023-12-19T16:07:02.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.442+0000 7f7b384d5640 1 -- 172.21.15.37:0/66556553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300b6690 msgr2=0x7f7b30144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:02.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.442+0000 7f7b384d5640 1 --2- 172.21.15.37:0/66556553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300b6690 0x7f7b30144790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7b3006a090 tx=0x7f7b2002b9a0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.442+0000 7f7b384d5640 1 -- 172.21.15.37:0/66556553 shutdown_connections 2023-12-19T16:07:02.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.442+0000 7f7b384d5640 1 --2- 172.21.15.37:0/66556553 >> v2:172.21.15.78:3300/0 conn(0x7f7b30144cd0 0x7f7b30155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.442+0000 7f7b384d5640 1 --2- 172.21.15.37:0/66556553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300b6690 0x7f7b30144790 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.442+0000 7f7b384d5640 1 -- 172.21.15.37:0/66556553 >> 172.21.15.37:0/66556553 conn(0x7f7b30071e60 msgr2=0x7f7b300c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:02.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.442+0000 7f7b384d5640 1 -- 172.21.15.37:0/66556553 shutdown_connections 2023-12-19T16:07:02.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.443+0000 7f7b384d5640 1 -- 172.21.15.37:0/66556553 wait complete. 2023-12-19T16:07:02.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.444+0000 7f7b384d5640 1 Processor -- start 2023-12-19T16:07:02.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.444+0000 7f7b384d5640 1 -- start start 2023-12-19T16:07:02.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.444+0000 7f7b384d5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b300b6690 0x7f7b3014ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:02.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.444+0000 7f7b384d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300bcdd0 0x7f7b3013e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:02.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.444+0000 7f7b384d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b30144cd0 0x7f7b3013c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:02.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.444+0000 7f7b384d5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3013ec10 con 0x7f7b300bcdd0 2023-12-19T16:07:02.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.444+0000 7f7b384d5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b30148960 con 0x7f7b30144cd0 2023-12-19T16:07:02.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.444+0000 7f7b384d5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b30148c00 con 0x7f7b300b6690 2023-12-19T16:07:02.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.444+0000 7f7b35a70640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300bcdd0 0x7f7b3013e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:02.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.444+0000 7f7b35a70640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300bcdd0 0x7f7b3013e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49384/0 (socket says 172.21.15.37:49384) 2023-12-19T16:07:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.444+0000 7f7b35a70640 1 -- 172.21.15.37:0/1875414451 learned_addr learned my addr 172.21.15.37:0/1875414451 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.445+0000 7f7b36a72640 1 --2- 172.21.15.37:0/1875414451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b30144cd0 0x7f7b3013c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.445+0000 7f7b36271640 1 --2- 172.21.15.37:0/1875414451 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b300b6690 0x7f7b3014ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.445+0000 7f7b35a70640 1 -- 172.21.15.37:0/1875414451 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b300b6690 msgr2=0x7f7b3014ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.445+0000 7f7b35a70640 1 --2- 172.21.15.37:0/1875414451 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b300b6690 0x7f7b3014ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.445+0000 7f7b35a70640 1 -- 172.21.15.37:0/1875414451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b30144cd0 msgr2=0x7f7b3013c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.445+0000 7f7b35a70640 1 --2- 172.21.15.37:0/1875414451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b30144cd0 0x7f7b3013c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.445+0000 7f7b35a70640 1 -- 172.21.15.37:0/1875414451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b200094d0 con 0x7f7b300bcdd0 2023-12-19T16:07:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.445+0000 7f7b35a70640 1 --2- 172.21.15.37:0/1875414451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300bcdd0 0x7f7b3013e6d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b20000c00 tx=0x7f7b20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.445+0000 7f7b26ffd640 1 -- 172.21.15.37:0/1875414451 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20030830 con 0x7f7b300bcdd0 2023-12-19T16:07:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.445+0000 7f7b26ffd640 1 -- 172.21.15.37:0/1875414451 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b20043400 con 0x7f7b300bcdd0 2023-12-19T16:07:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.445+0000 7f7b384d5640 1 -- 172.21.15.37:0/1875414451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b30148ee0 con 0x7f7b300bcdd0 2023-12-19T16:07:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.445+0000 7f7b26ffd640 1 -- 172.21.15.37:0/1875414451 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b200437b0 con 0x7f7b300bcdd0 2023-12-19T16:07:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.445+0000 7f7b384d5640 1 -- 172.21.15.37:0/1875414451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3014a080 con 0x7f7b300bcdd0 2023-12-19T16:07:02.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.446+0000 7f7b384d5640 1 -- 172.21.15.37:0/1875414451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b301490d0 con 0x7f7b300bcdd0 2023-12-19T16:07:02.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.446+0000 7f7b26ffd640 1 -- 172.21.15.37:0/1875414451 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7b20043910 con 0x7f7b300bcdd0 2023-12-19T16:07:02.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.447+0000 7f7b26ffd640 1 --2- 172.21.15.37:0/1875414451 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7b1406a430 0x7f7b1406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:02.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.447+0000 7f7b26ffd640 1 -- 172.21.15.37:0/1875414451 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b2003e070 con 0x7f7b300bcdd0 2023-12-19T16:07:02.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.447+0000 7f7b36271640 1 --2- 172.21.15.37:0/1875414451 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7b1406a430 0x7f7b1406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:02.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.447+0000 7f7b36271640 1 --2- 172.21.15.37:0/1875414451 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7b1406a430 0x7f7b1406c8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c003d90 tx=0x7f7b2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:02.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.451+0000 7f7b26ffd640 1 -- 172.21.15.37:0/1875414451 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7b200ade60 con 0x7f7b300bcdd0 2023-12-19T16:07:02.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.624+0000 7f7b384d5640 1 -- 172.21.15.37:0/1875414451 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b300bd1b0 con 0x7f7b1406a430 2023-12-19T16:07:02.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.631+0000 7f7b26ffd640 1 -- 172.21.15.37:0/1875414451 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249747 (secure 0 0 0) 0x7f7b2c003a30 con 0x7f7b1406a430 2023-12-19T16:07:02.636 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:02.637 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-19T16:07:02.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.633+0000 7f7b384d5640 1 -- 172.21.15.37:0/1875414451 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7b1406a430 msgr2=0x7f7b1406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:02.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.633+0000 7f7b384d5640 1 --2- 172.21.15.37:0/1875414451 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7b1406a430 0x7f7b1406c8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c003d90 tx=0x7f7b2c009040 comp rx=0 tx=0).stop 2023-12-19T16:07:02.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.633+0000 7f7b384d5640 1 -- 172.21.15.37:0/1875414451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300bcdd0 msgr2=0x7f7b3013e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:02.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.633+0000 7f7b384d5640 1 --2- 172.21.15.37:0/1875414451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300bcdd0 0x7f7b3013e6d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b20000c00 tx=0x7f7b20004730 comp rx=0 tx=0).stop 2023-12-19T16:07:02.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.633+0000 7f7b384d5640 1 -- 172.21.15.37:0/1875414451 shutdown_connections 2023-12-19T16:07:02.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.633+0000 7f7b384d5640 1 --2- 172.21.15.37:0/1875414451 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7b1406a430 0x7f7b1406c8f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.633+0000 7f7b384d5640 1 --2- 172.21.15.37:0/1875414451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b30144cd0 0x7f7b3013c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.633+0000 7f7b384d5640 1 --2- 172.21.15.37:0/1875414451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300bcdd0 0x7f7b3013e6d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.633+0000 7f7b384d5640 1 --2- 172.21.15.37:0/1875414451 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b300b6690 0x7f7b3014ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.633+0000 7f7b384d5640 1 -- 172.21.15.37:0/1875414451 >> 172.21.15.37:0/1875414451 conn(0x7f7b30071e60 msgr2=0x7f7b30072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:02.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.633+0000 7f7b384d5640 1 -- 172.21.15.37:0/1875414451 shutdown_connections 2023-12-19T16:07:02.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.633+0000 7f7b384d5640 1 -- 172.21.15.37:0/1875414451 wait complete. 2023-12-19T16:07:02.647 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-12-19T16:07:00.628299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218120,"kb_used_data":2376,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756600,"statfs":{"total":773094113280,"available":772870758400,"internally_reserved":0,"allocated":2433024,"data_stored":1546584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000987"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-19T16:06:49.313668+0000","last_change":"2023-12-19T16:06:47.761389+0000","last_active":"2023-12-19T16:06:49.313668+0000","last_peered":"2023-12-19T16:06:49.313668+0000","last_clean":"2023-12-19T16:06:49.313668+0000","last_became_active":"2023-12-19T16:06:47.760252+0000","last_became_peered":"2023-12-19T16:06:47.760252+0000","last_unstale":"2023-12-19T16:06:49.313668+0000","last_undegraded":"2023-12-19T16:06:49.313668+0000","last_fullsized":"2023-12-19T16:06:49.313668+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_clean_scrub_stamp":"2023-12-19T16:06:46.706871+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:09.167979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:58.277242+0000","last_change":"2023-12-19T16:06:58.277242+0000","last_active":"2023-12-19T16:06:58.277242+0000","last_peered":"2023-12-19T16:06:58.277242+0000","last_clean":"2023-12-19T16:06:58.277242+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:58.277242+0000","last_undegraded":"2023-12-19T16:06:58.277242+0000","last_fullsized":"2023-12-19T16:06:58.277242+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:06:57.272318+0000","last_change":"2023-12-19T16:06:57.272318+0000","last_active":"2023-12-19T16:06:57.272318+0000","last_peered":"2023-12-19T16:06:57.272318+0000","last_clean":"2023-12-19T16:06:57.272318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:06:57.272318+0000","last_undegraded":"2023-12-19T16:06:57.272318+0000","last_fullsized":"2023-12-19T16:06:57.272318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.214}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:07:02.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:07:02.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.790+0000 7f91d0c51640 1 Processor -- start 2023-12-19T16:07:02.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.790+0000 7f91d0c51640 1 -- start start 2023-12-19T16:07:02.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.791+0000 7f91d0c51640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f91cc0bcdd0 0x7f91cc0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:02.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.791+0000 7f91d0c51640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f91cc0b64c0 0x7f91cc144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.791+0000 7f91d0c51640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91cc0bc6b0 con 0x7f91cc144cd0 2023-12-19T16:07:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.791+0000 7f91d0c51640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91cc0b6900 con 0x7f91cc0bcdd0 2023-12-19T16:07:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.791+0000 7f91d0c51640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91cc0a59f0 con 0x7f91cc0b64c0 2023-12-19T16:07:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.791+0000 7f91ca59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f91cc0bcdd0 0x7f91cc0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.791+0000 7f91ca59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f91cc0bcdd0 0x7f91cc0b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49392/0 (socket says 172.21.15.37:49392) 2023-12-19T16:07:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.791+0000 7f91ca59c640 1 -- 172.21.15.37:0/3875891313 learned_addr learned my addr 172.21.15.37:0/3875891313 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.791+0000 7f91c3fff640 1 --2- 172.21.15.37:0/3875891313 >> v2:172.21.15.78:3300/0 conn(0x7f91cc0b64c0 0x7f91cc144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.791+0000 7f91ca59c640 1 -- 172.21.15.37:0/3875891313 >> v2:172.21.15.78:3300/0 conn(0x7f91cc0b64c0 msgr2=0x7f91cc144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.791+0000 7f91ca59c640 1 --2- 172.21.15.37:0/3875891313 >> v2:172.21.15.78:3300/0 conn(0x7f91cc0b64c0 0x7f91cc144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.791+0000 7f91ca59c640 1 -- 172.21.15.37:0/3875891313 >> v1:172.21.15.78:6789/0 conn(0x7f91cc144cd0 legacy=0x7f91cc14e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.791+0000 7f91ca59c640 1 -- 172.21.15.37:0/3875891313 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc0bc0a0 con 0x7f91cc0bcdd0 2023-12-19T16:07:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.791+0000 7f91c3fff640 1 --2- 172.21.15.37:0/3875891313 >> v2:172.21.15.78:3300/0 conn(0x7f91cc0b64c0 0x7f91cc144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:02.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.792+0000 7f91ca59c640 1 --2- 172.21.15.37:0/3875891313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91cc0bcdd0 0x7f91cc0b5f80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f91cc0b72e0 tx=0x7f91bc02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e389c932c7ccbba1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:02.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.792+0000 7f91c9d9b640 1 -- 172.21.15.37:0/3875891313 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc02f850 con 0x7f91cc0bcdd0 2023-12-19T16:07:02.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.792+0000 7f91c9d9b640 1 -- 172.21.15.37:0/3875891313 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91bc02f9b0 con 0x7f91cc0bcdd0 2023-12-19T16:07:02.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.792+0000 7f91c9d9b640 1 -- 172.21.15.37:0/3875891313 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc02fd40 con 0x7f91cc0bcdd0 2023-12-19T16:07:02.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.792+0000 7f91d0c51640 1 -- 172.21.15.37:0/3875891313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91cc0bcdd0 msgr2=0x7f91cc0b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:02.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.792+0000 7f91d0c51640 1 --2- 172.21.15.37:0/3875891313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91cc0bcdd0 0x7f91cc0b5f80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f91cc0b72e0 tx=0x7f91bc02ba30 comp rx=0 tx=0).stop 2023-12-19T16:07:02.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.793+0000 7f91d0c51640 1 -- 172.21.15.37:0/3875891313 shutdown_connections 2023-12-19T16:07:02.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.793+0000 7f91d0c51640 1 --2- 172.21.15.37:0/3875891313 >> v2:172.21.15.78:3300/0 conn(0x7f91cc0b64c0 0x7f91cc144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.793+0000 7f91d0c51640 1 --2- 172.21.15.37:0/3875891313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91cc0bcdd0 0x7f91cc0b5f80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.793+0000 7f91d0c51640 1 -- 172.21.15.37:0/3875891313 >> 172.21.15.37:0/3875891313 conn(0x7f91cc071e60 msgr2=0x7f91cc0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:02.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.793+0000 7f91d0c51640 1 -- 172.21.15.37:0/3875891313 shutdown_connections 2023-12-19T16:07:02.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.793+0000 7f91d0c51640 1 -- 172.21.15.37:0/3875891313 wait complete. 2023-12-19T16:07:02.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.794+0000 7f91d0c51640 1 Processor -- start 2023-12-19T16:07:02.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.794+0000 7f91d0c51640 1 -- start start 2023-12-19T16:07:02.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.794+0000 7f91d0c51640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91cc0b64c0 0x7f91cc145660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:02.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.794+0000 7f91d0c51640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f91cc0bcdd0 0x7f91cc1dfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:02.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.794+0000 7f91d0c51640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91cc144cd0 0x7f91cc1dff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:02.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.794+0000 7f91d0c51640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc145ba0 con 0x7f91cc0b64c0 2023-12-19T16:07:02.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.794+0000 7f91d0c51640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc1d3cc0 con 0x7f91cc144cd0 2023-12-19T16:07:02.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.794+0000 7f91d0c51640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc1d4870 con 0x7f91cc0bcdd0 2023-12-19T16:07:02.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.794+0000 7f91ca59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91cc0b64c0 0x7f91cc145660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:02.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.795+0000 7f91ca59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91cc0b64c0 0x7f91cc145660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49408/0 (socket says 172.21.15.37:49408) 2023-12-19T16:07:02.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.795+0000 7f91ca59c640 1 -- 172.21.15.37:0/4033176076 learned_addr learned my addr 172.21.15.37:0/4033176076 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:02.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.795+0000 7f91cad9d640 1 --2- 172.21.15.37:0/4033176076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91cc144cd0 0x7f91cc1dff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:02.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.795+0000 7f91c3fff640 1 --2- 172.21.15.37:0/4033176076 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f91cc0bcdd0 0x7f91cc1dfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:02.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.795+0000 7f91ca59c640 1 -- 172.21.15.37:0/4033176076 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f91cc0bcdd0 msgr2=0x7f91cc1dfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:02.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.795+0000 7f91ca59c640 1 --2- 172.21.15.37:0/4033176076 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f91cc0bcdd0 0x7f91cc1dfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.795+0000 7f91ca59c640 1 -- 172.21.15.37:0/4033176076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91cc144cd0 msgr2=0x7f91cc1dff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:02.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.795+0000 7f91ca59c640 1 --2- 172.21.15.37:0/4033176076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91cc144cd0 0x7f91cc1dff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.795+0000 7f91ca59c640 1 -- 172.21.15.37:0/4033176076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc0094d0 con 0x7f91cc0b64c0 2023-12-19T16:07:02.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.795+0000 7f91ca59c640 1 --2- 172.21.15.37:0/4033176076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91cc0b64c0 0x7f91cc145660 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f91bc02ba70 tx=0x7f91bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:02.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.795+0000 7f91c2ffd640 1 -- 172.21.15.37:0/4033176076 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc037d10 con 0x7f91cc0b64c0 2023-12-19T16:07:02.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.795+0000 7f91c2ffd640 1 -- 172.21.15.37:0/4033176076 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91bc037e90 con 0x7f91cc0b64c0 2023-12-19T16:07:02.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.795+0000 7f91d0c51640 1 -- 172.21.15.37:0/4033176076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91cc1d4d60 con 0x7f91cc0b64c0 2023-12-19T16:07:02.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.795+0000 7f91c2ffd640 1 -- 172.21.15.37:0/4033176076 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc041640 con 0x7f91cc0b64c0 2023-12-19T16:07:02.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.795+0000 7f91d0c51640 1 -- 172.21.15.37:0/4033176076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91cc1d3550 con 0x7f91cc0b64c0 2023-12-19T16:07:02.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.796+0000 7f91d0c51640 1 -- 172.21.15.37:0/4033176076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91cc04e840 con 0x7f91cc0b64c0 2023-12-19T16:07:02.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.797+0000 7f91c2ffd640 1 -- 172.21.15.37:0/4033176076 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f91bc0417a0 con 0x7f91cc0b64c0 2023-12-19T16:07:02.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.797+0000 7f91c2ffd640 1 --2- 172.21.15.37:0/4033176076 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f91ac06a430 0x7f91ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:02.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.797+0000 7f91c2ffd640 1 -- 172.21.15.37:0/4033176076 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91bc03c070 con 0x7f91cc0b64c0 2023-12-19T16:07:02.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.797+0000 7f91c3fff640 1 --2- 172.21.15.37:0/4033176076 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f91ac06a430 0x7f91ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:02.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.798+0000 7f91c3fff640 1 --2- 172.21.15.37:0/4033176076 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f91ac06a430 0x7f91ac06c8f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f91cc1441f0 tx=0x7f91b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:02.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.801+0000 7f91c2ffd640 1 -- 172.21.15.37:0/4033176076 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f91bc076f50 con 0x7f91cc0b64c0 2023-12-19T16:07:02.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.976+0000 7f91d0c51640 1 -- 172.21.15.37:0/4033176076 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91cc0bc340 con 0x7f91ac06a430 2023-12-19T16:07:02.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.983+0000 7f91c2ffd640 1 -- 172.21.15.37:0/4033176076 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264656 (secure 0 0 0) 0x7f91b4009e60 con 0x7f91ac06a430 2023-12-19T16:07:02.989 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:02.990 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-19T16:07:02.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.987+0000 7f91d0c51640 1 -- 172.21.15.37:0/4033176076 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f91ac06a430 msgr2=0x7f91ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:02.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.987+0000 7f91d0c51640 1 --2- 172.21.15.37:0/4033176076 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f91ac06a430 0x7f91ac06c8f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f91cc1441f0 tx=0x7f91b4008040 comp rx=0 tx=0).stop 2023-12-19T16:07:02.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.987+0000 7f91d0c51640 1 -- 172.21.15.37:0/4033176076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91cc0b64c0 msgr2=0x7f91cc145660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:02.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.987+0000 7f91d0c51640 1 --2- 172.21.15.37:0/4033176076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91cc0b64c0 0x7f91cc145660 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f91bc02ba70 tx=0x7f91bc004730 comp rx=0 tx=0).stop 2023-12-19T16:07:02.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.987+0000 7f91d0c51640 1 -- 172.21.15.37:0/4033176076 shutdown_connections 2023-12-19T16:07:02.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.987+0000 7f91d0c51640 1 --2- 172.21.15.37:0/4033176076 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f91ac06a430 0x7f91ac06c8f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.987+0000 7f91d0c51640 1 --2- 172.21.15.37:0/4033176076 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f91cc144cd0 0x7f91cc1dff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.987+0000 7f91d0c51640 1 --2- 172.21.15.37:0/4033176076 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f91cc0bcdd0 0x7f91cc1dfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.987+0000 7f91d0c51640 1 --2- 172.21.15.37:0/4033176076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91cc0b64c0 0x7f91cc145660 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:02.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.987+0000 7f91d0c51640 1 -- 172.21.15.37:0/4033176076 >> 172.21.15.37:0/4033176076 conn(0x7f91cc071e60 msgr2=0x7f91cc0b7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:02.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.987+0000 7f91d0c51640 1 -- 172.21.15.37:0/4033176076 shutdown_connections 2023-12-19T16:07:02.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:02.987+0000 7f91d0c51640 1 -- 172.21.15.37:0/4033176076 wait complete. 2023-12-19T16:07:03.000 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-19T16:07:02.632207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218416,"kb_used_data":2800,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756304,"statfs":{"total":773094113280,"available":772870455296,"internally_reserved":0,"allocated":2867200,"data_stored":1740044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.350188"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109838+0000","last_change":"2023-12-19T16:06:58.760625+0000","last_active":"2023-12-19T16:07:01.109838+0000","last_peered":"2023-12-19T16:07:01.109838+0000","last_clean":"2023-12-19T16:07:01.109838+0000","last_became_active":"2023-12-19T16:06:58.760229+0000","last_became_peered":"2023-12-19T16:06:58.760229+0000","last_unstale":"2023-12-19T16:07:01.109838+0000","last_undegraded":"2023-12-19T16:07:01.109838+0000","last_fullsized":"2023-12-19T16:07:01.109838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735747+0000","last_change":"2023-12-19T16:06:58.749173+0000","last_active":"2023-12-19T16:06:59.735747+0000","last_peered":"2023-12-19T16:06:59.735747+0000","last_clean":"2023-12-19T16:06:59.735747+0000","last_became_active":"2023-12-19T16:06:58.748736+0000","last_became_peered":"2023-12-19T16:06:58.748736+0000","last_unstale":"2023-12-19T16:06:59.735747+0000","last_undegraded":"2023-12-19T16:06:59.735747+0000","last_fullsized":"2023-12-19T16:06:59.735747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466127+0000","last_change":"2023-12-19T16:06:58.738858+0000","last_active":"2023-12-19T16:07:00.466127+0000","last_peered":"2023-12-19T16:07:00.466127+0000","last_clean":"2023-12-19T16:07:00.466127+0000","last_became_active":"2023-12-19T16:06:58.738178+0000","last_became_peered":"2023-12-19T16:06:58.738178+0000","last_unstale":"2023-12-19T16:07:00.466127+0000","last_undegraded":"2023-12-19T16:07:00.466127+0000","last_fullsized":"2023-12-19T16:07:00.466127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109498+0000","last_change":"2023-12-19T16:06:58.754766+0000","last_active":"2023-12-19T16:07:01.109498+0000","last_peered":"2023-12-19T16:07:01.109498+0000","last_clean":"2023-12-19T16:07:01.109498+0000","last_became_active":"2023-12-19T16:06:58.754289+0000","last_became_peered":"2023-12-19T16:06:58.754289+0000","last_unstale":"2023-12-19T16:07:01.109498+0000","last_undegraded":"2023-12-19T16:07:01.109498+0000","last_fullsized":"2023-12-19T16:07:01.109498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:26:37.888389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109413+0000","last_change":"2023-12-19T16:06:58.743609+0000","last_active":"2023-12-19T16:07:01.109413+0000","last_peered":"2023-12-19T16:07:01.109413+0000","last_clean":"2023-12-19T16:07:01.109413+0000","last_became_active":"2023-12-19T16:06:58.743331+0000","last_became_peered":"2023-12-19T16:06:58.743331+0000","last_unstale":"2023-12-19T16:07:01.109413+0000","last_undegraded":"2023-12-19T16:07:01.109413+0000","last_fullsized":"2023-12-19T16:07:01.109413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:11.108008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109102+0000","last_change":"2023-12-19T16:06:58.752778+0000","last_active":"2023-12-19T16:07:01.109102+0000","last_peered":"2023-12-19T16:07:01.109102+0000","last_clean":"2023-12-19T16:07:01.109102+0000","last_became_active":"2023-12-19T16:06:58.752519+0000","last_became_peered":"2023-12-19T16:06:58.752519+0000","last_unstale":"2023-12-19T16:07:01.109102+0000","last_undegraded":"2023-12-19T16:07:01.109102+0000","last_fullsized":"2023-12-19T16:07:01.109102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:17.210206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109322+0000","last_change":"2023-12-19T16:06:58.748834+0000","last_active":"2023-12-19T16:07:01.109322+0000","last_peered":"2023-12-19T16:07:01.109322+0000","last_clean":"2023-12-19T16:07:01.109322+0000","last_became_active":"2023-12-19T16:06:58.748039+0000","last_became_peered":"2023-12-19T16:06:58.748039+0000","last_unstale":"2023-12-19T16:07:01.109322+0000","last_undegraded":"2023-12-19T16:07:01.109322+0000","last_fullsized":"2023-12-19T16:07:01.109322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:26:37.888389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429554+0000","last_change":"2023-12-19T16:06:58.754746+0000","last_active":"2023-12-19T16:07:00.429554+0000","last_peered":"2023-12-19T16:07:00.429554+0000","last_clean":"2023-12-19T16:07:00.429554+0000","last_became_active":"2023-12-19T16:06:58.754477+0000","last_became_peered":"2023-12-19T16:06:58.754477+0000","last_unstale":"2023-12-19T16:07:00.429554+0000","last_undegraded":"2023-12-19T16:07:00.429554+0000","last_fullsized":"2023-12-19T16:07:00.429554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:02.578194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109955+0000","last_change":"2023-12-19T16:06:58.755823+0000","last_active":"2023-12-19T16:07:01.109955+0000","last_peered":"2023-12-19T16:07:01.109955+0000","last_clean":"2023-12-19T16:07:01.109955+0000","last_became_active":"2023-12-19T16:06:58.755519+0000","last_became_peered":"2023-12-19T16:06:58.755519+0000","last_unstale":"2023-12-19T16:07:01.109955+0000","last_undegraded":"2023-12-19T16:07:01.109955+0000","last_fullsized":"2023-12-19T16:07:01.109955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:17.210206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594076+0000","last_change":"2023-12-19T16:06:58.757791+0000","last_active":"2023-12-19T16:07:00.594076+0000","last_peered":"2023-12-19T16:07:00.594076+0000","last_clean":"2023-12-19T16:07:00.594076+0000","last_became_active":"2023-12-19T16:06:58.757519+0000","last_became_peered":"2023-12-19T16:06:58.757519+0000","last_unstale":"2023-12-19T16:07:00.594076+0000","last_undegraded":"2023-12-19T16:07:00.594076+0000","last_fullsized":"2023-12-19T16:07:00.594076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593880+0000","last_change":"2023-12-19T16:06:58.757323+0000","last_active":"2023-12-19T16:07:00.593880+0000","last_peered":"2023-12-19T16:07:00.593880+0000","last_clean":"2023-12-19T16:07:00.593880+0000","last_became_active":"2023-12-19T16:06:58.757070+0000","last_became_peered":"2023-12-19T16:06:58.757070+0000","last_unstale":"2023-12-19T16:07:00.593880+0000","last_undegraded":"2023-12-19T16:07:00.593880+0000","last_fullsized":"2023-12-19T16:07:00.593880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735789+0000","last_change":"2023-12-19T16:06:58.748826+0000","last_active":"2023-12-19T16:06:59.735789+0000","last_peered":"2023-12-19T16:06:59.735789+0000","last_clean":"2023-12-19T16:06:59.735789+0000","last_became_active":"2023-12-19T16:06:58.748455+0000","last_became_peered":"2023-12-19T16:06:58.748455+0000","last_unstale":"2023-12-19T16:06:59.735789+0000","last_undegraded":"2023-12-19T16:06:59.735789+0000","last_fullsized":"2023-12-19T16:06:59.735789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:45:54.216383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429773+0000","last_change":"2023-12-19T16:06:58.746487+0000","last_active":"2023-12-19T16:07:00.429773+0000","last_peered":"2023-12-19T16:07:00.429773+0000","last_clean":"2023-12-19T16:07:00.429773+0000","last_became_active":"2023-12-19T16:06:58.746251+0000","last_became_peered":"2023-12-19T16:06:58.746251+0000","last_unstale":"2023-12-19T16:07:00.429773+0000","last_undegraded":"2023-12-19T16:07:00.429773+0000","last_fullsized":"2023-12-19T16:07:00.429773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.465948+0000","last_change":"2023-12-19T16:06:58.749166+0000","last_active":"2023-12-19T16:07:00.465948+0000","last_peered":"2023-12-19T16:07:00.465948+0000","last_clean":"2023-12-19T16:07:00.465948+0000","last_became_active":"2023-12-19T16:06:58.748884+0000","last_became_peered":"2023-12-19T16:06:58.748884+0000","last_unstale":"2023-12-19T16:07:00.465948+0000","last_undegraded":"2023-12-19T16:07:00.465948+0000","last_fullsized":"2023-12-19T16:07:00.465948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735398+0000","last_change":"2023-12-19T16:06:58.744455+0000","last_active":"2023-12-19T16:06:59.735398+0000","last_peered":"2023-12-19T16:06:59.735398+0000","last_clean":"2023-12-19T16:06:59.735398+0000","last_became_active":"2023-12-19T16:06:58.744204+0000","last_became_peered":"2023-12-19T16:06:58.744204+0000","last_unstale":"2023-12-19T16:06:59.735398+0000","last_undegraded":"2023-12-19T16:06:59.735398+0000","last_fullsized":"2023-12-19T16:06:59.735398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109012+0000","last_change":"2023-12-19T16:06:58.751725+0000","last_active":"2023-12-19T16:07:01.109012+0000","last_peered":"2023-12-19T16:07:01.109012+0000","last_clean":"2023-12-19T16:07:01.109012+0000","last_became_active":"2023-12-19T16:06:58.751476+0000","last_became_peered":"2023-12-19T16:06:58.751476+0000","last_unstale":"2023-12-19T16:07:01.109012+0000","last_undegraded":"2023-12-19T16:07:01.109012+0000","last_fullsized":"2023-12-19T16:07:01.109012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:49.465099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109749+0000","last_change":"2023-12-19T16:06:58.752816+0000","last_active":"2023-12-19T16:07:01.109749+0000","last_peered":"2023-12-19T16:07:01.109749+0000","last_clean":"2023-12-19T16:07:01.109749+0000","last_became_active":"2023-12-19T16:06:58.752475+0000","last_became_peered":"2023-12-19T16:06:58.752475+0000","last_unstale":"2023-12-19T16:07:01.109749+0000","last_undegraded":"2023-12-19T16:07:01.109749+0000","last_fullsized":"2023-12-19T16:07:01.109749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736208+0000","last_change":"2023-12-19T16:06:58.745867+0000","last_active":"2023-12-19T16:06:59.736208+0000","last_peered":"2023-12-19T16:06:59.736208+0000","last_clean":"2023-12-19T16:06:59.736208+0000","last_became_active":"2023-12-19T16:06:58.745603+0000","last_became_peered":"2023-12-19T16:06:58.745603+0000","last_unstale":"2023-12-19T16:06:59.736208+0000","last_undegraded":"2023-12-19T16:06:59.736208+0000","last_fullsized":"2023-12-19T16:06:59.736208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:45:54.216383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109763+0000","last_change":"2023-12-19T16:06:58.744080+0000","last_active":"2023-12-19T16:07:01.109763+0000","last_peered":"2023-12-19T16:07:01.109763+0000","last_clean":"2023-12-19T16:07:01.109763+0000","last_became_active":"2023-12-19T16:06:58.743129+0000","last_became_peered":"2023-12-19T16:06:58.743129+0000","last_unstale":"2023-12-19T16:07:01.109763+0000","last_undegraded":"2023-12-19T16:07:01.109763+0000","last_fullsized":"2023-12-19T16:07:01.109763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593848+0000","last_change":"2023-12-19T16:06:58.754725+0000","last_active":"2023-12-19T16:07:00.593848+0000","last_peered":"2023-12-19T16:07:00.593848+0000","last_clean":"2023-12-19T16:07:00.593848+0000","last_became_active":"2023-12-19T16:06:58.754476+0000","last_became_peered":"2023-12-19T16:06:58.754476+0000","last_unstale":"2023-12-19T16:07:00.593848+0000","last_undegraded":"2023-12-19T16:07:00.593848+0000","last_fullsized":"2023-12-19T16:07:00.593848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466100+0000","last_change":"2023-12-19T16:06:58.744917+0000","last_active":"2023-12-19T16:07:00.466100+0000","last_peered":"2023-12-19T16:07:00.466100+0000","last_clean":"2023-12-19T16:07:00.466100+0000","last_became_active":"2023-12-19T16:06:58.744663+0000","last_became_peered":"2023-12-19T16:06:58.744663+0000","last_unstale":"2023-12-19T16:07:00.466100+0000","last_undegraded":"2023-12-19T16:07:00.466100+0000","last_fullsized":"2023-12-19T16:07:00.466100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109326+0000","last_change":"2023-12-19T16:06:58.752295+0000","last_active":"2023-12-19T16:07:01.109326+0000","last_peered":"2023-12-19T16:07:01.109326+0000","last_clean":"2023-12-19T16:07:01.109326+0000","last_became_active":"2023-12-19T16:06:58.752030+0000","last_became_peered":"2023-12-19T16:06:58.752030+0000","last_unstale":"2023-12-19T16:07:01.109326+0000","last_undegraded":"2023-12-19T16:07:01.109326+0000","last_fullsized":"2023-12-19T16:07:01.109326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:02.578194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429607+0000","last_change":"2023-12-19T16:06:58.737261+0000","last_active":"2023-12-19T16:07:00.429607+0000","last_peered":"2023-12-19T16:07:00.429607+0000","last_clean":"2023-12-19T16:07:00.429607+0000","last_became_active":"2023-12-19T16:06:58.736978+0000","last_became_peered":"2023-12-19T16:06:58.736978+0000","last_unstale":"2023-12-19T16:07:00.429607+0000","last_undegraded":"2023-12-19T16:07:00.429607+0000","last_fullsized":"2023-12-19T16:07:00.429607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109099+0000","last_change":"2023-12-19T16:06:58.751235+0000","last_active":"2023-12-19T16:07:01.109099+0000","last_peered":"2023-12-19T16:07:01.109099+0000","last_clean":"2023-12-19T16:07:01.109099+0000","last_became_active":"2023-12-19T16:06:58.750410+0000","last_became_peered":"2023-12-19T16:06:58.750410+0000","last_unstale":"2023-12-19T16:07:01.109099+0000","last_undegraded":"2023-12-19T16:07:01.109099+0000","last_fullsized":"2023-12-19T16:07:01.109099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:56:59.199473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429968+0000","last_change":"2023-12-19T16:06:58.744478+0000","last_active":"2023-12-19T16:07:00.429968+0000","last_peered":"2023-12-19T16:07:00.429968+0000","last_clean":"2023-12-19T16:07:00.429968+0000","last_became_active":"2023-12-19T16:06:58.742838+0000","last_became_peered":"2023-12-19T16:06:58.742838+0000","last_unstale":"2023-12-19T16:07:00.429968+0000","last_undegraded":"2023-12-19T16:07:00.429968+0000","last_fullsized":"2023-12-19T16:07:00.429968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594088+0000","last_change":"2023-12-19T16:06:58.746043+0000","last_active":"2023-12-19T16:07:00.594088+0000","last_peered":"2023-12-19T16:07:00.594088+0000","last_clean":"2023-12-19T16:07:00.594088+0000","last_became_active":"2023-12-19T16:06:58.745779+0000","last_became_peered":"2023-12-19T16:06:58.745779+0000","last_unstale":"2023-12-19T16:07:00.594088+0000","last_undegraded":"2023-12-19T16:07:00.594088+0000","last_fullsized":"2023-12-19T16:07:00.594088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:04.102120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735628+0000","last_change":"2023-12-19T16:06:58.749441+0000","last_active":"2023-12-19T16:06:59.735628+0000","last_peered":"2023-12-19T16:06:59.735628+0000","last_clean":"2023-12-19T16:06:59.735628+0000","last_became_active":"2023-12-19T16:06:58.748234+0000","last_became_peered":"2023-12-19T16:06:58.748234+0000","last_unstale":"2023-12-19T16:06:59.735628+0000","last_undegraded":"2023-12-19T16:06:59.735628+0000","last_fullsized":"2023-12-19T16:06:59.735628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429935+0000","last_change":"2023-12-19T16:06:58.744976+0000","last_active":"2023-12-19T16:07:00.429935+0000","last_peered":"2023-12-19T16:07:00.429935+0000","last_clean":"2023-12-19T16:07:00.429935+0000","last_became_active":"2023-12-19T16:06:58.744731+0000","last_became_peered":"2023-12-19T16:06:58.744731+0000","last_unstale":"2023-12-19T16:07:00.429935+0000","last_undegraded":"2023-12-19T16:07:00.429935+0000","last_fullsized":"2023-12-19T16:07:00.429935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466162+0000","last_change":"2023-12-19T16:06:58.748370+0000","last_active":"2023-12-19T16:07:00.466162+0000","last_peered":"2023-12-19T16:07:00.466162+0000","last_clean":"2023-12-19T16:07:00.466162+0000","last_became_active":"2023-12-19T16:06:58.748079+0000","last_became_peered":"2023-12-19T16:06:58.748079+0000","last_unstale":"2023-12-19T16:07:00.466162+0000","last_undegraded":"2023-12-19T16:07:00.466162+0000","last_fullsized":"2023-12-19T16:07:00.466162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109837+0000","last_change":"2023-12-19T16:06:58.751906+0000","last_active":"2023-12-19T16:07:01.109837+0000","last_peered":"2023-12-19T16:07:01.109837+0000","last_clean":"2023-12-19T16:07:01.109837+0000","last_became_active":"2023-12-19T16:06:58.750803+0000","last_became_peered":"2023-12-19T16:06:58.750803+0000","last_unstale":"2023-12-19T16:07:01.109837+0000","last_undegraded":"2023-12-19T16:07:01.109837+0000","last_fullsized":"2023-12-19T16:07:01.109837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:34:52.231787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736199+0000","last_change":"2023-12-19T16:06:58.753386+0000","last_active":"2023-12-19T16:06:59.736199+0000","last_peered":"2023-12-19T16:06:59.736199+0000","last_clean":"2023-12-19T16:06:59.736199+0000","last_became_active":"2023-12-19T16:06:58.753213+0000","last_became_peered":"2023-12-19T16:06:58.753213+0000","last_unstale":"2023-12-19T16:06:59.736199+0000","last_undegraded":"2023-12-19T16:06:59.736199+0000","last_fullsized":"2023-12-19T16:06:59.736199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:56.721659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593758+0000","last_change":"2023-12-19T16:06:58.753896+0000","last_active":"2023-12-19T16:07:00.593758+0000","last_peered":"2023-12-19T16:07:00.593758+0000","last_clean":"2023-12-19T16:07:00.593758+0000","last_became_active":"2023-12-19T16:06:58.753594+0000","last_became_peered":"2023-12-19T16:06:58.753594+0000","last_unstale":"2023-12-19T16:07:00.593758+0000","last_undegraded":"2023-12-19T16:07:00.593758+0000","last_fullsized":"2023-12-19T16:07:00.593758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:49.465099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735526+0000","last_change":"2023-12-19T16:06:58.749736+0000","last_active":"2023-12-19T16:06:59.735526+0000","last_peered":"2023-12-19T16:06:59.735526+0000","last_clean":"2023-12-19T16:06:59.735526+0000","last_became_active":"2023-12-19T16:06:58.749468+0000","last_became_peered":"2023-12-19T16:06:58.749468+0000","last_unstale":"2023-12-19T16:06:59.735526+0000","last_undegraded":"2023-12-19T16:06:59.735526+0000","last_fullsized":"2023-12-19T16:06:59.735526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:17.323789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429911+0000","last_change":"2023-12-19T16:06:58.304535+0000","last_active":"2023-12-19T16:07:00.429911+0000","last_peered":"2023-12-19T16:07:00.429911+0000","last_clean":"2023-12-19T16:07:00.429911+0000","last_became_active":"2023-12-19T16:06:58.304271+0000","last_became_peered":"2023-12-19T16:06:58.304271+0000","last_unstale":"2023-12-19T16:07:00.429911+0000","last_undegraded":"2023-12-19T16:07:00.429911+0000","last_fullsized":"2023-12-19T16:07:00.429911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466191+0000","last_change":"2023-12-19T16:06:58.741261+0000","last_active":"2023-12-19T16:07:00.466191+0000","last_peered":"2023-12-19T16:07:00.466191+0000","last_clean":"2023-12-19T16:07:00.466191+0000","last_became_active":"2023-12-19T16:06:58.741000+0000","last_became_peered":"2023-12-19T16:06:58.741000+0000","last_unstale":"2023-12-19T16:07:00.466191+0000","last_undegraded":"2023-12-19T16:07:00.466191+0000","last_fullsized":"2023-12-19T16:07:00.466191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:21:27.003991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593812+0000","last_change":"2023-12-19T16:06:58.304385+0000","last_active":"2023-12-19T16:07:00.593812+0000","last_peered":"2023-12-19T16:07:00.593812+0000","last_clean":"2023-12-19T16:07:00.593812+0000","last_became_active":"2023-12-19T16:06:58.304091+0000","last_became_peered":"2023-12-19T16:06:58.304091+0000","last_unstale":"2023-12-19T16:07:00.593812+0000","last_undegraded":"2023-12-19T16:07:00.593812+0000","last_fullsized":"2023-12-19T16:07:00.593812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429698+0000","last_change":"2023-12-19T16:06:58.305822+0000","last_active":"2023-12-19T16:07:00.429698+0000","last_peered":"2023-12-19T16:07:00.429698+0000","last_clean":"2023-12-19T16:07:00.429698+0000","last_became_active":"2023-12-19T16:06:58.305070+0000","last_became_peered":"2023-12-19T16:06:58.305070+0000","last_unstale":"2023-12-19T16:07:00.429698+0000","last_undegraded":"2023-12-19T16:07:00.429698+0000","last_fullsized":"2023-12-19T16:07:00.429698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429590+0000","last_change":"2023-12-19T16:06:58.741414+0000","last_active":"2023-12-19T16:07:00.429590+0000","last_peered":"2023-12-19T16:07:00.429590+0000","last_clean":"2023-12-19T16:07:00.429590+0000","last_became_active":"2023-12-19T16:06:58.741166+0000","last_became_peered":"2023-12-19T16:06:58.741166+0000","last_unstale":"2023-12-19T16:07:00.429590+0000","last_undegraded":"2023-12-19T16:07:00.429590+0000","last_fullsized":"2023-12-19T16:07:00.429590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109102+0000","last_change":"2023-12-19T16:06:58.304842+0000","last_active":"2023-12-19T16:07:01.109102+0000","last_peered":"2023-12-19T16:07:01.109102+0000","last_clean":"2023-12-19T16:07:01.109102+0000","last_became_active":"2023-12-19T16:06:58.302883+0000","last_became_peered":"2023-12-19T16:06:58.302883+0000","last_unstale":"2023-12-19T16:07:01.109102+0000","last_undegraded":"2023-12-19T16:07:01.109102+0000","last_fullsized":"2023-12-19T16:07:01.109102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735403+0000","last_change":"2023-12-19T16:06:58.750010+0000","last_active":"2023-12-19T16:06:59.735403+0000","last_peered":"2023-12-19T16:06:59.735403+0000","last_clean":"2023-12-19T16:06:59.735403+0000","last_became_active":"2023-12-19T16:06:58.749766+0000","last_became_peered":"2023-12-19T16:06:58.749766+0000","last_unstale":"2023-12-19T16:06:59.735403+0000","last_undegraded":"2023-12-19T16:06:59.735403+0000","last_fullsized":"2023-12-19T16:06:59.735403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594040+0000","last_change":"2023-12-19T16:06:58.307494+0000","last_active":"2023-12-19T16:07:00.594040+0000","last_peered":"2023-12-19T16:07:00.594040+0000","last_clean":"2023-12-19T16:07:00.594040+0000","last_became_active":"2023-12-19T16:06:58.307191+0000","last_became_peered":"2023-12-19T16:06:58.307191+0000","last_unstale":"2023-12-19T16:07:00.594040+0000","last_undegraded":"2023-12-19T16:07:00.594040+0000","last_fullsized":"2023-12-19T16:07:00.594040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109823+0000","last_change":"2023-12-19T16:06:58.752792+0000","last_active":"2023-12-19T16:07:01.109823+0000","last_peered":"2023-12-19T16:07:01.109823+0000","last_clean":"2023-12-19T16:07:01.109823+0000","last_became_active":"2023-12-19T16:06:58.752494+0000","last_became_peered":"2023-12-19T16:06:58.752494+0000","last_unstale":"2023-12-19T16:07:01.109823+0000","last_undegraded":"2023-12-19T16:07:01.109823+0000","last_fullsized":"2023-12-19T16:07:01.109823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109839+0000","last_change":"2023-12-19T16:06:58.309509+0000","last_active":"2023-12-19T16:07:01.109839+0000","last_peered":"2023-12-19T16:07:01.109839+0000","last_clean":"2023-12-19T16:07:01.109839+0000","last_became_active":"2023-12-19T16:06:58.309139+0000","last_became_peered":"2023-12-19T16:06:58.309139+0000","last_unstale":"2023-12-19T16:07:01.109839+0000","last_undegraded":"2023-12-19T16:07:01.109839+0000","last_fullsized":"2023-12-19T16:07:01.109839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466307+0000","last_change":"2023-12-19T16:06:58.756009+0000","last_active":"2023-12-19T16:07:00.466307+0000","last_peered":"2023-12-19T16:07:00.466307+0000","last_clean":"2023-12-19T16:07:00.466307+0000","last_became_active":"2023-12-19T16:06:58.755610+0000","last_became_peered":"2023-12-19T16:06:58.755610+0000","last_unstale":"2023-12-19T16:07:00.466307+0000","last_undegraded":"2023-12-19T16:07:00.466307+0000","last_fullsized":"2023-12-19T16:07:00.466307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735683+0000","last_change":"2023-12-19T16:06:58.312257+0000","last_active":"2023-12-19T16:06:59.735683+0000","last_peered":"2023-12-19T16:06:59.735683+0000","last_clean":"2023-12-19T16:06:59.735683+0000","last_became_active":"2023-12-19T16:06:58.311988+0000","last_became_peered":"2023-12-19T16:06:58.311988+0000","last_unstale":"2023-12-19T16:06:59.735683+0000","last_undegraded":"2023-12-19T16:06:59.735683+0000","last_fullsized":"2023-12-19T16:06:59.735683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:55.716735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735863+0000","last_change":"2023-12-19T16:06:58.743459+0000","last_active":"2023-12-19T16:06:59.735863+0000","last_peered":"2023-12-19T16:06:59.735863+0000","last_clean":"2023-12-19T16:06:59.735863+0000","last_became_active":"2023-12-19T16:06:58.743184+0000","last_became_peered":"2023-12-19T16:06:58.743184+0000","last_unstale":"2023-12-19T16:06:59.735863+0000","last_undegraded":"2023-12-19T16:06:59.735863+0000","last_fullsized":"2023-12-19T16:06:59.735863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:56.721659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593958+0000","last_change":"2023-12-19T16:06:58.310349+0000","last_active":"2023-12-19T16:07:00.593958+0000","last_peered":"2023-12-19T16:07:00.593958+0000","last_clean":"2023-12-19T16:07:00.593958+0000","last_became_active":"2023-12-19T16:06:58.310059+0000","last_became_peered":"2023-12-19T16:06:58.310059+0000","last_unstale":"2023-12-19T16:07:00.593958+0000","last_undegraded":"2023-12-19T16:07:00.593958+0000","last_fullsized":"2023-12-19T16:07:00.593958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:35.961254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109478+0000","last_change":"2023-12-19T16:06:58.751190+0000","last_active":"2023-12-19T16:07:01.109478+0000","last_peered":"2023-12-19T16:07:01.109478+0000","last_clean":"2023-12-19T16:07:01.109478+0000","last_became_active":"2023-12-19T16:06:58.748432+0000","last_became_peered":"2023-12-19T16:06:58.748432+0000","last_unstale":"2023-12-19T16:07:01.109478+0000","last_undegraded":"2023-12-19T16:07:01.109478+0000","last_fullsized":"2023-12-19T16:07:01.109478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:30.281031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466247+0000","last_change":"2023-12-19T16:06:58.307849+0000","last_active":"2023-12-19T16:07:00.466247+0000","last_peered":"2023-12-19T16:07:00.466247+0000","last_clean":"2023-12-19T16:07:00.466247+0000","last_became_active":"2023-12-19T16:06:58.307562+0000","last_became_peered":"2023-12-19T16:06:58.307562+0000","last_unstale":"2023-12-19T16:07:00.466247+0000","last_undegraded":"2023-12-19T16:07:00.466247+0000","last_fullsized":"2023-12-19T16:07:00.466247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466011+0000","last_change":"2023-12-19T16:06:58.744304+0000","last_active":"2023-12-19T16:07:00.466011+0000","last_peered":"2023-12-19T16:07:00.466011+0000","last_clean":"2023-12-19T16:07:00.466011+0000","last_became_active":"2023-12-19T16:06:58.744034+0000","last_became_peered":"2023-12-19T16:06:58.744034+0000","last_unstale":"2023-12-19T16:07:00.466011+0000","last_undegraded":"2023-12-19T16:07:00.466011+0000","last_fullsized":"2023-12-19T16:07:00.466011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:04.102120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109966+0000","last_change":"2023-12-19T16:06:58.310576+0000","last_active":"2023-12-19T16:07:01.109966+0000","last_peered":"2023-12-19T16:07:01.109966+0000","last_clean":"2023-12-19T16:07:01.109966+0000","last_became_active":"2023-12-19T16:06:58.310298+0000","last_became_peered":"2023-12-19T16:06:58.310298+0000","last_unstale":"2023-12-19T16:07:01.109966+0000","last_undegraded":"2023-12-19T16:07:01.109966+0000","last_fullsized":"2023-12-19T16:07:01.109966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:06.572806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109450+0000","last_change":"2023-12-19T16:06:58.746329+0000","last_active":"2023-12-19T16:07:01.109450+0000","last_peered":"2023-12-19T16:07:01.109450+0000","last_clean":"2023-12-19T16:07:01.109450+0000","last_became_active":"2023-12-19T16:06:58.746010+0000","last_became_peered":"2023-12-19T16:06:58.746010+0000","last_unstale":"2023-12-19T16:07:01.109450+0000","last_undegraded":"2023-12-19T16:07:01.109450+0000","last_fullsized":"2023-12-19T16:07:01.109450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:34:52.231787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593805+0000","last_change":"2023-12-19T16:06:58.309330+0000","last_active":"2023-12-19T16:07:00.593805+0000","last_peered":"2023-12-19T16:07:00.593805+0000","last_clean":"2023-12-19T16:07:00.593805+0000","last_became_active":"2023-12-19T16:06:58.309039+0000","last_became_peered":"2023-12-19T16:06:58.309039+0000","last_unstale":"2023-12-19T16:07:00.593805+0000","last_undegraded":"2023-12-19T16:07:00.593805+0000","last_fullsized":"2023-12-19T16:07:00.593805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593766+0000","last_change":"2023-12-19T16:06:58.752891+0000","last_active":"2023-12-19T16:07:00.593766+0000","last_peered":"2023-12-19T16:07:00.593766+0000","last_clean":"2023-12-19T16:07:00.593766+0000","last_became_active":"2023-12-19T16:06:58.752582+0000","last_became_peered":"2023-12-19T16:06:58.752582+0000","last_unstale":"2023-12-19T16:07:00.593766+0000","last_undegraded":"2023-12-19T16:07:00.593766+0000","last_fullsized":"2023-12-19T16:07:00.593766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:07:12.391535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736116+0000","last_change":"2023-12-19T16:06:58.308799+0000","last_active":"2023-12-19T16:06:59.736116+0000","last_peered":"2023-12-19T16:06:59.736116+0000","last_clean":"2023-12-19T16:06:59.736116+0000","last_became_active":"2023-12-19T16:06:58.308452+0000","last_became_peered":"2023-12-19T16:06:58.308452+0000","last_unstale":"2023-12-19T16:06:59.736116+0000","last_undegraded":"2023-12-19T16:06:59.736116+0000","last_fullsized":"2023-12-19T16:06:59.736116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109274+0000","last_change":"2023-12-19T16:06:58.746864+0000","last_active":"2023-12-19T16:07:01.109274+0000","last_peered":"2023-12-19T16:07:01.109274+0000","last_clean":"2023-12-19T16:07:01.109274+0000","last_became_active":"2023-12-19T16:06:58.746614+0000","last_became_peered":"2023-12-19T16:06:58.746614+0000","last_unstale":"2023-12-19T16:07:01.109274+0000","last_undegraded":"2023-12-19T16:07:01.109274+0000","last_fullsized":"2023-12-19T16:07:01.109274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:08:43.126506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735933+0000","last_change":"2023-12-19T16:06:58.308443+0000","last_active":"2023-12-19T16:06:59.735933+0000","last_peered":"2023-12-19T16:06:59.735933+0000","last_clean":"2023-12-19T16:06:59.735933+0000","last_became_active":"2023-12-19T16:06:58.308138+0000","last_became_peered":"2023-12-19T16:06:58.308138+0000","last_unstale":"2023-12-19T16:06:59.735933+0000","last_undegraded":"2023-12-19T16:06:59.735933+0000","last_fullsized":"2023-12-19T16:06:59.735933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:45:16.445340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109774+0000","last_change":"2023-12-19T16:06:58.743581+0000","last_active":"2023-12-19T16:07:01.109774+0000","last_peered":"2023-12-19T16:07:01.109774+0000","last_clean":"2023-12-19T16:07:01.109774+0000","last_became_active":"2023-12-19T16:06:58.743215+0000","last_became_peered":"2023-12-19T16:06:58.743215+0000","last_unstale":"2023-12-19T16:07:01.109774+0000","last_undegraded":"2023-12-19T16:07:01.109774+0000","last_fullsized":"2023-12-19T16:07:01.109774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:56:59.199473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736253+0000","last_change":"2023-12-19T16:06:58.301431+0000","last_active":"2023-12-19T16:06:59.736253+0000","last_peered":"2023-12-19T16:06:59.736253+0000","last_clean":"2023-12-19T16:06:59.736253+0000","last_became_active":"2023-12-19T16:06:58.301154+0000","last_became_peered":"2023-12-19T16:06:58.301154+0000","last_unstale":"2023-12-19T16:06:59.736253+0000","last_undegraded":"2023-12-19T16:06:59.736253+0000","last_fullsized":"2023-12-19T16:06:59.736253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109948+0000","last_change":"2023-12-19T16:06:58.747109+0000","last_active":"2023-12-19T16:07:01.109948+0000","last_peered":"2023-12-19T16:07:01.109948+0000","last_clean":"2023-12-19T16:07:01.109948+0000","last_became_active":"2023-12-19T16:06:58.746296+0000","last_became_peered":"2023-12-19T16:06:58.746296+0000","last_unstale":"2023-12-19T16:07:01.109948+0000","last_undegraded":"2023-12-19T16:07:01.109948+0000","last_fullsized":"2023-12-19T16:07:01.109948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:02.578194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735717+0000","last_change":"2023-12-19T16:06:58.314755+0000","last_active":"2023-12-19T16:06:59.735717+0000","last_peered":"2023-12-19T16:06:59.735717+0000","last_clean":"2023-12-19T16:06:59.735717+0000","last_became_active":"2023-12-19T16:06:58.314554+0000","last_became_peered":"2023-12-19T16:06:58.314554+0000","last_unstale":"2023-12-19T16:06:59.735717+0000","last_undegraded":"2023-12-19T16:06:59.735717+0000","last_fullsized":"2023-12-19T16:06:59.735717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:16.318865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.110048+0000","last_change":"2023-12-19T16:06:58.751149+0000","last_active":"2023-12-19T16:07:01.110048+0000","last_peered":"2023-12-19T16:07:01.110048+0000","last_clean":"2023-12-19T16:07:01.110048+0000","last_became_active":"2023-12-19T16:06:58.750741+0000","last_became_peered":"2023-12-19T16:06:58.750741+0000","last_unstale":"2023-12-19T16:07:01.110048+0000","last_undegraded":"2023-12-19T16:07:01.110048+0000","last_fullsized":"2023-12-19T16:07:01.110048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:30.281031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736230+0000","last_change":"2023-12-19T16:06:58.301782+0000","last_active":"2023-12-19T16:06:59.736230+0000","last_peered":"2023-12-19T16:06:59.736230+0000","last_clean":"2023-12-19T16:06:59.736230+0000","last_became_active":"2023-12-19T16:06:58.300855+0000","last_became_peered":"2023-12-19T16:06:58.300855+0000","last_unstale":"2023-12-19T16:06:59.736230+0000","last_undegraded":"2023-12-19T16:06:59.736230+0000","last_fullsized":"2023-12-19T16:06:59.736230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109583+0000","last_change":"2023-12-19T16:06:58.755507+0000","last_active":"2023-12-19T16:07:01.109583+0000","last_peered":"2023-12-19T16:07:01.109583+0000","last_clean":"2023-12-19T16:07:01.109583+0000","last_became_active":"2023-12-19T16:06:58.755176+0000","last_became_peered":"2023-12-19T16:06:58.755176+0000","last_unstale":"2023-12-19T16:07:01.109583+0000","last_undegraded":"2023-12-19T16:07:01.109583+0000","last_fullsized":"2023-12-19T16:07:01.109583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:59:45.402539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T16:06:58.733783+0000","last_change":"2023-12-19T16:06:47.761389+0000","last_active":"2023-12-19T16:06:58.733783+0000","last_peered":"2023-12-19T16:06:58.733783+0000","last_clean":"2023-12-19T16:06:58.733783+0000","last_became_active":"2023-12-19T16:06:47.760252+0000","last_became_peered":"2023-12-19T16:06:47.760252+0000","last_unstale":"2023-12-19T16:06:58.733783+0000","last_undegraded":"2023-12-19T16:06:58.733783+0000","last_fullsized":"2023-12-19T16:06:58.733783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_clean_scrub_stamp":"2023-12-19T16:06:46.706871+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:09.167979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109217+0000","last_change":"2023-12-19T16:06:58.300900+0000","last_active":"2023-12-19T16:07:01.109217+0000","last_peered":"2023-12-19T16:07:01.109217+0000","last_clean":"2023-12-19T16:07:01.109217+0000","last_became_active":"2023-12-19T16:06:58.300641+0000","last_became_peered":"2023-12-19T16:06:58.300641+0000","last_unstale":"2023-12-19T16:07:01.109217+0000","last_undegraded":"2023-12-19T16:07:01.109217+0000","last_fullsized":"2023-12-19T16:07:01.109217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:07.531619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429774+0000","last_change":"2023-12-19T16:06:58.755362+0000","last_active":"2023-12-19T16:07:00.429774+0000","last_peered":"2023-12-19T16:07:00.429774+0000","last_clean":"2023-12-19T16:07:00.429774+0000","last_became_active":"2023-12-19T16:06:58.755055+0000","last_became_peered":"2023-12-19T16:06:58.755055+0000","last_unstale":"2023-12-19T16:07:00.429774+0000","last_undegraded":"2023-12-19T16:07:00.429774+0000","last_fullsized":"2023-12-19T16:07:00.429774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:08:43.126506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109035+0000","last_change":"2023-12-19T16:06:58.310316+0000","last_active":"2023-12-19T16:07:01.109035+0000","last_peered":"2023-12-19T16:07:01.109035+0000","last_clean":"2023-12-19T16:07:01.109035+0000","last_became_active":"2023-12-19T16:06:58.310035+0000","last_became_peered":"2023-12-19T16:06:58.310035+0000","last_unstale":"2023-12-19T16:07:01.109035+0000","last_undegraded":"2023-12-19T16:07:01.109035+0000","last_fullsized":"2023-12-19T16:07:01.109035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:07.531619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466062+0000","last_change":"2023-12-19T16:06:58.741676+0000","last_active":"2023-12-19T16:07:00.466062+0000","last_peered":"2023-12-19T16:07:00.466062+0000","last_clean":"2023-12-19T16:07:00.466062+0000","last_became_active":"2023-12-19T16:06:58.741422+0000","last_became_peered":"2023-12-19T16:06:58.741422+0000","last_unstale":"2023-12-19T16:07:00.466062+0000","last_undegraded":"2023-12-19T16:07:00.466062+0000","last_fullsized":"2023-12-19T16:07:00.466062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:46:27.205690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736299+0000","last_change":"2023-12-19T16:06:58.296822+0000","last_active":"2023-12-19T16:06:59.736299+0000","last_peered":"2023-12-19T16:06:59.736299+0000","last_clean":"2023-12-19T16:06:59.736299+0000","last_became_active":"2023-12-19T16:06:58.296555+0000","last_became_peered":"2023-12-19T16:06:58.296555+0000","last_unstale":"2023-12-19T16:06:59.736299+0000","last_undegraded":"2023-12-19T16:06:59.736299+0000","last_fullsized":"2023-12-19T16:06:59.736299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735354+0000","last_change":"2023-12-19T16:06:58.750259+0000","last_active":"2023-12-19T16:06:59.735354+0000","last_peered":"2023-12-19T16:06:59.735354+0000","last_clean":"2023-12-19T16:06:59.735354+0000","last_became_active":"2023-12-19T16:06:58.749971+0000","last_became_peered":"2023-12-19T16:06:58.749971+0000","last_unstale":"2023-12-19T16:06:59.735354+0000","last_undegraded":"2023-12-19T16:06:59.735354+0000","last_fullsized":"2023-12-19T16:06:59.735354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109975+0000","last_change":"2023-12-19T16:06:58.308334+0000","last_active":"2023-12-19T16:07:01.109975+0000","last_peered":"2023-12-19T16:07:01.109975+0000","last_clean":"2023-12-19T16:07:01.109975+0000","last_became_active":"2023-12-19T16:06:58.307997+0000","last_became_peered":"2023-12-19T16:06:58.307997+0000","last_unstale":"2023-12-19T16:07:01.109975+0000","last_undegraded":"2023-12-19T16:07:01.109975+0000","last_fullsized":"2023-12-19T16:07:01.109975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735908+0000","last_change":"2023-12-19T16:06:58.749875+0000","last_active":"2023-12-19T16:06:59.735908+0000","last_peered":"2023-12-19T16:06:59.735908+0000","last_clean":"2023-12-19T16:06:59.735908+0000","last_became_active":"2023-12-19T16:06:58.749604+0000","last_became_peered":"2023-12-19T16:06:58.749604+0000","last_unstale":"2023-12-19T16:06:59.735908+0000","last_undegraded":"2023-12-19T16:06:59.735908+0000","last_fullsized":"2023-12-19T16:06:59.735908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:07.695345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735602+0000","last_change":"2023-12-19T16:06:58.310432+0000","last_active":"2023-12-19T16:06:59.735602+0000","last_peered":"2023-12-19T16:06:59.735602+0000","last_clean":"2023-12-19T16:06:59.735602+0000","last_became_active":"2023-12-19T16:06:58.310052+0000","last_became_peered":"2023-12-19T16:06:58.310052+0000","last_unstale":"2023-12-19T16:06:59.735602+0000","last_undegraded":"2023-12-19T16:06:59.735602+0000","last_fullsized":"2023-12-19T16:06:59.735602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:07.531619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109764+0000","last_change":"2023-12-19T16:06:58.755050+0000","last_active":"2023-12-19T16:07:01.109764+0000","last_peered":"2023-12-19T16:07:01.109764+0000","last_clean":"2023-12-19T16:07:01.109764+0000","last_became_active":"2023-12-19T16:06:58.754666+0000","last_became_peered":"2023-12-19T16:06:58.754666+0000","last_unstale":"2023-12-19T16:07:01.109764+0000","last_undegraded":"2023-12-19T16:07:01.109764+0000","last_fullsized":"2023-12-19T16:07:01.109764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:11.108008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109843+0000","last_change":"2023-12-19T16:06:58.311812+0000","last_active":"2023-12-19T16:07:01.109843+0000","last_peered":"2023-12-19T16:07:01.109843+0000","last_clean":"2023-12-19T16:07:01.109843+0000","last_became_active":"2023-12-19T16:06:58.311423+0000","last_became_peered":"2023-12-19T16:06:58.311423+0000","last_unstale":"2023-12-19T16:07:01.109843+0000","last_undegraded":"2023-12-19T16:07:01.109843+0000","last_fullsized":"2023-12-19T16:07:01.109843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735591+0000","last_change":"2023-12-19T16:06:58.747297+0000","last_active":"2023-12-19T16:06:59.735591+0000","last_peered":"2023-12-19T16:06:59.735591+0000","last_clean":"2023-12-19T16:06:59.735591+0000","last_became_active":"2023-12-19T16:06:58.747025+0000","last_became_peered":"2023-12-19T16:06:58.747025+0000","last_unstale":"2023-12-19T16:06:59.735591+0000","last_undegraded":"2023-12-19T16:06:59.735591+0000","last_fullsized":"2023-12-19T16:06:59.735591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735768+0000","last_change":"2023-12-19T16:06:58.309515+0000","last_active":"2023-12-19T16:06:59.735768+0000","last_peered":"2023-12-19T16:06:59.735768+0000","last_clean":"2023-12-19T16:06:59.735768+0000","last_became_active":"2023-12-19T16:06:58.309120+0000","last_became_peered":"2023-12-19T16:06:58.309120+0000","last_unstale":"2023-12-19T16:06:59.735768+0000","last_undegraded":"2023-12-19T16:06:59.735768+0000","last_fullsized":"2023-12-19T16:06:59.735768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:06.572806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429995+0000","last_change":"2023-12-19T16:06:58.744382+0000","last_active":"2023-12-19T16:07:00.429995+0000","last_peered":"2023-12-19T16:07:00.429995+0000","last_clean":"2023-12-19T16:07:00.429995+0000","last_became_active":"2023-12-19T16:06:58.744125+0000","last_became_peered":"2023-12-19T16:06:58.744125+0000","last_unstale":"2023-12-19T16:07:00.429995+0000","last_undegraded":"2023-12-19T16:07:00.429995+0000","last_fullsized":"2023-12-19T16:07:00.429995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:17.210206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594111+0000","last_change":"2023-12-19T16:06:58.306697+0000","last_active":"2023-12-19T16:07:00.594111+0000","last_peered":"2023-12-19T16:07:00.594111+0000","last_clean":"2023-12-19T16:07:00.594111+0000","last_became_active":"2023-12-19T16:06:58.306411+0000","last_became_peered":"2023-12-19T16:06:58.306411+0000","last_unstale":"2023-12-19T16:07:00.594111+0000","last_undegraded":"2023-12-19T16:07:00.594111+0000","last_fullsized":"2023-12-19T16:07:00.594111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466265+0000","last_change":"2023-12-19T16:06:58.749375+0000","last_active":"2023-12-19T16:07:00.466265+0000","last_peered":"2023-12-19T16:07:00.466265+0000","last_clean":"2023-12-19T16:07:00.466265+0000","last_became_active":"2023-12-19T16:06:58.749123+0000","last_became_peered":"2023-12-19T16:06:58.749123+0000","last_unstale":"2023-12-19T16:07:00.466265+0000","last_undegraded":"2023-12-19T16:07:00.466265+0000","last_fullsized":"2023-12-19T16:07:00.466265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109074+0000","last_change":"2023-12-19T16:06:58.311689+0000","last_active":"2023-12-19T16:07:01.109074+0000","last_peered":"2023-12-19T16:07:01.109074+0000","last_clean":"2023-12-19T16:07:01.109074+0000","last_became_active":"2023-12-19T16:06:58.311443+0000","last_became_peered":"2023-12-19T16:06:58.311443+0000","last_unstale":"2023-12-19T16:07:01.109074+0000","last_undegraded":"2023-12-19T16:07:01.109074+0000","last_fullsized":"2023-12-19T16:07:01.109074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:16.318865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735579+0000","last_change":"2023-12-19T16:06:58.737013+0000","last_active":"2023-12-19T16:06:59.735579+0000","last_peered":"2023-12-19T16:06:59.735579+0000","last_clean":"2023-12-19T16:06:59.735579+0000","last_became_active":"2023-12-19T16:06:58.736732+0000","last_became_peered":"2023-12-19T16:06:58.736732+0000","last_unstale":"2023-12-19T16:06:59.735579+0000","last_undegraded":"2023-12-19T16:06:59.735579+0000","last_fullsized":"2023-12-19T16:06:59.735579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:08.536543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735494+0000","last_change":"2023-12-19T16:06:58.311956+0000","last_active":"2023-12-19T16:06:59.735494+0000","last_peered":"2023-12-19T16:06:59.735494+0000","last_clean":"2023-12-19T16:06:59.735494+0000","last_became_active":"2023-12-19T16:06:58.311426+0000","last_became_peered":"2023-12-19T16:06:58.311426+0000","last_unstale":"2023-12-19T16:06:59.735494+0000","last_undegraded":"2023-12-19T16:06:59.735494+0000","last_fullsized":"2023-12-19T16:06:59.735494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429662+0000","last_change":"2023-12-19T16:06:58.751593+0000","last_active":"2023-12-19T16:07:00.429662+0000","last_peered":"2023-12-19T16:07:00.429662+0000","last_clean":"2023-12-19T16:07:00.429662+0000","last_became_active":"2023-12-19T16:06:58.751335+0000","last_became_peered":"2023-12-19T16:06:58.751335+0000","last_unstale":"2023-12-19T16:07:00.429662+0000","last_undegraded":"2023-12-19T16:07:00.429662+0000","last_fullsized":"2023-12-19T16:07:00.429662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735607+0000","last_change":"2023-12-19T16:06:58.310478+0000","last_active":"2023-12-19T16:06:59.735607+0000","last_peered":"2023-12-19T16:06:59.735607+0000","last_clean":"2023-12-19T16:06:59.735607+0000","last_became_active":"2023-12-19T16:06:58.310172+0000","last_became_peered":"2023-12-19T16:06:58.310172+0000","last_unstale":"2023-12-19T16:06:59.735607+0000","last_undegraded":"2023-12-19T16:06:59.735607+0000","last_fullsized":"2023-12-19T16:06:59.735607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429817+0000","last_change":"2023-12-19T16:06:58.745013+0000","last_active":"2023-12-19T16:07:00.429817+0000","last_peered":"2023-12-19T16:07:00.429817+0000","last_clean":"2023-12-19T16:07:00.429817+0000","last_became_active":"2023-12-19T16:06:58.744739+0000","last_became_peered":"2023-12-19T16:06:58.744739+0000","last_unstale":"2023-12-19T16:07:00.429817+0000","last_undegraded":"2023-12-19T16:07:00.429817+0000","last_fullsized":"2023-12-19T16:07:00.429817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:59:45.402539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109787+0000","last_change":"2023-12-19T16:06:58.314931+0000","last_active":"2023-12-19T16:07:01.109787+0000","last_peered":"2023-12-19T16:07:01.109787+0000","last_clean":"2023-12-19T16:07:01.109787+0000","last_became_active":"2023-12-19T16:06:58.314637+0000","last_became_peered":"2023-12-19T16:06:58.314637+0000","last_unstale":"2023-12-19T16:07:01.109787+0000","last_undegraded":"2023-12-19T16:07:01.109787+0000","last_fullsized":"2023-12-19T16:07:01.109787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593737+0000","last_change":"2023-12-19T16:06:58.753329+0000","last_active":"2023-12-19T16:07:00.593737+0000","last_peered":"2023-12-19T16:07:00.593737+0000","last_clean":"2023-12-19T16:07:00.593737+0000","last_became_active":"2023-12-19T16:06:58.749183+0000","last_became_peered":"2023-12-19T16:06:58.749183+0000","last_unstale":"2023-12-19T16:07:00.593737+0000","last_undegraded":"2023-12-19T16:07:00.593737+0000","last_fullsized":"2023-12-19T16:07:00.593737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109649+0000","last_change":"2023-12-19T16:06:58.751468+0000","last_active":"2023-12-19T16:07:01.109649+0000","last_peered":"2023-12-19T16:07:01.109649+0000","last_clean":"2023-12-19T16:07:01.109649+0000","last_became_active":"2023-12-19T16:06:58.750502+0000","last_became_peered":"2023-12-19T16:06:58.750502+0000","last_unstale":"2023-12-19T16:07:01.109649+0000","last_undegraded":"2023-12-19T16:07:01.109649+0000","last_fullsized":"2023-12-19T16:07:01.109649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:59:45.402539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109568+0000","last_change":"2023-12-19T16:06:58.311983+0000","last_active":"2023-12-19T16:07:01.109568+0000","last_peered":"2023-12-19T16:07:01.109568+0000","last_clean":"2023-12-19T16:07:01.109568+0000","last_became_active":"2023-12-19T16:06:58.311706+0000","last_became_peered":"2023-12-19T16:06:58.311706+0000","last_unstale":"2023-12-19T16:07:01.109568+0000","last_undegraded":"2023-12-19T16:07:01.109568+0000","last_fullsized":"2023-12-19T16:07:01.109568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:55.716735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109940+0000","last_change":"2023-12-19T16:06:58.751294+0000","last_active":"2023-12-19T16:07:01.109940+0000","last_peered":"2023-12-19T16:07:01.109940+0000","last_clean":"2023-12-19T16:07:01.109940+0000","last_became_active":"2023-12-19T16:06:58.751039+0000","last_became_peered":"2023-12-19T16:06:58.751039+0000","last_unstale":"2023-12-19T16:07:01.109940+0000","last_undegraded":"2023-12-19T16:07:01.109940+0000","last_fullsized":"2023-12-19T16:07:01.109940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:08:43.126506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109669+0000","last_change":"2023-12-19T16:06:58.309418+0000","last_active":"2023-12-19T16:07:01.109669+0000","last_peered":"2023-12-19T16:07:01.109669+0000","last_clean":"2023-12-19T16:07:01.109669+0000","last_became_active":"2023-12-19T16:06:58.309108+0000","last_became_peered":"2023-12-19T16:06:58.309108+0000","last_unstale":"2023-12-19T16:07:01.109669+0000","last_undegraded":"2023-12-19T16:07:01.109669+0000","last_fullsized":"2023-12-19T16:07:01.109669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:06.572806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466323+0000","last_change":"2023-12-19T16:06:58.755879+0000","last_active":"2023-12-19T16:07:00.466323+0000","last_peered":"2023-12-19T16:07:00.466323+0000","last_clean":"2023-12-19T16:07:00.466323+0000","last_became_active":"2023-12-19T16:06:58.755019+0000","last_became_peered":"2023-12-19T16:06:58.755019+0000","last_unstale":"2023-12-19T16:07:00.466323+0000","last_undegraded":"2023-12-19T16:07:00.466323+0000","last_fullsized":"2023-12-19T16:07:00.466323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.430019+0000","last_change":"2023-12-19T16:06:58.308088+0000","last_active":"2023-12-19T16:07:00.430019+0000","last_peered":"2023-12-19T16:07:00.430019+0000","last_clean":"2023-12-19T16:07:00.430019+0000","last_became_active":"2023-12-19T16:06:58.307702+0000","last_became_peered":"2023-12-19T16:06:58.307702+0000","last_unstale":"2023-12-19T16:07:00.430019+0000","last_undegraded":"2023-12-19T16:07:00.430019+0000","last_fullsized":"2023-12-19T16:07:00.430019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429908+0000","last_change":"2023-12-19T16:06:58.745962+0000","last_active":"2023-12-19T16:07:00.429908+0000","last_peered":"2023-12-19T16:07:00.429908+0000","last_clean":"2023-12-19T16:07:00.429908+0000","last_became_active":"2023-12-19T16:06:58.745668+0000","last_became_peered":"2023-12-19T16:06:58.745668+0000","last_unstale":"2023-12-19T16:07:00.429908+0000","last_undegraded":"2023-12-19T16:07:00.429908+0000","last_fullsized":"2023-12-19T16:07:00.429908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466374+0000","last_change":"2023-12-19T16:06:58.307135+0000","last_active":"2023-12-19T16:07:00.466374+0000","last_peered":"2023-12-19T16:07:00.466374+0000","last_clean":"2023-12-19T16:07:00.466374+0000","last_became_active":"2023-12-19T16:06:58.306810+0000","last_became_peered":"2023-12-19T16:06:58.306810+0000","last_unstale":"2023-12-19T16:07:00.466374+0000","last_undegraded":"2023-12-19T16:07:00.466374+0000","last_fullsized":"2023-12-19T16:07:00.466374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:35.961254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":790528,"data_stored":655548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":196608,"data_stored":64688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:07:03.005 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-19T16:07:03.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.142+0000 7f3f0db9f640 1 Processor -- start 2023-12-19T16:07:03.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.142+0000 7f3f0db9f640 1 -- start start 2023-12-19T16:07:03.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.143+0000 7f3f0db9f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3f0806af80 0x7f3f0806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:03.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.143+0000 7f3f0db9f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3f081482a0 0x7f3f080b9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:03.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.143+0000 7f3f0db9f640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f08070960 0x7f3f080b6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:03.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.143+0000 7f3f0db9f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f08147e10 con 0x7f3f0806af80 2023-12-19T16:07:03.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.143+0000 7f3f0db9f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f08070df0 con 0x7f3f081482a0 2023-12-19T16:07:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.143+0000 7f3f0db9f640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f08147800 con 0x7f3f08070960 2023-12-19T16:07:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.143+0000 7f3f077fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3f0806af80 0x7f3f0806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.143+0000 7f3f077fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3f0806af80 0x7f3f0806fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49418/0 (socket says 172.21.15.37:49418) 2023-12-19T16:07:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.143+0000 7f3f077fe640 1 -- 172.21.15.37:0/122508101 learned_addr learned my addr 172.21.15.37:0/122508101 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.143+0000 7f3f06ffd640 1 --2- 172.21.15.37:0/122508101 >> v2:172.21.15.78:3300/0 conn(0x7f3f081482a0 0x7f3f080b9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.143+0000 7f3f07fff640 1 --2- 172.21.15.37:0/122508101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f08070960 0x7f3f080b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.143+0000 7f3f077fe640 1 -- 172.21.15.37:0/122508101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f08070960 msgr2=0x7f3f080b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.143+0000 7f3f077fe640 1 --2- 172.21.15.37:0/122508101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f08070960 0x7f3f080b6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.143+0000 7f3f077fe640 1 -- 172.21.15.37:0/122508101 >> v2:172.21.15.78:3300/0 conn(0x7f3f081482a0 msgr2=0x7f3f080b9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.143+0000 7f3f077fe640 1 --2- 172.21.15.37:0/122508101 >> v2:172.21.15.78:3300/0 conn(0x7f3f081482a0 0x7f3f080b9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.143+0000 7f3f077fe640 1 -- 172.21.15.37:0/122508101 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0806b360 con 0x7f3f0806af80 2023-12-19T16:07:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.144+0000 7f3f077fe640 1 --2- 172.21.15.37:0/122508101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f0806af80 0x7f3f0806fca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3f0806b5d0 tx=0x7f3ef802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0744a232390ad1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.144+0000 7f3f067fc640 1 -- 172.21.15.37:0/122508101 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8031870 con 0x7f3f0806af80 2023-12-19T16:07:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.144+0000 7f3f067fc640 1 -- 172.21.15.37:0/122508101 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef80319d0 con 0x7f3f0806af80 2023-12-19T16:07:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.144+0000 7f3f067fc640 1 -- 172.21.15.37:0/122508101 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8031d60 con 0x7f3f0806af80 2023-12-19T16:07:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.145+0000 7f3f0db9f640 1 -- 172.21.15.37:0/122508101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f0806af80 msgr2=0x7f3f0806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.145+0000 7f3f0db9f640 1 --2- 172.21.15.37:0/122508101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f0806af80 0x7f3f0806fca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3f0806b5d0 tx=0x7f3ef802b910 comp rx=0 tx=0).stop 2023-12-19T16:07:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.145+0000 7f3f0db9f640 1 -- 172.21.15.37:0/122508101 shutdown_connections 2023-12-19T16:07:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.145+0000 7f3f0db9f640 1 --2- 172.21.15.37:0/122508101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f08070960 0x7f3f080b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.145+0000 7f3f0db9f640 1 --2- 172.21.15.37:0/122508101 >> v2:172.21.15.78:3300/0 conn(0x7f3f081482a0 0x7f3f080b9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.145+0000 7f3f0db9f640 1 --2- 172.21.15.37:0/122508101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f0806af80 0x7f3f0806fca0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.145+0000 7f3f0db9f640 1 -- 172.21.15.37:0/122508101 >> 172.21.15.37:0/122508101 conn(0x7f3f080bcfc0 msgr2=0x7f3f080bd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.145+0000 7f3f0db9f640 1 -- 172.21.15.37:0/122508101 shutdown_connections 2023-12-19T16:07:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.145+0000 7f3f0db9f640 1 -- 172.21.15.37:0/122508101 wait complete. 2023-12-19T16:07:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.146+0000 7f3f0db9f640 1 Processor -- start 2023-12-19T16:07:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.146+0000 7f3f0db9f640 1 -- start start 2023-12-19T16:07:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3f0db9f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f0806af80 0x7f3f081468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3f0db9f640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f08070960 0x7f3f081430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3f0db9f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f081482a0 0x7f3f08143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3f0db9f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0814b450 con 0x7f3f081482a0 2023-12-19T16:07:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3f0db9f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f08144bf0 con 0x7f3f0806af80 2023-12-19T16:07:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3f0db9f640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f081de110 con 0x7f3f08070960 2023-12-19T16:07:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3f07fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f081482a0 0x7f3f08143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3f07fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f081482a0 0x7f3f08143600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49420/0 (socket says 172.21.15.37:49420) 2023-12-19T16:07:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3f07fff640 1 -- 172.21.15.37:0/1227401693 learned_addr learned my addr 172.21.15.37:0/1227401693 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3f06ffd640 1 --2- 172.21.15.37:0/1227401693 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f08070960 0x7f3f081430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3f077fe640 1 --2- 172.21.15.37:0/1227401693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f0806af80 0x7f3f081468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3f07fff640 1 -- 172.21.15.37:0/1227401693 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f08070960 msgr2=0x7f3f081430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3f07fff640 1 --2- 172.21.15.37:0/1227401693 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f08070960 0x7f3f081430c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3f07fff640 1 -- 172.21.15.37:0/1227401693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f0806af80 msgr2=0x7f3f081468e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3f07fff640 1 --2- 172.21.15.37:0/1227401693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f0806af80 0x7f3f081468e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3f07fff640 1 -- 172.21.15.37:0/1227401693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef80094d0 con 0x7f3f081482a0 2023-12-19T16:07:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3f07fff640 1 --2- 172.21.15.37:0/1227401693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f081482a0 0x7f3f08143600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3f00007e60 tx=0x7f3f0000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3eeffff640 1 -- 172.21.15.37:0/1227401693 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00014620 con 0x7f3f081482a0 2023-12-19T16:07:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3eeffff640 1 -- 172.21.15.37:0/1227401693 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0000ee90 con 0x7f3f081482a0 2023-12-19T16:07:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.147+0000 7f3f0db9f640 1 -- 172.21.15.37:0/1227401693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f081de3f0 con 0x7f3f081482a0 2023-12-19T16:07:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.148+0000 7f3eeffff640 1 -- 172.21.15.37:0/1227401693 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f000149e0 con 0x7f3f081482a0 2023-12-19T16:07:03.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.148+0000 7f3f0db9f640 1 -- 172.21.15.37:0/1227401693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f081de780 con 0x7f3f081482a0 2023-12-19T16:07:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.149+0000 7f3f0db9f640 1 -- 172.21.15.37:0/1227401693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f080b6d60 con 0x7f3f081482a0 2023-12-19T16:07:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.149+0000 7f3eeffff640 1 -- 172.21.15.37:0/1227401693 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3f00014b40 con 0x7f3f081482a0 2023-12-19T16:07:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.149+0000 7f3eeffff640 1 --2- 172.21.15.37:0/1227401693 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3ef406a460 0x7f3ef406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.149+0000 7f3eeffff640 1 -- 172.21.15.37:0/1227401693 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f000890b0 con 0x7f3f081482a0 2023-12-19T16:07:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.149+0000 7f3f077fe640 1 --2- 172.21.15.37:0/1227401693 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3ef406a460 0x7f3ef406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.150+0000 7f3f077fe640 1 --2- 172.21.15.37:0/1227401693 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3ef406a460 0x7f3ef406c920 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8036000 tx=0x7f3ef803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.154+0000 7f3eeffff640 1 -- 172.21.15.37:0/1227401693 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3f080b6d60 con 0x7f3f081482a0 2023-12-19T16:07:03.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.396+0000 7f3f0db9f640 1 -- 172.21.15.37:0/1227401693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3f081de910 con 0x7f3f081482a0 2023-12-19T16:07:03.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.396+0000 7f3eeffff640 1 -- 172.21.15.37:0/1227401693 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1010 (secure 0 0 0) 0x7f3f081de910 con 0x7f3f081482a0 2023-12-19T16:07:03.399 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:03.400 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":28,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1703002005,"num_in_osds":8,"osd_in_since":1703001996,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":223657984,"bytes_avail":772870455296,"bytes_total":773094113280,"write_bytes_sec":2679,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4282}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-12-19T16:06:34.513406+0000","services":{}},"progress_events":{}} 2023-12-19T16:07:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.398+0000 7f3f0db9f640 1 -- 172.21.15.37:0/1227401693 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3ef406a460 msgr2=0x7f3ef406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.398+0000 7f3f0db9f640 1 --2- 172.21.15.37:0/1227401693 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3ef406a460 0x7f3ef406c920 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8036000 tx=0x7f3ef803c040 comp rx=0 tx=0).stop 2023-12-19T16:07:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.398+0000 7f3f0db9f640 1 -- 172.21.15.37:0/1227401693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f081482a0 msgr2=0x7f3f08143600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.398+0000 7f3f0db9f640 1 --2- 172.21.15.37:0/1227401693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f081482a0 0x7f3f08143600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3f00007e60 tx=0x7f3f0000e4b0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.398+0000 7f3f0db9f640 1 -- 172.21.15.37:0/1227401693 shutdown_connections 2023-12-19T16:07:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.398+0000 7f3f0db9f640 1 --2- 172.21.15.37:0/1227401693 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3ef406a460 0x7f3ef406c920 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.398+0000 7f3f0db9f640 1 --2- 172.21.15.37:0/1227401693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f081482a0 0x7f3f08143600 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.398+0000 7f3f0db9f640 1 --2- 172.21.15.37:0/1227401693 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3f08070960 0x7f3f081430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.398+0000 7f3f0db9f640 1 --2- 172.21.15.37:0/1227401693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f0806af80 0x7f3f081468e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.398+0000 7f3f0db9f640 1 -- 172.21.15.37:0/1227401693 >> 172.21.15.37:0/1227401693 conn(0x7f3f080bcfc0 msgr2=0x7f3f080b5500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:03.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.398+0000 7f3f0db9f640 1 -- 172.21.15.37:0/1227401693 shutdown_connections 2023-12-19T16:07:03.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.398+0000 7f3f0db9f640 1 -- 172.21.15.37:0/1227401693 wait complete. 2023-12-19T16:07:03.412 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-19T16:07:03.412 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:07:03.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.514+0000 7f404565b640 1 Processor -- start 2023-12-19T16:07:03.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.514+0000 7f404565b640 1 -- start start 2023-12-19T16:07:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.515+0000 7f404565b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f404006a470 0x7f40400bb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.515+0000 7f404565b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40400b3900 0x7f404014abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.515+0000 7f404565b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f404014b110 con 0x7f4040148040 2023-12-19T16:07:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.515+0000 7f404565b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40400c1220 con 0x7f404006a470 2023-12-19T16:07:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.515+0000 7f404565b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40400bae20 con 0x7f40400b3900 2023-12-19T16:07:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.515+0000 7f403f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4040148040 0x7f404014e0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37008/0 (socket says 172.21.15.37:37008) 2023-12-19T16:07:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.515+0000 7f403f7fe640 1 -- 172.21.15.37:0/2363221039 learned_addr learned my addr 172.21.15.37:0/2363221039 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.515+0000 7f403effd640 1 --2- 172.21.15.37:0/2363221039 >> v2:172.21.15.78:3300/0 conn(0x7f404006a470 0x7f40400bb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.515+0000 7f403e7fc640 1 --2- 172.21.15.37:0/2363221039 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40400b3900 0x7f404014abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.515+0000 7f403dffb640 1 -- 172.21.15.37:0/2363221039 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407602418 0 0) 0x7f404014b110 con 0x7f4040148040 2023-12-19T16:07:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.515+0000 7f403dffb640 1 -- 172.21.15.37:0/2363221039 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4028003520 con 0x7f4040148040 2023-12-19T16:07:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.515+0000 7f403effd640 1 -- 172.21.15.37:0/2363221039 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40400b3900 msgr2=0x7f404014abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.515+0000 7f403effd640 1 --2- 172.21.15.37:0/2363221039 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40400b3900 0x7f404014abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.515+0000 7f403effd640 1 -- 172.21.15.37:0/2363221039 >> v1:172.21.15.37:6789/0 conn(0x7f4040148040 legacy=0x7f404014e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.516+0000 7f403effd640 1 -- 172.21.15.37:0/2363221039 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40400bf900 con 0x7f404006a470 2023-12-19T16:07:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.516+0000 7f403effd640 1 --2- 172.21.15.37:0/2363221039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f404006a470 0x7f40400bb2b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40300097a0 tx=0x7f403002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a2cf9301483f460 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.516+0000 7f403dffb640 1 -- 172.21.15.37:0/2363221039 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4030031830 con 0x7f404006a470 2023-12-19T16:07:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.516+0000 7f403dffb640 1 -- 172.21.15.37:0/2363221039 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4030031990 con 0x7f404006a470 2023-12-19T16:07:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.517+0000 7f403dffb640 1 -- 172.21.15.37:0/2363221039 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4030031d20 con 0x7f404006a470 2023-12-19T16:07:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.517+0000 7f404565b640 1 -- 172.21.15.37:0/2363221039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f404006a470 msgr2=0x7f40400bb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.517+0000 7f404565b640 1 --2- 172.21.15.37:0/2363221039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f404006a470 0x7f40400bb2b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40300097a0 tx=0x7f403002b8d0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.517+0000 7f404565b640 1 -- 172.21.15.37:0/2363221039 shutdown_connections 2023-12-19T16:07:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.517+0000 7f404565b640 1 --2- 172.21.15.37:0/2363221039 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40400b3900 0x7f404014abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.517+0000 7f404565b640 1 --2- 172.21.15.37:0/2363221039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f404006a470 0x7f40400bb2b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.517+0000 7f404565b640 1 -- 172.21.15.37:0/2363221039 >> 172.21.15.37:0/2363221039 conn(0x7f40400c0270 msgr2=0x7f40400c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.517+0000 7f404565b640 1 -- 172.21.15.37:0/2363221039 shutdown_connections 2023-12-19T16:07:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.517+0000 7f404565b640 1 -- 172.21.15.37:0/2363221039 wait complete. 2023-12-19T16:07:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.518+0000 7f404565b640 1 Processor -- start 2023-12-19T16:07:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.518+0000 7f404565b640 1 -- start start 2023-12-19T16:07:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.519+0000 7f404565b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f404006a470 0x7f40400a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.519+0000 7f404565b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40400b3900 0x7f404014aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.519+0000 7f404565b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4040148040 0x7f40401e0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.519+0000 7f404565b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404014b3e0 con 0x7f4040148040 2023-12-19T16:07:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.519+0000 7f404565b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40400a4a70 con 0x7f40400b3900 2023-12-19T16:07:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.519+0000 7f404565b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40400a4d10 con 0x7f404006a470 2023-12-19T16:07:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.519+0000 7f403f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4040148040 0x7f40401e0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.519+0000 7f403f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4040148040 0x7f40401e0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49426/0 (socket says 172.21.15.37:49426) 2023-12-19T16:07:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.519+0000 7f403f7fe640 1 -- 172.21.15.37:0/28350391 learned_addr learned my addr 172.21.15.37:0/28350391 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.519+0000 7f403e7fc640 1 --2- 172.21.15.37:0/28350391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40400b3900 0x7f404014aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.519+0000 7f403effd640 1 --2- 172.21.15.37:0/28350391 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f404006a470 0x7f40400a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.519+0000 7f403f7fe640 1 -- 172.21.15.37:0/28350391 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f404006a470 msgr2=0x7f40400a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.519+0000 7f403f7fe640 1 --2- 172.21.15.37:0/28350391 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f404006a470 0x7f40400a5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.519+0000 7f403f7fe640 1 -- 172.21.15.37:0/28350391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40400b3900 msgr2=0x7f404014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.519+0000 7f403f7fe640 1 --2- 172.21.15.37:0/28350391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40400b3900 0x7f404014aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.519+0000 7f403f7fe640 1 -- 172.21.15.37:0/28350391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4030009400 con 0x7f4040148040 2023-12-19T16:07:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.519+0000 7f403e7fc640 1 --2- 172.21.15.37:0/28350391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40400b3900 0x7f404014aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.520+0000 7f403f7fe640 1 --2- 172.21.15.37:0/28350391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4040148040 0x7f40401e0000 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f403800caa0 tx=0x7f403800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.520+0000 7f40277fe640 1 -- 172.21.15.37:0/28350391 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403800ac00 con 0x7f4040148040 2023-12-19T16:07:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.520+0000 7f40277fe640 1 -- 172.21.15.37:0/28350391 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403800ad60 con 0x7f4040148040 2023-12-19T16:07:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.520+0000 7f404565b640 1 -- 172.21.15.37:0/28350391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40400a4ff0 con 0x7f4040148040 2023-12-19T16:07:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.520+0000 7f40277fe640 1 -- 172.21.15.37:0/28350391 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4038012620 con 0x7f4040148040 2023-12-19T16:07:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.520+0000 7f404565b640 1 -- 172.21.15.37:0/28350391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40400a57f0 con 0x7f4040148040 2023-12-19T16:07:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.521+0000 7f404565b640 1 -- 172.21.15.37:0/28350391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40400a5510 con 0x7f4040148040 2023-12-19T16:07:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.521+0000 7f40277fe640 1 -- 172.21.15.37:0/28350391 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4038007070 con 0x7f4040148040 2023-12-19T16:07:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.522+0000 7f40277fe640 1 --2- 172.21.15.37:0/28350391 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f402c06a430 0x7f402c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.522+0000 7f40277fe640 1 -- 172.21.15.37:0/28350391 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4038088910 con 0x7f4040148040 2023-12-19T16:07:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.522+0000 7f403effd640 1 --2- 172.21.15.37:0/28350391 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f402c06a430 0x7f402c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.522+0000 7f403effd640 1 --2- 172.21.15.37:0/28350391 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f402c06a430 0x7f402c06c8f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4030036000 tx=0x7f403003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.526+0000 7f40277fe640 1 -- 172.21.15.37:0/28350391 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f40400a5510 con 0x7f4040148040 2023-12-19T16:07:03.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.697+0000 7f404565b640 1 -- 172.21.15.37:0/28350391 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40400bfe80 con 0x7f402c06a430 2023-12-19T16:07:03.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.705+0000 7f40277fe640 1 -- 172.21.15.37:0/28350391 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264656 (secure 0 0 0) 0x7f4030031b80 con 0x7f402c06a430 2023-12-19T16:07:03.755 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:03.756 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-19T16:07:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.708+0000 7f404565b640 1 -- 172.21.15.37:0/28350391 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f402c06a430 msgr2=0x7f402c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.708+0000 7f404565b640 1 --2- 172.21.15.37:0/28350391 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f402c06a430 0x7f402c06c8f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4030036000 tx=0x7f403003c040 comp rx=0 tx=0).stop 2023-12-19T16:07:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.708+0000 7f404565b640 1 -- 172.21.15.37:0/28350391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4040148040 msgr2=0x7f40401e0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.708+0000 7f404565b640 1 --2- 172.21.15.37:0/28350391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4040148040 0x7f40401e0000 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f403800caa0 tx=0x7f403800cf60 comp rx=0 tx=0).stop 2023-12-19T16:07:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.708+0000 7f404565b640 1 -- 172.21.15.37:0/28350391 shutdown_connections 2023-12-19T16:07:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.708+0000 7f404565b640 1 --2- 172.21.15.37:0/28350391 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f402c06a430 0x7f402c06c8f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.708+0000 7f404565b640 1 --2- 172.21.15.37:0/28350391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4040148040 0x7f40401e0000 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.708+0000 7f404565b640 1 --2- 172.21.15.37:0/28350391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40400b3900 0x7f404014aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.708+0000 7f404565b640 1 --2- 172.21.15.37:0/28350391 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f404006a470 0x7f40400a5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.708+0000 7f404565b640 1 -- 172.21.15.37:0/28350391 >> 172.21.15.37:0/28350391 conn(0x7f40400c0270 msgr2=0x7f40400be050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.708+0000 7f404565b640 1 -- 172.21.15.37:0/28350391 shutdown_connections 2023-12-19T16:07:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:03.708+0000 7f404565b640 1 -- 172.21.15.37:0/28350391 wait complete. 2023-12-19T16:07:03.759 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-19T16:07:02.632207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218416,"kb_used_data":2800,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756304,"statfs":{"total":773094113280,"available":772870455296,"internally_reserved":0,"allocated":2867200,"data_stored":1740044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.350188"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109838+0000","last_change":"2023-12-19T16:06:58.760625+0000","last_active":"2023-12-19T16:07:01.109838+0000","last_peered":"2023-12-19T16:07:01.109838+0000","last_clean":"2023-12-19T16:07:01.109838+0000","last_became_active":"2023-12-19T16:06:58.760229+0000","last_became_peered":"2023-12-19T16:06:58.760229+0000","last_unstale":"2023-12-19T16:07:01.109838+0000","last_undegraded":"2023-12-19T16:07:01.109838+0000","last_fullsized":"2023-12-19T16:07:01.109838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735747+0000","last_change":"2023-12-19T16:06:58.749173+0000","last_active":"2023-12-19T16:06:59.735747+0000","last_peered":"2023-12-19T16:06:59.735747+0000","last_clean":"2023-12-19T16:06:59.735747+0000","last_became_active":"2023-12-19T16:06:58.748736+0000","last_became_peered":"2023-12-19T16:06:58.748736+0000","last_unstale":"2023-12-19T16:06:59.735747+0000","last_undegraded":"2023-12-19T16:06:59.735747+0000","last_fullsized":"2023-12-19T16:06:59.735747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466127+0000","last_change":"2023-12-19T16:06:58.738858+0000","last_active":"2023-12-19T16:07:00.466127+0000","last_peered":"2023-12-19T16:07:00.466127+0000","last_clean":"2023-12-19T16:07:00.466127+0000","last_became_active":"2023-12-19T16:06:58.738178+0000","last_became_peered":"2023-12-19T16:06:58.738178+0000","last_unstale":"2023-12-19T16:07:00.466127+0000","last_undegraded":"2023-12-19T16:07:00.466127+0000","last_fullsized":"2023-12-19T16:07:00.466127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109498+0000","last_change":"2023-12-19T16:06:58.754766+0000","last_active":"2023-12-19T16:07:01.109498+0000","last_peered":"2023-12-19T16:07:01.109498+0000","last_clean":"2023-12-19T16:07:01.109498+0000","last_became_active":"2023-12-19T16:06:58.754289+0000","last_became_peered":"2023-12-19T16:06:58.754289+0000","last_unstale":"2023-12-19T16:07:01.109498+0000","last_undegraded":"2023-12-19T16:07:01.109498+0000","last_fullsized":"2023-12-19T16:07:01.109498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:26:37.888389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109413+0000","last_change":"2023-12-19T16:06:58.743609+0000","last_active":"2023-12-19T16:07:01.109413+0000","last_peered":"2023-12-19T16:07:01.109413+0000","last_clean":"2023-12-19T16:07:01.109413+0000","last_became_active":"2023-12-19T16:06:58.743331+0000","last_became_peered":"2023-12-19T16:06:58.743331+0000","last_unstale":"2023-12-19T16:07:01.109413+0000","last_undegraded":"2023-12-19T16:07:01.109413+0000","last_fullsized":"2023-12-19T16:07:01.109413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:11.108008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109102+0000","last_change":"2023-12-19T16:06:58.752778+0000","last_active":"2023-12-19T16:07:01.109102+0000","last_peered":"2023-12-19T16:07:01.109102+0000","last_clean":"2023-12-19T16:07:01.109102+0000","last_became_active":"2023-12-19T16:06:58.752519+0000","last_became_peered":"2023-12-19T16:06:58.752519+0000","last_unstale":"2023-12-19T16:07:01.109102+0000","last_undegraded":"2023-12-19T16:07:01.109102+0000","last_fullsized":"2023-12-19T16:07:01.109102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:17.210206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109322+0000","last_change":"2023-12-19T16:06:58.748834+0000","last_active":"2023-12-19T16:07:01.109322+0000","last_peered":"2023-12-19T16:07:01.109322+0000","last_clean":"2023-12-19T16:07:01.109322+0000","last_became_active":"2023-12-19T16:06:58.748039+0000","last_became_peered":"2023-12-19T16:06:58.748039+0000","last_unstale":"2023-12-19T16:07:01.109322+0000","last_undegraded":"2023-12-19T16:07:01.109322+0000","last_fullsized":"2023-12-19T16:07:01.109322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:26:37.888389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429554+0000","last_change":"2023-12-19T16:06:58.754746+0000","last_active":"2023-12-19T16:07:00.429554+0000","last_peered":"2023-12-19T16:07:00.429554+0000","last_clean":"2023-12-19T16:07:00.429554+0000","last_became_active":"2023-12-19T16:06:58.754477+0000","last_became_peered":"2023-12-19T16:06:58.754477+0000","last_unstale":"2023-12-19T16:07:00.429554+0000","last_undegraded":"2023-12-19T16:07:00.429554+0000","last_fullsized":"2023-12-19T16:07:00.429554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:02.578194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109955+0000","last_change":"2023-12-19T16:06:58.755823+0000","last_active":"2023-12-19T16:07:01.109955+0000","last_peered":"2023-12-19T16:07:01.109955+0000","last_clean":"2023-12-19T16:07:01.109955+0000","last_became_active":"2023-12-19T16:06:58.755519+0000","last_became_peered":"2023-12-19T16:06:58.755519+0000","last_unstale":"2023-12-19T16:07:01.109955+0000","last_undegraded":"2023-12-19T16:07:01.109955+0000","last_fullsized":"2023-12-19T16:07:01.109955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:17.210206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594076+0000","last_change":"2023-12-19T16:06:58.757791+0000","last_active":"2023-12-19T16:07:00.594076+0000","last_peered":"2023-12-19T16:07:00.594076+0000","last_clean":"2023-12-19T16:07:00.594076+0000","last_became_active":"2023-12-19T16:06:58.757519+0000","last_became_peered":"2023-12-19T16:06:58.757519+0000","last_unstale":"2023-12-19T16:07:00.594076+0000","last_undegraded":"2023-12-19T16:07:00.594076+0000","last_fullsized":"2023-12-19T16:07:00.594076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593880+0000","last_change":"2023-12-19T16:06:58.757323+0000","last_active":"2023-12-19T16:07:00.593880+0000","last_peered":"2023-12-19T16:07:00.593880+0000","last_clean":"2023-12-19T16:07:00.593880+0000","last_became_active":"2023-12-19T16:06:58.757070+0000","last_became_peered":"2023-12-19T16:06:58.757070+0000","last_unstale":"2023-12-19T16:07:00.593880+0000","last_undegraded":"2023-12-19T16:07:00.593880+0000","last_fullsized":"2023-12-19T16:07:00.593880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735789+0000","last_change":"2023-12-19T16:06:58.748826+0000","last_active":"2023-12-19T16:06:59.735789+0000","last_peered":"2023-12-19T16:06:59.735789+0000","last_clean":"2023-12-19T16:06:59.735789+0000","last_became_active":"2023-12-19T16:06:58.748455+0000","last_became_peered":"2023-12-19T16:06:58.748455+0000","last_unstale":"2023-12-19T16:06:59.735789+0000","last_undegraded":"2023-12-19T16:06:59.735789+0000","last_fullsized":"2023-12-19T16:06:59.735789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:45:54.216383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429773+0000","last_change":"2023-12-19T16:06:58.746487+0000","last_active":"2023-12-19T16:07:00.429773+0000","last_peered":"2023-12-19T16:07:00.429773+0000","last_clean":"2023-12-19T16:07:00.429773+0000","last_became_active":"2023-12-19T16:06:58.746251+0000","last_became_peered":"2023-12-19T16:06:58.746251+0000","last_unstale":"2023-12-19T16:07:00.429773+0000","last_undegraded":"2023-12-19T16:07:00.429773+0000","last_fullsized":"2023-12-19T16:07:00.429773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.465948+0000","last_change":"2023-12-19T16:06:58.749166+0000","last_active":"2023-12-19T16:07:00.465948+0000","last_peered":"2023-12-19T16:07:00.465948+0000","last_clean":"2023-12-19T16:07:00.465948+0000","last_became_active":"2023-12-19T16:06:58.748884+0000","last_became_peered":"2023-12-19T16:06:58.748884+0000","last_unstale":"2023-12-19T16:07:00.465948+0000","last_undegraded":"2023-12-19T16:07:00.465948+0000","last_fullsized":"2023-12-19T16:07:00.465948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735398+0000","last_change":"2023-12-19T16:06:58.744455+0000","last_active":"2023-12-19T16:06:59.735398+0000","last_peered":"2023-12-19T16:06:59.735398+0000","last_clean":"2023-12-19T16:06:59.735398+0000","last_became_active":"2023-12-19T16:06:58.744204+0000","last_became_peered":"2023-12-19T16:06:58.744204+0000","last_unstale":"2023-12-19T16:06:59.735398+0000","last_undegraded":"2023-12-19T16:06:59.735398+0000","last_fullsized":"2023-12-19T16:06:59.735398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109012+0000","last_change":"2023-12-19T16:06:58.751725+0000","last_active":"2023-12-19T16:07:01.109012+0000","last_peered":"2023-12-19T16:07:01.109012+0000","last_clean":"2023-12-19T16:07:01.109012+0000","last_became_active":"2023-12-19T16:06:58.751476+0000","last_became_peered":"2023-12-19T16:06:58.751476+0000","last_unstale":"2023-12-19T16:07:01.109012+0000","last_undegraded":"2023-12-19T16:07:01.109012+0000","last_fullsized":"2023-12-19T16:07:01.109012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:49.465099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109749+0000","last_change":"2023-12-19T16:06:58.752816+0000","last_active":"2023-12-19T16:07:01.109749+0000","last_peered":"2023-12-19T16:07:01.109749+0000","last_clean":"2023-12-19T16:07:01.109749+0000","last_became_active":"2023-12-19T16:06:58.752475+0000","last_became_peered":"2023-12-19T16:06:58.752475+0000","last_unstale":"2023-12-19T16:07:01.109749+0000","last_undegraded":"2023-12-19T16:07:01.109749+0000","last_fullsized":"2023-12-19T16:07:01.109749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736208+0000","last_change":"2023-12-19T16:06:58.745867+0000","last_active":"2023-12-19T16:06:59.736208+0000","last_peered":"2023-12-19T16:06:59.736208+0000","last_clean":"2023-12-19T16:06:59.736208+0000","last_became_active":"2023-12-19T16:06:58.745603+0000","last_became_peered":"2023-12-19T16:06:58.745603+0000","last_unstale":"2023-12-19T16:06:59.736208+0000","last_undegraded":"2023-12-19T16:06:59.736208+0000","last_fullsized":"2023-12-19T16:06:59.736208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:45:54.216383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109763+0000","last_change":"2023-12-19T16:06:58.744080+0000","last_active":"2023-12-19T16:07:01.109763+0000","last_peered":"2023-12-19T16:07:01.109763+0000","last_clean":"2023-12-19T16:07:01.109763+0000","last_became_active":"2023-12-19T16:06:58.743129+0000","last_became_peered":"2023-12-19T16:06:58.743129+0000","last_unstale":"2023-12-19T16:07:01.109763+0000","last_undegraded":"2023-12-19T16:07:01.109763+0000","last_fullsized":"2023-12-19T16:07:01.109763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593848+0000","last_change":"2023-12-19T16:06:58.754725+0000","last_active":"2023-12-19T16:07:00.593848+0000","last_peered":"2023-12-19T16:07:00.593848+0000","last_clean":"2023-12-19T16:07:00.593848+0000","last_became_active":"2023-12-19T16:06:58.754476+0000","last_became_peered":"2023-12-19T16:06:58.754476+0000","last_unstale":"2023-12-19T16:07:00.593848+0000","last_undegraded":"2023-12-19T16:07:00.593848+0000","last_fullsized":"2023-12-19T16:07:00.593848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466100+0000","last_change":"2023-12-19T16:06:58.744917+0000","last_active":"2023-12-19T16:07:00.466100+0000","last_peered":"2023-12-19T16:07:00.466100+0000","last_clean":"2023-12-19T16:07:00.466100+0000","last_became_active":"2023-12-19T16:06:58.744663+0000","last_became_peered":"2023-12-19T16:06:58.744663+0000","last_unstale":"2023-12-19T16:07:00.466100+0000","last_undegraded":"2023-12-19T16:07:00.466100+0000","last_fullsized":"2023-12-19T16:07:00.466100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109326+0000","last_change":"2023-12-19T16:06:58.752295+0000","last_active":"2023-12-19T16:07:01.109326+0000","last_peered":"2023-12-19T16:07:01.109326+0000","last_clean":"2023-12-19T16:07:01.109326+0000","last_became_active":"2023-12-19T16:06:58.752030+0000","last_became_peered":"2023-12-19T16:06:58.752030+0000","last_unstale":"2023-12-19T16:07:01.109326+0000","last_undegraded":"2023-12-19T16:07:01.109326+0000","last_fullsized":"2023-12-19T16:07:01.109326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:02.578194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429607+0000","last_change":"2023-12-19T16:06:58.737261+0000","last_active":"2023-12-19T16:07:00.429607+0000","last_peered":"2023-12-19T16:07:00.429607+0000","last_clean":"2023-12-19T16:07:00.429607+0000","last_became_active":"2023-12-19T16:06:58.736978+0000","last_became_peered":"2023-12-19T16:06:58.736978+0000","last_unstale":"2023-12-19T16:07:00.429607+0000","last_undegraded":"2023-12-19T16:07:00.429607+0000","last_fullsized":"2023-12-19T16:07:00.429607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109099+0000","last_change":"2023-12-19T16:06:58.751235+0000","last_active":"2023-12-19T16:07:01.109099+0000","last_peered":"2023-12-19T16:07:01.109099+0000","last_clean":"2023-12-19T16:07:01.109099+0000","last_became_active":"2023-12-19T16:06:58.750410+0000","last_became_peered":"2023-12-19T16:06:58.750410+0000","last_unstale":"2023-12-19T16:07:01.109099+0000","last_undegraded":"2023-12-19T16:07:01.109099+0000","last_fullsized":"2023-12-19T16:07:01.109099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:56:59.199473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429968+0000","last_change":"2023-12-19T16:06:58.744478+0000","last_active":"2023-12-19T16:07:00.429968+0000","last_peered":"2023-12-19T16:07:00.429968+0000","last_clean":"2023-12-19T16:07:00.429968+0000","last_became_active":"2023-12-19T16:06:58.742838+0000","last_became_peered":"2023-12-19T16:06:58.742838+0000","last_unstale":"2023-12-19T16:07:00.429968+0000","last_undegraded":"2023-12-19T16:07:00.429968+0000","last_fullsized":"2023-12-19T16:07:00.429968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594088+0000","last_change":"2023-12-19T16:06:58.746043+0000","last_active":"2023-12-19T16:07:00.594088+0000","last_peered":"2023-12-19T16:07:00.594088+0000","last_clean":"2023-12-19T16:07:00.594088+0000","last_became_active":"2023-12-19T16:06:58.745779+0000","last_became_peered":"2023-12-19T16:06:58.745779+0000","last_unstale":"2023-12-19T16:07:00.594088+0000","last_undegraded":"2023-12-19T16:07:00.594088+0000","last_fullsized":"2023-12-19T16:07:00.594088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:04.102120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735628+0000","last_change":"2023-12-19T16:06:58.749441+0000","last_active":"2023-12-19T16:06:59.735628+0000","last_peered":"2023-12-19T16:06:59.735628+0000","last_clean":"2023-12-19T16:06:59.735628+0000","last_became_active":"2023-12-19T16:06:58.748234+0000","last_became_peered":"2023-12-19T16:06:58.748234+0000","last_unstale":"2023-12-19T16:06:59.735628+0000","last_undegraded":"2023-12-19T16:06:59.735628+0000","last_fullsized":"2023-12-19T16:06:59.735628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429935+0000","last_change":"2023-12-19T16:06:58.744976+0000","last_active":"2023-12-19T16:07:00.429935+0000","last_peered":"2023-12-19T16:07:00.429935+0000","last_clean":"2023-12-19T16:07:00.429935+0000","last_became_active":"2023-12-19T16:06:58.744731+0000","last_became_peered":"2023-12-19T16:06:58.744731+0000","last_unstale":"2023-12-19T16:07:00.429935+0000","last_undegraded":"2023-12-19T16:07:00.429935+0000","last_fullsized":"2023-12-19T16:07:00.429935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466162+0000","last_change":"2023-12-19T16:06:58.748370+0000","last_active":"2023-12-19T16:07:00.466162+0000","last_peered":"2023-12-19T16:07:00.466162+0000","last_clean":"2023-12-19T16:07:00.466162+0000","last_became_active":"2023-12-19T16:06:58.748079+0000","last_became_peered":"2023-12-19T16:06:58.748079+0000","last_unstale":"2023-12-19T16:07:00.466162+0000","last_undegraded":"2023-12-19T16:07:00.466162+0000","last_fullsized":"2023-12-19T16:07:00.466162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109837+0000","last_change":"2023-12-19T16:06:58.751906+0000","last_active":"2023-12-19T16:07:01.109837+0000","last_peered":"2023-12-19T16:07:01.109837+0000","last_clean":"2023-12-19T16:07:01.109837+0000","last_became_active":"2023-12-19T16:06:58.750803+0000","last_became_peered":"2023-12-19T16:06:58.750803+0000","last_unstale":"2023-12-19T16:07:01.109837+0000","last_undegraded":"2023-12-19T16:07:01.109837+0000","last_fullsized":"2023-12-19T16:07:01.109837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:34:52.231787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736199+0000","last_change":"2023-12-19T16:06:58.753386+0000","last_active":"2023-12-19T16:06:59.736199+0000","last_peered":"2023-12-19T16:06:59.736199+0000","last_clean":"2023-12-19T16:06:59.736199+0000","last_became_active":"2023-12-19T16:06:58.753213+0000","last_became_peered":"2023-12-19T16:06:58.753213+0000","last_unstale":"2023-12-19T16:06:59.736199+0000","last_undegraded":"2023-12-19T16:06:59.736199+0000","last_fullsized":"2023-12-19T16:06:59.736199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:56.721659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593758+0000","last_change":"2023-12-19T16:06:58.753896+0000","last_active":"2023-12-19T16:07:00.593758+0000","last_peered":"2023-12-19T16:07:00.593758+0000","last_clean":"2023-12-19T16:07:00.593758+0000","last_became_active":"2023-12-19T16:06:58.753594+0000","last_became_peered":"2023-12-19T16:06:58.753594+0000","last_unstale":"2023-12-19T16:07:00.593758+0000","last_undegraded":"2023-12-19T16:07:00.593758+0000","last_fullsized":"2023-12-19T16:07:00.593758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:49.465099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735526+0000","last_change":"2023-12-19T16:06:58.749736+0000","last_active":"2023-12-19T16:06:59.735526+0000","last_peered":"2023-12-19T16:06:59.735526+0000","last_clean":"2023-12-19T16:06:59.735526+0000","last_became_active":"2023-12-19T16:06:58.749468+0000","last_became_peered":"2023-12-19T16:06:58.749468+0000","last_unstale":"2023-12-19T16:06:59.735526+0000","last_undegraded":"2023-12-19T16:06:59.735526+0000","last_fullsized":"2023-12-19T16:06:59.735526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:17.323789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429911+0000","last_change":"2023-12-19T16:06:58.304535+0000","last_active":"2023-12-19T16:07:00.429911+0000","last_peered":"2023-12-19T16:07:00.429911+0000","last_clean":"2023-12-19T16:07:00.429911+0000","last_became_active":"2023-12-19T16:06:58.304271+0000","last_became_peered":"2023-12-19T16:06:58.304271+0000","last_unstale":"2023-12-19T16:07:00.429911+0000","last_undegraded":"2023-12-19T16:07:00.429911+0000","last_fullsized":"2023-12-19T16:07:00.429911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466191+0000","last_change":"2023-12-19T16:06:58.741261+0000","last_active":"2023-12-19T16:07:00.466191+0000","last_peered":"2023-12-19T16:07:00.466191+0000","last_clean":"2023-12-19T16:07:00.466191+0000","last_became_active":"2023-12-19T16:06:58.741000+0000","last_became_peered":"2023-12-19T16:06:58.741000+0000","last_unstale":"2023-12-19T16:07:00.466191+0000","last_undegraded":"2023-12-19T16:07:00.466191+0000","last_fullsized":"2023-12-19T16:07:00.466191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:21:27.003991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593812+0000","last_change":"2023-12-19T16:06:58.304385+0000","last_active":"2023-12-19T16:07:00.593812+0000","last_peered":"2023-12-19T16:07:00.593812+0000","last_clean":"2023-12-19T16:07:00.593812+0000","last_became_active":"2023-12-19T16:06:58.304091+0000","last_became_peered":"2023-12-19T16:06:58.304091+0000","last_unstale":"2023-12-19T16:07:00.593812+0000","last_undegraded":"2023-12-19T16:07:00.593812+0000","last_fullsized":"2023-12-19T16:07:00.593812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429698+0000","last_change":"2023-12-19T16:06:58.305822+0000","last_active":"2023-12-19T16:07:00.429698+0000","last_peered":"2023-12-19T16:07:00.429698+0000","last_clean":"2023-12-19T16:07:00.429698+0000","last_became_active":"2023-12-19T16:06:58.305070+0000","last_became_peered":"2023-12-19T16:06:58.305070+0000","last_unstale":"2023-12-19T16:07:00.429698+0000","last_undegraded":"2023-12-19T16:07:00.429698+0000","last_fullsized":"2023-12-19T16:07:00.429698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429590+0000","last_change":"2023-12-19T16:06:58.741414+0000","last_active":"2023-12-19T16:07:00.429590+0000","last_peered":"2023-12-19T16:07:00.429590+0000","last_clean":"2023-12-19T16:07:00.429590+0000","last_became_active":"2023-12-19T16:06:58.741166+0000","last_became_peered":"2023-12-19T16:06:58.741166+0000","last_unstale":"2023-12-19T16:07:00.429590+0000","last_undegraded":"2023-12-19T16:07:00.429590+0000","last_fullsized":"2023-12-19T16:07:00.429590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109102+0000","last_change":"2023-12-19T16:06:58.304842+0000","last_active":"2023-12-19T16:07:01.109102+0000","last_peered":"2023-12-19T16:07:01.109102+0000","last_clean":"2023-12-19T16:07:01.109102+0000","last_became_active":"2023-12-19T16:06:58.302883+0000","last_became_peered":"2023-12-19T16:06:58.302883+0000","last_unstale":"2023-12-19T16:07:01.109102+0000","last_undegraded":"2023-12-19T16:07:01.109102+0000","last_fullsized":"2023-12-19T16:07:01.109102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735403+0000","last_change":"2023-12-19T16:06:58.750010+0000","last_active":"2023-12-19T16:06:59.735403+0000","last_peered":"2023-12-19T16:06:59.735403+0000","last_clean":"2023-12-19T16:06:59.735403+0000","last_became_active":"2023-12-19T16:06:58.749766+0000","last_became_peered":"2023-12-19T16:06:58.749766+0000","last_unstale":"2023-12-19T16:06:59.735403+0000","last_undegraded":"2023-12-19T16:06:59.735403+0000","last_fullsized":"2023-12-19T16:06:59.735403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594040+0000","last_change":"2023-12-19T16:06:58.307494+0000","last_active":"2023-12-19T16:07:00.594040+0000","last_peered":"2023-12-19T16:07:00.594040+0000","last_clean":"2023-12-19T16:07:00.594040+0000","last_became_active":"2023-12-19T16:06:58.307191+0000","last_became_peered":"2023-12-19T16:06:58.307191+0000","last_unstale":"2023-12-19T16:07:00.594040+0000","last_undegraded":"2023-12-19T16:07:00.594040+0000","last_fullsized":"2023-12-19T16:07:00.594040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109823+0000","last_change":"2023-12-19T16:06:58.752792+0000","last_active":"2023-12-19T16:07:01.109823+0000","last_peered":"2023-12-19T16:07:01.109823+0000","last_clean":"2023-12-19T16:07:01.109823+0000","last_became_active":"2023-12-19T16:06:58.752494+0000","last_became_peered":"2023-12-19T16:06:58.752494+0000","last_unstale":"2023-12-19T16:07:01.109823+0000","last_undegraded":"2023-12-19T16:07:01.109823+0000","last_fullsized":"2023-12-19T16:07:01.109823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109839+0000","last_change":"2023-12-19T16:06:58.309509+0000","last_active":"2023-12-19T16:07:01.109839+0000","last_peered":"2023-12-19T16:07:01.109839+0000","last_clean":"2023-12-19T16:07:01.109839+0000","last_became_active":"2023-12-19T16:06:58.309139+0000","last_became_peered":"2023-12-19T16:06:58.309139+0000","last_unstale":"2023-12-19T16:07:01.109839+0000","last_undegraded":"2023-12-19T16:07:01.109839+0000","last_fullsized":"2023-12-19T16:07:01.109839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466307+0000","last_change":"2023-12-19T16:06:58.756009+0000","last_active":"2023-12-19T16:07:00.466307+0000","last_peered":"2023-12-19T16:07:00.466307+0000","last_clean":"2023-12-19T16:07:00.466307+0000","last_became_active":"2023-12-19T16:06:58.755610+0000","last_became_peered":"2023-12-19T16:06:58.755610+0000","last_unstale":"2023-12-19T16:07:00.466307+0000","last_undegraded":"2023-12-19T16:07:00.466307+0000","last_fullsized":"2023-12-19T16:07:00.466307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735683+0000","last_change":"2023-12-19T16:06:58.312257+0000","last_active":"2023-12-19T16:06:59.735683+0000","last_peered":"2023-12-19T16:06:59.735683+0000","last_clean":"2023-12-19T16:06:59.735683+0000","last_became_active":"2023-12-19T16:06:58.311988+0000","last_became_peered":"2023-12-19T16:06:58.311988+0000","last_unstale":"2023-12-19T16:06:59.735683+0000","last_undegraded":"2023-12-19T16:06:59.735683+0000","last_fullsized":"2023-12-19T16:06:59.735683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:55.716735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735863+0000","last_change":"2023-12-19T16:06:58.743459+0000","last_active":"2023-12-19T16:06:59.735863+0000","last_peered":"2023-12-19T16:06:59.735863+0000","last_clean":"2023-12-19T16:06:59.735863+0000","last_became_active":"2023-12-19T16:06:58.743184+0000","last_became_peered":"2023-12-19T16:06:58.743184+0000","last_unstale":"2023-12-19T16:06:59.735863+0000","last_undegraded":"2023-12-19T16:06:59.735863+0000","last_fullsized":"2023-12-19T16:06:59.735863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:56.721659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593958+0000","last_change":"2023-12-19T16:06:58.310349+0000","last_active":"2023-12-19T16:07:00.593958+0000","last_peered":"2023-12-19T16:07:00.593958+0000","last_clean":"2023-12-19T16:07:00.593958+0000","last_became_active":"2023-12-19T16:06:58.310059+0000","last_became_peered":"2023-12-19T16:06:58.310059+0000","last_unstale":"2023-12-19T16:07:00.593958+0000","last_undegraded":"2023-12-19T16:07:00.593958+0000","last_fullsized":"2023-12-19T16:07:00.593958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:35.961254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109478+0000","last_change":"2023-12-19T16:06:58.751190+0000","last_active":"2023-12-19T16:07:01.109478+0000","last_peered":"2023-12-19T16:07:01.109478+0000","last_clean":"2023-12-19T16:07:01.109478+0000","last_became_active":"2023-12-19T16:06:58.748432+0000","last_became_peered":"2023-12-19T16:06:58.748432+0000","last_unstale":"2023-12-19T16:07:01.109478+0000","last_undegraded":"2023-12-19T16:07:01.109478+0000","last_fullsized":"2023-12-19T16:07:01.109478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:30.281031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466247+0000","last_change":"2023-12-19T16:06:58.307849+0000","last_active":"2023-12-19T16:07:00.466247+0000","last_peered":"2023-12-19T16:07:00.466247+0000","last_clean":"2023-12-19T16:07:00.466247+0000","last_became_active":"2023-12-19T16:06:58.307562+0000","last_became_peered":"2023-12-19T16:06:58.307562+0000","last_unstale":"2023-12-19T16:07:00.466247+0000","last_undegraded":"2023-12-19T16:07:00.466247+0000","last_fullsized":"2023-12-19T16:07:00.466247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466011+0000","last_change":"2023-12-19T16:06:58.744304+0000","last_active":"2023-12-19T16:07:00.466011+0000","last_peered":"2023-12-19T16:07:00.466011+0000","last_clean":"2023-12-19T16:07:00.466011+0000","last_became_active":"2023-12-19T16:06:58.744034+0000","last_became_peered":"2023-12-19T16:06:58.744034+0000","last_unstale":"2023-12-19T16:07:00.466011+0000","last_undegraded":"2023-12-19T16:07:00.466011+0000","last_fullsized":"2023-12-19T16:07:00.466011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:04.102120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109966+0000","last_change":"2023-12-19T16:06:58.310576+0000","last_active":"2023-12-19T16:07:01.109966+0000","last_peered":"2023-12-19T16:07:01.109966+0000","last_clean":"2023-12-19T16:07:01.109966+0000","last_became_active":"2023-12-19T16:06:58.310298+0000","last_became_peered":"2023-12-19T16:06:58.310298+0000","last_unstale":"2023-12-19T16:07:01.109966+0000","last_undegraded":"2023-12-19T16:07:01.109966+0000","last_fullsized":"2023-12-19T16:07:01.109966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:06.572806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109450+0000","last_change":"2023-12-19T16:06:58.746329+0000","last_active":"2023-12-19T16:07:01.109450+0000","last_peered":"2023-12-19T16:07:01.109450+0000","last_clean":"2023-12-19T16:07:01.109450+0000","last_became_active":"2023-12-19T16:06:58.746010+0000","last_became_peered":"2023-12-19T16:06:58.746010+0000","last_unstale":"2023-12-19T16:07:01.109450+0000","last_undegraded":"2023-12-19T16:07:01.109450+0000","last_fullsized":"2023-12-19T16:07:01.109450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:34:52.231787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593805+0000","last_change":"2023-12-19T16:06:58.309330+0000","last_active":"2023-12-19T16:07:00.593805+0000","last_peered":"2023-12-19T16:07:00.593805+0000","last_clean":"2023-12-19T16:07:00.593805+0000","last_became_active":"2023-12-19T16:06:58.309039+0000","last_became_peered":"2023-12-19T16:06:58.309039+0000","last_unstale":"2023-12-19T16:07:00.593805+0000","last_undegraded":"2023-12-19T16:07:00.593805+0000","last_fullsized":"2023-12-19T16:07:00.593805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593766+0000","last_change":"2023-12-19T16:06:58.752891+0000","last_active":"2023-12-19T16:07:00.593766+0000","last_peered":"2023-12-19T16:07:00.593766+0000","last_clean":"2023-12-19T16:07:00.593766+0000","last_became_active":"2023-12-19T16:06:58.752582+0000","last_became_peered":"2023-12-19T16:06:58.752582+0000","last_unstale":"2023-12-19T16:07:00.593766+0000","last_undegraded":"2023-12-19T16:07:00.593766+0000","last_fullsized":"2023-12-19T16:07:00.593766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:07:12.391535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736116+0000","last_change":"2023-12-19T16:06:58.308799+0000","last_active":"2023-12-19T16:06:59.736116+0000","last_peered":"2023-12-19T16:06:59.736116+0000","last_clean":"2023-12-19T16:06:59.736116+0000","last_became_active":"2023-12-19T16:06:58.308452+0000","last_became_peered":"2023-12-19T16:06:58.308452+0000","last_unstale":"2023-12-19T16:06:59.736116+0000","last_undegraded":"2023-12-19T16:06:59.736116+0000","last_fullsized":"2023-12-19T16:06:59.736116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109274+0000","last_change":"2023-12-19T16:06:58.746864+0000","last_active":"2023-12-19T16:07:01.109274+0000","last_peered":"2023-12-19T16:07:01.109274+0000","last_clean":"2023-12-19T16:07:01.109274+0000","last_became_active":"2023-12-19T16:06:58.746614+0000","last_became_peered":"2023-12-19T16:06:58.746614+0000","last_unstale":"2023-12-19T16:07:01.109274+0000","last_undegraded":"2023-12-19T16:07:01.109274+0000","last_fullsized":"2023-12-19T16:07:01.109274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:08:43.126506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735933+0000","last_change":"2023-12-19T16:06:58.308443+0000","last_active":"2023-12-19T16:06:59.735933+0000","last_peered":"2023-12-19T16:06:59.735933+0000","last_clean":"2023-12-19T16:06:59.735933+0000","last_became_active":"2023-12-19T16:06:58.308138+0000","last_became_peered":"2023-12-19T16:06:58.308138+0000","last_unstale":"2023-12-19T16:06:59.735933+0000","last_undegraded":"2023-12-19T16:06:59.735933+0000","last_fullsized":"2023-12-19T16:06:59.735933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:45:16.445340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109774+0000","last_change":"2023-12-19T16:06:58.743581+0000","last_active":"2023-12-19T16:07:01.109774+0000","last_peered":"2023-12-19T16:07:01.109774+0000","last_clean":"2023-12-19T16:07:01.109774+0000","last_became_active":"2023-12-19T16:06:58.743215+0000","last_became_peered":"2023-12-19T16:06:58.743215+0000","last_unstale":"2023-12-19T16:07:01.109774+0000","last_undegraded":"2023-12-19T16:07:01.109774+0000","last_fullsized":"2023-12-19T16:07:01.109774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:56:59.199473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736253+0000","last_change":"2023-12-19T16:06:58.301431+0000","last_active":"2023-12-19T16:06:59.736253+0000","last_peered":"2023-12-19T16:06:59.736253+0000","last_clean":"2023-12-19T16:06:59.736253+0000","last_became_active":"2023-12-19T16:06:58.301154+0000","last_became_peered":"2023-12-19T16:06:58.301154+0000","last_unstale":"2023-12-19T16:06:59.736253+0000","last_undegraded":"2023-12-19T16:06:59.736253+0000","last_fullsized":"2023-12-19T16:06:59.736253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109948+0000","last_change":"2023-12-19T16:06:58.747109+0000","last_active":"2023-12-19T16:07:01.109948+0000","last_peered":"2023-12-19T16:07:01.109948+0000","last_clean":"2023-12-19T16:07:01.109948+0000","last_became_active":"2023-12-19T16:06:58.746296+0000","last_became_peered":"2023-12-19T16:06:58.746296+0000","last_unstale":"2023-12-19T16:07:01.109948+0000","last_undegraded":"2023-12-19T16:07:01.109948+0000","last_fullsized":"2023-12-19T16:07:01.109948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:02.578194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735717+0000","last_change":"2023-12-19T16:06:58.314755+0000","last_active":"2023-12-19T16:06:59.735717+0000","last_peered":"2023-12-19T16:06:59.735717+0000","last_clean":"2023-12-19T16:06:59.735717+0000","last_became_active":"2023-12-19T16:06:58.314554+0000","last_became_peered":"2023-12-19T16:06:58.314554+0000","last_unstale":"2023-12-19T16:06:59.735717+0000","last_undegraded":"2023-12-19T16:06:59.735717+0000","last_fullsized":"2023-12-19T16:06:59.735717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:16.318865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.110048+0000","last_change":"2023-12-19T16:06:58.751149+0000","last_active":"2023-12-19T16:07:01.110048+0000","last_peered":"2023-12-19T16:07:01.110048+0000","last_clean":"2023-12-19T16:07:01.110048+0000","last_became_active":"2023-12-19T16:06:58.750741+0000","last_became_peered":"2023-12-19T16:06:58.750741+0000","last_unstale":"2023-12-19T16:07:01.110048+0000","last_undegraded":"2023-12-19T16:07:01.110048+0000","last_fullsized":"2023-12-19T16:07:01.110048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:30.281031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736230+0000","last_change":"2023-12-19T16:06:58.301782+0000","last_active":"2023-12-19T16:06:59.736230+0000","last_peered":"2023-12-19T16:06:59.736230+0000","last_clean":"2023-12-19T16:06:59.736230+0000","last_became_active":"2023-12-19T16:06:58.300855+0000","last_became_peered":"2023-12-19T16:06:58.300855+0000","last_unstale":"2023-12-19T16:06:59.736230+0000","last_undegraded":"2023-12-19T16:06:59.736230+0000","last_fullsized":"2023-12-19T16:06:59.736230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109583+0000","last_change":"2023-12-19T16:06:58.755507+0000","last_active":"2023-12-19T16:07:01.109583+0000","last_peered":"2023-12-19T16:07:01.109583+0000","last_clean":"2023-12-19T16:07:01.109583+0000","last_became_active":"2023-12-19T16:06:58.755176+0000","last_became_peered":"2023-12-19T16:06:58.755176+0000","last_unstale":"2023-12-19T16:07:01.109583+0000","last_undegraded":"2023-12-19T16:07:01.109583+0000","last_fullsized":"2023-12-19T16:07:01.109583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:59:45.402539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T16:06:58.733783+0000","last_change":"2023-12-19T16:06:47.761389+0000","last_active":"2023-12-19T16:06:58.733783+0000","last_peered":"2023-12-19T16:06:58.733783+0000","last_clean":"2023-12-19T16:06:58.733783+0000","last_became_active":"2023-12-19T16:06:47.760252+0000","last_became_peered":"2023-12-19T16:06:47.760252+0000","last_unstale":"2023-12-19T16:06:58.733783+0000","last_undegraded":"2023-12-19T16:06:58.733783+0000","last_fullsized":"2023-12-19T16:06:58.733783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_clean_scrub_stamp":"2023-12-19T16:06:46.706871+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:09.167979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109217+0000","last_change":"2023-12-19T16:06:58.300900+0000","last_active":"2023-12-19T16:07:01.109217+0000","last_peered":"2023-12-19T16:07:01.109217+0000","last_clean":"2023-12-19T16:07:01.109217+0000","last_became_active":"2023-12-19T16:06:58.300641+0000","last_became_peered":"2023-12-19T16:06:58.300641+0000","last_unstale":"2023-12-19T16:07:01.109217+0000","last_undegraded":"2023-12-19T16:07:01.109217+0000","last_fullsized":"2023-12-19T16:07:01.109217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:07.531619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429774+0000","last_change":"2023-12-19T16:06:58.755362+0000","last_active":"2023-12-19T16:07:00.429774+0000","last_peered":"2023-12-19T16:07:00.429774+0000","last_clean":"2023-12-19T16:07:00.429774+0000","last_became_active":"2023-12-19T16:06:58.755055+0000","last_became_peered":"2023-12-19T16:06:58.755055+0000","last_unstale":"2023-12-19T16:07:00.429774+0000","last_undegraded":"2023-12-19T16:07:00.429774+0000","last_fullsized":"2023-12-19T16:07:00.429774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:08:43.126506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109035+0000","last_change":"2023-12-19T16:06:58.310316+0000","last_active":"2023-12-19T16:07:01.109035+0000","last_peered":"2023-12-19T16:07:01.109035+0000","last_clean":"2023-12-19T16:07:01.109035+0000","last_became_active":"2023-12-19T16:06:58.310035+0000","last_became_peered":"2023-12-19T16:06:58.310035+0000","last_unstale":"2023-12-19T16:07:01.109035+0000","last_undegraded":"2023-12-19T16:07:01.109035+0000","last_fullsized":"2023-12-19T16:07:01.109035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:07.531619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466062+0000","last_change":"2023-12-19T16:06:58.741676+0000","last_active":"2023-12-19T16:07:00.466062+0000","last_peered":"2023-12-19T16:07:00.466062+0000","last_clean":"2023-12-19T16:07:00.466062+0000","last_became_active":"2023-12-19T16:06:58.741422+0000","last_became_peered":"2023-12-19T16:06:58.741422+0000","last_unstale":"2023-12-19T16:07:00.466062+0000","last_undegraded":"2023-12-19T16:07:00.466062+0000","last_fullsized":"2023-12-19T16:07:00.466062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:46:27.205690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736299+0000","last_change":"2023-12-19T16:06:58.296822+0000","last_active":"2023-12-19T16:06:59.736299+0000","last_peered":"2023-12-19T16:06:59.736299+0000","last_clean":"2023-12-19T16:06:59.736299+0000","last_became_active":"2023-12-19T16:06:58.296555+0000","last_became_peered":"2023-12-19T16:06:58.296555+0000","last_unstale":"2023-12-19T16:06:59.736299+0000","last_undegraded":"2023-12-19T16:06:59.736299+0000","last_fullsized":"2023-12-19T16:06:59.736299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735354+0000","last_change":"2023-12-19T16:06:58.750259+0000","last_active":"2023-12-19T16:06:59.735354+0000","last_peered":"2023-12-19T16:06:59.735354+0000","last_clean":"2023-12-19T16:06:59.735354+0000","last_became_active":"2023-12-19T16:06:58.749971+0000","last_became_peered":"2023-12-19T16:06:58.749971+0000","last_unstale":"2023-12-19T16:06:59.735354+0000","last_undegraded":"2023-12-19T16:06:59.735354+0000","last_fullsized":"2023-12-19T16:06:59.735354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109975+0000","last_change":"2023-12-19T16:06:58.308334+0000","last_active":"2023-12-19T16:07:01.109975+0000","last_peered":"2023-12-19T16:07:01.109975+0000","last_clean":"2023-12-19T16:07:01.109975+0000","last_became_active":"2023-12-19T16:06:58.307997+0000","last_became_peered":"2023-12-19T16:06:58.307997+0000","last_unstale":"2023-12-19T16:07:01.109975+0000","last_undegraded":"2023-12-19T16:07:01.109975+0000","last_fullsized":"2023-12-19T16:07:01.109975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735908+0000","last_change":"2023-12-19T16:06:58.749875+0000","last_active":"2023-12-19T16:06:59.735908+0000","last_peered":"2023-12-19T16:06:59.735908+0000","last_clean":"2023-12-19T16:06:59.735908+0000","last_became_active":"2023-12-19T16:06:58.749604+0000","last_became_peered":"2023-12-19T16:06:58.749604+0000","last_unstale":"2023-12-19T16:06:59.735908+0000","last_undegraded":"2023-12-19T16:06:59.735908+0000","last_fullsized":"2023-12-19T16:06:59.735908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:07.695345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735602+0000","last_change":"2023-12-19T16:06:58.310432+0000","last_active":"2023-12-19T16:06:59.735602+0000","last_peered":"2023-12-19T16:06:59.735602+0000","last_clean":"2023-12-19T16:06:59.735602+0000","last_became_active":"2023-12-19T16:06:58.310052+0000","last_became_peered":"2023-12-19T16:06:58.310052+0000","last_unstale":"2023-12-19T16:06:59.735602+0000","last_undegraded":"2023-12-19T16:06:59.735602+0000","last_fullsized":"2023-12-19T16:06:59.735602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:07.531619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109764+0000","last_change":"2023-12-19T16:06:58.755050+0000","last_active":"2023-12-19T16:07:01.109764+0000","last_peered":"2023-12-19T16:07:01.109764+0000","last_clean":"2023-12-19T16:07:01.109764+0000","last_became_active":"2023-12-19T16:06:58.754666+0000","last_became_peered":"2023-12-19T16:06:58.754666+0000","last_unstale":"2023-12-19T16:07:01.109764+0000","last_undegraded":"2023-12-19T16:07:01.109764+0000","last_fullsized":"2023-12-19T16:07:01.109764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:11.108008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109843+0000","last_change":"2023-12-19T16:06:58.311812+0000","last_active":"2023-12-19T16:07:01.109843+0000","last_peered":"2023-12-19T16:07:01.109843+0000","last_clean":"2023-12-19T16:07:01.109843+0000","last_became_active":"2023-12-19T16:06:58.311423+0000","last_became_peered":"2023-12-19T16:06:58.311423+0000","last_unstale":"2023-12-19T16:07:01.109843+0000","last_undegraded":"2023-12-19T16:07:01.109843+0000","last_fullsized":"2023-12-19T16:07:01.109843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735591+0000","last_change":"2023-12-19T16:06:58.747297+0000","last_active":"2023-12-19T16:06:59.735591+0000","last_peered":"2023-12-19T16:06:59.735591+0000","last_clean":"2023-12-19T16:06:59.735591+0000","last_became_active":"2023-12-19T16:06:58.747025+0000","last_became_peered":"2023-12-19T16:06:58.747025+0000","last_unstale":"2023-12-19T16:06:59.735591+0000","last_undegraded":"2023-12-19T16:06:59.735591+0000","last_fullsized":"2023-12-19T16:06:59.735591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735768+0000","last_change":"2023-12-19T16:06:58.309515+0000","last_active":"2023-12-19T16:06:59.735768+0000","last_peered":"2023-12-19T16:06:59.735768+0000","last_clean":"2023-12-19T16:06:59.735768+0000","last_became_active":"2023-12-19T16:06:58.309120+0000","last_became_peered":"2023-12-19T16:06:58.309120+0000","last_unstale":"2023-12-19T16:06:59.735768+0000","last_undegraded":"2023-12-19T16:06:59.735768+0000","last_fullsized":"2023-12-19T16:06:59.735768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:06.572806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429995+0000","last_change":"2023-12-19T16:06:58.744382+0000","last_active":"2023-12-19T16:07:00.429995+0000","last_peered":"2023-12-19T16:07:00.429995+0000","last_clean":"2023-12-19T16:07:00.429995+0000","last_became_active":"2023-12-19T16:06:58.744125+0000","last_became_peered":"2023-12-19T16:06:58.744125+0000","last_unstale":"2023-12-19T16:07:00.429995+0000","last_undegraded":"2023-12-19T16:07:00.429995+0000","last_fullsized":"2023-12-19T16:07:00.429995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:17.210206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594111+0000","last_change":"2023-12-19T16:06:58.306697+0000","last_active":"2023-12-19T16:07:00.594111+0000","last_peered":"2023-12-19T16:07:00.594111+0000","last_clean":"2023-12-19T16:07:00.594111+0000","last_became_active":"2023-12-19T16:06:58.306411+0000","last_became_peered":"2023-12-19T16:06:58.306411+0000","last_unstale":"2023-12-19T16:07:00.594111+0000","last_undegraded":"2023-12-19T16:07:00.594111+0000","last_fullsized":"2023-12-19T16:07:00.594111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466265+0000","last_change":"2023-12-19T16:06:58.749375+0000","last_active":"2023-12-19T16:07:00.466265+0000","last_peered":"2023-12-19T16:07:00.466265+0000","last_clean":"2023-12-19T16:07:00.466265+0000","last_became_active":"2023-12-19T16:06:58.749123+0000","last_became_peered":"2023-12-19T16:06:58.749123+0000","last_unstale":"2023-12-19T16:07:00.466265+0000","last_undegraded":"2023-12-19T16:07:00.466265+0000","last_fullsized":"2023-12-19T16:07:00.466265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109074+0000","last_change":"2023-12-19T16:06:58.311689+0000","last_active":"2023-12-19T16:07:01.109074+0000","last_peered":"2023-12-19T16:07:01.109074+0000","last_clean":"2023-12-19T16:07:01.109074+0000","last_became_active":"2023-12-19T16:06:58.311443+0000","last_became_peered":"2023-12-19T16:06:58.311443+0000","last_unstale":"2023-12-19T16:07:01.109074+0000","last_undegraded":"2023-12-19T16:07:01.109074+0000","last_fullsized":"2023-12-19T16:07:01.109074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:16.318865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735579+0000","last_change":"2023-12-19T16:06:58.737013+0000","last_active":"2023-12-19T16:06:59.735579+0000","last_peered":"2023-12-19T16:06:59.735579+0000","last_clean":"2023-12-19T16:06:59.735579+0000","last_became_active":"2023-12-19T16:06:58.736732+0000","last_became_peered":"2023-12-19T16:06:58.736732+0000","last_unstale":"2023-12-19T16:06:59.735579+0000","last_undegraded":"2023-12-19T16:06:59.735579+0000","last_fullsized":"2023-12-19T16:06:59.735579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:08.536543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735494+0000","last_change":"2023-12-19T16:06:58.311956+0000","last_active":"2023-12-19T16:06:59.735494+0000","last_peered":"2023-12-19T16:06:59.735494+0000","last_clean":"2023-12-19T16:06:59.735494+0000","last_became_active":"2023-12-19T16:06:58.311426+0000","last_became_peered":"2023-12-19T16:06:58.311426+0000","last_unstale":"2023-12-19T16:06:59.735494+0000","last_undegraded":"2023-12-19T16:06:59.735494+0000","last_fullsized":"2023-12-19T16:06:59.735494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429662+0000","last_change":"2023-12-19T16:06:58.751593+0000","last_active":"2023-12-19T16:07:00.429662+0000","last_peered":"2023-12-19T16:07:00.429662+0000","last_clean":"2023-12-19T16:07:00.429662+0000","last_became_active":"2023-12-19T16:06:58.751335+0000","last_became_peered":"2023-12-19T16:06:58.751335+0000","last_unstale":"2023-12-19T16:07:00.429662+0000","last_undegraded":"2023-12-19T16:07:00.429662+0000","last_fullsized":"2023-12-19T16:07:00.429662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735607+0000","last_change":"2023-12-19T16:06:58.310478+0000","last_active":"2023-12-19T16:06:59.735607+0000","last_peered":"2023-12-19T16:06:59.735607+0000","last_clean":"2023-12-19T16:06:59.735607+0000","last_became_active":"2023-12-19T16:06:58.310172+0000","last_became_peered":"2023-12-19T16:06:58.310172+0000","last_unstale":"2023-12-19T16:06:59.735607+0000","last_undegraded":"2023-12-19T16:06:59.735607+0000","last_fullsized":"2023-12-19T16:06:59.735607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429817+0000","last_change":"2023-12-19T16:06:58.745013+0000","last_active":"2023-12-19T16:07:00.429817+0000","last_peered":"2023-12-19T16:07:00.429817+0000","last_clean":"2023-12-19T16:07:00.429817+0000","last_became_active":"2023-12-19T16:06:58.744739+0000","last_became_peered":"2023-12-19T16:06:58.744739+0000","last_unstale":"2023-12-19T16:07:00.429817+0000","last_undegraded":"2023-12-19T16:07:00.429817+0000","last_fullsized":"2023-12-19T16:07:00.429817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:59:45.402539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109787+0000","last_change":"2023-12-19T16:06:58.314931+0000","last_active":"2023-12-19T16:07:01.109787+0000","last_peered":"2023-12-19T16:07:01.109787+0000","last_clean":"2023-12-19T16:07:01.109787+0000","last_became_active":"2023-12-19T16:06:58.314637+0000","last_became_peered":"2023-12-19T16:06:58.314637+0000","last_unstale":"2023-12-19T16:07:01.109787+0000","last_undegraded":"2023-12-19T16:07:01.109787+0000","last_fullsized":"2023-12-19T16:07:01.109787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593737+0000","last_change":"2023-12-19T16:06:58.753329+0000","last_active":"2023-12-19T16:07:00.593737+0000","last_peered":"2023-12-19T16:07:00.593737+0000","last_clean":"2023-12-19T16:07:00.593737+0000","last_became_active":"2023-12-19T16:06:58.749183+0000","last_became_peered":"2023-12-19T16:06:58.749183+0000","last_unstale":"2023-12-19T16:07:00.593737+0000","last_undegraded":"2023-12-19T16:07:00.593737+0000","last_fullsized":"2023-12-19T16:07:00.593737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109649+0000","last_change":"2023-12-19T16:06:58.751468+0000","last_active":"2023-12-19T16:07:01.109649+0000","last_peered":"2023-12-19T16:07:01.109649+0000","last_clean":"2023-12-19T16:07:01.109649+0000","last_became_active":"2023-12-19T16:06:58.750502+0000","last_became_peered":"2023-12-19T16:06:58.750502+0000","last_unstale":"2023-12-19T16:07:01.109649+0000","last_undegraded":"2023-12-19T16:07:01.109649+0000","last_fullsized":"2023-12-19T16:07:01.109649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:59:45.402539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109568+0000","last_change":"2023-12-19T16:06:58.311983+0000","last_active":"2023-12-19T16:07:01.109568+0000","last_peered":"2023-12-19T16:07:01.109568+0000","last_clean":"2023-12-19T16:07:01.109568+0000","last_became_active":"2023-12-19T16:06:58.311706+0000","last_became_peered":"2023-12-19T16:06:58.311706+0000","last_unstale":"2023-12-19T16:07:01.109568+0000","last_undegraded":"2023-12-19T16:07:01.109568+0000","last_fullsized":"2023-12-19T16:07:01.109568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:55.716735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109940+0000","last_change":"2023-12-19T16:06:58.751294+0000","last_active":"2023-12-19T16:07:01.109940+0000","last_peered":"2023-12-19T16:07:01.109940+0000","last_clean":"2023-12-19T16:07:01.109940+0000","last_became_active":"2023-12-19T16:06:58.751039+0000","last_became_peered":"2023-12-19T16:06:58.751039+0000","last_unstale":"2023-12-19T16:07:01.109940+0000","last_undegraded":"2023-12-19T16:07:01.109940+0000","last_fullsized":"2023-12-19T16:07:01.109940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:08:43.126506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109669+0000","last_change":"2023-12-19T16:06:58.309418+0000","last_active":"2023-12-19T16:07:01.109669+0000","last_peered":"2023-12-19T16:07:01.109669+0000","last_clean":"2023-12-19T16:07:01.109669+0000","last_became_active":"2023-12-19T16:06:58.309108+0000","last_became_peered":"2023-12-19T16:06:58.309108+0000","last_unstale":"2023-12-19T16:07:01.109669+0000","last_undegraded":"2023-12-19T16:07:01.109669+0000","last_fullsized":"2023-12-19T16:07:01.109669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:06.572806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466323+0000","last_change":"2023-12-19T16:06:58.755879+0000","last_active":"2023-12-19T16:07:00.466323+0000","last_peered":"2023-12-19T16:07:00.466323+0000","last_clean":"2023-12-19T16:07:00.466323+0000","last_became_active":"2023-12-19T16:06:58.755019+0000","last_became_peered":"2023-12-19T16:06:58.755019+0000","last_unstale":"2023-12-19T16:07:00.466323+0000","last_undegraded":"2023-12-19T16:07:00.466323+0000","last_fullsized":"2023-12-19T16:07:00.466323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.430019+0000","last_change":"2023-12-19T16:06:58.308088+0000","last_active":"2023-12-19T16:07:00.430019+0000","last_peered":"2023-12-19T16:07:00.430019+0000","last_clean":"2023-12-19T16:07:00.430019+0000","last_became_active":"2023-12-19T16:06:58.307702+0000","last_became_peered":"2023-12-19T16:06:58.307702+0000","last_unstale":"2023-12-19T16:07:00.430019+0000","last_undegraded":"2023-12-19T16:07:00.430019+0000","last_fullsized":"2023-12-19T16:07:00.430019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429908+0000","last_change":"2023-12-19T16:06:58.745962+0000","last_active":"2023-12-19T16:07:00.429908+0000","last_peered":"2023-12-19T16:07:00.429908+0000","last_clean":"2023-12-19T16:07:00.429908+0000","last_became_active":"2023-12-19T16:06:58.745668+0000","last_became_peered":"2023-12-19T16:06:58.745668+0000","last_unstale":"2023-12-19T16:07:00.429908+0000","last_undegraded":"2023-12-19T16:07:00.429908+0000","last_fullsized":"2023-12-19T16:07:00.429908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466374+0000","last_change":"2023-12-19T16:06:58.307135+0000","last_active":"2023-12-19T16:07:00.466374+0000","last_peered":"2023-12-19T16:07:00.466374+0000","last_clean":"2023-12-19T16:07:00.466374+0000","last_became_active":"2023-12-19T16:06:58.306810+0000","last_became_peered":"2023-12-19T16:06:58.306810+0000","last_unstale":"2023-12-19T16:07:00.466374+0000","last_undegraded":"2023-12-19T16:07:00.466374+0000","last_fullsized":"2023-12-19T16:07:00.466374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:35.961254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":790528,"data_stored":655548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":196608,"data_stored":64688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:07:06.764 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:07:06.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.878+0000 7f16edffb640 1 Processor -- start 2023-12-19T16:07:06.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.878+0000 7f16edffb640 1 -- start start 2023-12-19T16:07:06.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.878+0000 7f16edffb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f16e80b7d00 0x7f16e80b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:06.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.878+0000 7f16edffb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16e8148d10 0x7f16e8153180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:06.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.878+0000 7f16edffb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e80b3c80 con 0x7f16e81488c0 2023-12-19T16:07:06.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.878+0000 7f16edffb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e80b44f0 con 0x7f16e80b7d00 2023-12-19T16:07:06.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.878+0000 7f16edffb640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e8071470 con 0x7f16e8148d10 2023-12-19T16:07:06.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.879+0000 7f16e77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f16e80b7d00 0x7f16e80b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:06.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.879+0000 7f16e6ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f16e81488c0 0x7f16e8070d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37012/0 (socket says 172.21.15.37:37012) 2023-12-19T16:07:06.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.879+0000 7f16e6ffd640 1 -- 172.21.15.37:0/3677135139 learned_addr learned my addr 172.21.15.37:0/3677135139 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:06.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.879+0000 7f16e77fe640 1 -- 172.21.15.37:0/3677135139 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16e8148d10 msgr2=0x7f16e8153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:06.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.879+0000 7f16e7fff640 1 --2- 172.21.15.37:0/3677135139 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16e8148d10 0x7f16e8153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:06.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.879+0000 7f16e77fe640 1 --2- 172.21.15.37:0/3677135139 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16e8148d10 0x7f16e8153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:06.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.879+0000 7f16e67fc640 1 -- 172.21.15.37:0/3677135139 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706517205 0 0) 0x7f16e80b3c80 con 0x7f16e81488c0 2023-12-19T16:07:06.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.879+0000 7f16e77fe640 1 -- 172.21.15.37:0/3677135139 >> v1:172.21.15.37:6789/0 conn(0x7f16e81488c0 legacy=0x7f16e8070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:06.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.879+0000 7f16e77fe640 1 -- 172.21.15.37:0/3677135139 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e80b80e0 con 0x7f16e80b7d00 2023-12-19T16:07:06.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.880+0000 7f16e77fe640 1 --2- 172.21.15.37:0/3677135139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e80b7d00 0x7f16e80b3740 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f16d80097a0 tx=0x7f16d802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e1415ecd93ed50 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:06.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.880+0000 7f16e67fc640 1 -- 172.21.15.37:0/3677135139 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8031830 con 0x7f16e80b7d00 2023-12-19T16:07:06.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.880+0000 7f16e67fc640 1 -- 172.21.15.37:0/3677135139 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d8031990 con 0x7f16e80b7d00 2023-12-19T16:07:06.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.880+0000 7f16e67fc640 1 -- 172.21.15.37:0/3677135139 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8031d20 con 0x7f16e80b7d00 2023-12-19T16:07:06.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.880+0000 7f16edffb640 1 -- 172.21.15.37:0/3677135139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e80b7d00 msgr2=0x7f16e80b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:06.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.880+0000 7f16edffb640 1 --2- 172.21.15.37:0/3677135139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e80b7d00 0x7f16e80b3740 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f16d80097a0 tx=0x7f16d802b8d0 comp rx=0 tx=0).stop 2023-12-19T16:07:06.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.880+0000 7f16edffb640 1 -- 172.21.15.37:0/3677135139 shutdown_connections 2023-12-19T16:07:06.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.880+0000 7f16edffb640 1 --2- 172.21.15.37:0/3677135139 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16e8148d10 0x7f16e8153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:06.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.880+0000 7f16edffb640 1 --2- 172.21.15.37:0/3677135139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e80b7d00 0x7f16e80b3740 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:06.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.880+0000 7f16edffb640 1 -- 172.21.15.37:0/3677135139 >> 172.21.15.37:0/3677135139 conn(0x7f16e80bc220 msgr2=0x7f16e80bc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:06.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.880+0000 7f16edffb640 1 -- 172.21.15.37:0/3677135139 shutdown_connections 2023-12-19T16:07:06.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.880+0000 7f16edffb640 1 -- 172.21.15.37:0/3677135139 wait complete. 2023-12-19T16:07:06.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.882+0000 7f16edffb640 1 Processor -- start 2023-12-19T16:07:06.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.882+0000 7f16edffb640 1 -- start start 2023-12-19T16:07:06.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.882+0000 7f16edffb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e80b7d00 0x7f16e80b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:06.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.882+0000 7f16edffb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e81488c0 0x7f16e81dfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:06.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.882+0000 7f16edffb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16e8148d10 0x7f16e813ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:06.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.882+0000 7f16edffb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e8149a00 con 0x7f16e80b7d00 2023-12-19T16:07:06.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.882+0000 7f16edffb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e81df9c0 con 0x7f16e81488c0 2023-12-19T16:07:06.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.882+0000 7f16edffb640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e814bdc0 con 0x7f16e8148d10 2023-12-19T16:07:06.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.883+0000 7f16e77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e80b7d00 0x7f16e80b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:06.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.883+0000 7f16e77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e80b7d00 0x7f16e80b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49446/0 (socket says 172.21.15.37:49446) 2023-12-19T16:07:06.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.883+0000 7f16e77fe640 1 -- 172.21.15.37:0/792610739 learned_addr learned my addr 172.21.15.37:0/792610739 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:06.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.883+0000 7f16e6ffd640 1 --2- 172.21.15.37:0/792610739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e81488c0 0x7f16e81dfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:06.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.883+0000 7f16e7fff640 1 --2- 172.21.15.37:0/792610739 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16e8148d10 0x7f16e813ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:06.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.883+0000 7f16e77fe640 1 -- 172.21.15.37:0/792610739 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16e8148d10 msgr2=0x7f16e813ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:06.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.883+0000 7f16e77fe640 1 --2- 172.21.15.37:0/792610739 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16e8148d10 0x7f16e813ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:06.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.883+0000 7f16e77fe640 1 -- 172.21.15.37:0/792610739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e81488c0 msgr2=0x7f16e81dfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:06.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.883+0000 7f16e77fe640 1 --2- 172.21.15.37:0/792610739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e81488c0 0x7f16e81dfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:06.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.883+0000 7f16e77fe640 1 -- 172.21.15.37:0/792610739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d8009400 con 0x7f16e80b7d00 2023-12-19T16:07:06.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.883+0000 7f16e6ffd640 1 --2- 172.21.15.37:0/792610739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e81488c0 0x7f16e81dfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:06.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.883+0000 7f16e77fe640 1 --2- 172.21.15.37:0/792610739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e80b7d00 0x7f16e80b1da0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f16d80097a0 tx=0x7f16d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:06.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.883+0000 7f16dffff640 1 -- 172.21.15.37:0/792610739 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8004230 con 0x7f16e80b7d00 2023-12-19T16:07:06.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.883+0000 7f16dffff640 1 -- 172.21.15.37:0/792610739 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d8004390 con 0x7f16e80b7d00 2023-12-19T16:07:06.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.883+0000 7f16edffb640 1 -- 172.21.15.37:0/792610739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e814bae0 con 0x7f16e80b7d00 2023-12-19T16:07:06.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.883+0000 7f16dffff640 1 -- 172.21.15.37:0/792610739 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d803a930 con 0x7f16e80b7d00 2023-12-19T16:07:06.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.883+0000 7f16edffb640 1 -- 172.21.15.37:0/792610739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e8071100 con 0x7f16e80b7d00 2023-12-19T16:07:06.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.884+0000 7f16edffb640 1 -- 172.21.15.37:0/792610739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e81dfb80 con 0x7f16e80b7d00 2023-12-19T16:07:06.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.885+0000 7f16dffff640 1 -- 172.21.15.37:0/792610739 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f16d803aa90 con 0x7f16e80b7d00 2023-12-19T16:07:06.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.885+0000 7f16dffff640 1 --2- 172.21.15.37:0/792610739 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f16c806a430 0x7f16c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:06.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.885+0000 7f16dffff640 1 -- 172.21.15.37:0/792610739 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16d80aaba0 con 0x7f16e80b7d00 2023-12-19T16:07:06.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.885+0000 7f16e6ffd640 1 --2- 172.21.15.37:0/792610739 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f16c806a430 0x7f16c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:06.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.886+0000 7f16e6ffd640 1 --2- 172.21.15.37:0/792610739 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f16c806a430 0x7f16c806c8f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f16e8146780 tx=0x7f16d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:06.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:06.890+0000 7f16dffff640 1 -- 172.21.15.37:0/792610739 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f16d8076340 con 0x7f16e80b7d00 2023-12-19T16:07:07.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.063+0000 7f16edffb640 1 -- 172.21.15.37:0/792610739 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f16e80b5920 con 0x7f16c806a430 2023-12-19T16:07:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.071+0000 7f16dffff640 1 -- 172.21.15.37:0/792610739 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264656 (secure 0 0 0) 0x7f16d0001d00 con 0x7f16c806a430 2023-12-19T16:07:07.077 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-19T16:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.073+0000 7f16edffb640 1 -- 172.21.15.37:0/792610739 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f16c806a430 msgr2=0x7f16c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.073+0000 7f16edffb640 1 --2- 172.21.15.37:0/792610739 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f16c806a430 0x7f16c806c8f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f16e8146780 tx=0x7f16d0009040 comp rx=0 tx=0).stop 2023-12-19T16:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.073+0000 7f16edffb640 1 -- 172.21.15.37:0/792610739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e80b7d00 msgr2=0x7f16e80b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.073+0000 7f16edffb640 1 --2- 172.21.15.37:0/792610739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e80b7d00 0x7f16e80b1da0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f16d80097a0 tx=0x7f16d80046c0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.073+0000 7f16edffb640 1 -- 172.21.15.37:0/792610739 shutdown_connections 2023-12-19T16:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.073+0000 7f16edffb640 1 --2- 172.21.15.37:0/792610739 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f16c806a430 0x7f16c806c8f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.073+0000 7f16edffb640 1 --2- 172.21.15.37:0/792610739 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16e8148d10 0x7f16e813ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.073+0000 7f16edffb640 1 --2- 172.21.15.37:0/792610739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e81488c0 0x7f16e81dfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.073+0000 7f16edffb640 1 --2- 172.21.15.37:0/792610739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e80b7d00 0x7f16e80b1da0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.073+0000 7f16edffb640 1 -- 172.21.15.37:0/792610739 >> 172.21.15.37:0/792610739 conn(0x7f16e80bc220 msgr2=0x7f16e80b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.074+0000 7f16edffb640 1 -- 172.21.15.37:0/792610739 shutdown_connections 2023-12-19T16:07:07.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.074+0000 7f16edffb640 1 -- 172.21.15.37:0/792610739 wait complete. 2023-12-19T16:07:07.087 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-19T16:07:06.633060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218416,"kb_used_data":2800,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756304,"statfs":{"total":773094113280,"available":772870455296,"internally_reserved":0,"allocated":2867200,"data_stored":1740044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.005371"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109838+0000","last_change":"2023-12-19T16:06:58.760625+0000","last_active":"2023-12-19T16:07:01.109838+0000","last_peered":"2023-12-19T16:07:01.109838+0000","last_clean":"2023-12-19T16:07:01.109838+0000","last_became_active":"2023-12-19T16:06:58.760229+0000","last_became_peered":"2023-12-19T16:06:58.760229+0000","last_unstale":"2023-12-19T16:07:01.109838+0000","last_undegraded":"2023-12-19T16:07:01.109838+0000","last_fullsized":"2023-12-19T16:07:01.109838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735747+0000","last_change":"2023-12-19T16:06:58.749173+0000","last_active":"2023-12-19T16:06:59.735747+0000","last_peered":"2023-12-19T16:06:59.735747+0000","last_clean":"2023-12-19T16:06:59.735747+0000","last_became_active":"2023-12-19T16:06:58.748736+0000","last_became_peered":"2023-12-19T16:06:58.748736+0000","last_unstale":"2023-12-19T16:06:59.735747+0000","last_undegraded":"2023-12-19T16:06:59.735747+0000","last_fullsized":"2023-12-19T16:06:59.735747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466127+0000","last_change":"2023-12-19T16:06:58.738858+0000","last_active":"2023-12-19T16:07:00.466127+0000","last_peered":"2023-12-19T16:07:00.466127+0000","last_clean":"2023-12-19T16:07:00.466127+0000","last_became_active":"2023-12-19T16:06:58.738178+0000","last_became_peered":"2023-12-19T16:06:58.738178+0000","last_unstale":"2023-12-19T16:07:00.466127+0000","last_undegraded":"2023-12-19T16:07:00.466127+0000","last_fullsized":"2023-12-19T16:07:00.466127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109498+0000","last_change":"2023-12-19T16:06:58.754766+0000","last_active":"2023-12-19T16:07:01.109498+0000","last_peered":"2023-12-19T16:07:01.109498+0000","last_clean":"2023-12-19T16:07:01.109498+0000","last_became_active":"2023-12-19T16:06:58.754289+0000","last_became_peered":"2023-12-19T16:06:58.754289+0000","last_unstale":"2023-12-19T16:07:01.109498+0000","last_undegraded":"2023-12-19T16:07:01.109498+0000","last_fullsized":"2023-12-19T16:07:01.109498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:26:37.888389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109413+0000","last_change":"2023-12-19T16:06:58.743609+0000","last_active":"2023-12-19T16:07:01.109413+0000","last_peered":"2023-12-19T16:07:01.109413+0000","last_clean":"2023-12-19T16:07:01.109413+0000","last_became_active":"2023-12-19T16:06:58.743331+0000","last_became_peered":"2023-12-19T16:06:58.743331+0000","last_unstale":"2023-12-19T16:07:01.109413+0000","last_undegraded":"2023-12-19T16:07:01.109413+0000","last_fullsized":"2023-12-19T16:07:01.109413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:11.108008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109102+0000","last_change":"2023-12-19T16:06:58.752778+0000","last_active":"2023-12-19T16:07:01.109102+0000","last_peered":"2023-12-19T16:07:01.109102+0000","last_clean":"2023-12-19T16:07:01.109102+0000","last_became_active":"2023-12-19T16:06:58.752519+0000","last_became_peered":"2023-12-19T16:06:58.752519+0000","last_unstale":"2023-12-19T16:07:01.109102+0000","last_undegraded":"2023-12-19T16:07:01.109102+0000","last_fullsized":"2023-12-19T16:07:01.109102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:17.210206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109322+0000","last_change":"2023-12-19T16:06:58.748834+0000","last_active":"2023-12-19T16:07:01.109322+0000","last_peered":"2023-12-19T16:07:01.109322+0000","last_clean":"2023-12-19T16:07:01.109322+0000","last_became_active":"2023-12-19T16:06:58.748039+0000","last_became_peered":"2023-12-19T16:06:58.748039+0000","last_unstale":"2023-12-19T16:07:01.109322+0000","last_undegraded":"2023-12-19T16:07:01.109322+0000","last_fullsized":"2023-12-19T16:07:01.109322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:26:37.888389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429554+0000","last_change":"2023-12-19T16:06:58.754746+0000","last_active":"2023-12-19T16:07:00.429554+0000","last_peered":"2023-12-19T16:07:00.429554+0000","last_clean":"2023-12-19T16:07:00.429554+0000","last_became_active":"2023-12-19T16:06:58.754477+0000","last_became_peered":"2023-12-19T16:06:58.754477+0000","last_unstale":"2023-12-19T16:07:00.429554+0000","last_undegraded":"2023-12-19T16:07:00.429554+0000","last_fullsized":"2023-12-19T16:07:00.429554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:02.578194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109955+0000","last_change":"2023-12-19T16:06:58.755823+0000","last_active":"2023-12-19T16:07:01.109955+0000","last_peered":"2023-12-19T16:07:01.109955+0000","last_clean":"2023-12-19T16:07:01.109955+0000","last_became_active":"2023-12-19T16:06:58.755519+0000","last_became_peered":"2023-12-19T16:06:58.755519+0000","last_unstale":"2023-12-19T16:07:01.109955+0000","last_undegraded":"2023-12-19T16:07:01.109955+0000","last_fullsized":"2023-12-19T16:07:01.109955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:17.210206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594076+0000","last_change":"2023-12-19T16:06:58.757791+0000","last_active":"2023-12-19T16:07:00.594076+0000","last_peered":"2023-12-19T16:07:00.594076+0000","last_clean":"2023-12-19T16:07:00.594076+0000","last_became_active":"2023-12-19T16:06:58.757519+0000","last_became_peered":"2023-12-19T16:06:58.757519+0000","last_unstale":"2023-12-19T16:07:00.594076+0000","last_undegraded":"2023-12-19T16:07:00.594076+0000","last_fullsized":"2023-12-19T16:07:00.594076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593880+0000","last_change":"2023-12-19T16:06:58.757323+0000","last_active":"2023-12-19T16:07:00.593880+0000","last_peered":"2023-12-19T16:07:00.593880+0000","last_clean":"2023-12-19T16:07:00.593880+0000","last_became_active":"2023-12-19T16:06:58.757070+0000","last_became_peered":"2023-12-19T16:06:58.757070+0000","last_unstale":"2023-12-19T16:07:00.593880+0000","last_undegraded":"2023-12-19T16:07:00.593880+0000","last_fullsized":"2023-12-19T16:07:00.593880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735789+0000","last_change":"2023-12-19T16:06:58.748826+0000","last_active":"2023-12-19T16:06:59.735789+0000","last_peered":"2023-12-19T16:06:59.735789+0000","last_clean":"2023-12-19T16:06:59.735789+0000","last_became_active":"2023-12-19T16:06:58.748455+0000","last_became_peered":"2023-12-19T16:06:58.748455+0000","last_unstale":"2023-12-19T16:06:59.735789+0000","last_undegraded":"2023-12-19T16:06:59.735789+0000","last_fullsized":"2023-12-19T16:06:59.735789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:45:54.216383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429773+0000","last_change":"2023-12-19T16:06:58.746487+0000","last_active":"2023-12-19T16:07:00.429773+0000","last_peered":"2023-12-19T16:07:00.429773+0000","last_clean":"2023-12-19T16:07:00.429773+0000","last_became_active":"2023-12-19T16:06:58.746251+0000","last_became_peered":"2023-12-19T16:06:58.746251+0000","last_unstale":"2023-12-19T16:07:00.429773+0000","last_undegraded":"2023-12-19T16:07:00.429773+0000","last_fullsized":"2023-12-19T16:07:00.429773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.465948+0000","last_change":"2023-12-19T16:06:58.749166+0000","last_active":"2023-12-19T16:07:00.465948+0000","last_peered":"2023-12-19T16:07:00.465948+0000","last_clean":"2023-12-19T16:07:00.465948+0000","last_became_active":"2023-12-19T16:06:58.748884+0000","last_became_peered":"2023-12-19T16:06:58.748884+0000","last_unstale":"2023-12-19T16:07:00.465948+0000","last_undegraded":"2023-12-19T16:07:00.465948+0000","last_fullsized":"2023-12-19T16:07:00.465948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735398+0000","last_change":"2023-12-19T16:06:58.744455+0000","last_active":"2023-12-19T16:06:59.735398+0000","last_peered":"2023-12-19T16:06:59.735398+0000","last_clean":"2023-12-19T16:06:59.735398+0000","last_became_active":"2023-12-19T16:06:58.744204+0000","last_became_peered":"2023-12-19T16:06:58.744204+0000","last_unstale":"2023-12-19T16:06:59.735398+0000","last_undegraded":"2023-12-19T16:06:59.735398+0000","last_fullsized":"2023-12-19T16:06:59.735398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109012+0000","last_change":"2023-12-19T16:06:58.751725+0000","last_active":"2023-12-19T16:07:01.109012+0000","last_peered":"2023-12-19T16:07:01.109012+0000","last_clean":"2023-12-19T16:07:01.109012+0000","last_became_active":"2023-12-19T16:06:58.751476+0000","last_became_peered":"2023-12-19T16:06:58.751476+0000","last_unstale":"2023-12-19T16:07:01.109012+0000","last_undegraded":"2023-12-19T16:07:01.109012+0000","last_fullsized":"2023-12-19T16:07:01.109012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:49.465099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109749+0000","last_change":"2023-12-19T16:06:58.752816+0000","last_active":"2023-12-19T16:07:01.109749+0000","last_peered":"2023-12-19T16:07:01.109749+0000","last_clean":"2023-12-19T16:07:01.109749+0000","last_became_active":"2023-12-19T16:06:58.752475+0000","last_became_peered":"2023-12-19T16:06:58.752475+0000","last_unstale":"2023-12-19T16:07:01.109749+0000","last_undegraded":"2023-12-19T16:07:01.109749+0000","last_fullsized":"2023-12-19T16:07:01.109749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736208+0000","last_change":"2023-12-19T16:06:58.745867+0000","last_active":"2023-12-19T16:06:59.736208+0000","last_peered":"2023-12-19T16:06:59.736208+0000","last_clean":"2023-12-19T16:06:59.736208+0000","last_became_active":"2023-12-19T16:06:58.745603+0000","last_became_peered":"2023-12-19T16:06:58.745603+0000","last_unstale":"2023-12-19T16:06:59.736208+0000","last_undegraded":"2023-12-19T16:06:59.736208+0000","last_fullsized":"2023-12-19T16:06:59.736208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:45:54.216383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109763+0000","last_change":"2023-12-19T16:06:58.744080+0000","last_active":"2023-12-19T16:07:01.109763+0000","last_peered":"2023-12-19T16:07:01.109763+0000","last_clean":"2023-12-19T16:07:01.109763+0000","last_became_active":"2023-12-19T16:06:58.743129+0000","last_became_peered":"2023-12-19T16:06:58.743129+0000","last_unstale":"2023-12-19T16:07:01.109763+0000","last_undegraded":"2023-12-19T16:07:01.109763+0000","last_fullsized":"2023-12-19T16:07:01.109763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593848+0000","last_change":"2023-12-19T16:06:58.754725+0000","last_active":"2023-12-19T16:07:00.593848+0000","last_peered":"2023-12-19T16:07:00.593848+0000","last_clean":"2023-12-19T16:07:00.593848+0000","last_became_active":"2023-12-19T16:06:58.754476+0000","last_became_peered":"2023-12-19T16:06:58.754476+0000","last_unstale":"2023-12-19T16:07:00.593848+0000","last_undegraded":"2023-12-19T16:07:00.593848+0000","last_fullsized":"2023-12-19T16:07:00.593848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466100+0000","last_change":"2023-12-19T16:06:58.744917+0000","last_active":"2023-12-19T16:07:00.466100+0000","last_peered":"2023-12-19T16:07:00.466100+0000","last_clean":"2023-12-19T16:07:00.466100+0000","last_became_active":"2023-12-19T16:06:58.744663+0000","last_became_peered":"2023-12-19T16:06:58.744663+0000","last_unstale":"2023-12-19T16:07:00.466100+0000","last_undegraded":"2023-12-19T16:07:00.466100+0000","last_fullsized":"2023-12-19T16:07:00.466100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109326+0000","last_change":"2023-12-19T16:06:58.752295+0000","last_active":"2023-12-19T16:07:01.109326+0000","last_peered":"2023-12-19T16:07:01.109326+0000","last_clean":"2023-12-19T16:07:01.109326+0000","last_became_active":"2023-12-19T16:06:58.752030+0000","last_became_peered":"2023-12-19T16:06:58.752030+0000","last_unstale":"2023-12-19T16:07:01.109326+0000","last_undegraded":"2023-12-19T16:07:01.109326+0000","last_fullsized":"2023-12-19T16:07:01.109326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:02.578194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429607+0000","last_change":"2023-12-19T16:06:58.737261+0000","last_active":"2023-12-19T16:07:00.429607+0000","last_peered":"2023-12-19T16:07:00.429607+0000","last_clean":"2023-12-19T16:07:00.429607+0000","last_became_active":"2023-12-19T16:06:58.736978+0000","last_became_peered":"2023-12-19T16:06:58.736978+0000","last_unstale":"2023-12-19T16:07:00.429607+0000","last_undegraded":"2023-12-19T16:07:00.429607+0000","last_fullsized":"2023-12-19T16:07:00.429607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109099+0000","last_change":"2023-12-19T16:06:58.751235+0000","last_active":"2023-12-19T16:07:01.109099+0000","last_peered":"2023-12-19T16:07:01.109099+0000","last_clean":"2023-12-19T16:07:01.109099+0000","last_became_active":"2023-12-19T16:06:58.750410+0000","last_became_peered":"2023-12-19T16:06:58.750410+0000","last_unstale":"2023-12-19T16:07:01.109099+0000","last_undegraded":"2023-12-19T16:07:01.109099+0000","last_fullsized":"2023-12-19T16:07:01.109099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:56:59.199473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429968+0000","last_change":"2023-12-19T16:06:58.744478+0000","last_active":"2023-12-19T16:07:00.429968+0000","last_peered":"2023-12-19T16:07:00.429968+0000","last_clean":"2023-12-19T16:07:00.429968+0000","last_became_active":"2023-12-19T16:06:58.742838+0000","last_became_peered":"2023-12-19T16:06:58.742838+0000","last_unstale":"2023-12-19T16:07:00.429968+0000","last_undegraded":"2023-12-19T16:07:00.429968+0000","last_fullsized":"2023-12-19T16:07:00.429968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594088+0000","last_change":"2023-12-19T16:06:58.746043+0000","last_active":"2023-12-19T16:07:00.594088+0000","last_peered":"2023-12-19T16:07:00.594088+0000","last_clean":"2023-12-19T16:07:00.594088+0000","last_became_active":"2023-12-19T16:06:58.745779+0000","last_became_peered":"2023-12-19T16:06:58.745779+0000","last_unstale":"2023-12-19T16:07:00.594088+0000","last_undegraded":"2023-12-19T16:07:00.594088+0000","last_fullsized":"2023-12-19T16:07:00.594088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:04.102120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735628+0000","last_change":"2023-12-19T16:06:58.749441+0000","last_active":"2023-12-19T16:06:59.735628+0000","last_peered":"2023-12-19T16:06:59.735628+0000","last_clean":"2023-12-19T16:06:59.735628+0000","last_became_active":"2023-12-19T16:06:58.748234+0000","last_became_peered":"2023-12-19T16:06:58.748234+0000","last_unstale":"2023-12-19T16:06:59.735628+0000","last_undegraded":"2023-12-19T16:06:59.735628+0000","last_fullsized":"2023-12-19T16:06:59.735628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429935+0000","last_change":"2023-12-19T16:06:58.744976+0000","last_active":"2023-12-19T16:07:00.429935+0000","last_peered":"2023-12-19T16:07:00.429935+0000","last_clean":"2023-12-19T16:07:00.429935+0000","last_became_active":"2023-12-19T16:06:58.744731+0000","last_became_peered":"2023-12-19T16:06:58.744731+0000","last_unstale":"2023-12-19T16:07:00.429935+0000","last_undegraded":"2023-12-19T16:07:00.429935+0000","last_fullsized":"2023-12-19T16:07:00.429935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466162+0000","last_change":"2023-12-19T16:06:58.748370+0000","last_active":"2023-12-19T16:07:00.466162+0000","last_peered":"2023-12-19T16:07:00.466162+0000","last_clean":"2023-12-19T16:07:00.466162+0000","last_became_active":"2023-12-19T16:06:58.748079+0000","last_became_peered":"2023-12-19T16:06:58.748079+0000","last_unstale":"2023-12-19T16:07:00.466162+0000","last_undegraded":"2023-12-19T16:07:00.466162+0000","last_fullsized":"2023-12-19T16:07:00.466162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109837+0000","last_change":"2023-12-19T16:06:58.751906+0000","last_active":"2023-12-19T16:07:01.109837+0000","last_peered":"2023-12-19T16:07:01.109837+0000","last_clean":"2023-12-19T16:07:01.109837+0000","last_became_active":"2023-12-19T16:06:58.750803+0000","last_became_peered":"2023-12-19T16:06:58.750803+0000","last_unstale":"2023-12-19T16:07:01.109837+0000","last_undegraded":"2023-12-19T16:07:01.109837+0000","last_fullsized":"2023-12-19T16:07:01.109837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:34:52.231787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736199+0000","last_change":"2023-12-19T16:06:58.753386+0000","last_active":"2023-12-19T16:06:59.736199+0000","last_peered":"2023-12-19T16:06:59.736199+0000","last_clean":"2023-12-19T16:06:59.736199+0000","last_became_active":"2023-12-19T16:06:58.753213+0000","last_became_peered":"2023-12-19T16:06:58.753213+0000","last_unstale":"2023-12-19T16:06:59.736199+0000","last_undegraded":"2023-12-19T16:06:59.736199+0000","last_fullsized":"2023-12-19T16:06:59.736199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:56.721659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593758+0000","last_change":"2023-12-19T16:06:58.753896+0000","last_active":"2023-12-19T16:07:00.593758+0000","last_peered":"2023-12-19T16:07:00.593758+0000","last_clean":"2023-12-19T16:07:00.593758+0000","last_became_active":"2023-12-19T16:06:58.753594+0000","last_became_peered":"2023-12-19T16:06:58.753594+0000","last_unstale":"2023-12-19T16:07:00.593758+0000","last_undegraded":"2023-12-19T16:07:00.593758+0000","last_fullsized":"2023-12-19T16:07:00.593758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:49.465099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735526+0000","last_change":"2023-12-19T16:06:58.749736+0000","last_active":"2023-12-19T16:06:59.735526+0000","last_peered":"2023-12-19T16:06:59.735526+0000","last_clean":"2023-12-19T16:06:59.735526+0000","last_became_active":"2023-12-19T16:06:58.749468+0000","last_became_peered":"2023-12-19T16:06:58.749468+0000","last_unstale":"2023-12-19T16:06:59.735526+0000","last_undegraded":"2023-12-19T16:06:59.735526+0000","last_fullsized":"2023-12-19T16:06:59.735526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:17.323789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429911+0000","last_change":"2023-12-19T16:06:58.304535+0000","last_active":"2023-12-19T16:07:00.429911+0000","last_peered":"2023-12-19T16:07:00.429911+0000","last_clean":"2023-12-19T16:07:00.429911+0000","last_became_active":"2023-12-19T16:06:58.304271+0000","last_became_peered":"2023-12-19T16:06:58.304271+0000","last_unstale":"2023-12-19T16:07:00.429911+0000","last_undegraded":"2023-12-19T16:07:00.429911+0000","last_fullsized":"2023-12-19T16:07:00.429911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466191+0000","last_change":"2023-12-19T16:06:58.741261+0000","last_active":"2023-12-19T16:07:00.466191+0000","last_peered":"2023-12-19T16:07:00.466191+0000","last_clean":"2023-12-19T16:07:00.466191+0000","last_became_active":"2023-12-19T16:06:58.741000+0000","last_became_peered":"2023-12-19T16:06:58.741000+0000","last_unstale":"2023-12-19T16:07:00.466191+0000","last_undegraded":"2023-12-19T16:07:00.466191+0000","last_fullsized":"2023-12-19T16:07:00.466191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:21:27.003991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593812+0000","last_change":"2023-12-19T16:06:58.304385+0000","last_active":"2023-12-19T16:07:00.593812+0000","last_peered":"2023-12-19T16:07:00.593812+0000","last_clean":"2023-12-19T16:07:00.593812+0000","last_became_active":"2023-12-19T16:06:58.304091+0000","last_became_peered":"2023-12-19T16:06:58.304091+0000","last_unstale":"2023-12-19T16:07:00.593812+0000","last_undegraded":"2023-12-19T16:07:00.593812+0000","last_fullsized":"2023-12-19T16:07:00.593812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429698+0000","last_change":"2023-12-19T16:06:58.305822+0000","last_active":"2023-12-19T16:07:00.429698+0000","last_peered":"2023-12-19T16:07:00.429698+0000","last_clean":"2023-12-19T16:07:00.429698+0000","last_became_active":"2023-12-19T16:06:58.305070+0000","last_became_peered":"2023-12-19T16:06:58.305070+0000","last_unstale":"2023-12-19T16:07:00.429698+0000","last_undegraded":"2023-12-19T16:07:00.429698+0000","last_fullsized":"2023-12-19T16:07:00.429698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429590+0000","last_change":"2023-12-19T16:06:58.741414+0000","last_active":"2023-12-19T16:07:00.429590+0000","last_peered":"2023-12-19T16:07:00.429590+0000","last_clean":"2023-12-19T16:07:00.429590+0000","last_became_active":"2023-12-19T16:06:58.741166+0000","last_became_peered":"2023-12-19T16:06:58.741166+0000","last_unstale":"2023-12-19T16:07:00.429590+0000","last_undegraded":"2023-12-19T16:07:00.429590+0000","last_fullsized":"2023-12-19T16:07:00.429590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109102+0000","last_change":"2023-12-19T16:06:58.304842+0000","last_active":"2023-12-19T16:07:01.109102+0000","last_peered":"2023-12-19T16:07:01.109102+0000","last_clean":"2023-12-19T16:07:01.109102+0000","last_became_active":"2023-12-19T16:06:58.302883+0000","last_became_peered":"2023-12-19T16:06:58.302883+0000","last_unstale":"2023-12-19T16:07:01.109102+0000","last_undegraded":"2023-12-19T16:07:01.109102+0000","last_fullsized":"2023-12-19T16:07:01.109102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735403+0000","last_change":"2023-12-19T16:06:58.750010+0000","last_active":"2023-12-19T16:06:59.735403+0000","last_peered":"2023-12-19T16:06:59.735403+0000","last_clean":"2023-12-19T16:06:59.735403+0000","last_became_active":"2023-12-19T16:06:58.749766+0000","last_became_peered":"2023-12-19T16:06:58.749766+0000","last_unstale":"2023-12-19T16:06:59.735403+0000","last_undegraded":"2023-12-19T16:06:59.735403+0000","last_fullsized":"2023-12-19T16:06:59.735403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594040+0000","last_change":"2023-12-19T16:06:58.307494+0000","last_active":"2023-12-19T16:07:00.594040+0000","last_peered":"2023-12-19T16:07:00.594040+0000","last_clean":"2023-12-19T16:07:00.594040+0000","last_became_active":"2023-12-19T16:06:58.307191+0000","last_became_peered":"2023-12-19T16:06:58.307191+0000","last_unstale":"2023-12-19T16:07:00.594040+0000","last_undegraded":"2023-12-19T16:07:00.594040+0000","last_fullsized":"2023-12-19T16:07:00.594040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109823+0000","last_change":"2023-12-19T16:06:58.752792+0000","last_active":"2023-12-19T16:07:01.109823+0000","last_peered":"2023-12-19T16:07:01.109823+0000","last_clean":"2023-12-19T16:07:01.109823+0000","last_became_active":"2023-12-19T16:06:58.752494+0000","last_became_peered":"2023-12-19T16:06:58.752494+0000","last_unstale":"2023-12-19T16:07:01.109823+0000","last_undegraded":"2023-12-19T16:07:01.109823+0000","last_fullsized":"2023-12-19T16:07:01.109823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109839+0000","last_change":"2023-12-19T16:06:58.309509+0000","last_active":"2023-12-19T16:07:01.109839+0000","last_peered":"2023-12-19T16:07:01.109839+0000","last_clean":"2023-12-19T16:07:01.109839+0000","last_became_active":"2023-12-19T16:06:58.309139+0000","last_became_peered":"2023-12-19T16:06:58.309139+0000","last_unstale":"2023-12-19T16:07:01.109839+0000","last_undegraded":"2023-12-19T16:07:01.109839+0000","last_fullsized":"2023-12-19T16:07:01.109839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466307+0000","last_change":"2023-12-19T16:06:58.756009+0000","last_active":"2023-12-19T16:07:00.466307+0000","last_peered":"2023-12-19T16:07:00.466307+0000","last_clean":"2023-12-19T16:07:00.466307+0000","last_became_active":"2023-12-19T16:06:58.755610+0000","last_became_peered":"2023-12-19T16:06:58.755610+0000","last_unstale":"2023-12-19T16:07:00.466307+0000","last_undegraded":"2023-12-19T16:07:00.466307+0000","last_fullsized":"2023-12-19T16:07:00.466307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735683+0000","last_change":"2023-12-19T16:06:58.312257+0000","last_active":"2023-12-19T16:06:59.735683+0000","last_peered":"2023-12-19T16:06:59.735683+0000","last_clean":"2023-12-19T16:06:59.735683+0000","last_became_active":"2023-12-19T16:06:58.311988+0000","last_became_peered":"2023-12-19T16:06:58.311988+0000","last_unstale":"2023-12-19T16:06:59.735683+0000","last_undegraded":"2023-12-19T16:06:59.735683+0000","last_fullsized":"2023-12-19T16:06:59.735683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:55.716735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735863+0000","last_change":"2023-12-19T16:06:58.743459+0000","last_active":"2023-12-19T16:06:59.735863+0000","last_peered":"2023-12-19T16:06:59.735863+0000","last_clean":"2023-12-19T16:06:59.735863+0000","last_became_active":"2023-12-19T16:06:58.743184+0000","last_became_peered":"2023-12-19T16:06:58.743184+0000","last_unstale":"2023-12-19T16:06:59.735863+0000","last_undegraded":"2023-12-19T16:06:59.735863+0000","last_fullsized":"2023-12-19T16:06:59.735863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:56.721659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593958+0000","last_change":"2023-12-19T16:06:58.310349+0000","last_active":"2023-12-19T16:07:00.593958+0000","last_peered":"2023-12-19T16:07:00.593958+0000","last_clean":"2023-12-19T16:07:00.593958+0000","last_became_active":"2023-12-19T16:06:58.310059+0000","last_became_peered":"2023-12-19T16:06:58.310059+0000","last_unstale":"2023-12-19T16:07:00.593958+0000","last_undegraded":"2023-12-19T16:07:00.593958+0000","last_fullsized":"2023-12-19T16:07:00.593958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:35.961254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109478+0000","last_change":"2023-12-19T16:06:58.751190+0000","last_active":"2023-12-19T16:07:01.109478+0000","last_peered":"2023-12-19T16:07:01.109478+0000","last_clean":"2023-12-19T16:07:01.109478+0000","last_became_active":"2023-12-19T16:06:58.748432+0000","last_became_peered":"2023-12-19T16:06:58.748432+0000","last_unstale":"2023-12-19T16:07:01.109478+0000","last_undegraded":"2023-12-19T16:07:01.109478+0000","last_fullsized":"2023-12-19T16:07:01.109478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:30.281031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466247+0000","last_change":"2023-12-19T16:06:58.307849+0000","last_active":"2023-12-19T16:07:00.466247+0000","last_peered":"2023-12-19T16:07:00.466247+0000","last_clean":"2023-12-19T16:07:00.466247+0000","last_became_active":"2023-12-19T16:06:58.307562+0000","last_became_peered":"2023-12-19T16:06:58.307562+0000","last_unstale":"2023-12-19T16:07:00.466247+0000","last_undegraded":"2023-12-19T16:07:00.466247+0000","last_fullsized":"2023-12-19T16:07:00.466247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466011+0000","last_change":"2023-12-19T16:06:58.744304+0000","last_active":"2023-12-19T16:07:00.466011+0000","last_peered":"2023-12-19T16:07:00.466011+0000","last_clean":"2023-12-19T16:07:00.466011+0000","last_became_active":"2023-12-19T16:06:58.744034+0000","last_became_peered":"2023-12-19T16:06:58.744034+0000","last_unstale":"2023-12-19T16:07:00.466011+0000","last_undegraded":"2023-12-19T16:07:00.466011+0000","last_fullsized":"2023-12-19T16:07:00.466011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:04.102120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109966+0000","last_change":"2023-12-19T16:06:58.310576+0000","last_active":"2023-12-19T16:07:01.109966+0000","last_peered":"2023-12-19T16:07:01.109966+0000","last_clean":"2023-12-19T16:07:01.109966+0000","last_became_active":"2023-12-19T16:06:58.310298+0000","last_became_peered":"2023-12-19T16:06:58.310298+0000","last_unstale":"2023-12-19T16:07:01.109966+0000","last_undegraded":"2023-12-19T16:07:01.109966+0000","last_fullsized":"2023-12-19T16:07:01.109966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:06.572806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109450+0000","last_change":"2023-12-19T16:06:58.746329+0000","last_active":"2023-12-19T16:07:01.109450+0000","last_peered":"2023-12-19T16:07:01.109450+0000","last_clean":"2023-12-19T16:07:01.109450+0000","last_became_active":"2023-12-19T16:06:58.746010+0000","last_became_peered":"2023-12-19T16:06:58.746010+0000","last_unstale":"2023-12-19T16:07:01.109450+0000","last_undegraded":"2023-12-19T16:07:01.109450+0000","last_fullsized":"2023-12-19T16:07:01.109450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:34:52.231787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593805+0000","last_change":"2023-12-19T16:06:58.309330+0000","last_active":"2023-12-19T16:07:00.593805+0000","last_peered":"2023-12-19T16:07:00.593805+0000","last_clean":"2023-12-19T16:07:00.593805+0000","last_became_active":"2023-12-19T16:06:58.309039+0000","last_became_peered":"2023-12-19T16:06:58.309039+0000","last_unstale":"2023-12-19T16:07:00.593805+0000","last_undegraded":"2023-12-19T16:07:00.593805+0000","last_fullsized":"2023-12-19T16:07:00.593805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593766+0000","last_change":"2023-12-19T16:06:58.752891+0000","last_active":"2023-12-19T16:07:00.593766+0000","last_peered":"2023-12-19T16:07:00.593766+0000","last_clean":"2023-12-19T16:07:00.593766+0000","last_became_active":"2023-12-19T16:06:58.752582+0000","last_became_peered":"2023-12-19T16:06:58.752582+0000","last_unstale":"2023-12-19T16:07:00.593766+0000","last_undegraded":"2023-12-19T16:07:00.593766+0000","last_fullsized":"2023-12-19T16:07:00.593766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:07:12.391535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736116+0000","last_change":"2023-12-19T16:06:58.308799+0000","last_active":"2023-12-19T16:06:59.736116+0000","last_peered":"2023-12-19T16:06:59.736116+0000","last_clean":"2023-12-19T16:06:59.736116+0000","last_became_active":"2023-12-19T16:06:58.308452+0000","last_became_peered":"2023-12-19T16:06:58.308452+0000","last_unstale":"2023-12-19T16:06:59.736116+0000","last_undegraded":"2023-12-19T16:06:59.736116+0000","last_fullsized":"2023-12-19T16:06:59.736116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109274+0000","last_change":"2023-12-19T16:06:58.746864+0000","last_active":"2023-12-19T16:07:01.109274+0000","last_peered":"2023-12-19T16:07:01.109274+0000","last_clean":"2023-12-19T16:07:01.109274+0000","last_became_active":"2023-12-19T16:06:58.746614+0000","last_became_peered":"2023-12-19T16:06:58.746614+0000","last_unstale":"2023-12-19T16:07:01.109274+0000","last_undegraded":"2023-12-19T16:07:01.109274+0000","last_fullsized":"2023-12-19T16:07:01.109274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:08:43.126506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735933+0000","last_change":"2023-12-19T16:06:58.308443+0000","last_active":"2023-12-19T16:06:59.735933+0000","last_peered":"2023-12-19T16:06:59.735933+0000","last_clean":"2023-12-19T16:06:59.735933+0000","last_became_active":"2023-12-19T16:06:58.308138+0000","last_became_peered":"2023-12-19T16:06:58.308138+0000","last_unstale":"2023-12-19T16:06:59.735933+0000","last_undegraded":"2023-12-19T16:06:59.735933+0000","last_fullsized":"2023-12-19T16:06:59.735933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:45:16.445340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109774+0000","last_change":"2023-12-19T16:06:58.743581+0000","last_active":"2023-12-19T16:07:01.109774+0000","last_peered":"2023-12-19T16:07:01.109774+0000","last_clean":"2023-12-19T16:07:01.109774+0000","last_became_active":"2023-12-19T16:06:58.743215+0000","last_became_peered":"2023-12-19T16:06:58.743215+0000","last_unstale":"2023-12-19T16:07:01.109774+0000","last_undegraded":"2023-12-19T16:07:01.109774+0000","last_fullsized":"2023-12-19T16:07:01.109774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:56:59.199473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736253+0000","last_change":"2023-12-19T16:06:58.301431+0000","last_active":"2023-12-19T16:06:59.736253+0000","last_peered":"2023-12-19T16:06:59.736253+0000","last_clean":"2023-12-19T16:06:59.736253+0000","last_became_active":"2023-12-19T16:06:58.301154+0000","last_became_peered":"2023-12-19T16:06:58.301154+0000","last_unstale":"2023-12-19T16:06:59.736253+0000","last_undegraded":"2023-12-19T16:06:59.736253+0000","last_fullsized":"2023-12-19T16:06:59.736253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109948+0000","last_change":"2023-12-19T16:06:58.747109+0000","last_active":"2023-12-19T16:07:01.109948+0000","last_peered":"2023-12-19T16:07:01.109948+0000","last_clean":"2023-12-19T16:07:01.109948+0000","last_became_active":"2023-12-19T16:06:58.746296+0000","last_became_peered":"2023-12-19T16:06:58.746296+0000","last_unstale":"2023-12-19T16:07:01.109948+0000","last_undegraded":"2023-12-19T16:07:01.109948+0000","last_fullsized":"2023-12-19T16:07:01.109948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:02.578194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735717+0000","last_change":"2023-12-19T16:06:58.314755+0000","last_active":"2023-12-19T16:06:59.735717+0000","last_peered":"2023-12-19T16:06:59.735717+0000","last_clean":"2023-12-19T16:06:59.735717+0000","last_became_active":"2023-12-19T16:06:58.314554+0000","last_became_peered":"2023-12-19T16:06:58.314554+0000","last_unstale":"2023-12-19T16:06:59.735717+0000","last_undegraded":"2023-12-19T16:06:59.735717+0000","last_fullsized":"2023-12-19T16:06:59.735717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:16.318865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.110048+0000","last_change":"2023-12-19T16:06:58.751149+0000","last_active":"2023-12-19T16:07:01.110048+0000","last_peered":"2023-12-19T16:07:01.110048+0000","last_clean":"2023-12-19T16:07:01.110048+0000","last_became_active":"2023-12-19T16:06:58.750741+0000","last_became_peered":"2023-12-19T16:06:58.750741+0000","last_unstale":"2023-12-19T16:07:01.110048+0000","last_undegraded":"2023-12-19T16:07:01.110048+0000","last_fullsized":"2023-12-19T16:07:01.110048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:30.281031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736230+0000","last_change":"2023-12-19T16:06:58.301782+0000","last_active":"2023-12-19T16:06:59.736230+0000","last_peered":"2023-12-19T16:06:59.736230+0000","last_clean":"2023-12-19T16:06:59.736230+0000","last_became_active":"2023-12-19T16:06:58.300855+0000","last_became_peered":"2023-12-19T16:06:58.300855+0000","last_unstale":"2023-12-19T16:06:59.736230+0000","last_undegraded":"2023-12-19T16:06:59.736230+0000","last_fullsized":"2023-12-19T16:06:59.736230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109583+0000","last_change":"2023-12-19T16:06:58.755507+0000","last_active":"2023-12-19T16:07:01.109583+0000","last_peered":"2023-12-19T16:07:01.109583+0000","last_clean":"2023-12-19T16:07:01.109583+0000","last_became_active":"2023-12-19T16:06:58.755176+0000","last_became_peered":"2023-12-19T16:06:58.755176+0000","last_unstale":"2023-12-19T16:07:01.109583+0000","last_undegraded":"2023-12-19T16:07:01.109583+0000","last_fullsized":"2023-12-19T16:07:01.109583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:59:45.402539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T16:06:58.733783+0000","last_change":"2023-12-19T16:06:47.761389+0000","last_active":"2023-12-19T16:06:58.733783+0000","last_peered":"2023-12-19T16:06:58.733783+0000","last_clean":"2023-12-19T16:06:58.733783+0000","last_became_active":"2023-12-19T16:06:47.760252+0000","last_became_peered":"2023-12-19T16:06:47.760252+0000","last_unstale":"2023-12-19T16:06:58.733783+0000","last_undegraded":"2023-12-19T16:06:58.733783+0000","last_fullsized":"2023-12-19T16:06:58.733783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_clean_scrub_stamp":"2023-12-19T16:06:46.706871+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:09.167979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109217+0000","last_change":"2023-12-19T16:06:58.300900+0000","last_active":"2023-12-19T16:07:01.109217+0000","last_peered":"2023-12-19T16:07:01.109217+0000","last_clean":"2023-12-19T16:07:01.109217+0000","last_became_active":"2023-12-19T16:06:58.300641+0000","last_became_peered":"2023-12-19T16:06:58.300641+0000","last_unstale":"2023-12-19T16:07:01.109217+0000","last_undegraded":"2023-12-19T16:07:01.109217+0000","last_fullsized":"2023-12-19T16:07:01.109217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:07.531619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429774+0000","last_change":"2023-12-19T16:06:58.755362+0000","last_active":"2023-12-19T16:07:00.429774+0000","last_peered":"2023-12-19T16:07:00.429774+0000","last_clean":"2023-12-19T16:07:00.429774+0000","last_became_active":"2023-12-19T16:06:58.755055+0000","last_became_peered":"2023-12-19T16:06:58.755055+0000","last_unstale":"2023-12-19T16:07:00.429774+0000","last_undegraded":"2023-12-19T16:07:00.429774+0000","last_fullsized":"2023-12-19T16:07:00.429774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:08:43.126506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109035+0000","last_change":"2023-12-19T16:06:58.310316+0000","last_active":"2023-12-19T16:07:01.109035+0000","last_peered":"2023-12-19T16:07:01.109035+0000","last_clean":"2023-12-19T16:07:01.109035+0000","last_became_active":"2023-12-19T16:06:58.310035+0000","last_became_peered":"2023-12-19T16:06:58.310035+0000","last_unstale":"2023-12-19T16:07:01.109035+0000","last_undegraded":"2023-12-19T16:07:01.109035+0000","last_fullsized":"2023-12-19T16:07:01.109035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:07.531619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466062+0000","last_change":"2023-12-19T16:06:58.741676+0000","last_active":"2023-12-19T16:07:00.466062+0000","last_peered":"2023-12-19T16:07:00.466062+0000","last_clean":"2023-12-19T16:07:00.466062+0000","last_became_active":"2023-12-19T16:06:58.741422+0000","last_became_peered":"2023-12-19T16:06:58.741422+0000","last_unstale":"2023-12-19T16:07:00.466062+0000","last_undegraded":"2023-12-19T16:07:00.466062+0000","last_fullsized":"2023-12-19T16:07:00.466062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:46:27.205690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736299+0000","last_change":"2023-12-19T16:06:58.296822+0000","last_active":"2023-12-19T16:06:59.736299+0000","last_peered":"2023-12-19T16:06:59.736299+0000","last_clean":"2023-12-19T16:06:59.736299+0000","last_became_active":"2023-12-19T16:06:58.296555+0000","last_became_peered":"2023-12-19T16:06:58.296555+0000","last_unstale":"2023-12-19T16:06:59.736299+0000","last_undegraded":"2023-12-19T16:06:59.736299+0000","last_fullsized":"2023-12-19T16:06:59.736299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735354+0000","last_change":"2023-12-19T16:06:58.750259+0000","last_active":"2023-12-19T16:06:59.735354+0000","last_peered":"2023-12-19T16:06:59.735354+0000","last_clean":"2023-12-19T16:06:59.735354+0000","last_became_active":"2023-12-19T16:06:58.749971+0000","last_became_peered":"2023-12-19T16:06:58.749971+0000","last_unstale":"2023-12-19T16:06:59.735354+0000","last_undegraded":"2023-12-19T16:06:59.735354+0000","last_fullsized":"2023-12-19T16:06:59.735354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109975+0000","last_change":"2023-12-19T16:06:58.308334+0000","last_active":"2023-12-19T16:07:01.109975+0000","last_peered":"2023-12-19T16:07:01.109975+0000","last_clean":"2023-12-19T16:07:01.109975+0000","last_became_active":"2023-12-19T16:06:58.307997+0000","last_became_peered":"2023-12-19T16:06:58.307997+0000","last_unstale":"2023-12-19T16:07:01.109975+0000","last_undegraded":"2023-12-19T16:07:01.109975+0000","last_fullsized":"2023-12-19T16:07:01.109975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735908+0000","last_change":"2023-12-19T16:06:58.749875+0000","last_active":"2023-12-19T16:06:59.735908+0000","last_peered":"2023-12-19T16:06:59.735908+0000","last_clean":"2023-12-19T16:06:59.735908+0000","last_became_active":"2023-12-19T16:06:58.749604+0000","last_became_peered":"2023-12-19T16:06:58.749604+0000","last_unstale":"2023-12-19T16:06:59.735908+0000","last_undegraded":"2023-12-19T16:06:59.735908+0000","last_fullsized":"2023-12-19T16:06:59.735908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:07.695345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735602+0000","last_change":"2023-12-19T16:06:58.310432+0000","last_active":"2023-12-19T16:06:59.735602+0000","last_peered":"2023-12-19T16:06:59.735602+0000","last_clean":"2023-12-19T16:06:59.735602+0000","last_became_active":"2023-12-19T16:06:58.310052+0000","last_became_peered":"2023-12-19T16:06:58.310052+0000","last_unstale":"2023-12-19T16:06:59.735602+0000","last_undegraded":"2023-12-19T16:06:59.735602+0000","last_fullsized":"2023-12-19T16:06:59.735602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:07.531619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109764+0000","last_change":"2023-12-19T16:06:58.755050+0000","last_active":"2023-12-19T16:07:01.109764+0000","last_peered":"2023-12-19T16:07:01.109764+0000","last_clean":"2023-12-19T16:07:01.109764+0000","last_became_active":"2023-12-19T16:06:58.754666+0000","last_became_peered":"2023-12-19T16:06:58.754666+0000","last_unstale":"2023-12-19T16:07:01.109764+0000","last_undegraded":"2023-12-19T16:07:01.109764+0000","last_fullsized":"2023-12-19T16:07:01.109764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:11.108008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109843+0000","last_change":"2023-12-19T16:06:58.311812+0000","last_active":"2023-12-19T16:07:01.109843+0000","last_peered":"2023-12-19T16:07:01.109843+0000","last_clean":"2023-12-19T16:07:01.109843+0000","last_became_active":"2023-12-19T16:06:58.311423+0000","last_became_peered":"2023-12-19T16:06:58.311423+0000","last_unstale":"2023-12-19T16:07:01.109843+0000","last_undegraded":"2023-12-19T16:07:01.109843+0000","last_fullsized":"2023-12-19T16:07:01.109843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735591+0000","last_change":"2023-12-19T16:06:58.747297+0000","last_active":"2023-12-19T16:06:59.735591+0000","last_peered":"2023-12-19T16:06:59.735591+0000","last_clean":"2023-12-19T16:06:59.735591+0000","last_became_active":"2023-12-19T16:06:58.747025+0000","last_became_peered":"2023-12-19T16:06:58.747025+0000","last_unstale":"2023-12-19T16:06:59.735591+0000","last_undegraded":"2023-12-19T16:06:59.735591+0000","last_fullsized":"2023-12-19T16:06:59.735591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735768+0000","last_change":"2023-12-19T16:06:58.309515+0000","last_active":"2023-12-19T16:06:59.735768+0000","last_peered":"2023-12-19T16:06:59.735768+0000","last_clean":"2023-12-19T16:06:59.735768+0000","last_became_active":"2023-12-19T16:06:58.309120+0000","last_became_peered":"2023-12-19T16:06:58.309120+0000","last_unstale":"2023-12-19T16:06:59.735768+0000","last_undegraded":"2023-12-19T16:06:59.735768+0000","last_fullsized":"2023-12-19T16:06:59.735768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:06.572806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429995+0000","last_change":"2023-12-19T16:06:58.744382+0000","last_active":"2023-12-19T16:07:00.429995+0000","last_peered":"2023-12-19T16:07:00.429995+0000","last_clean":"2023-12-19T16:07:00.429995+0000","last_became_active":"2023-12-19T16:06:58.744125+0000","last_became_peered":"2023-12-19T16:06:58.744125+0000","last_unstale":"2023-12-19T16:07:00.429995+0000","last_undegraded":"2023-12-19T16:07:00.429995+0000","last_fullsized":"2023-12-19T16:07:00.429995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:17.210206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594111+0000","last_change":"2023-12-19T16:06:58.306697+0000","last_active":"2023-12-19T16:07:00.594111+0000","last_peered":"2023-12-19T16:07:00.594111+0000","last_clean":"2023-12-19T16:07:00.594111+0000","last_became_active":"2023-12-19T16:06:58.306411+0000","last_became_peered":"2023-12-19T16:06:58.306411+0000","last_unstale":"2023-12-19T16:07:00.594111+0000","last_undegraded":"2023-12-19T16:07:00.594111+0000","last_fullsized":"2023-12-19T16:07:00.594111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466265+0000","last_change":"2023-12-19T16:06:58.749375+0000","last_active":"2023-12-19T16:07:00.466265+0000","last_peered":"2023-12-19T16:07:00.466265+0000","last_clean":"2023-12-19T16:07:00.466265+0000","last_became_active":"2023-12-19T16:06:58.749123+0000","last_became_peered":"2023-12-19T16:06:58.749123+0000","last_unstale":"2023-12-19T16:07:00.466265+0000","last_undegraded":"2023-12-19T16:07:00.466265+0000","last_fullsized":"2023-12-19T16:07:00.466265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109074+0000","last_change":"2023-12-19T16:06:58.311689+0000","last_active":"2023-12-19T16:07:01.109074+0000","last_peered":"2023-12-19T16:07:01.109074+0000","last_clean":"2023-12-19T16:07:01.109074+0000","last_became_active":"2023-12-19T16:06:58.311443+0000","last_became_peered":"2023-12-19T16:06:58.311443+0000","last_unstale":"2023-12-19T16:07:01.109074+0000","last_undegraded":"2023-12-19T16:07:01.109074+0000","last_fullsized":"2023-12-19T16:07:01.109074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:16.318865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735579+0000","last_change":"2023-12-19T16:06:58.737013+0000","last_active":"2023-12-19T16:06:59.735579+0000","last_peered":"2023-12-19T16:06:59.735579+0000","last_clean":"2023-12-19T16:06:59.735579+0000","last_became_active":"2023-12-19T16:06:58.736732+0000","last_became_peered":"2023-12-19T16:06:58.736732+0000","last_unstale":"2023-12-19T16:06:59.735579+0000","last_undegraded":"2023-12-19T16:06:59.735579+0000","last_fullsized":"2023-12-19T16:06:59.735579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:08.536543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735494+0000","last_change":"2023-12-19T16:06:58.311956+0000","last_active":"2023-12-19T16:06:59.735494+0000","last_peered":"2023-12-19T16:06:59.735494+0000","last_clean":"2023-12-19T16:06:59.735494+0000","last_became_active":"2023-12-19T16:06:58.311426+0000","last_became_peered":"2023-12-19T16:06:58.311426+0000","last_unstale":"2023-12-19T16:06:59.735494+0000","last_undegraded":"2023-12-19T16:06:59.735494+0000","last_fullsized":"2023-12-19T16:06:59.735494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429662+0000","last_change":"2023-12-19T16:06:58.751593+0000","last_active":"2023-12-19T16:07:00.429662+0000","last_peered":"2023-12-19T16:07:00.429662+0000","last_clean":"2023-12-19T16:07:00.429662+0000","last_became_active":"2023-12-19T16:06:58.751335+0000","last_became_peered":"2023-12-19T16:06:58.751335+0000","last_unstale":"2023-12-19T16:07:00.429662+0000","last_undegraded":"2023-12-19T16:07:00.429662+0000","last_fullsized":"2023-12-19T16:07:00.429662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735607+0000","last_change":"2023-12-19T16:06:58.310478+0000","last_active":"2023-12-19T16:06:59.735607+0000","last_peered":"2023-12-19T16:06:59.735607+0000","last_clean":"2023-12-19T16:06:59.735607+0000","last_became_active":"2023-12-19T16:06:58.310172+0000","last_became_peered":"2023-12-19T16:06:58.310172+0000","last_unstale":"2023-12-19T16:06:59.735607+0000","last_undegraded":"2023-12-19T16:06:59.735607+0000","last_fullsized":"2023-12-19T16:06:59.735607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429817+0000","last_change":"2023-12-19T16:06:58.745013+0000","last_active":"2023-12-19T16:07:00.429817+0000","last_peered":"2023-12-19T16:07:00.429817+0000","last_clean":"2023-12-19T16:07:00.429817+0000","last_became_active":"2023-12-19T16:06:58.744739+0000","last_became_peered":"2023-12-19T16:06:58.744739+0000","last_unstale":"2023-12-19T16:07:00.429817+0000","last_undegraded":"2023-12-19T16:07:00.429817+0000","last_fullsized":"2023-12-19T16:07:00.429817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:59:45.402539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109787+0000","last_change":"2023-12-19T16:06:58.314931+0000","last_active":"2023-12-19T16:07:01.109787+0000","last_peered":"2023-12-19T16:07:01.109787+0000","last_clean":"2023-12-19T16:07:01.109787+0000","last_became_active":"2023-12-19T16:06:58.314637+0000","last_became_peered":"2023-12-19T16:06:58.314637+0000","last_unstale":"2023-12-19T16:07:01.109787+0000","last_undegraded":"2023-12-19T16:07:01.109787+0000","last_fullsized":"2023-12-19T16:07:01.109787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593737+0000","last_change":"2023-12-19T16:06:58.753329+0000","last_active":"2023-12-19T16:07:00.593737+0000","last_peered":"2023-12-19T16:07:00.593737+0000","last_clean":"2023-12-19T16:07:00.593737+0000","last_became_active":"2023-12-19T16:06:58.749183+0000","last_became_peered":"2023-12-19T16:06:58.749183+0000","last_unstale":"2023-12-19T16:07:00.593737+0000","last_undegraded":"2023-12-19T16:07:00.593737+0000","last_fullsized":"2023-12-19T16:07:00.593737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109649+0000","last_change":"2023-12-19T16:06:58.751468+0000","last_active":"2023-12-19T16:07:01.109649+0000","last_peered":"2023-12-19T16:07:01.109649+0000","last_clean":"2023-12-19T16:07:01.109649+0000","last_became_active":"2023-12-19T16:06:58.750502+0000","last_became_peered":"2023-12-19T16:06:58.750502+0000","last_unstale":"2023-12-19T16:07:01.109649+0000","last_undegraded":"2023-12-19T16:07:01.109649+0000","last_fullsized":"2023-12-19T16:07:01.109649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:59:45.402539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109568+0000","last_change":"2023-12-19T16:06:58.311983+0000","last_active":"2023-12-19T16:07:01.109568+0000","last_peered":"2023-12-19T16:07:01.109568+0000","last_clean":"2023-12-19T16:07:01.109568+0000","last_became_active":"2023-12-19T16:06:58.311706+0000","last_became_peered":"2023-12-19T16:06:58.311706+0000","last_unstale":"2023-12-19T16:07:01.109568+0000","last_undegraded":"2023-12-19T16:07:01.109568+0000","last_fullsized":"2023-12-19T16:07:01.109568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:55.716735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109940+0000","last_change":"2023-12-19T16:06:58.751294+0000","last_active":"2023-12-19T16:07:01.109940+0000","last_peered":"2023-12-19T16:07:01.109940+0000","last_clean":"2023-12-19T16:07:01.109940+0000","last_became_active":"2023-12-19T16:06:58.751039+0000","last_became_peered":"2023-12-19T16:06:58.751039+0000","last_unstale":"2023-12-19T16:07:01.109940+0000","last_undegraded":"2023-12-19T16:07:01.109940+0000","last_fullsized":"2023-12-19T16:07:01.109940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:08:43.126506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109669+0000","last_change":"2023-12-19T16:06:58.309418+0000","last_active":"2023-12-19T16:07:01.109669+0000","last_peered":"2023-12-19T16:07:01.109669+0000","last_clean":"2023-12-19T16:07:01.109669+0000","last_became_active":"2023-12-19T16:06:58.309108+0000","last_became_peered":"2023-12-19T16:06:58.309108+0000","last_unstale":"2023-12-19T16:07:01.109669+0000","last_undegraded":"2023-12-19T16:07:01.109669+0000","last_fullsized":"2023-12-19T16:07:01.109669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:06.572806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466323+0000","last_change":"2023-12-19T16:06:58.755879+0000","last_active":"2023-12-19T16:07:00.466323+0000","last_peered":"2023-12-19T16:07:00.466323+0000","last_clean":"2023-12-19T16:07:00.466323+0000","last_became_active":"2023-12-19T16:06:58.755019+0000","last_became_peered":"2023-12-19T16:06:58.755019+0000","last_unstale":"2023-12-19T16:07:00.466323+0000","last_undegraded":"2023-12-19T16:07:00.466323+0000","last_fullsized":"2023-12-19T16:07:00.466323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.430019+0000","last_change":"2023-12-19T16:06:58.308088+0000","last_active":"2023-12-19T16:07:00.430019+0000","last_peered":"2023-12-19T16:07:00.430019+0000","last_clean":"2023-12-19T16:07:00.430019+0000","last_became_active":"2023-12-19T16:06:58.307702+0000","last_became_peered":"2023-12-19T16:06:58.307702+0000","last_unstale":"2023-12-19T16:07:00.430019+0000","last_undegraded":"2023-12-19T16:07:00.430019+0000","last_fullsized":"2023-12-19T16:07:00.430019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429908+0000","last_change":"2023-12-19T16:06:58.745962+0000","last_active":"2023-12-19T16:07:00.429908+0000","last_peered":"2023-12-19T16:07:00.429908+0000","last_clean":"2023-12-19T16:07:00.429908+0000","last_became_active":"2023-12-19T16:06:58.745668+0000","last_became_peered":"2023-12-19T16:06:58.745668+0000","last_unstale":"2023-12-19T16:07:00.429908+0000","last_undegraded":"2023-12-19T16:07:00.429908+0000","last_fullsized":"2023-12-19T16:07:00.429908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466374+0000","last_change":"2023-12-19T16:06:58.307135+0000","last_active":"2023-12-19T16:07:00.466374+0000","last_peered":"2023-12-19T16:07:00.466374+0000","last_clean":"2023-12-19T16:07:00.466374+0000","last_became_active":"2023-12-19T16:06:58.306810+0000","last_became_peered":"2023-12-19T16:06:58.306810+0000","last_unstale":"2023-12-19T16:07:00.466374+0000","last_undegraded":"2023-12-19T16:07:00.466374+0000","last_fullsized":"2023-12-19T16:07:00.466374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:35.961254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":790528,"data_stored":655548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":196608,"data_stored":64688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:07:07.091 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T16:07:07.092 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-19T16:07:07.092 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-19T16:07:07.092 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-19T16:07:07.093 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-19T16:07:07.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.231+0000 7f9690238640 1 Processor -- start 2023-12-19T16:07:07.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.231+0000 7f9690238640 1 -- start start 2023-12-19T16:07:07.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.231+0000 7f9690238640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96880bcdd0 0x7f96880b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:07.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.231+0000 7f9690238640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96880b64c0 0x7f9688144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:07.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.231+0000 7f9690238640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96880bc6b0 con 0x7f9688144cd0 2023-12-19T16:07:07.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.231+0000 7f9690238640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96880b6900 con 0x7f96880bcdd0 2023-12-19T16:07:07.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.231+0000 7f9690238640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96880a59f0 con 0x7f96880b64c0 2023-12-19T16:07:07.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.232+0000 7f968dfd4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96880bcdd0 0x7f96880b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:07.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.232+0000 7f968d7d3640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96880b64c0 0x7f9688144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:07.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.232+0000 7f968dfd4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96880bcdd0 0x7f96880b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:40702/0 (socket says 172.21.15.37:40702) 2023-12-19T16:07:07.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.232+0000 7f968dfd4640 1 -- 172.21.15.37:0/2037774024 learned_addr learned my addr 172.21.15.37:0/2037774024 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:07.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.232+0000 7f968d7d3640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96880b64c0 0x7f9688144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:45450/0 (socket says 172.21.15.37:45450) 2023-12-19T16:07:07.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.232+0000 7f968e7d5640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9688144cd0 0x7f968814e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.37:50736/0 (socket says 172.21.15.37:50736) 2023-12-19T16:07:07.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.232+0000 7f968dfd4640 1 -- 172.21.15.37:0/2037774024 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96880b64c0 msgr2=0x7f9688144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:07.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.232+0000 7f968dfd4640 1 --2- 172.21.15.37:0/2037774024 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96880b64c0 0x7f9688144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.232+0000 7f968dfd4640 1 -- 172.21.15.37:0/2037774024 >> v1:172.21.15.78:6789/0 conn(0x7f9688144cd0 legacy=0x7f968814e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:07.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.232+0000 7f968cfd2640 1 -- 172.21.15.37:0/2037774024 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036013866 0 0) 0x7f96880bc6b0 con 0x7f9688144cd0 2023-12-19T16:07:07.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.232+0000 7f968dfd4640 1 -- 172.21.15.37:0/2037774024 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96880bc0a0 con 0x7f96880bcdd0 2023-12-19T16:07:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.233+0000 7f968dfd4640 1 --2- 172.21.15.37:0/2037774024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96880bcdd0 0x7f96880b5f80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9684009870 tx=0x7f968402ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=667ebe23fbf113c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.233+0000 7f968cfd2640 1 -- 172.21.15.37:0/2037774024 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968402f840 con 0x7f96880bcdd0 2023-12-19T16:07:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.233+0000 7f968cfd2640 1 -- 172.21.15.37:0/2037774024 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968402f9a0 con 0x7f96880bcdd0 2023-12-19T16:07:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.233+0000 7f968cfd2640 1 -- 172.21.15.37:0/2037774024 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968402fd30 con 0x7f96880bcdd0 2023-12-19T16:07:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.234+0000 7f9690238640 1 -- 172.21.15.37:0/2037774024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96880bcdd0 msgr2=0x7f96880b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.234+0000 7f9690238640 1 --2- 172.21.15.37:0/2037774024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96880bcdd0 0x7f96880b5f80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9684009870 tx=0x7f968402ba20 comp rx=0 tx=0).stop 2023-12-19T16:07:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.234+0000 7f9690238640 1 -- 172.21.15.37:0/2037774024 shutdown_connections 2023-12-19T16:07:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.234+0000 7f9690238640 1 --2- 172.21.15.37:0/2037774024 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96880b64c0 0x7f9688144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.234+0000 7f9690238640 1 --2- 172.21.15.37:0/2037774024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96880bcdd0 0x7f96880b5f80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.234+0000 7f9690238640 1 -- 172.21.15.37:0/2037774024 >> 172.21.15.37:0/2037774024 conn(0x7f9688071e60 msgr2=0x7f96880c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.234+0000 7f9690238640 1 -- 172.21.15.37:0/2037774024 shutdown_connections 2023-12-19T16:07:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.234+0000 7f9690238640 1 -- 172.21.15.37:0/2037774024 wait complete. 2023-12-19T16:07:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.235+0000 7f9690238640 1 Processor -- start 2023-12-19T16:07:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.235+0000 7f9690238640 1 -- start start 2023-12-19T16:07:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.235+0000 7f9690238640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96880b64c0 0x7f96881d2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.235+0000 7f9690238640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96880bcdd0 0x7f9688148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.235+0000 7f9690238640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9688144cd0 0x7f96881e0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.235+0000 7f9690238640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96881d2b60 con 0x7f96880bcdd0 2023-12-19T16:07:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.235+0000 7f9690238640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96881491a0 con 0x7f9688144cd0 2023-12-19T16:07:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.235+0000 7f9690238640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9688148d90 con 0x7f96880b64c0 2023-12-19T16:07:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.235+0000 7f968d7d3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96880bcdd0 0x7f9688148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.235+0000 7f968d7d3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96880bcdd0 0x7f9688148850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49458/0 (socket says 172.21.15.37:49458) 2023-12-19T16:07:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.235+0000 7f968d7d3640 1 -- 172.21.15.37:0/974911904 learned_addr learned my addr 172.21.15.37:0/974911904 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.235+0000 7f968dfd4640 1 --2- 172.21.15.37:0/974911904 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96880b64c0 0x7f96881d2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.236+0000 7f968e7d5640 1 --2- 172.21.15.37:0/974911904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9688144cd0 0x7f96881e0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.236+0000 7f968d7d3640 1 -- 172.21.15.37:0/974911904 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96880b64c0 msgr2=0x7f96881d2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.236+0000 7f968d7d3640 1 --2- 172.21.15.37:0/974911904 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96880b64c0 0x7f96881d2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.236+0000 7f968d7d3640 1 -- 172.21.15.37:0/974911904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9688144cd0 msgr2=0x7f96881e0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.236+0000 7f968d7d3640 1 --2- 172.21.15.37:0/974911904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9688144cd0 0x7f96881e0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.236+0000 7f968d7d3640 1 -- 172.21.15.37:0/974911904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96840094d0 con 0x7f96880bcdd0 2023-12-19T16:07:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.236+0000 7f968d7d3640 1 --2- 172.21.15.37:0/974911904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96880bcdd0 0x7f9688148850 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f967800e9b0 tx=0x7f967800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.236+0000 7f967e7fc640 1 -- 172.21.15.37:0/974911904 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678009670 con 0x7f96880bcdd0 2023-12-19T16:07:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.236+0000 7f967e7fc640 1 -- 172.21.15.37:0/974911904 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967800c9a0 con 0x7f96880bcdd0 2023-12-19T16:07:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.236+0000 7f9690238640 1 -- 172.21.15.37:0/974911904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96881d1f20 con 0x7f96880bcdd0 2023-12-19T16:07:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.236+0000 7f967e7fc640 1 -- 172.21.15.37:0/974911904 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967800cd50 con 0x7f96880bcdd0 2023-12-19T16:07:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.236+0000 7f9690238640 1 -- 172.21.15.37:0/974911904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96881d1140 con 0x7f96880bcdd0 2023-12-19T16:07:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.237+0000 7f9690238640 1 -- 172.21.15.37:0/974911904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968804e840 con 0x7f96880bcdd0 2023-12-19T16:07:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.238+0000 7f967e7fc640 1 -- 172.21.15.37:0/974911904 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9678013470 con 0x7f96880bcdd0 2023-12-19T16:07:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.238+0000 7f967e7fc640 1 --2- 172.21.15.37:0/974911904 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f966c06a430 0x7f966c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.238+0000 7f967e7fc640 1 -- 172.21.15.37:0/974911904 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9678088a60 con 0x7f96880bcdd0 2023-12-19T16:07:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.238+0000 7f968dfd4640 1 --2- 172.21.15.37:0/974911904 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f966c06a430 0x7f966c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.239+0000 7f968dfd4640 1 --2- 172.21.15.37:0/974911904 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f966c06a430 0x7f966c06c8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9684036000 tx=0x7f9684008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:07.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.242+0000 7f967e7fc640 1 -- 172.21.15.37:0/974911904 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9678054190 con 0x7f96880bcdd0 2023-12-19T16:07:07.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.465+0000 7f9690238640 1 -- 172.21.15.37:0/974911904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f96881440b0 con 0x7f96880bcdd0 2023-12-19T16:07:07.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.468+0000 7f967e7fc640 1 -- 172.21.15.37:0/974911904 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169962 (secure 0 0 0) 0x7f9678017090 con 0x7f96880bcdd0 2023-12-19T16:07:07.473 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.470+0000 7f9690238640 1 -- 172.21.15.37:0/974911904 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f966c06a430 msgr2=0x7f966c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.470+0000 7f9690238640 1 --2- 172.21.15.37:0/974911904 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f966c06a430 0x7f966c06c8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9684036000 tx=0x7f9684008030 comp rx=0 tx=0).stop 2023-12-19T16:07:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.470+0000 7f9690238640 1 -- 172.21.15.37:0/974911904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96880bcdd0 msgr2=0x7f9688148850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.470+0000 7f9690238640 1 --2- 172.21.15.37:0/974911904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96880bcdd0 0x7f9688148850 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f967800e9b0 tx=0x7f967800ee70 comp rx=0 tx=0).stop 2023-12-19T16:07:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.470+0000 7f9690238640 1 -- 172.21.15.37:0/974911904 shutdown_connections 2023-12-19T16:07:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.470+0000 7f9690238640 1 --2- 172.21.15.37:0/974911904 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f966c06a430 0x7f966c06c8f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.470+0000 7f9690238640 1 --2- 172.21.15.37:0/974911904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9688144cd0 0x7f96881e0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.470+0000 7f9690238640 1 --2- 172.21.15.37:0/974911904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96880bcdd0 0x7f9688148850 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.470+0000 7f9690238640 1 --2- 172.21.15.37:0/974911904 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96880b64c0 0x7f96881d2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.470+0000 7f9690238640 1 -- 172.21.15.37:0/974911904 >> 172.21.15.37:0/974911904 conn(0x7f9688071e60 msgr2=0x7f9688141280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.471+0000 7f9690238640 1 -- 172.21.15.37:0/974911904 shutdown_connections 2023-12-19T16:07:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.471+0000 7f9690238640 1 -- 172.21.15.37:0/974911904 wait complete. 2023-12-19T16:07:07.484 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":88890},{"type":"v1","addr":"172.21.15.78:6833","nonce":88890}]},"active_addr":"172.21.15.78:6833/88890","active_change":"2023-12-19T16:06:38.616439+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":2540907236}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":2589988182}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":586719214}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":1265311549}]}]} 2023-12-19T16:07:07.488 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-19T16:07:07.488 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-19T16:07:07.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:07:07.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.592+0000 7fc56bc43640 1 Processor -- start 2023-12-19T16:07:07.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.592+0000 7fc56bc43640 1 -- start start 2023-12-19T16:07:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.592+0000 7fc56bc43640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5640bcdd0 0x7fc5640b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.592+0000 7fc56bc43640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5640b64c0 0x7fc564144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.592+0000 7fc56bc43640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc564144cd0 0x7fc56414e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.592+0000 7fc56bc43640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5640bc6b0 con 0x7fc5640bcdd0 2023-12-19T16:07:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.592+0000 7fc56bc43640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5640b6900 con 0x7fc564144cd0 2023-12-19T16:07:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.592+0000 7fc56bc43640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640a59f0 con 0x7fc5640b64c0 2023-12-19T16:07:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.592+0000 7fc5699df640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5640bcdd0 0x7fc5640b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.593+0000 7fc5699df640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5640bcdd0 0x7fc5640b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49470/0 (socket says 172.21.15.37:49470) 2023-12-19T16:07:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.593+0000 7fc5699df640 1 -- 172.21.15.37:0/1011851872 learned_addr learned my addr 172.21.15.37:0/1011851872 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.593+0000 7fc56a1e0640 1 --2- 172.21.15.37:0/1011851872 >> v2:172.21.15.78:3300/0 conn(0x7fc564144cd0 0x7fc56414e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:07.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.593+0000 7fc5699df640 1 -- 172.21.15.37:0/1011851872 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5640b64c0 msgr2=0x7fc564144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.593+0000 7fc5691de640 1 --2- 172.21.15.37:0/1011851872 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5640b64c0 0x7fc564144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.593+0000 7fc5699df640 1 --2- 172.21.15.37:0/1011851872 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5640b64c0 0x7fc564144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.593+0000 7fc5699df640 1 -- 172.21.15.37:0/1011851872 >> v2:172.21.15.78:3300/0 conn(0x7fc564144cd0 msgr2=0x7fc56414e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.593+0000 7fc5699df640 1 --2- 172.21.15.37:0/1011851872 >> v2:172.21.15.78:3300/0 conn(0x7fc564144cd0 0x7fc56414e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.593+0000 7fc5699df640 1 -- 172.21.15.37:0/1011851872 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5640bc0a0 con 0x7fc5640bcdd0 2023-12-19T16:07:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.593+0000 7fc56a1e0640 1 --2- 172.21.15.37:0/1011851872 >> v2:172.21.15.78:3300/0 conn(0x7fc564144cd0 0x7fc56414e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.594+0000 7fc5699df640 1 --2- 172.21.15.37:0/1011851872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5640bcdd0 0x7fc5640b5f80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc5641486d0 tx=0x7fc56002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f993850ca1d858b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.594+0000 7fc5689dd640 1 -- 172.21.15.37:0/1011851872 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560030860 con 0x7fc5640bcdd0 2023-12-19T16:07:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.594+0000 7fc5689dd640 1 -- 172.21.15.37:0/1011851872 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5600309c0 con 0x7fc5640bcdd0 2023-12-19T16:07:07.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.594+0000 7fc5689dd640 1 -- 172.21.15.37:0/1011851872 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560030d50 con 0x7fc5640bcdd0 2023-12-19T16:07:07.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.594+0000 7fc56bc43640 1 -- 172.21.15.37:0/1011851872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5640bcdd0 msgr2=0x7fc5640b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:07.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.594+0000 7fc56bc43640 1 --2- 172.21.15.37:0/1011851872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5640bcdd0 0x7fc5640b5f80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc5641486d0 tx=0x7fc56002b9a0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.594+0000 7fc56bc43640 1 -- 172.21.15.37:0/1011851872 shutdown_connections 2023-12-19T16:07:07.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.594+0000 7fc56bc43640 1 --2- 172.21.15.37:0/1011851872 >> v2:172.21.15.78:3300/0 conn(0x7fc564144cd0 0x7fc56414e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.594+0000 7fc56bc43640 1 --2- 172.21.15.37:0/1011851872 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5640b64c0 0x7fc564144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.594+0000 7fc56bc43640 1 --2- 172.21.15.37:0/1011851872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5640bcdd0 0x7fc5640b5f80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.594+0000 7fc56bc43640 1 -- 172.21.15.37:0/1011851872 >> 172.21.15.37:0/1011851872 conn(0x7fc564071e60 msgr2=0x7fc5640c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.594+0000 7fc56bc43640 1 -- 172.21.15.37:0/1011851872 shutdown_connections 2023-12-19T16:07:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.594+0000 7fc56bc43640 1 -- 172.21.15.37:0/1011851872 wait complete. 2023-12-19T16:07:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.595+0000 7fc56bc43640 1 Processor -- start 2023-12-19T16:07:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.596+0000 7fc56bc43640 1 -- start start 2023-12-19T16:07:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.596+0000 7fc56bc43640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5640b64c0 0x7fc56413e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.596+0000 7fc56bc43640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5640bcdd0 0x7fc5641e3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.596+0000 7fc56bc43640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc564144cd0 0x7fc5640bae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:07.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.596+0000 7fc56bc43640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5641e09b0 con 0x7fc5640bcdd0 2023-12-19T16:07:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.596+0000 7fc56bc43640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5641e32c0 con 0x7fc564144cd0 2023-12-19T16:07:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.596+0000 7fc56bc43640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc564146b90 con 0x7fc5640b64c0 2023-12-19T16:07:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.596+0000 7fc5691de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5640bcdd0 0x7fc5641e3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.596+0000 7fc5691de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5640bcdd0 0x7fc5641e3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49472/0 (socket says 172.21.15.37:49472) 2023-12-19T16:07:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.596+0000 7fc5691de640 1 -- 172.21.15.37:0/3053995967 learned_addr learned my addr 172.21.15.37:0/3053995967 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.597+0000 7fc56a1e0640 1 --2- 172.21.15.37:0/3053995967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc564144cd0 0x7fc5640bae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.597+0000 7fc5699df640 1 --2- 172.21.15.37:0/3053995967 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5640b64c0 0x7fc56413e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.597+0000 7fc5691de640 1 -- 172.21.15.37:0/3053995967 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5640b64c0 msgr2=0x7fc56413e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.597+0000 7fc5691de640 1 --2- 172.21.15.37:0/3053995967 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5640b64c0 0x7fc56413e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.597+0000 7fc5691de640 1 -- 172.21.15.37:0/3053995967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc564144cd0 msgr2=0x7fc5640bae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.597+0000 7fc5691de640 1 --2- 172.21.15.37:0/3053995967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc564144cd0 0x7fc5640bae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.597+0000 7fc5691de640 1 -- 172.21.15.37:0/3053995967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5600094d0 con 0x7fc5640bcdd0 2023-12-19T16:07:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.597+0000 7fc5691de640 1 --2- 172.21.15.37:0/3053995967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5640bcdd0 0x7fc5641e3750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc55400c850 tx=0x7fc55400cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.597+0000 7fc55a7fc640 1 -- 172.21.15.37:0/3053995967 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554004020 con 0x7fc5640bcdd0 2023-12-19T16:07:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.597+0000 7fc55a7fc640 1 -- 172.21.15.37:0/3053995967 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5540041a0 con 0x7fc5640bcdd0 2023-12-19T16:07:07.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.597+0000 7fc56bc43640 1 -- 172.21.15.37:0/3053995967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5641e2f70 con 0x7fc5640bcdd0 2023-12-19T16:07:07.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.597+0000 7fc55a7fc640 1 -- 172.21.15.37:0/3053995967 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554007830 con 0x7fc5640bcdd0 2023-12-19T16:07:07.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.597+0000 7fc56bc43640 1 -- 172.21.15.37:0/3053995967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc564145c00 con 0x7fc5640bcdd0 2023-12-19T16:07:07.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.598+0000 7fc56bc43640 1 -- 172.21.15.37:0/3053995967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56404e840 con 0x7fc5640bcdd0 2023-12-19T16:07:07.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.598+0000 7fc55a7fc640 1 -- 172.21.15.37:0/3053995967 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc554007990 con 0x7fc5640bcdd0 2023-12-19T16:07:07.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.599+0000 7fc55a7fc640 1 --2- 172.21.15.37:0/3053995967 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc54806a460 0x7fc54806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:07.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.599+0000 7fc55a7fc640 1 -- 172.21.15.37:0/3053995967 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc554088630 con 0x7fc5640bcdd0 2023-12-19T16:07:07.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.599+0000 7fc5699df640 1 --2- 172.21.15.37:0/3053995967 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc54806a460 0x7fc54806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:07.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.600+0000 7fc5699df640 1 --2- 172.21.15.37:0/3053995967 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc54806a460 0x7fc54806c920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc560036000 tx=0x7fc56003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:07.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.603+0000 7fc55a7fc640 1 -- 172.21.15.37:0/3053995967 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc554053cb0 con 0x7fc5640bcdd0 2023-12-19T16:07:07.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.780+0000 7fc56bc43640 1 -- 172.21.15.37:0/3053995967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc564145df0 con 0x7fc5640bcdd0 2023-12-19T16:07:07.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.781+0000 7fc55a7fc640 1 -- 172.21.15.37:0/3053995967 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7fc5540572d0 con 0x7fc5640bcdd0 2023-12-19T16:07:07.784 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:07.785 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:59.728935+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:06:56.758166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:06:57.635291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:07:07.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.784+0000 7fc56bc43640 1 -- 172.21.15.37:0/3053995967 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc54806a460 msgr2=0x7fc54806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:07.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.784+0000 7fc56bc43640 1 --2- 172.21.15.37:0/3053995967 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc54806a460 0x7fc54806c920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc560036000 tx=0x7fc56003b040 comp rx=0 tx=0).stop 2023-12-19T16:07:07.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.784+0000 7fc56bc43640 1 -- 172.21.15.37:0/3053995967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5640bcdd0 msgr2=0x7fc5641e3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:07.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.784+0000 7fc56bc43640 1 --2- 172.21.15.37:0/3053995967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5640bcdd0 0x7fc5641e3750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc55400c850 tx=0x7fc55400cd10 comp rx=0 tx=0).stop 2023-12-19T16:07:07.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.784+0000 7fc56bc43640 1 -- 172.21.15.37:0/3053995967 shutdown_connections 2023-12-19T16:07:07.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.784+0000 7fc56bc43640 1 --2- 172.21.15.37:0/3053995967 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc54806a460 0x7fc54806c920 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.784+0000 7fc56bc43640 1 --2- 172.21.15.37:0/3053995967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc564144cd0 0x7fc5640bae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.784+0000 7fc56bc43640 1 --2- 172.21.15.37:0/3053995967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5640bcdd0 0x7fc5641e3750 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.784+0000 7fc56bc43640 1 --2- 172.21.15.37:0/3053995967 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc5640b64c0 0x7fc56413e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.784+0000 7fc56bc43640 1 -- 172.21.15.37:0/3053995967 >> 172.21.15.37:0/3053995967 conn(0x7fc564071e60 msgr2=0x7fc5641425a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:07.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.784+0000 7fc56bc43640 1 -- 172.21.15.37:0/3053995967 shutdown_connections 2023-12-19T16:07:07.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.784+0000 7fc56bc43640 1 -- 172.21.15.37:0/3053995967 wait complete. 2023-12-19T16:07:07.797 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-19T16:07:07.797 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:07:07.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.900+0000 7f808c9a2640 1 Processor -- start 2023-12-19T16:07:07.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.900+0000 7f808c9a2640 1 -- start start 2023-12-19T16:07:07.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.902+0000 7f808c9a2640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80880b6860 0x7f80880b9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:07.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.902+0000 7f808c9a2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80880b6f50 0x7f80880ba0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:07.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.902+0000 7f808c9a2640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80880bc360 con 0x7f80881333e0 2023-12-19T16:07:07.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.902+0000 7f808c9a2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f808814ac10 con 0x7f80880b6f50 2023-12-19T16:07:07.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.902+0000 7f808c9a2640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808814aef0 con 0x7f80880b6860 2023-12-19T16:07:07.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.902+0000 7f8086ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80880b6f50 0x7f80880ba0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:07.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.902+0000 7f8086ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80880b6f50 0x7f80880ba0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49482/0 (socket says 172.21.15.37:49482) 2023-12-19T16:07:07.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.902+0000 7f8086ffd640 1 -- 172.21.15.37:0/646553046 learned_addr learned my addr 172.21.15.37:0/646553046 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:07.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.902+0000 7f80877fe640 1 --2- 172.21.15.37:0/646553046 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80880b6860 0x7f80880b9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:07.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.902+0000 7f8086ffd640 1 -- 172.21.15.37:0/646553046 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80880b6860 msgr2=0x7f80880b9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:07.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.902+0000 7f8086ffd640 1 --2- 172.21.15.37:0/646553046 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80880b6860 0x7f80880b9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.902+0000 7f8086ffd640 1 -- 172.21.15.37:0/646553046 >> v1:172.21.15.78:6789/0 conn(0x7f80881333e0 legacy=0x7f80880b50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:07.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.902+0000 7f8086ffd640 1 -- 172.21.15.37:0/646553046 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808814b1d0 con 0x7f80880b6f50 2023-12-19T16:07:07.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.902+0000 7f80877fe640 1 --2- 172.21.15.37:0/646553046 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80880b6860 0x7f80880b9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:07.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.902+0000 7f8086ffd640 1 --2- 172.21.15.37:0/646553046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80880b6f50 0x7f80880ba0c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f807c009870 tx=0x7f807c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ae829733486d3e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:07.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.902+0000 7f80867fc640 1 -- 172.21.15.37:0/646553046 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c02f840 con 0x7f80880b6f50 2023-12-19T16:07:07.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.902+0000 7f80867fc640 1 -- 172.21.15.37:0/646553046 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807c02f9a0 con 0x7f80880b6f50 2023-12-19T16:07:07.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.902+0000 7f80867fc640 1 -- 172.21.15.37:0/646553046 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c02fd30 con 0x7f80880b6f50 2023-12-19T16:07:07.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.903+0000 7f808c9a2640 1 -- 172.21.15.37:0/646553046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80880b6f50 msgr2=0x7f80880ba0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:07.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.903+0000 7f808c9a2640 1 --2- 172.21.15.37:0/646553046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80880b6f50 0x7f80880ba0c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f807c009870 tx=0x7f807c02ba20 comp rx=0 tx=0).stop 2023-12-19T16:07:07.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.903+0000 7f808c9a2640 1 -- 172.21.15.37:0/646553046 shutdown_connections 2023-12-19T16:07:07.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.903+0000 7f808c9a2640 1 --2- 172.21.15.37:0/646553046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80880b6f50 0x7f80880ba0c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.903+0000 7f808c9a2640 1 --2- 172.21.15.37:0/646553046 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80880b6860 0x7f80880b9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.903+0000 7f808c9a2640 1 -- 172.21.15.37:0/646553046 >> 172.21.15.37:0/646553046 conn(0x7f80880c0030 msgr2=0x7f80880c0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:07.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.903+0000 7f808c9a2640 1 -- 172.21.15.37:0/646553046 shutdown_connections 2023-12-19T16:07:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.903+0000 7f808c9a2640 1 -- 172.21.15.37:0/646553046 wait complete. 2023-12-19T16:07:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.904+0000 7f808c9a2640 1 Processor -- start 2023-12-19T16:07:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.904+0000 7f808c9a2640 1 -- start start 2023-12-19T16:07:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f808c9a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80880b6860 0x7f808814cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f808c9a2640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80880b6f50 0x7f8088145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f808c9a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80881333e0 0x7f80881467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f808c9a2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8088146d30 con 0x7f80880b6860 2023-12-19T16:07:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f808c9a2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80881460d0 con 0x7f80881333e0 2023-12-19T16:07:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f808c9a2640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8088144e00 con 0x7f80880b6f50 2023-12-19T16:07:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f80877fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80880b6860 0x7f808814cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f80877fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80880b6860 0x7f808814cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49488/0 (socket says 172.21.15.37:49488) 2023-12-19T16:07:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f80877fe640 1 -- 172.21.15.37:0/946891756 learned_addr learned my addr 172.21.15.37:0/946891756 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f8086ffd640 1 --2- 172.21.15.37:0/946891756 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80880b6f50 0x7f8088145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f8087fff640 1 --2- 172.21.15.37:0/946891756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80881333e0 0x7f80881467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:07.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f80877fe640 1 -- 172.21.15.37:0/946891756 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80880b6f50 msgr2=0x7f8088145570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:07.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f80877fe640 1 --2- 172.21.15.37:0/946891756 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80880b6f50 0x7f8088145570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f80877fe640 1 -- 172.21.15.37:0/946891756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80881333e0 msgr2=0x7f80881467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:07.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f80877fe640 1 --2- 172.21.15.37:0/946891756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80881333e0 0x7f80881467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:07.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f80877fe640 1 -- 172.21.15.37:0/946891756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807c0094d0 con 0x7f80880b6860 2023-12-19T16:07:07.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f8086ffd640 1 --2- 172.21.15.37:0/946891756 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80880b6f50 0x7f8088145570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:07.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f8087fff640 1 --2- 172.21.15.37:0/946891756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80881333e0 0x7f80881467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:07.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f80877fe640 1 --2- 172.21.15.37:0/946891756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80880b6860 0x7f808814cbe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f807800c7f0 tx=0x7f807800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:07.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f806ffff640 1 -- 172.21.15.37:0/946891756 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80780079d0 con 0x7f80880b6860 2023-12-19T16:07:07.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f806ffff640 1 -- 172.21.15.37:0/946891756 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8078007b30 con 0x7f80880b6860 2023-12-19T16:07:07.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f806ffff640 1 -- 172.21.15.37:0/946891756 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807800ce40 con 0x7f80880b6860 2023-12-19T16:07:07.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f808c9a2640 1 -- 172.21.15.37:0/946891756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808814eb40 con 0x7f80880b6860 2023-12-19T16:07:07.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.905+0000 7f808c9a2640 1 -- 172.21.15.37:0/946891756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8088140680 con 0x7f80880b6860 2023-12-19T16:07:07.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.906+0000 7f808c9a2640 1 -- 172.21.15.37:0/946891756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8088061880 con 0x7f80880b6860 2023-12-19T16:07:07.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.907+0000 7f806ffff640 1 -- 172.21.15.37:0/946891756 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f80780113f0 con 0x7f80880b6860 2023-12-19T16:07:07.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.907+0000 7f806ffff640 1 --2- 172.21.15.37:0/946891756 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f807406a430 0x7f807406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:07.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.907+0000 7f806ffff640 1 -- 172.21.15.37:0/946891756 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8078088a50 con 0x7f80880b6860 2023-12-19T16:07:07.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.908+0000 7f8086ffd640 1 --2- 172.21.15.37:0/946891756 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f807406a430 0x7f807406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:07.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.908+0000 7f8086ffd640 1 --2- 172.21.15.37:0/946891756 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f807406a430 0x7f807406c8f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f807c036000 tx=0x7f807c039040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:07.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:07.912+0000 7f806ffff640 1 -- 172.21.15.37:0/946891756 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f80780540d0 con 0x7f80880b6860 2023-12-19T16:07:08.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.090+0000 7f808c9a2640 1 -- 172.21.15.37:0/946891756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80881481e0 con 0x7f80880b6860 2023-12-19T16:07:08.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.091+0000 7f806ffff640 1 -- 172.21.15.37:0/946891756 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f807801f090 con 0x7f80880b6860 2023-12-19T16:07:08.094 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:08.094 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:59.728935+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:06:56.758166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:06:57.635291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:07:08.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.093+0000 7f808c9a2640 1 -- 172.21.15.37:0/946891756 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f807406a430 msgr2=0x7f807406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.093+0000 7f808c9a2640 1 --2- 172.21.15.37:0/946891756 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f807406a430 0x7f807406c8f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f807c036000 tx=0x7f807c039040 comp rx=0 tx=0).stop 2023-12-19T16:07:08.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.093+0000 7f808c9a2640 1 -- 172.21.15.37:0/946891756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80880b6860 msgr2=0x7f808814cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.093+0000 7f808c9a2640 1 --2- 172.21.15.37:0/946891756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80880b6860 0x7f808814cbe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f807800c7f0 tx=0x7f807800cbf0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.093+0000 7f808c9a2640 1 -- 172.21.15.37:0/946891756 shutdown_connections 2023-12-19T16:07:08.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.093+0000 7f808c9a2640 1 --2- 172.21.15.37:0/946891756 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f807406a430 0x7f807406c8f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.093+0000 7f808c9a2640 1 --2- 172.21.15.37:0/946891756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80881333e0 0x7f80881467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.093+0000 7f808c9a2640 1 --2- 172.21.15.37:0/946891756 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80880b6f50 0x7f8088145570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.093+0000 7f808c9a2640 1 --2- 172.21.15.37:0/946891756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80880b6860 0x7f808814cbe0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.093+0000 7f808c9a2640 1 -- 172.21.15.37:0/946891756 >> 172.21.15.37:0/946891756 conn(0x7f80880c0030 msgr2=0x7f8088148450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.093+0000 7f808c9a2640 1 -- 172.21.15.37:0/946891756 shutdown_connections 2023-12-19T16:07:08.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.093+0000 7f808c9a2640 1 -- 172.21.15.37:0/946891756 wait complete. 2023-12-19T16:07:08.107 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-19T16:07:08.107 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-19T16:07:08.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-19T16:07:08.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-19T16:07:08.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-19T16:07:08.109 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-19T16:07:08.109 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-19T16:07:08.110 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-19T16:07:08.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.286+0000 7fe54022c640 1 Processor -- start 2023-12-19T16:07:08.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.287+0000 7fe54022c640 1 -- start start 2023-12-19T16:07:08.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.287+0000 7efef845c640 1 Processor -- start 2023-12-19T16:07:08.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.287+0000 7efef845c640 1 -- start start 2023-12-19T16:07:08.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.288+0000 7fe54022c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe5300078b0 0x7fe5300062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.288+0000 7fe54022c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe530007fc0 0x7fe5300d8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.288+0000 7fe54022c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53003c6b0 con 0x7fe5300d90b0 2023-12-19T16:07:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.288+0000 7fe54022c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe530006a00 con 0x7fe5300078b0 2023-12-19T16:07:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.288+0000 7fe54022c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53003b2d0 con 0x7fe530007fc0 2023-12-19T16:07:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.288+0000 7fe53dfc8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe5300078b0 0x7fe5300062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.288+0000 7fe53dfc8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe5300078b0 0x7fe5300062c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49490/0 (socket says 172.21.15.37:49490) 2023-12-19T16:07:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.288+0000 7fe53dfc8640 1 -- 172.21.15.37:0/2259019460 learned_addr learned my addr 172.21.15.37:0/2259019460 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.288+0000 7efef845c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efef00b3900 0x7efef00bb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.288+0000 7fe53d7c7640 1 --2- 172.21.15.37:0/2259019460 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe530007fc0 0x7fe5300d8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.288+0000 7efef61f8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efef006a470 0x7efef0148040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37028/0 (socket says 172.21.15.37:37028) 2023-12-19T16:07:08.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.289+0000 7fe53cfc6640 1 -- 172.21.15.37:0/2259019460 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289358455 0 0) 0x7fe53003c6b0 con 0x7fe5300d90b0 2023-12-19T16:07:08.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.289+0000 7fe53cfc6640 1 -- 172.21.15.37:0/2259019460 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe524003520 con 0x7fe5300d90b0 2023-12-19T16:07:08.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.289+0000 7efef59f7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efef00b3900 0x7efef00bb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.289+0000 7efef59f7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efef00b3900 0x7efef00bb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49498/0 (socket says 172.21.15.37:49498) 2023-12-19T16:07:08.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.289+0000 7efef59f7640 1 -- 172.21.15.37:0/2436354787 learned_addr learned my addr 172.21.15.37:0/2436354787 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.289+0000 7fe53dfc8640 1 -- 172.21.15.37:0/2259019460 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe530007fc0 msgr2=0x7fe5300d8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.289+0000 7fe53dfc8640 1 --2- 172.21.15.37:0/2259019460 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe530007fc0 0x7fe5300d8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.289+0000 7fe53dfc8640 1 -- 172.21.15.37:0/2259019460 >> v1:172.21.15.78:6789/0 conn(0x7fe5300d90b0 legacy=0x7fe5300cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.289+0000 7fe53dfc8640 1 -- 172.21.15.37:0/2259019460 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53003bfb0 con 0x7fe5300078b0 2023-12-19T16:07:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.289+0000 7efef845c640 1 --2- 172.21.15.37:0/2436354787 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efef014abd0 0x7efef0155400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.289+0000 7efef845c640 1 -- 172.21.15.37:0/2436354787 --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef00bae20 con 0x7efef006a470 2023-12-19T16:07:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.289+0000 7efef845c640 1 -- 172.21.15.37:0/2436354787 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef00c1220 con 0x7efef00b3900 2023-12-19T16:07:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.289+0000 7efef845c640 1 -- 172.21.15.37:0/2436354787 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef00bf900 con 0x7efef014abd0 2023-12-19T16:07:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.289+0000 7efef69f9640 1 --2- 172.21.15.37:0/2436354787 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efef014abd0 0x7efef0155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.289+0000 7efef69f9640 1 -- 172.21.15.37:0/2436354787 >> v2:172.21.15.37:3300/0 conn(0x7efef00b3900 msgr2=0x7efef00bb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.289+0000 7efef69f9640 1 --2- 172.21.15.37:0/2436354787 >> v2:172.21.15.37:3300/0 conn(0x7efef00b3900 0x7efef00bb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.289+0000 7efef69f9640 1 -- 172.21.15.37:0/2436354787 >> v1:172.21.15.37:6789/0 conn(0x7efef006a470 legacy=0x7efef0148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.289+0000 7efef69f9640 1 -- 172.21.15.37:0/2436354787 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef014b080 con 0x7efef014abd0 2023-12-19T16:07:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.290+0000 7f5cdbe82640 1 Processor -- start 2023-12-19T16:07:08.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.290+0000 7fe53dfc8640 1 --2- 172.21.15.37:0/2259019460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5300078b0 0x7fe5300062c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe534009870 tx=0x7fe53402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2af46e6982a6cb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.290+0000 7f5cdbe82640 1 -- start start 2023-12-19T16:07:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.291+0000 7f3a5f1ef640 1 Processor -- start 2023-12-19T16:07:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.291+0000 7f5cdbe82640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5cd41488c0 0x7f5cd4070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.291+0000 7f5cdbe82640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5cd4148ce0 0x7f5cd4153180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.291+0000 7f5cdbe82640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd40b80e0 con 0x7f5cd40b7d00 2023-12-19T16:07:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.291+0000 7f5cdbe82640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd40b44f0 con 0x7f5cd4148ce0 2023-12-19T16:07:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.291+0000 7f5cdbe82640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd40b5640 con 0x7f5cd41488c0 2023-12-19T16:07:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.291+0000 7efef69f9640 1 --2- 172.21.15.37:0/2436354787 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efef014abd0 0x7efef0155400 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efee8009dc0 tx=0x7efee802be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89e8d64f82fafa7c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.291+0000 7efef51f6640 1 -- 172.21.15.37:0/2436354787 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee802cc40 con 0x7efef014abd0 2023-12-19T16:07:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.291+0000 7efef51f6640 1 -- 172.21.15.37:0/2436354787 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee802cda0 con 0x7efef014abd0 2023-12-19T16:07:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.291+0000 7efef51f6640 1 -- 172.21.15.37:0/2436354787 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee8034660 con 0x7efef014abd0 2023-12-19T16:07:08.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.291+0000 7f5cd9c1e640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5cd40b7d00 0x7f5cd40b3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.37:50762/0 (socket says 172.21.15.37:50762) 2023-12-19T16:07:08.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.291+0000 7f5cd9c1e640 1 -- 172.21.15.37:0/2717264549 learned_addr learned my addr 172.21.15.37:0/2717264549 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:08.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.291+0000 7f5cda41f640 1 --2- 172.21.15.37:0/2717264549 >> v2:172.21.15.37:3300/0 conn(0x7f5cd4148ce0 0x7f5cd4153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.292+0000 7f5cd941d640 1 --2- 172.21.15.37:0/2717264549 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5cd41488c0 0x7f5cd4070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.292+0000 7fb7af59e640 1 Processor -- start 2023-12-19T16:07:08.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.292+0000 7fb7af59e640 1 -- start start 2023-12-19T16:07:08.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.291+0000 7f3a5f1ef640 1 -- start start 2023-12-19T16:07:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.292+0000 7f5cda41f640 1 -- 172.21.15.37:0/2717264549 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5cd41488c0 msgr2=0x7f5cd4070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.292+0000 7f5cda41f640 1 --2- 172.21.15.37:0/2717264549 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5cd41488c0 0x7f5cd4070d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.292+0000 7f5cda41f640 1 -- 172.21.15.37:0/2717264549 >> v1:172.21.15.78:6789/0 conn(0x7f5cd40b7d00 legacy=0x7f5cd40b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.292+0000 7f5cda41f640 1 -- 172.21.15.37:0/2717264549 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd40b5920 con 0x7f5cd4148ce0 2023-12-19T16:07:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.292+0000 7efef845c640 1 -- 172.21.15.37:0/2436354787 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efef014abd0 msgr2=0x7efef0155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.292+0000 7f5cd941d640 1 --2- 172.21.15.37:0/2717264549 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5cd41488c0 0x7f5cd4070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.292+0000 7efef845c640 1 --2- 172.21.15.37:0/2436354787 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efef014abd0 0x7efef0155400 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efee8009dc0 tx=0x7efee802be90 comp rx=0 tx=0).stop 2023-12-19T16:07:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.292+0000 7fe53cfc6640 1 -- 172.21.15.37:0/2259019460 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe534030860 con 0x7fe5300078b0 2023-12-19T16:07:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.292+0000 7fe53cfc6640 1 -- 172.21.15.37:0/2259019460 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5340309c0 con 0x7fe5300078b0 2023-12-19T16:07:08.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.292+0000 7fe53cfc6640 1 -- 172.21.15.37:0/2259019460 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe534030d50 con 0x7fe5300078b0 2023-12-19T16:07:08.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.292+0000 7f3a5f1ef640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3a5003c160 0x7f3a500da8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.292+0000 7f3a5d9ec640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3a5003b370 0x7f3a500c9060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.37:50772/0 (socket says 172.21.15.37:50772) 2023-12-19T16:07:08.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.292+0000 7f3a5d9ec640 1 -- 172.21.15.37:0/2089580748 learned_addr learned my addr 172.21.15.37:0/2089580748 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:08.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7f3a5f1ef640 1 -- 172.21.15.37:0/2089580748 --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5003e840 con 0x7f3a50007010 2023-12-19T16:07:08.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7f3a5f1ef640 1 -- 172.21.15.37:0/2089580748 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a500d2c80 con 0x7f3a5003b370 2023-12-19T16:07:08.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7f3a5f1ef640 1 -- 172.21.15.37:0/2089580748 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a5003d480 con 0x7f3a5003c160 2023-12-19T16:07:08.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7efef845c640 1 -- 172.21.15.37:0/2436354787 shutdown_connections 2023-12-19T16:07:08.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7fe54022c640 1 -- 172.21.15.37:0/2259019460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5300078b0 msgr2=0x7fe5300062c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7fe54022c640 1 --2- 172.21.15.37:0/2259019460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5300078b0 0x7fe5300062c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe534009870 tx=0x7fe53402b9a0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7efef845c640 1 --2- 172.21.15.37:0/2436354787 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efef014abd0 0x7efef0155400 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7efef845c640 1 --2- 172.21.15.37:0/2436354787 >> v2:172.21.15.37:3300/0 conn(0x7efef00b3900 0x7efef00bb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7efef845c640 1 -- 172.21.15.37:0/2436354787 >> 172.21.15.37:0/2436354787 conn(0x7efef00c0270 msgr2=0x7efef00c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7fe54022c640 1 -- 172.21.15.37:0/2259019460 shutdown_connections 2023-12-19T16:07:08.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7fe54022c640 1 --2- 172.21.15.37:0/2259019460 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe530007fc0 0x7fe5300d8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7fe54022c640 1 --2- 172.21.15.37:0/2259019460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5300078b0 0x7fe5300062c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7fe54022c640 1 -- 172.21.15.37:0/2259019460 >> 172.21.15.37:0/2259019460 conn(0x7fe530006b50 msgr2=0x7fe530006f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7f3a5d1eb640 1 -- 172.21.15.37:0/2089580748 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082814920 0 0) 0x7f3a500d2c80 con 0x7f3a5003b370 2023-12-19T16:07:08.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7f3a5d1eb640 1 -- 172.21.15.37:0/2089580748 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a44003520 con 0x7f3a5003b370 2023-12-19T16:07:08.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7fb7af59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb7b006b530 0x7fb7b0144a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7fb7af59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7b00bc5a0 0x7fb7b014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7fb7af59e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb7b014b1f0 0x7fb7b014df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7fb7af59e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b00b6ca0 con 0x7fb7b00bc5a0 2023-12-19T16:07:08.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7fb7af59e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b014b6a0 con 0x7fb7b006b530 2023-12-19T16:07:08.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7fb7af59e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00b5660 con 0x7fb7b014b1f0 2023-12-19T16:07:08.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7f3a5e9ee640 1 --2- 172.21.15.37:0/2089580748 >> v2:172.21.15.37:3300/0 conn(0x7f3a5003c160 0x7f3a500da8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7fe54022c640 1 -- 172.21.15.37:0/2259019460 shutdown_connections 2023-12-19T16:07:08.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7f3a5d1eb640 1 -- 172.21.15.37:0/2089580748 <== mon.1 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4102229137 0 0) 0x7f3a44003520 con 0x7f3a5003b370 2023-12-19T16:07:08.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7fe54022c640 1 -- 172.21.15.37:0/2259019460 wait complete. 2023-12-19T16:07:08.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7f5cda41f640 1 --2- 172.21.15.37:0/2717264549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd4148ce0 0x7f5cd4153180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009d90 tx=0x7f5ccc02bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b677a843fa8dae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7fb7ae59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb7b006b530 0x7fb7b0144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7fb7ae59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb7b006b530 0x7fb7b0144a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:40736/0 (socket says 172.21.15.37:40736) 2023-12-19T16:07:08.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7fb7ae59c640 1 -- 172.21.15.37:0/238742470 learned_addr learned my addr 172.21.15.37:0/238742470 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7f5cd8c1c640 1 -- 172.21.15.37:0/2717264549 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc02ca10 con 0x7f5cd4148ce0 2023-12-19T16:07:08.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7efef845c640 1 -- 172.21.15.37:0/2436354787 shutdown_connections 2023-12-19T16:07:08.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7fb7add9b640 1 --2- 172.21.15.37:0/238742470 >> v2:172.21.15.37:3300/0 conn(0x7fb7b00bc5a0 0x7fb7b014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7efef845c640 1 -- 172.21.15.37:0/2436354787 wait complete. 2023-12-19T16:07:08.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7f3a5d1eb640 1 -- 172.21.15.37:0/2089580748 >> v2:172.21.15.37:3300/0 conn(0x7f3a5003c160 msgr2=0x7f3a500da8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.293+0000 7f3a5d1eb640 1 --2- 172.21.15.37:0/2089580748 >> v2:172.21.15.37:3300/0 conn(0x7f3a5003c160 0x7f3a500da8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7f3a5d1eb640 1 -- 172.21.15.37:0/2089580748 >> v1:172.21.15.37:6789/0 conn(0x7f3a50007010 legacy=0x7f3a500d2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7f3a5d1eb640 1 -- 172.21.15.37:0/2089580748 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5003ce00 con 0x7f3a5003b370 2023-12-19T16:07:08.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7f3a5d1eb640 1 -- 172.21.15.37:0/2089580748 <== mon.1 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f3a48001670 con 0x7f3a5003b370 2023-12-19T16:07:08.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7f3a5d1eb640 1 -- 172.21.15.37:0/2089580748 >> v1:172.21.15.78:6789/0 conn(0x7f3a5003b370 legacy=0x7f3a500c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7f3a5d1eb640 1 --2- 172.21.15.37:0/2089580748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a44003970 0x7f3a44003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7f3a5d1eb640 1 --2- 172.21.15.37:0/2089580748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a440047c0 0x7f3a44004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7f3a5d1eb640 1 --2- 172.21.15.37:0/2089580748 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a440052a0 0x7f3a44007960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7f3a5d1eb640 1 -- 172.21.15.37:0/2089580748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5003d480 con 0x7f3a440047c0 2023-12-19T16:07:08.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7f3a5d1eb640 1 -- 172.21.15.37:0/2089580748 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a44008160 con 0x7f3a44003970 2023-12-19T16:07:08.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7f3a5d1eb640 1 -- 172.21.15.37:0/2089580748 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a44008320 con 0x7f3a440052a0 2023-12-19T16:07:08.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7fb7ae59c640 1 -- 172.21.15.37:0/238742470 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb7b014b1f0 msgr2=0x7fb7b014df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7fb7ae59c640 1 --2- 172.21.15.37:0/238742470 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb7b014b1f0 0x7fb7b014df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7fb7ae59c640 1 -- 172.21.15.37:0/238742470 >> v2:172.21.15.37:3300/0 conn(0x7fb7b00bc5a0 msgr2=0x7fb7b014acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7fb7ae59c640 1 --2- 172.21.15.37:0/238742470 >> v2:172.21.15.37:3300/0 conn(0x7fb7b00bc5a0 0x7fb7b014acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7fb7ae59c640 1 -- 172.21.15.37:0/238742470 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b00b5e70 con 0x7fb7b006b530 2023-12-19T16:07:08.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7f5cd8c1c640 1 -- 172.21.15.37:0/2717264549 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc02cb70 con 0x7f5cd4148ce0 2023-12-19T16:07:08.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7f5cd8c1c640 1 -- 172.21.15.37:0/2717264549 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc034440 con 0x7f5cd4148ce0 2023-12-19T16:07:08.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7f3a5e1ed640 1 --2- 172.21.15.37:0/2089580748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a44003970 0x7f3a44003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7f3a5e9ee640 1 --2- 172.21.15.37:0/2089580748 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a440052a0 0x7f3a44007960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.294+0000 7fb7add9b640 1 --2- 172.21.15.37:0/238742470 >> v2:172.21.15.37:3300/0 conn(0x7fb7b00bc5a0 0x7fb7b014acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:08.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.295+0000 7f3a5d9ec640 1 --2- 172.21.15.37:0/2089580748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a440047c0 0x7f3a44004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.295+0000 7efe2ec38640 1 Processor -- start 2023-12-19T16:07:08.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.295+0000 7efe2ec38640 1 -- start start 2023-12-19T16:07:08.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.295+0000 7f5cdbe82640 1 -- 172.21.15.37:0/2717264549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd4148ce0 msgr2=0x7f5cd4153180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.295+0000 7f5cdbe82640 1 --2- 172.21.15.37:0/2717264549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd4148ce0 0x7f5cd4153180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009d90 tx=0x7f5ccc02bce0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.295+0000 7f5cdbe82640 1 -- 172.21.15.37:0/2717264549 shutdown_connections 2023-12-19T16:07:08.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.295+0000 7fe54022c640 1 Processor -- start 2023-12-19T16:07:08.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.295+0000 7fe54022c640 1 -- start start 2023-12-19T16:07:08.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.295+0000 7f5cdbe82640 1 --2- 172.21.15.37:0/2717264549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd4148ce0 0x7f5cd4153180 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.295+0000 7f3781d70640 1 Processor -- start 2023-12-19T16:07:08.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.296+0000 7efef845c640 1 Processor -- start 2023-12-19T16:07:08.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.295+0000 7f5cdbe82640 1 --2- 172.21.15.37:0/2717264549 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5cd41488c0 0x7f5cd4070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.295+0000 7f5cdbe82640 1 -- 172.21.15.37:0/2717264549 >> 172.21.15.37:0/2717264549 conn(0x7f5cd40bc220 msgr2=0x7f5cd40bc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.296+0000 7efef845c640 1 -- start start 2023-12-19T16:07:08.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.295+0000 7f5cdbe82640 1 -- 172.21.15.37:0/2717264549 shutdown_connections 2023-12-19T16:07:08.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.296+0000 7f5cdbe82640 1 -- 172.21.15.37:0/2717264549 wait complete. 2023-12-19T16:07:08.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.295+0000 7f3a5e9ee640 1 -- 172.21.15.37:0/2089580748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a44003970 msgr2=0x7f3a44003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.296+0000 7fb7ae59c640 1 --2- 172.21.15.37:0/238742470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7b006b530 0x7fb7b0144a60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7b006bf40 tx=0x7fb7a002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17cb924c0cb753a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.295+0000 7f3a5e9ee640 1 --2- 172.21.15.37:0/2089580748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a44003970 0x7f3a44003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.295+0000 7f3a5e9ee640 1 -- 172.21.15.37:0/2089580748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a440047c0 msgr2=0x7f3a44004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.295+0000 7f3a5e9ee640 1 --2- 172.21.15.37:0/2089580748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a440047c0 0x7f3a44004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.295+0000 7f3a5e9ee640 1 -- 172.21.15.37:0/2089580748 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5003ce00 con 0x7f3a440052a0 2023-12-19T16:07:08.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.296+0000 7f3a5e9ee640 1 -- 172.21.15.37:0/2089580748 reap_dead start 2023-12-19T16:07:08.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.296+0000 7f3a5d9ec640 1 --2- 172.21.15.37:0/2089580748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a440047c0 0x7f3a44004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:07:08.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.296+0000 7f3781d70640 1 -- start start 2023-12-19T16:07:08.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.296+0000 7efe2ec38640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe280b3900 0x7efe280bb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.296+0000 7fb7ad59a640 1 -- 172.21.15.37:0/238742470 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0004230 con 0x7fb7b006b530 2023-12-19T16:07:08.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.296+0000 7efe2c9d4640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7efe2806a470 0x7efe28148040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.37:50774/0 (socket says 172.21.15.37:50774) 2023-12-19T16:07:08.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7fe54022c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe5300078b0 0x7fe530160690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7fb7ad59a640 1 -- 172.21.15.37:0/238742470 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a0004390 con 0x7fb7b006b530 2023-12-19T16:07:08.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efe27fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe280b3900 0x7efe280bb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7fe54022c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe530007fc0 0x7fe530038660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efe27fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe280b3900 0x7efe280bb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49548/0 (socket says 172.21.15.37:49548) 2023-12-19T16:07:08.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efe27fff640 1 -- 172.21.15.37:0/2818616676 learned_addr learned my addr 172.21.15.37:0/2818616676 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7fe54022c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5300d90b0 0x7fe5300ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efe2ec38640 1 --2- 172.21.15.37:0/2818616676 >> v2:172.21.15.78:3300/0 conn(0x7efe2814abd0 0x7efe28155400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7fe53dfc8640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe5300078b0 0x7fe530160690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7fe53dfc8640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe5300078b0 0x7fe530160690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:45536/0 (socket says 172.21.15.37:45536) 2023-12-19T16:07:08.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7fe53d7c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe530007fc0 0x7fe530038660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7fe53d7c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe530007fc0 0x7fe530038660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:40758/0 (socket says 172.21.15.37:40758) 2023-12-19T16:07:08.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efe2ec38640 1 -- 172.21.15.37:0/2818616676 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe280bae20 con 0x7efe2806a470 2023-12-19T16:07:08.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efef845c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efef006a470 0x7efef00a4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7f3a5e9ee640 1 --2- 172.21.15.37:0/2089580748 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a440052a0 0x7f3a44007960 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3a580685a0 tx=0x7f3a440057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e13b59c8fa1d469f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7f5cdbe82640 1 Processor -- start 2023-12-19T16:07:08.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efef845c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efef00b3900 0x7efef01e3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7f3781d70640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f377c14b170 0x7f377c0b98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7f3781d70640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f377c14b600 0x7f377c0b9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7f3781d70640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377c14aa00 con 0x7f377c0b6220 2023-12-19T16:07:08.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7f3781d70640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c14ad50 con 0x7f377c14b600 2023-12-19T16:07:08.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7f3781d70640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c0baa10 con 0x7f377c14b170 2023-12-19T16:07:08.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efef845c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efef014abd0 0x7efef00a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efef845c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef01e40f0 con 0x7efef014abd0 2023-12-19T16:07:08.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efef845c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef014ca20 con 0x7efef006a470 2023-12-19T16:07:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7fe53e7c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5300d90b0 0x7fe5300ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7fe53e7c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5300d90b0 0x7fe5300ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49560/0 (socket says 172.21.15.37:49560) 2023-12-19T16:07:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efef845c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef00ba2d0 con 0x7efef00b3900 2023-12-19T16:07:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efef59f7640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efef00b3900 0x7efef01e3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efef59f7640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efef00b3900 0x7efef01e3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:45550/0 (socket says 172.21.15.37:45550) 2023-12-19T16:07:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efef59f7640 1 -- 172.21.15.37:0/1928937671 learned_addr learned my addr 172.21.15.37:0/1928937671 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efef69f9640 1 --2- 172.21.15.37:0/1928937671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efef014abd0 0x7efef00a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7fe53dfc8640 1 -- 172.21.15.37:0/3449914082 learned_addr learned my addr 172.21.15.37:0/3449914082 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7fe54022c640 1 -- 172.21.15.37:0/3449914082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe530160bd0 con 0x7fe5300d90b0 2023-12-19T16:07:08.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7fe54022c640 1 -- 172.21.15.37:0/3449914082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5300c9cf0 con 0x7fe530007fc0 2023-12-19T16:07:08.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7f378156f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f377c14b600 0x7f377c0b9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7f378156f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f377c14b600 0x7f377c0b9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49580/0 (socket says 172.21.15.37:49580) 2023-12-19T16:07:08.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7fe54022c640 1 -- 172.21.15.37:0/3449914082 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe530036880 con 0x7fe5300078b0 2023-12-19T16:07:08.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7f378156f640 1 -- 172.21.15.37:0/2390337773 learned_addr learned my addr 172.21.15.37:0/2390337773 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7f377bfff640 1 --2- 172.21.15.37:0/2390337773 >> v2:172.21.15.78:3300/0 conn(0x7f377c14b170 0x7f377c0b98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7fb7af59e640 1 -- 172.21.15.37:0/238742470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7b006b530 msgr2=0x7fb7b0144a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7fb7af59e640 1 --2- 172.21.15.37:0/238742470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7b006b530 0x7fb7b0144a60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7b006bf40 tx=0x7fb7a002b960 comp rx=0 tx=0).stop 2023-12-19T16:07:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efe2ec38640 1 -- 172.21.15.37:0/2818616676 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe280c1220 con 0x7efe280b3900 2023-12-19T16:07:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efe2ec38640 1 -- 172.21.15.37:0/2818616676 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe280bf900 con 0x7efe2814abd0 2023-12-19T16:07:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7f5cdbe82640 1 -- start start 2023-12-19T16:07:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efe2d1d5640 1 --2- 172.21.15.37:0/2818616676 >> v2:172.21.15.78:3300/0 conn(0x7efe2814abd0 0x7efe28155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efe2d1d5640 1 -- 172.21.15.37:0/2818616676 >> v2:172.21.15.37:3300/0 conn(0x7efe280b3900 msgr2=0x7efe280bb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efe2d1d5640 1 --2- 172.21.15.37:0/2818616676 >> v2:172.21.15.37:3300/0 conn(0x7efe280b3900 0x7efe280bb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efe2d1d5640 1 -- 172.21.15.37:0/2818616676 >> v1:172.21.15.78:6789/0 conn(0x7efe2806a470 legacy=0x7efe28148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.297+0000 7efe2d1d5640 1 -- 172.21.15.37:0/2818616676 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe280bfba0 con 0x7efe2814abd0 2023-12-19T16:07:08.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7efef61f8640 1 --2- 172.21.15.37:0/1928937671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efef006a470 0x7efef00a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7f378156f640 1 -- 172.21.15.37:0/2390337773 >> v2:172.21.15.78:3300/0 conn(0x7f377c14b170 msgr2=0x7f377c0b98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7f378156f640 1 --2- 172.21.15.37:0/2390337773 >> v2:172.21.15.78:3300/0 conn(0x7f377c14b170 0x7f377c0b98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7f378156f640 1 -- 172.21.15.37:0/2390337773 >> v1:172.21.15.37:6789/0 conn(0x7f377c0b6220 legacy=0x7f377c0b6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7f378156f640 1 -- 172.21.15.37:0/2390337773 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0bc3f0 con 0x7f377c14b600 2023-12-19T16:07:08.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7f3a5d1eb640 1 -- 172.21.15.37:0/2089580748 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580a7610 con 0x7f3a440052a0 2023-12-19T16:07:08.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7f3a5d1eb640 1 -- 172.21.15.37:0/2089580748 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a580a7790 con 0x7f3a440052a0 2023-12-19T16:07:08.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7f3a5d1eb640 1 -- 172.21.15.37:0/2089580748 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580a7b40 con 0x7f3a440052a0 2023-12-19T16:07:08.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7fb7af59e640 1 -- 172.21.15.37:0/238742470 shutdown_connections 2023-12-19T16:07:08.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7fb7af59e640 1 --2- 172.21.15.37:0/238742470 >> v2:172.21.15.37:3300/0 conn(0x7fb7b00bc5a0 0x7fb7b014acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7fb7af59e640 1 --2- 172.21.15.37:0/238742470 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb7b014b1f0 0x7fb7b014df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7fb7af59e640 1 --2- 172.21.15.37:0/238742470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7b006b530 0x7fb7b0144a60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7f5cdbe82640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5cd40b7d00 0x7f5cd4141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7fb7af59e640 1 -- 172.21.15.37:0/238742470 >> 172.21.15.37:0/238742470 conn(0x7fb7b00c0090 msgr2=0x7fb7b00c04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7f5cdbe82640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cd41488c0 0x7f5cd4070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7fb7af59e640 1 -- 172.21.15.37:0/238742470 shutdown_connections 2023-12-19T16:07:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7f5cd9c1e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5cd40b7d00 0x7f5cd4141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7efe27fff640 1 --2- 172.21.15.37:0/2818616676 >> v2:172.21.15.37:3300/0 conn(0x7efe280b3900 0x7efe280bb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7fe53d7c7640 1 -- 172.21.15.37:0/3449914082 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe5300078b0 msgr2=0x7fe530160690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7fe53d7c7640 1 --2- 172.21.15.37:0/3449914082 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe5300078b0 0x7fe530160690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7fe53d7c7640 1 -- 172.21.15.37:0/3449914082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5300d90b0 msgr2=0x7fe5300ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7fe53d7c7640 1 --2- 172.21.15.37:0/3449914082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5300d90b0 0x7fe5300ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.298+0000 7fe53d7c7640 1 -- 172.21.15.37:0/3449914082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5340094d0 con 0x7fe530007fc0 2023-12-19T16:07:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7fe53dfc8640 1 --2- 172.21.15.37:0/3449914082 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe5300078b0 0x7fe530160690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:07:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7efef59f7640 1 -- 172.21.15.37:0/1928937671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efef006a470 msgr2=0x7efef00a4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7efe2d1d5640 1 --2- 172.21.15.37:0/2818616676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe2814abd0 0x7efe28155400 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efe20009d90 tx=0x7efe20034650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=965ae50a797cfa4e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7f5cdbe82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd4148ce0 0x7f5cd41e78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7f5cdbe82640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd4141e60 con 0x7f5cd4148ce0 2023-12-19T16:07:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7efef59f7640 1 --2- 172.21.15.37:0/1928937671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efef006a470 0x7efef00a4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7f5cdbe82640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd414c6d0 con 0x7f5cd41488c0 2023-12-19T16:07:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7f5cdbe82640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd40b1120 con 0x7f5cd40b7d00 2023-12-19T16:07:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7efef59f7640 1 -- 172.21.15.37:0/1928937671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efef014abd0 msgr2=0x7efef00a4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7efe277fe640 1 -- 172.21.15.37:0/2818616676 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20007740 con 0x7efe2814abd0 2023-12-19T16:07:08.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7fb7af59e640 1 -- 172.21.15.37:0/238742470 wait complete. 2023-12-19T16:07:08.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7fe53d7c7640 1 --2- 172.21.15.37:0/3449914082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe530007fc0 0x7fe530038660 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe52800d5f0 tx=0x7fe52800d9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7efe277fe640 1 -- 172.21.15.37:0/2818616676 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe20037050 con 0x7efe2814abd0 2023-12-19T16:07:08.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7efe277fe640 1 -- 172.21.15.37:0/2818616676 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20007aa0 con 0x7efe2814abd0 2023-12-19T16:07:08.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7f3a5f1ef640 1 -- 172.21.15.37:0/2089580748 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a440052a0 msgr2=0x7f3a44007960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7f5cda41f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd4148ce0 0x7f5cd41e78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7efef59f7640 1 --2- 172.21.15.37:0/1928937671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efef014abd0 0x7efef00a4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7efef59f7640 1 -- 172.21.15.37:0/1928937671 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee8009a70 con 0x7efef00b3900 2023-12-19T16:07:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7fe52e7fc640 1 -- 172.21.15.37:0/3449914082 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5280125f0 con 0x7fe530007fc0 2023-12-19T16:07:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7efef59f7640 1 --2- 172.21.15.37:0/1928937671 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efef00b3900 0x7efef01e3bb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efee000e870 tx=0x7efee000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7f5cda41f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd4148ce0 0x7f5cd41e78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49590/0 (socket says 172.21.15.37:49590) 2023-12-19T16:07:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7f5cda41f640 1 -- 172.21.15.37:0/1652425716 learned_addr learned my addr 172.21.15.37:0/1652425716 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7f378156f640 1 --2- 172.21.15.37:0/2390337773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f377c14b600 0x7f377c0b9e00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f377c0bdf40 tx=0x7f377402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2aeb3ad0c754213 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7fe54022c640 1 -- 172.21.15.37:0/3449914082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5300ca270 con 0x7fe530007fc0 2023-12-19T16:07:08.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7fe54022c640 1 -- 172.21.15.37:0/3449914082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe530038140 con 0x7fe530007fc0 2023-12-19T16:07:08.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7fe52e7fc640 1 -- 172.21.15.37:0/3449914082 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe528012750 con 0x7fe530007fc0 2023-12-19T16:07:08.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.299+0000 7f3a5f1ef640 1 --2- 172.21.15.37:0/2089580748 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a440052a0 0x7f3a44007960 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3a580685a0 tx=0x7f3a440057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7fe52e7fc640 1 -- 172.21.15.37:0/3449914082 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528012ae0 con 0x7fe530007fc0 2023-12-19T16:07:08.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7f5cd941d640 1 --2- 172.21.15.37:0/1652425716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cd41488c0 0x7f5cd4070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7f511c428640 1 Processor -- start 2023-12-19T16:07:08.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7f511c428640 1 -- start start 2023-12-19T16:07:08.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7f5cda41f640 1 -- 172.21.15.37:0/1652425716 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5cd40b7d00 msgr2=0x7f5cd4141920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7f377b7fe640 1 -- 172.21.15.37:0/2390337773 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377402cbb0 con 0x7f377c14b600 2023-12-19T16:07:08.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7f5cda41f640 1 --2- 172.21.15.37:0/1652425716 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5cd40b7d00 0x7f5cd4141920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7f377b7fe640 1 -- 172.21.15.37:0/2390337773 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377402cd10 con 0x7f377c14b600 2023-12-19T16:07:08.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7fb7af59e640 1 Processor -- start 2023-12-19T16:07:08.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7f377b7fe640 1 -- 172.21.15.37:0/2390337773 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774034610 con 0x7f377c14b600 2023-12-19T16:07:08.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7efe2ec38640 1 -- 172.21.15.37:0/2818616676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe2814abd0 msgr2=0x7efe28155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7f5cda41f640 1 -- 172.21.15.37:0/1652425716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cd41488c0 msgr2=0x7f5cd4070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7f5cda41f640 1 --2- 172.21.15.37:0/1652425716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cd41488c0 0x7f5cd4070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7f5cda41f640 1 -- 172.21.15.37:0/1652425716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ccc009a70 con 0x7f5cd4148ce0 2023-12-19T16:07:08.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7f5cd941d640 1 --2- 172.21.15.37:0/1652425716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cd41488c0 0x7f5cd4070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:08.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7efe2ec38640 1 --2- 172.21.15.37:0/2818616676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe2814abd0 0x7efe28155400 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efe20009d90 tx=0x7efe20034650 comp rx=0 tx=0).stop 2023-12-19T16:07:08.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7efe2ec38640 1 -- 172.21.15.37:0/2818616676 shutdown_connections 2023-12-19T16:07:08.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7f5cda41f640 1 --2- 172.21.15.37:0/1652425716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd4148ce0 0x7f5cd41e78b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009eb0 tx=0x7f5ccc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7efe2ec38640 1 --2- 172.21.15.37:0/2818616676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe2814abd0 0x7efe28155400 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.300+0000 7efee6ffd640 1 -- 172.21.15.37:0/1928937671 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee000c8e0 con 0x7efef00b3900 2023-12-19T16:07:08.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7f3a5f1ef640 1 -- 172.21.15.37:0/2089580748 shutdown_connections 2023-12-19T16:07:08.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7f3a5f1ef640 1 --2- 172.21.15.37:0/2089580748 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a440052a0 0x7f3a44007960 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7f3a5f1ef640 1 -- 172.21.15.37:0/2089580748 >> 172.21.15.37:0/2089580748 conn(0x7f3a500062b0 msgr2=0x7f3a50006690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7fe54022c640 1 -- 172.21.15.37:0/3449914082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe520000fc0 con 0x7fe530007fc0 2023-12-19T16:07:08.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7efee6ffd640 1 -- 172.21.15.37:0/1928937671 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee000ca40 con 0x7efef00b3900 2023-12-19T16:07:08.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7efee6ffd640 1 -- 172.21.15.37:0/1928937671 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee000cdd0 con 0x7efef00b3900 2023-12-19T16:07:08.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7efef845c640 1 -- 172.21.15.37:0/1928937671 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef00a5ec0 con 0x7efef00b3900 2023-12-19T16:07:08.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7efef845c640 1 -- 172.21.15.37:0/1928937671 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef014bfa0 con 0x7efef00b3900 2023-12-19T16:07:08.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7efe2ec38640 1 --2- 172.21.15.37:0/2818616676 >> v2:172.21.15.37:3300/0 conn(0x7efe280b3900 0x7efe280bb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7efe2ec38640 1 -- 172.21.15.37:0/2818616676 >> 172.21.15.37:0/2818616676 conn(0x7efe280c0270 msgr2=0x7efe280c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7f5cca7fc640 1 -- 172.21.15.37:0/1652425716 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc03e610 con 0x7f5cd4148ce0 2023-12-19T16:07:08.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7f5cca7fc640 1 -- 172.21.15.37:0/1652425716 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc035e90 con 0x7f5cd4148ce0 2023-12-19T16:07:08.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7f511c428640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f51140bcdd0 0x7f51140b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7f511c428640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51140bc6b0 con 0x7f5114144ea0 2023-12-19T16:07:08.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7f511c428640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51140b6900 con 0x7f51140b64c0 2023-12-19T16:07:08.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7f511c428640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51140a59f0 con 0x7f51140bcdd0 2023-12-19T16:07:08.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f51199c3640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f51140b64c0 0x7f5114144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.37:50782/0 (socket says 172.21.15.37:50782) 2023-12-19T16:07:08.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f51199c3640 1 -- 172.21.15.37:0/4243272571 learned_addr learned my addr 172.21.15.37:0/4243272571 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:08.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f511a1c4640 1 --2- 172.21.15.37:0/4243272571 >> v2:172.21.15.78:3300/0 conn(0x7f51140bcdd0 0x7f51140b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.301+0000 7fb7af59e640 1 -- start start 2023-12-19T16:07:08.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7efef845c640 1 -- 172.21.15.37:0/1928937671 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efef00bfe80 con 0x7efef00b3900 2023-12-19T16:07:08.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7fe52e7fc640 1 -- 172.21.15.37:0/3449914082 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe528012c40 con 0x7fe530007fc0 2023-12-19T16:07:08.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f5cca7fc640 1 -- 172.21.15.37:0/1652425716 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc03e9b0 con 0x7f5cd4148ce0 2023-12-19T16:07:08.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7fb7af59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7b006b530 0x7fb7b0147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7fb7af59e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb7b00bc5a0 0x7fb7b00b9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7fb7af59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7b014b1f0 0x7fb7b0146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7fb7af59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b0145830 con 0x7fb7b006b530 2023-12-19T16:07:08.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7fb7af59e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b0148050 con 0x7fb7b014b1f0 2023-12-19T16:07:08.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7fb7af59e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00b97a0 con 0x7fb7b00bc5a0 2023-12-19T16:07:08.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7efe2ec38640 1 -- 172.21.15.37:0/2818616676 shutdown_connections 2023-12-19T16:07:08.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f51191c2640 1 -- 172.21.15.37:0/4243272571 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210988425 0 0) 0x7f51140b6900 con 0x7f51140b64c0 2023-12-19T16:07:08.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f3a5f1ef640 1 -- 172.21.15.37:0/2089580748 shutdown_connections 2023-12-19T16:07:08.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7fb7add9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb7b00bc5a0 0x7fb7b00b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7fb7add9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb7b00bc5a0 0x7fb7b00b9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:45572/0 (socket says 172.21.15.37:45572) 2023-12-19T16:07:08.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7fb7add9b640 1 -- 172.21.15.37:0/2454829073 learned_addr learned my addr 172.21.15.37:0/2454829073 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7efe2ec38640 1 -- 172.21.15.37:0/2818616676 wait complete. 2023-12-19T16:07:08.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f51191c2640 1 -- 172.21.15.37:0/4243272571 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5100003520 con 0x7f51140b64c0 2023-12-19T16:07:08.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f51191c2640 1 -- 172.21.15.37:0/4243272571 <== mon.1 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1823465805 0 0) 0x7f5100003520 con 0x7f51140b64c0 2023-12-19T16:07:08.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f51191c2640 1 -- 172.21.15.37:0/4243272571 >> v2:172.21.15.78:3300/0 conn(0x7f51140bcdd0 msgr2=0x7f51140b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7fb7ae59c640 1 --2- 172.21.15.37:0/2454829073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7b006b530 0x7fb7b0147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7fb7add9b640 1 -- 172.21.15.37:0/2454829073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7b014b1f0 msgr2=0x7fb7b0146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7fb7aed9d640 1 --2- 172.21.15.37:0/2454829073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7b014b1f0 0x7fb7b0146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f51191c2640 1 --2- 172.21.15.37:0/4243272571 >> v2:172.21.15.78:3300/0 conn(0x7f51140bcdd0 0x7f51140b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f3781d70640 1 -- 172.21.15.37:0/2390337773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f377c14b600 msgr2=0x7f377c0b9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f3781d70640 1 --2- 172.21.15.37:0/2390337773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f377c14b600 0x7f377c0b9e00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f377c0bdf40 tx=0x7f377402c010 comp rx=0 tx=0).stop 2023-12-19T16:07:08.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f51191c2640 1 -- 172.21.15.37:0/4243272571 >> v1:172.21.15.37:6789/0 conn(0x7f5114144ea0 legacy=0x7f5114155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f3a5f1ef640 1 -- 172.21.15.37:0/2089580748 wait complete. 2023-12-19T16:07:08.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7f3781d70640 1 -- 172.21.15.37:0/2390337773 shutdown_connections 2023-12-19T16:07:08.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7f3781d70640 1 --2- 172.21.15.37:0/2390337773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f377c14b600 0x7f377c0b9e00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7f3781d70640 1 --2- 172.21.15.37:0/2390337773 >> v2:172.21.15.78:3300/0 conn(0x7f377c14b170 0x7f377c0b98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7f3781d70640 1 -- 172.21.15.37:0/2390337773 >> 172.21.15.37:0/2390337773 conn(0x7f377c0c0090 msgr2=0x7f377c0c04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7fe52e7fc640 1 --2- 172.21.15.37:0/3449914082 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe51c06a430 0x7fe51c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7fe52e7fc640 1 -- 172.21.15.37:0/3449914082 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe528088c90 con 0x7fe530007fc0 2023-12-19T16:07:08.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7f5cdbe82640 1 -- 172.21.15.37:0/1652425716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd40b0b60 con 0x7f5cd4148ce0 2023-12-19T16:07:08.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f51191c2640 1 -- 172.21.15.37:0/4243272571 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51140bc0a0 con 0x7f51140b64c0 2023-12-19T16:07:08.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7fe52e7fc640 1 --2- 172.21.15.37:0/3449914082 >> [v2:172.21.15.37:6800/89452,v1:172.21.15.37:6801/89452] conn(0x7fe51c072650 0x7fe51c074a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7fe52e7fc640 1 -- 172.21.15.37:0/3449914082 --> [v2:172.21.15.37:6800/89452,v1:172.21.15.37:6801/89452] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe51c075120 con 0x7fe51c072650 2023-12-19T16:07:08.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7fe52e7fc640 1 -- 172.21.15.37:0/3449914082 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe52808e2a0 con 0x7fe530007fc0 2023-12-19T16:07:08.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7f5cdbe82640 1 -- 172.21.15.37:0/1652425716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd4070170 con 0x7f5cd4148ce0 2023-12-19T16:07:08.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f51191c2640 1 -- 172.21.15.37:0/4243272571 <== mon.1 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f5104001670 con 0x7f51140b64c0 2023-12-19T16:07:08.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7f3781d70640 1 -- 172.21.15.37:0/2390337773 shutdown_connections 2023-12-19T16:07:08.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f51191c2640 1 -- 172.21.15.37:0/4243272571 >> v1:172.21.15.78:6789/0 conn(0x7f51140b64c0 legacy=0x7f5114144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7fb7add9b640 1 --2- 172.21.15.37:0/2454829073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7b014b1f0 0x7fb7b0146bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f51191c2640 1 --2- 172.21.15.37:0/4243272571 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5100003970 0x7f5100003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7fb7add9b640 1 -- 172.21.15.37:0/2454829073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7b006b530 msgr2=0x7fb7b0147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7fb7add9b640 1 --2- 172.21.15.37:0/2454829073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7b006b530 0x7fb7b0147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7fb7add9b640 1 -- 172.21.15.37:0/2454829073 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a0009460 con 0x7fb7b00bc5a0 2023-12-19T16:07:08.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7fb7ae59c640 1 --2- 172.21.15.37:0/2454829073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7b006b530 0x7fb7b0147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:08.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7fb7aed9d640 1 --2- 172.21.15.37:0/2454829073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7b014b1f0 0x7fb7b0146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:08.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7fb7add9b640 1 --2- 172.21.15.37:0/2454829073 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb7b00bc5a0 0x7fb7b00b9260 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8007fc0 tx=0x7fb7a800d560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f51191c2640 1 --2- 172.21.15.37:0/4243272571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51000047c0 0x7f5100004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.304+0000 7fb7a6ffd640 1 -- 172.21.15.37:0/2454829073 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a8003b90 con 0x7fb7b00bc5a0 2023-12-19T16:07:08.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.304+0000 7f3a5f1ef640 1 Processor -- start 2023-12-19T16:07:08.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.304+0000 7fe53e7c9640 1 --2- 172.21.15.37:0/3449914082 >> [v2:172.21.15.37:6800/89452,v1:172.21.15.37:6801/89452] conn(0x7fe51c072650 0x7fe51c074a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.304+0000 7efe2ec38640 1 Processor -- start 2023-12-19T16:07:08.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.304+0000 7f5cdbe82640 1 -- 172.21.15.37:0/1652425716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5cd40b5c00 con 0x7f5cd4148ce0 2023-12-19T16:07:08.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.304+0000 7fb7af59e640 1 -- 172.21.15.37:0/2454829073 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b00710c0 con 0x7fb7b00bc5a0 2023-12-19T16:07:08.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.304+0000 7fb7af59e640 1 -- 172.21.15.37:0/2454829073 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b0145020 con 0x7fb7b00bc5a0 2023-12-19T16:07:08.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.304+0000 7fb7a6ffd640 1 -- 172.21.15.37:0/2454829073 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a800f040 con 0x7fb7b00bc5a0 2023-12-19T16:07:08.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f51191c2640 1 --2- 172.21.15.37:0/4243272571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5100005180 0x7f510000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f51191c2640 1 -- 172.21.15.37:0/4243272571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51140a59f0 con 0x7f51000047c0 2023-12-19T16:07:08.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f51191c2640 1 -- 172.21.15.37:0/4243272571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510000c000 con 0x7f5100005180 2023-12-19T16:07:08.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.302+0000 7f51191c2640 1 -- 172.21.15.37:0/4243272571 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510000c1c0 con 0x7f5100003970 2023-12-19T16:07:08.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7f51199c3640 1 --2- 172.21.15.37:0/4243272571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51000047c0 0x7f5100004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7f511a1c4640 1 --2- 172.21.15.37:0/4243272571 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5100003970 0x7f5100003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7f51199c3640 1 -- 172.21.15.37:0/4243272571 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5100003970 msgr2=0x7f5100003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7f51199c3640 1 --2- 172.21.15.37:0/4243272571 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5100003970 0x7f5100003d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7f51199c3640 1 -- 172.21.15.37:0/4243272571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5100005180 msgr2=0x7f510000b980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T16:07:08.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7f51199c3640 1 --2- 172.21.15.37:0/4243272571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5100005180 0x7f510000b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7f51199c3640 1 -- 172.21.15.37:0/4243272571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51140bc0a0 con 0x7f51000047c0 2023-12-19T16:07:08.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.305+0000 7fe53dfc8640 1 --2- 172.21.15.37:0/3449914082 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe51c06a430 0x7fe51c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.305+0000 7fe53e7c9640 1 --2- 172.21.15.37:0/3449914082 >> [v2:172.21.15.37:6800/89452,v1:172.21.15.37:6801/89452] conn(0x7fe51c072650 0x7fe51c074a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.304+0000 7f511a9c5640 1 -- 172.21.15.37:0/4243272571 reap_dead start 2023-12-19T16:07:08.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.305+0000 7fb7a6ffd640 1 -- 172.21.15.37:0/2454829073 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a8004030 con 0x7fb7b00bc5a0 2023-12-19T16:07:08.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.304+0000 7efee6ffd640 1 -- 172.21.15.37:0/1928937671 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efee0005990 con 0x7efef00b3900 2023-12-19T16:07:08.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.304+0000 7efee6ffd640 1 --2- 172.21.15.37:0/1928937671 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7efed406a500 0x7efed406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.305+0000 7efee6ffd640 1 -- 172.21.15.37:0/1928937671 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efee0088c70 con 0x7efef00b3900 2023-12-19T16:07:08.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.305+0000 7efee6ffd640 1 --2- 172.21.15.37:0/1928937671 >> [v2:172.21.15.78:6808/89459,v1:172.21.15.78:6809/89459] conn(0x7efed4072720 0x7efed4074b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.305+0000 7efee6ffd640 1 -- 172.21.15.37:0/1928937671 --> [v2:172.21.15.78:6808/89459,v1:172.21.15.78:6809/89459] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efed40751f0 con 0x7efed4072720 2023-12-19T16:07:08.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.305+0000 7efee6ffd640 1 -- 172.21.15.37:0/1928937671 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7efee0089020 con 0x7efef00b3900 2023-12-19T16:07:08.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.305+0000 7f51199c3640 1 --2- 172.21.15.37:0/4243272571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51000047c0 0x7f5100004c40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f510400c260 tx=0x7f51000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ec1af7480de130 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.303+0000 7f3781d70640 1 -- 172.21.15.37:0/2390337773 wait complete. 2023-12-19T16:07:08.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.304+0000 7f3a5f1ef640 1 -- start start 2023-12-19T16:07:08.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.305+0000 7efe2ec38640 1 -- start start 2023-12-19T16:07:08.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.305+0000 7f3a5f1ef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a440052a0 0x7f3a500c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.305+0000 7f3a5f1ef640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a500d0930 0x7f3a500d1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.305+0000 7f3a5f1ef640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a500d1e70 0x7f3a50029e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7f3a5f1ef640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a500c8700 con 0x7f3a440052a0 2023-12-19T16:07:08.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7f3a5f1ef640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a500d25b0 con 0x7f3a500d0930 2023-12-19T16:07:08.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7f3a5f1ef640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a500d2890 con 0x7f3a500d1e70 2023-12-19T16:07:08.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.305+0000 7f5cca7fc640 1 -- 172.21.15.37:0/1652425716 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5ccc03b050 con 0x7f5cd4148ce0 2023-12-19T16:07:08.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7fb7a6ffd640 1 -- 172.21.15.37:0/2454829073 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb7a8004210 con 0x7fb7b00bc5a0 2023-12-19T16:07:08.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.305+0000 7efef61f8640 1 --2- 172.21.15.37:0/1928937671 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7efed406a500 0x7efed406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7efef69f9640 1 --2- 172.21.15.37:0/1928937671 >> [v2:172.21.15.78:6808/89459,v1:172.21.15.78:6809/89459] conn(0x7efed4072720 0x7efed4074b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7f51191c2640 1 -- 172.21.15.37:0/4243272571 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510402cb00 con 0x7f51000047c0 2023-12-19T16:07:08.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7f51191c2640 1 -- 172.21.15.37:0/4243272571 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510402cc60 con 0x7f51000047c0 2023-12-19T16:07:08.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7f51191c2640 1 -- 172.21.15.37:0/4243272571 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51040058d0 con 0x7f51000047c0 2023-12-19T16:07:08.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7fe52e7fc640 1 -- 172.21.15.37:0/3449914082 <== osd.0 v2:172.21.15.37:6800/89452 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe51c075120 con 0x7fe51c072650 2023-12-19T16:07:08.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7f5cca7fc640 1 --2- 172.21.15.37:0/1652425716 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5cb806a480 0x7f5cb806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7fe53dfc8640 1 --2- 172.21.15.37:0/3449914082 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe51c06a430 0x7fe51c06c8f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe53402b9e0 tx=0x7fe534008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.305+0000 7f3781d70640 1 Processor -- start 2023-12-19T16:07:08.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7f5cca7fc640 1 -- 172.21.15.37:0/1652425716 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ccc0ab050 con 0x7f5cd4148ce0 2023-12-19T16:07:08.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7fb7af59e640 1 -- 172.21.15.37:0/2454829073 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb794000fc0 con 0x7fb7b00bc5a0 2023-12-19T16:07:08.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7efe2ec38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe2806a470 0x7efe2814bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7efe2ec38640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efe280b3900 0x7efe280a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7efe2ec38640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe2814abd0 0x7efe281de6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7efe2ec38640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe281dd2e0 con 0x7efe2806a470 2023-12-19T16:07:08.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7f3a5e1ed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a440052a0 0x7f3a500c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7f3a5e1ed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a440052a0 0x7f3a500c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49608/0 (socket says 172.21.15.37:49608) 2023-12-19T16:07:08.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7f3a5e1ed640 1 -- 172.21.15.37:0/1646269607 learned_addr learned my addr 172.21.15.37:0/1646269607 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7efe2ec38640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe281dfb50 con 0x7efe2814abd0 2023-12-19T16:07:08.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7efe2ec38640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe281dfe30 con 0x7efe280b3900 2023-12-19T16:07:08.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7f5cd9c1e640 1 --2- 172.21.15.37:0/1652425716 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5cb806a480 0x7f5cb806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7f5cca7fc640 1 --2- 172.21.15.37:0/1652425716 >> [v2:172.21.15.37:6816/89455,v1:172.21.15.37:6817/89455] conn(0x7f5cb80726a0 0x7f5cb8074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7f5cca7fc640 1 -- 172.21.15.37:0/1652425716 --> [v2:172.21.15.37:6816/89455,v1:172.21.15.37:6817/89455] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5cb8075170 con 0x7f5cb80726a0 2023-12-19T16:07:08.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7f5cca7fc640 1 -- 172.21.15.37:0/1652425716 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ccc0ad760 con 0x7f5cd4148ce0 2023-12-19T16:07:08.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7fb7a6ffd640 1 --2- 172.21.15.37:0/2454829073 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fb79006a500 0x7fb79006c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.306+0000 7f3781d70640 1 -- start start 2023-12-19T16:07:08.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7efe2d1d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe2814abd0 0x7efe281de6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7fb7ae59c640 1 --2- 172.21.15.37:0/2454829073 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fb79006a500 0x7fb79006c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7efe27fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efe280b3900 0x7efe280a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7efe27fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efe280b3900 0x7efe280a0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:45592/0 (socket says 172.21.15.37:45592) 2023-12-19T16:07:08.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7efe27fff640 1 -- 172.21.15.37:0/647713359 learned_addr learned my addr 172.21.15.37:0/647713359 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7f511c428640 1 -- 172.21.15.37:0/4243272571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51000047c0 msgr2=0x7f5100004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7f511c428640 1 --2- 172.21.15.37:0/4243272571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51000047c0 0x7f5100004c40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f510400c260 tx=0x7f51000057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7f5cd941d640 1 --2- 172.21.15.37:0/1652425716 >> [v2:172.21.15.37:6816/89455,v1:172.21.15.37:6817/89455] conn(0x7f5cb80726a0 0x7f5cb8074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7fb7a6ffd640 1 -- 172.21.15.37:0/2454829073 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7a8088b90 con 0x7fb7b00bc5a0 2023-12-19T16:07:08.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7f3a5e1ed640 1 -- 172.21.15.37:0/1646269607 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a500d1e70 msgr2=0x7f3a50029e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T16:07:08.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7f3a5e1ed640 1 --2- 172.21.15.37:0/1646269607 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a500d1e70 0x7f3a50029e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7f3a5e1ed640 1 -- 172.21.15.37:0/1646269607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a500d0930 msgr2=0x7f3a500d1930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T16:07:08.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7f3a5e1ed640 1 --2- 172.21.15.37:0/1646269607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a500d0930 0x7f3a500d1930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7f3a5e1ed640 1 -- 172.21.15.37:0/1646269607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a500d1410 con 0x7f3a440052a0 2023-12-19T16:07:08.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7efef61f8640 1 --2- 172.21.15.37:0/1928937671 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7efed406a500 0x7efed406c9c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efeec000f60 tx=0x7efeec007c80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7efef69f9640 1 --2- 172.21.15.37:0/1928937671 >> [v2:172.21.15.78:6808/89459,v1:172.21.15.78:6809/89459] conn(0x7efed4072720 0x7efed4074b40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7fb7a6ffd640 1 --2- 172.21.15.37:0/2454829073 >> [v2:172.21.15.78:6821/89462,v1:172.21.15.78:6823/89462] conn(0x7fb790072720 0x7fb790074b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7f511c428640 1 -- 172.21.15.37:0/4243272571 shutdown_connections 2023-12-19T16:07:08.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7f511c428640 1 --2- 172.21.15.37:0/4243272571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51000047c0 0x7f5100004c40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7f511c428640 1 -- 172.21.15.37:0/4243272571 >> 172.21.15.37:0/4243272571 conn(0x7f5114071e60 msgr2=0x7f51140c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7efe27fff640 1 -- 172.21.15.37:0/647713359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe2814abd0 msgr2=0x7efe281de6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7efe27fff640 1 --2- 172.21.15.37:0/647713359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe2814abd0 0x7efe281de6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7efe27fff640 1 -- 172.21.15.37:0/647713359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe2806a470 msgr2=0x7efe2814bcc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T16:07:08.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7efe27fff640 1 --2- 172.21.15.37:0/647713359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe2806a470 0x7efe2814bcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7efe27fff640 1 -- 172.21.15.37:0/647713359 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe20009a70 con 0x7efe280b3900 2023-12-19T16:07:08.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7f511c428640 1 -- 172.21.15.37:0/4243272571 shutdown_connections 2023-12-19T16:07:08.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7f5cd9c1e640 1 --2- 172.21.15.37:0/1652425716 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5cb806a480 0x7f5cb806c940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0000f60 tx=0x7f5cd0007e20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7f5cd941d640 1 --2- 172.21.15.37:0/1652425716 >> [v2:172.21.15.37:6816/89455,v1:172.21.15.37:6817/89455] conn(0x7f5cb80726a0 0x7f5cb8074ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7fb7a6ffd640 1 -- 172.21.15.37:0/2454829073 --> [v2:172.21.15.78:6821/89462,v1:172.21.15.78:6823/89462] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7900751f0 con 0x7fb790072720 2023-12-19T16:07:08.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7fb7a6ffd640 1 -- 172.21.15.37:0/2454829073 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7a808d240 con 0x7fb7b00bc5a0 2023-12-19T16:07:08.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7fb7ae59c640 1 --2- 172.21.15.37:0/2454829073 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fb79006a500 0x7fb79006c9c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0035000 tx=0x7fb7a003a040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7f511c428640 1 -- 172.21.15.37:0/4243272571 wait complete. 2023-12-19T16:07:08.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7fb7aed9d640 1 --2- 172.21.15.37:0/2454829073 >> [v2:172.21.15.78:6821/89462,v1:172.21.15.78:6823/89462] conn(0x7fb790072720 0x7fb790074b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.307+0000 7f3a5e1ed640 1 --2- 172.21.15.37:0/1646269607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a440052a0 0x7f3a500c81c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3a5400f5f0 tx=0x7f3a5400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f3781d70640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f377c0b6220 0x7f377c147740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f3781d70640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f377c14b170 0x7f377c0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f3781d70640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f377c14b600 0x7f377c1393a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f3781d70640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c147c80 con 0x7f377c0b6220 2023-12-19T16:07:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f3781d70640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c071170 con 0x7f377c14b600 2023-12-19T16:07:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f3781d70640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c06e4e0 con 0x7f377c14b170 2023-12-19T16:07:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7efe27fff640 1 --2- 172.21.15.37:0/647713359 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efe280b3900 0x7efe280a0dd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efe1400e810 tx=0x7efe1400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f3a4effd640 1 -- 172.21.15.37:0/1646269607 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a54003a70 con 0x7f3a440052a0 2023-12-19T16:07:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f3a4effd640 1 -- 172.21.15.37:0/1646269607 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a54003bd0 con 0x7f3a440052a0 2023-12-19T16:07:08.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f377bfff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f377c14b170 0x7f377c0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f377bfff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f377c14b170 0x7f377c0702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:45608/0 (socket says 172.21.15.37:45608) 2023-12-19T16:07:08.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f377bfff640 1 -- 172.21.15.37:0/1264849108 learned_addr learned my addr 172.21.15.37:0/1264849108 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f3a4effd640 1 -- 172.21.15.37:0/1646269607 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a54003d60 con 0x7f3a440052a0 2023-12-19T16:07:08.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f3a5f1ef640 1 -- 172.21.15.37:0/1646269607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5003a610 con 0x7f3a440052a0 2023-12-19T16:07:08.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7efe257fa640 1 -- 172.21.15.37:0/647713359 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe14004220 con 0x7efe280b3900 2023-12-19T16:07:08.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7efe257fa640 1 -- 172.21.15.37:0/647713359 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe14004380 con 0x7efe280b3900 2023-12-19T16:07:08.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7efe257fa640 1 -- 172.21.15.37:0/647713359 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1400c8d0 con 0x7efe280b3900 2023-12-19T16:07:08.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f3a5f1ef640 1 -- 172.21.15.37:0/1646269607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a500d2b70 con 0x7f3a440052a0 2023-12-19T16:07:08.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f3780d6e640 1 --2- 172.21.15.37:0/1264849108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f377c0b6220 0x7f377c147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f377bfff640 1 -- 172.21.15.37:0/1264849108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f377c14b600 msgr2=0x7f377c1393a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T16:07:08.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f377bfff640 1 --2- 172.21.15.37:0/1264849108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f377c14b600 0x7f377c1393a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f377bfff640 1 -- 172.21.15.37:0/1264849108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f377c0b6220 msgr2=0x7f377c147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f377bfff640 1 --2- 172.21.15.37:0/1264849108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f377c0b6220 0x7f377c147740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7f377bfff640 1 -- 172.21.15.37:0/1264849108 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3774009b30 con 0x7f377c14b170 2023-12-19T16:07:08.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7fb7aed9d640 1 --2- 172.21.15.37:0/2454829073 >> [v2:172.21.15.78:6821/89462,v1:172.21.15.78:6823/89462] conn(0x7fb790072720 0x7fb790074b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.308+0000 7efee6ffd640 1 -- 172.21.15.37:0/1928937671 <== osd.5 v2:172.21.15.78:6808/89459 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efed40751f0 con 0x7efed4072720 2023-12-19T16:07:08.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.309+0000 7f5cca7fc640 1 -- 172.21.15.37:0/1652425716 <== osd.3 v2:172.21.15.37:6816/89455 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5cb8075170 con 0x7f5cb80726a0 2023-12-19T16:07:08.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.309+0000 7efe2ec38640 1 -- 172.21.15.37:0/647713359 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2814c2e0 con 0x7efe280b3900 2023-12-19T16:07:08.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.309+0000 7efe2ec38640 1 -- 172.21.15.37:0/647713359 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe281e0110 con 0x7efe280b3900 2023-12-19T16:07:08.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.309+0000 7f511c428640 1 Processor -- start 2023-12-19T16:07:08.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.309+0000 7f3a4cff9640 1 -- 172.21.15.37:0/1646269607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3a34000fc0 con 0x7f3a440052a0 2023-12-19T16:07:08.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.309+0000 7f511c428640 1 -- start start 2023-12-19T16:07:08.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.309+0000 7fb7a6ffd640 1 -- 172.21.15.37:0/2454829073 <== osd.4 v2:172.21.15.78:6821/89462 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb7900751f0 con 0x7fb790072720 2023-12-19T16:07:08.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.309+0000 7f377bfff640 1 --2- 172.21.15.37:0/1264849108 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f377c14b170 0x7f377c0702e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f376c00e9e0 tx=0x7f376c00eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.310+0000 7f37797fa640 1 -- 172.21.15.37:0/1264849108 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c009670 con 0x7f377c14b170 2023-12-19T16:07:08.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.310+0000 7f37797fa640 1 -- 172.21.15.37:0/1264849108 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c00c9d0 con 0x7f377c14b170 2023-12-19T16:07:08.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.310+0000 7f37797fa640 1 -- 172.21.15.37:0/1264849108 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c00cd80 con 0x7f377c14b170 2023-12-19T16:07:08.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.311+0000 7efe2ec38640 1 -- 172.21.15.37:0/647713359 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efe2814b060 con 0x7efe280b3900 2023-12-19T16:07:08.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.311+0000 7f3a4effd640 1 -- 172.21.15.37:0/1646269607 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3a54004050 con 0x7f3a440052a0 2023-12-19T16:07:08.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.310+0000 7f511c428640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51000047c0 0x7f51141db840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.311+0000 7f511c428640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f511414b9c0 0x7f511413d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.311+0000 7f511c428640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f511413d6d0 0x7f51141deaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.311+0000 7f51199c3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f511414b9c0 0x7f511413d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.311+0000 7f51199c3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f511414b9c0 0x7f511413d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:40810/0 (socket says 172.21.15.37:40810) 2023-12-19T16:07:08.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.311+0000 7f51199c3640 1 -- 172.21.15.37:0/224493950 learned_addr learned my addr 172.21.15.37:0/224493950 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.311+0000 7f511c428640 1 -- 172.21.15.37:0/224493950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51141dbd80 con 0x7f51000047c0 2023-12-19T16:07:08.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.311+0000 7f511a9c5640 1 --2- 172.21.15.37:0/224493950 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f511413d6d0 0x7f51141deaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.311+0000 7f511c428640 1 -- 172.21.15.37:0/224493950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511413cd00 con 0x7f511414b9c0 2023-12-19T16:07:08.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.311+0000 7f511c428640 1 -- 172.21.15.37:0/224493950 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5114149b00 con 0x7f511413d6d0 2023-12-19T16:07:08.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.311+0000 7f511a1c4640 1 --2- 172.21.15.37:0/224493950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51000047c0 0x7f51141db840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.310+0000 7f3781d70640 1 -- 172.21.15.37:0/1264849108 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377c06ecf0 con 0x7f377c14b170 2023-12-19T16:07:08.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.310+0000 7f3781d70640 1 -- 172.21.15.37:0/1264849108 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377c06ea10 con 0x7f377c14b170 2023-12-19T16:07:08.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.312+0000 7f511a1c4640 1 -- 172.21.15.37:0/224493950 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f511413d6d0 msgr2=0x7f51141deaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.312+0000 7f511a1c4640 1 --2- 172.21.15.37:0/224493950 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f511413d6d0 0x7f51141deaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.312+0000 7f511a1c4640 1 -- 172.21.15.37:0/224493950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f511414b9c0 msgr2=0x7f511413d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.312+0000 7f511a1c4640 1 --2- 172.21.15.37:0/224493950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f511414b9c0 0x7f511413d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.312+0000 7f511a1c4640 1 -- 172.21.15.37:0/224493950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511413c3d0 con 0x7f51000047c0 2023-12-19T16:07:08.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.312+0000 7f3a4effd640 1 --2- 172.21.15.37:0/1646269607 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3a3c06a460 0x7f3a3c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.312+0000 7f3a4effd640 1 -- 172.21.15.37:0/1646269607 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a54088b50 con 0x7f3a440052a0 2023-12-19T16:07:08.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.312+0000 7f3a4effd640 1 --2- 172.21.15.37:0/1646269607 >> [v2:172.21.15.37:6824/89456,v1:172.21.15.37:6825/89456] conn(0x7f3a3c072680 0x7f3a3c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.312+0000 7f511a1c4640 1 --2- 172.21.15.37:0/224493950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51000047c0 0x7f51141db840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5110007fb0 tx=0x7f511000f5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.312+0000 7f3a4effd640 1 -- 172.21.15.37:0/1646269607 --> [v2:172.21.15.37:6824/89456,v1:172.21.15.37:6825/89456] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a3c075150 con 0x7f3a3c072680 2023-12-19T16:07:08.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.312+0000 7f3a4effd640 1 -- 172.21.15.37:0/1646269607 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a54088f00 con 0x7f3a440052a0 2023-12-19T16:07:08.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.312+0000 7f3a5e9ee640 1 --2- 172.21.15.37:0/1646269607 >> [v2:172.21.15.37:6824/89456,v1:172.21.15.37:6825/89456] conn(0x7f3a3c072680 0x7f3a3c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.312+0000 7f510affd640 1 -- 172.21.15.37:0/224493950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110016620 con 0x7f51000047c0 2023-12-19T16:07:08.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.313+0000 7efe257fa640 1 -- 172.21.15.37:0/647713359 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efe1400ca30 con 0x7efe280b3900 2023-12-19T16:07:08.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.313+0000 7efe257fa640 1 --2- 172.21.15.37:0/647713359 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7efe0c06a430 0x7efe0c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.313+0000 7efe2c9d4640 1 --2- 172.21.15.37:0/647713359 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7efe0c06a430 0x7efe0c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.313+0000 7f511c428640 1 -- 172.21.15.37:0/224493950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511413c6b0 con 0x7f51000047c0 2023-12-19T16:07:08.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.313+0000 7f510affd640 1 -- 172.21.15.37:0/224493950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5110016780 con 0x7f51000047c0 2023-12-19T16:07:08.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.314+0000 7efe257fa640 1 -- 172.21.15.37:0/647713359 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe14088500 con 0x7efe280b3900 2023-12-19T16:07:08.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.314+0000 7f511c428640 1 -- 172.21.15.37:0/224493950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5114145410 con 0x7f51000047c0 2023-12-19T16:07:08.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.313+0000 7f3a5e9ee640 1 --2- 172.21.15.37:0/1646269607 >> [v2:172.21.15.37:6824/89456,v1:172.21.15.37:6825/89456] conn(0x7f3a3c072680 0x7f3a3c074aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.314+0000 7f3a5d9ec640 1 --2- 172.21.15.37:0/1646269607 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3a3c06a460 0x7f3a3c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.314+0000 7efe2c9d4640 1 --2- 172.21.15.37:0/647713359 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7efe0c06a430 0x7efe0c06c8f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efe1c004e50 tx=0x7efe1c0079e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.314+0000 7efe257fa640 1 --2- 172.21.15.37:0/647713359 >> [v2:172.21.15.37:6808/89453,v1:172.21.15.37:6809/89453] conn(0x7efe0c072650 0x7efe0c074a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.314+0000 7efe257fa640 1 -- 172.21.15.37:0/647713359 --> [v2:172.21.15.37:6808/89453,v1:172.21.15.37:6809/89453] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe0c075120 con 0x7efe0c072650 2023-12-19T16:07:08.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.314+0000 7efe257fa640 1 -- 172.21.15.37:0/647713359 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe1408ab20 con 0x7efe280b3900 2023-12-19T16:07:08.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.314+0000 7efe2d1d5640 1 --2- 172.21.15.37:0/647713359 >> [v2:172.21.15.37:6808/89453,v1:172.21.15.37:6809/89453] conn(0x7efe0c072650 0x7efe0c074a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.314+0000 7f3a4effd640 1 -- 172.21.15.37:0/1646269607 <== osd.2 v2:172.21.15.37:6824/89456 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3a3c075150 con 0x7f3a3c072680 2023-12-19T16:07:08.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.315+0000 7f510affd640 1 -- 172.21.15.37:0/224493950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110016b10 con 0x7f51000047c0 2023-12-19T16:07:08.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.315+0000 7efe2d1d5640 1 --2- 172.21.15.37:0/647713359 >> [v2:172.21.15.37:6808/89453,v1:172.21.15.37:6809/89453] conn(0x7efe0c072650 0x7efe0c074a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.315+0000 7f511c428640 1 -- 172.21.15.37:0/224493950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f51140b5500 con 0x7f51000047c0 2023-12-19T16:07:08.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.315+0000 7f510affd640 1 -- 172.21.15.37:0/224493950 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5110016c70 con 0x7f51000047c0 2023-12-19T16:07:08.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.316+0000 7f510affd640 1 --2- 172.21.15.37:0/224493950 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f50f806a4b0 0x7f50f806c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.316+0000 7f510affd640 1 -- 172.21.15.37:0/224493950 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5110088ef0 con 0x7f51000047c0 2023-12-19T16:07:08.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.316+0000 7efe257fa640 1 -- 172.21.15.37:0/647713359 <== osd.1 v2:172.21.15.37:6808/89453 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efe0c075120 con 0x7efe0c072650 2023-12-19T16:07:08.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.316+0000 7f510affd640 1 --2- 172.21.15.37:0/224493950 >> [v2:172.21.15.78:6816/89460,v1:172.21.15.78:6817/89460] conn(0x7f50f8072560 0x7f50f8074980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.316+0000 7f510affd640 1 -- 172.21.15.37:0/224493950 --> [v2:172.21.15.78:6816/89460,v1:172.21.15.78:6817/89460] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50f8075030 con 0x7f50f8072560 2023-12-19T16:07:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.316+0000 7f510affd640 1 -- 172.21.15.37:0/224493950 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5110089270 con 0x7f51000047c0 2023-12-19T16:07:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.317+0000 7f51199c3640 1 --2- 172.21.15.37:0/224493950 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f50f806a4b0 0x7f50f806c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.317+0000 7f37797fa640 1 -- 172.21.15.37:0/1264849108 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f376c013470 con 0x7f377c14b170 2023-12-19T16:07:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.317+0000 7f511a9c5640 1 --2- 172.21.15.37:0/224493950 >> [v2:172.21.15.78:6816/89460,v1:172.21.15.78:6817/89460] conn(0x7f50f8072560 0x7f50f8074980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.317+0000 7f3a5d9ec640 1 --2- 172.21.15.37:0/1646269607 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3a3c06a460 0x7f3a3c06c920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3a5015f9d0 tx=0x7f3a48000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.317+0000 7f51199c3640 1 --2- 172.21.15.37:0/224493950 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f50f806a4b0 0x7f50f806c970 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f511413e240 tx=0x7f5104009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.318+0000 7f37797fa640 1 --2- 172.21.15.37:0/1264849108 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f376806a480 0x7f376806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.318+0000 7f37797fa640 1 -- 172.21.15.37:0/1264849108 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f376c088b40 con 0x7f377c14b170 2023-12-19T16:07:08.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.318+0000 7f3762ffd640 1 --2- 172.21.15.37:0/1264849108 >> [v2:172.21.15.78:6800/89461,v1:172.21.15.78:6801/89461] conn(0x7f377c1398e0 0x7f377c139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.318+0000 7f3762ffd640 1 -- 172.21.15.37:0/1264849108 --> [v2:172.21.15.78:6800/89461,v1:172.21.15.78:6801/89461] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f377c070000 con 0x7f377c1398e0 2023-12-19T16:07:08.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.318+0000 7f3780d6e640 1 --2- 172.21.15.37:0/1264849108 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f376806a480 0x7f376806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.319+0000 7f3780d6e640 1 --2- 172.21.15.37:0/1264849108 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f376806a480 0x7f376806c940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3770001640 tx=0x7f3770009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.320+0000 7f511a9c5640 1 --2- 172.21.15.37:0/224493950 >> [v2:172.21.15.78:6816/89460,v1:172.21.15.78:6817/89460] conn(0x7f50f8072560 0x7f50f8074980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.320+0000 7f378156f640 1 --2- 172.21.15.37:0/1264849108 >> [v2:172.21.15.78:6800/89461,v1:172.21.15.78:6801/89461] conn(0x7f377c1398e0 0x7f377c139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.321+0000 7f510affd640 1 -- 172.21.15.37:0/224493950 <== osd.6 v2:172.21.15.78:6816/89460 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f50f8075030 con 0x7f50f8072560 2023-12-19T16:07:08.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.322+0000 7f378156f640 1 --2- 172.21.15.37:0/1264849108 >> [v2:172.21.15.78:6800/89461,v1:172.21.15.78:6801/89461] conn(0x7f377c1398e0 0x7f377c139cc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.327+0000 7f37797fa640 1 -- 172.21.15.37:0/1264849108 <== osd.7 v2:172.21.15.78:6800/89461 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f377c070000 con 0x7f377c1398e0 2023-12-19T16:07:08.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.331+0000 7fe54022c640 1 -- 172.21.15.37:0/3449914082 --> [v2:172.21.15.37:6800/89452,v1:172.21.15.37:6801/89452] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe520002cb0 con 0x7fe51c072650 2023-12-19T16:07:08.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.331+0000 7fe52e7fc640 1 -- 172.21.15.37:0/3449914082 <== osd.0 v2:172.21.15.37:6800/89452 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe520002cb0 con 0x7fe51c072650 2023-12-19T16:07:08.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.332+0000 7fe51bfff640 1 -- 172.21.15.37:0/3449914082 >> [v2:172.21.15.37:6800/89452,v1:172.21.15.37:6801/89452] conn(0x7fe51c072650 msgr2=0x7fe51c074a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.332+0000 7fe51bfff640 1 --2- 172.21.15.37:0/3449914082 >> [v2:172.21.15.37:6800/89452,v1:172.21.15.37:6801/89452] conn(0x7fe51c072650 0x7fe51c074a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.333+0000 7fe51bfff640 1 -- 172.21.15.37:0/3449914082 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe51c06a430 msgr2=0x7fe51c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.333+0000 7fe51bfff640 1 --2- 172.21.15.37:0/3449914082 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe51c06a430 0x7fe51c06c8f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe53402b9e0 tx=0x7fe534008030 comp rx=0 tx=0).stop 2023-12-19T16:07:08.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.333+0000 7fe51bfff640 1 -- 172.21.15.37:0/3449914082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe530007fc0 msgr2=0x7fe530038660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.333+0000 7fe51bfff640 1 --2- 172.21.15.37:0/3449914082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe530007fc0 0x7fe530038660 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe52800d5f0 tx=0x7fe52800d9f0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.333+0000 7fe53e7c9640 1 -- 172.21.15.37:0/3449914082 reap_dead start 2023-12-19T16:07:08.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.333+0000 7fe51bfff640 1 -- 172.21.15.37:0/3449914082 shutdown_connections 2023-12-19T16:07:08.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.333+0000 7fe51bfff640 1 -- 172.21.15.37:0/3449914082 >> 172.21.15.37:0/3449914082 conn(0x7fe530006b50 msgr2=0x7fe5300d7160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.333+0000 7fe51bfff640 1 -- 172.21.15.37:0/3449914082 shutdown_connections 2023-12-19T16:07:08.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.334+0000 7fe51bfff640 1 -- 172.21.15.37:0/3449914082 wait complete. 2023-12-19T16:07:08.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.342+0000 7f5cdbe82640 1 -- 172.21.15.37:0/1652425716 --> [v2:172.21.15.37:6816/89455,v1:172.21.15.37:6817/89455] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5cd40b5280 con 0x7f5cb80726a0 2023-12-19T16:07:08.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.342+0000 7efef845c640 1 -- 172.21.15.37:0/1928937671 --> [v2:172.21.15.78:6808/89459,v1:172.21.15.78:6809/89459] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efef00bfba0 con 0x7efed4072720 2023-12-19T16:07:08.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.343+0000 7f5cca7fc640 1 -- 172.21.15.37:0/1652425716 <== osd.3 v2:172.21.15.37:6816/89455 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5cc4009510 con 0x7f5cb80726a0 2023-12-19T16:07:08.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.343+0000 7efee6ffd640 1 -- 172.21.15.37:0/1928937671 <== osd.5 v2:172.21.15.78:6808/89459 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efee8001090 con 0x7efed4072720 2023-12-19T16:07:08.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.343+0000 7f5cdbe82640 1 -- 172.21.15.37:0/1652425716 >> [v2:172.21.15.37:6816/89455,v1:172.21.15.37:6817/89455] conn(0x7f5cb80726a0 msgr2=0x7f5cb8074ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.343+0000 7f5cdbe82640 1 --2- 172.21.15.37:0/1652425716 >> [v2:172.21.15.37:6816/89455,v1:172.21.15.37:6817/89455] conn(0x7f5cb80726a0 0x7f5cb8074ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.343+0000 7efef845c640 1 -- 172.21.15.37:0/1928937671 >> [v2:172.21.15.78:6808/89459,v1:172.21.15.78:6809/89459] conn(0x7efed4072720 msgr2=0x7efed4074b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.343+0000 7efef845c640 1 --2- 172.21.15.37:0/1928937671 >> [v2:172.21.15.78:6808/89459,v1:172.21.15.78:6809/89459] conn(0x7efed4072720 0x7efed4074b40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.344+0000 7f5cdbe82640 1 -- 172.21.15.37:0/1652425716 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5cb806a480 msgr2=0x7f5cb806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.344+0000 7f5cdbe82640 1 --2- 172.21.15.37:0/1652425716 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5cb806a480 0x7f5cb806c940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0000f60 tx=0x7f5cd0007e20 comp rx=0 tx=0).stop 2023-12-19T16:07:08.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.344+0000 7efef845c640 1 -- 172.21.15.37:0/1928937671 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7efed406a500 msgr2=0x7efed406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.344+0000 7efef845c640 1 --2- 172.21.15.37:0/1928937671 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7efed406a500 0x7efed406c9c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efeec000f60 tx=0x7efeec007c80 comp rx=0 tx=0).stop 2023-12-19T16:07:08.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.344+0000 7efef845c640 1 -- 172.21.15.37:0/1928937671 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efef00b3900 msgr2=0x7efef01e3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.344+0000 7f5cdbe82640 1 -- 172.21.15.37:0/1652425716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd4148ce0 msgr2=0x7f5cd41e78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.344+0000 7efef845c640 1 --2- 172.21.15.37:0/1928937671 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efef00b3900 0x7efef01e3bb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efee000e870 tx=0x7efee000ed30 comp rx=0 tx=0).stop 2023-12-19T16:07:08.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.344+0000 7f5cdbe82640 1 --2- 172.21.15.37:0/1652425716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd4148ce0 0x7f5cd41e78b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009eb0 tx=0x7f5ccc004a40 comp rx=0 tx=0).stop 2023-12-19T16:07:08.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.344+0000 7f5cda41f640 1 -- 172.21.15.37:0/1652425716 reap_dead start 2023-12-19T16:07:08.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.344+0000 7efef69f9640 1 -- 172.21.15.37:0/1928937671 reap_dead start 2023-12-19T16:07:08.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.344+0000 7efef845c640 1 -- 172.21.15.37:0/1928937671 shutdown_connections 2023-12-19T16:07:08.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.344+0000 7efef845c640 1 -- 172.21.15.37:0/1928937671 >> 172.21.15.37:0/1928937671 conn(0x7efef00c0270 msgr2=0x7efef0149120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.344+0000 7f5cdbe82640 1 -- 172.21.15.37:0/1652425716 shutdown_connections 2023-12-19T16:07:08.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.344+0000 7f5cdbe82640 1 -- 172.21.15.37:0/1652425716 >> 172.21.15.37:0/1652425716 conn(0x7f5cd40bc220 msgr2=0x7f5cd40b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.344+0000 7efef845c640 1 -- 172.21.15.37:0/1928937671 shutdown_connections 2023-12-19T16:07:08.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.344+0000 7efef845c640 1 -- 172.21.15.37:0/1928937671 wait complete. 2023-12-19T16:07:08.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.344+0000 7fb7af59e640 1 -- 172.21.15.37:0/2454829073 --> [v2:172.21.15.78:6821/89462,v1:172.21.15.78:6823/89462] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb794002cb0 con 0x7fb790072720 2023-12-19T16:07:08.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.345+0000 7f5cdbe82640 1 -- 172.21.15.37:0/1652425716 shutdown_connections 2023-12-19T16:07:08.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.345+0000 7f5cdbe82640 1 -- 172.21.15.37:0/1652425716 wait complete. 2023-12-19T16:07:08.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.345+0000 7fb7a6ffd640 1 -- 172.21.15.37:0/2454829073 <== osd.4 v2:172.21.15.78:6821/89462 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb794002cb0 con 0x7fb790072720 2023-12-19T16:07:08.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.345+0000 7f3a4cff9640 1 -- 172.21.15.37:0/1646269607 --> [v2:172.21.15.37:6824/89456,v1:172.21.15.37:6825/89456] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3a34002cb0 con 0x7f3a3c072680 2023-12-19T16:07:08.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.345+0000 7fb7af59e640 1 -- 172.21.15.37:0/2454829073 >> [v2:172.21.15.78:6821/89462,v1:172.21.15.78:6823/89462] conn(0x7fb790072720 msgr2=0x7fb790074b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.345+0000 7fb7af59e640 1 --2- 172.21.15.37:0/2454829073 >> [v2:172.21.15.78:6821/89462,v1:172.21.15.78:6823/89462] conn(0x7fb790072720 0x7fb790074b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.346+0000 7fb7af59e640 1 -- 172.21.15.37:0/2454829073 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fb79006a500 msgr2=0x7fb79006c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.346+0000 7fb7af59e640 1 --2- 172.21.15.37:0/2454829073 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fb79006a500 0x7fb79006c9c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0035000 tx=0x7fb7a003a040 comp rx=0 tx=0).stop 2023-12-19T16:07:08.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.346+0000 7fb7af59e640 1 -- 172.21.15.37:0/2454829073 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb7b00bc5a0 msgr2=0x7fb7b00b9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.346+0000 7fb7af59e640 1 --2- 172.21.15.37:0/2454829073 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb7b00bc5a0 0x7fb7b00b9260 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8007fc0 tx=0x7fb7a800d560 comp rx=0 tx=0).stop 2023-12-19T16:07:08.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.346+0000 7fb7aed9d640 1 -- 172.21.15.37:0/2454829073 reap_dead start 2023-12-19T16:07:08.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.346+0000 7f3a4effd640 1 -- 172.21.15.37:0/1646269607 <== osd.2 v2:172.21.15.37:6824/89456 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3a34002cb0 con 0x7f3a3c072680 2023-12-19T16:07:08.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.346+0000 7fb7af59e640 1 -- 172.21.15.37:0/2454829073 shutdown_connections 2023-12-19T16:07:08.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.346+0000 7fb7af59e640 1 -- 172.21.15.37:0/2454829073 >> 172.21.15.37:0/2454829073 conn(0x7fb7b00c0090 msgr2=0x7fb7b0138290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.346+0000 7fb7af59e640 1 -- 172.21.15.37:0/2454829073 shutdown_connections 2023-12-19T16:07:08.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.346+0000 7fb7af59e640 1 -- 172.21.15.37:0/2454829073 wait complete. 2023-12-19T16:07:08.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.346+0000 7f3a4cff9640 1 -- 172.21.15.37:0/1646269607 >> [v2:172.21.15.37:6824/89456,v1:172.21.15.37:6825/89456] conn(0x7f3a3c072680 msgr2=0x7f3a3c074aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.347+0000 7f3a4cff9640 1 --2- 172.21.15.37:0/1646269607 >> [v2:172.21.15.37:6824/89456,v1:172.21.15.37:6825/89456] conn(0x7f3a3c072680 0x7f3a3c074aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.347+0000 7f3a4cff9640 1 -- 172.21.15.37:0/1646269607 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3a3c06a460 msgr2=0x7f3a3c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.347+0000 7f3a4cff9640 1 --2- 172.21.15.37:0/1646269607 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3a3c06a460 0x7f3a3c06c920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3a5015f9d0 tx=0x7f3a48000bc0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.347+0000 7efe2ec38640 1 -- 172.21.15.37:0/647713359 --> [v2:172.21.15.37:6808/89453,v1:172.21.15.37:6809/89453] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efe280bfe80 con 0x7efe0c072650 2023-12-19T16:07:08.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.347+0000 7f3a4cff9640 1 -- 172.21.15.37:0/1646269607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a440052a0 msgr2=0x7f3a500c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.347+0000 7f3a4cff9640 1 --2- 172.21.15.37:0/1646269607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a440052a0 0x7f3a500c81c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3a5400f5f0 tx=0x7f3a5400fab0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.347+0000 7f3a5e9ee640 1 -- 172.21.15.37:0/1646269607 reap_dead start 2023-12-19T16:07:08.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.347+0000 7f3a4cff9640 1 -- 172.21.15.37:0/1646269607 shutdown_connections 2023-12-19T16:07:08.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.347+0000 7f3a4cff9640 1 -- 172.21.15.37:0/1646269607 >> 172.21.15.37:0/1646269607 conn(0x7f3a500062b0 msgr2=0x7f3a500cc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.347+0000 7f3a4cff9640 1 -- 172.21.15.37:0/1646269607 shutdown_connections 2023-12-19T16:07:08.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.347+0000 7f3a4cff9640 1 -- 172.21.15.37:0/1646269607 wait complete. 2023-12-19T16:07:08.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.347+0000 7efe257fa640 1 -- 172.21.15.37:0/647713359 <== osd.1 v2:172.21.15.37:6808/89453 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efe20003990 con 0x7efe0c072650 2023-12-19T16:07:08.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.348+0000 7efe2ec38640 1 -- 172.21.15.37:0/647713359 >> [v2:172.21.15.37:6808/89453,v1:172.21.15.37:6809/89453] conn(0x7efe0c072650 msgr2=0x7efe0c074a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.348+0000 7efe2ec38640 1 --2- 172.21.15.37:0/647713359 >> [v2:172.21.15.37:6808/89453,v1:172.21.15.37:6809/89453] conn(0x7efe0c072650 0x7efe0c074a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.412 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-12-19T16:07:08.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.349+0000 7efe2ec38640 1 -- 172.21.15.37:0/647713359 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7efe0c06a430 msgr2=0x7efe0c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.349+0000 7efe2ec38640 1 --2- 172.21.15.37:0/647713359 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7efe0c06a430 0x7efe0c06c8f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efe1c004e50 tx=0x7efe1c0079e0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.413 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-19T16:07:08.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.349+0000 7efe2ec38640 1 -- 172.21.15.37:0/647713359 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efe280b3900 msgr2=0x7efe280a0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.349+0000 7efe2ec38640 1 --2- 172.21.15.37:0/647713359 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efe280b3900 0x7efe280a0dd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efe1400e810 tx=0x7efe1400ecd0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.349+0000 7efe2d1d5640 1 -- 172.21.15.37:0/647713359 reap_dead start 2023-12-19T16:07:08.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.349+0000 7efe2ec38640 1 -- 172.21.15.37:0/647713359 shutdown_connections 2023-12-19T16:07:08.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.349+0000 7efe2ec38640 1 -- 172.21.15.37:0/647713359 >> 172.21.15.37:0/647713359 conn(0x7efe280c0270 msgr2=0x7efe28149720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.349+0000 7efe2ec38640 1 -- 172.21.15.37:0/647713359 shutdown_connections 2023-12-19T16:07:08.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.349+0000 7efe2ec38640 1 -- 172.21.15.37:0/647713359 wait complete. 2023-12-19T16:07:08.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.353+0000 7f511c428640 1 -- 172.21.15.37:0/224493950 --> [v2:172.21.15.78:6816/89460,v1:172.21.15.78:6817/89460] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f51140bc340 con 0x7f50f8072560 2023-12-19T16:07:08.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.353+0000 7f510affd640 1 -- 172.21.15.37:0/224493950 <== osd.6 v2:172.21.15.78:6816/89460 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f510c007580 con 0x7f50f8072560 2023-12-19T16:07:08.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.353+0000 7f511c428640 1 -- 172.21.15.37:0/224493950 >> [v2:172.21.15.78:6816/89460,v1:172.21.15.78:6817/89460] conn(0x7f50f8072560 msgr2=0x7f50f8074980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.354+0000 7f511c428640 1 --2- 172.21.15.37:0/224493950 >> [v2:172.21.15.78:6816/89460,v1:172.21.15.78:6817/89460] conn(0x7f50f8072560 0x7f50f8074980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.354+0000 7f511c428640 1 -- 172.21.15.37:0/224493950 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f50f806a4b0 msgr2=0x7f50f806c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.354+0000 7f3762ffd640 1 -- 172.21.15.37:0/1264849108 --> [v2:172.21.15.78:6800/89461,v1:172.21.15.78:6801/89461] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f377c070170 con 0x7f377c1398e0 2023-12-19T16:07:08.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.354+0000 7f511c428640 1 --2- 172.21.15.37:0/224493950 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f50f806a4b0 0x7f50f806c970 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f511413e240 tx=0x7f5104009030 comp rx=0 tx=0).stop 2023-12-19T16:07:08.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.354+0000 7f511c428640 1 -- 172.21.15.37:0/224493950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51000047c0 msgr2=0x7f51141db840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.354+0000 7f511c428640 1 --2- 172.21.15.37:0/224493950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51000047c0 0x7f51141db840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5110007fb0 tx=0x7f511000f5e0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.354+0000 7f511a9c5640 1 -- 172.21.15.37:0/224493950 reap_dead start 2023-12-19T16:07:08.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.354+0000 7f37797fa640 1 -- 172.21.15.37:0/1264849108 <== osd.7 v2:172.21.15.78:6800/89461 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f377c070170 con 0x7f377c1398e0 2023-12-19T16:07:08.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.354+0000 7f511c428640 1 -- 172.21.15.37:0/224493950 shutdown_connections 2023-12-19T16:07:08.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.354+0000 7f511c428640 1 -- 172.21.15.37:0/224493950 >> 172.21.15.37:0/224493950 conn(0x7f5114071e60 msgr2=0x7f51141418f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.355+0000 7f511c428640 1 -- 172.21.15.37:0/224493950 shutdown_connections 2023-12-19T16:07:08.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.355+0000 7f511c428640 1 -- 172.21.15.37:0/224493950 wait complete. 2023-12-19T16:07:08.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.355+0000 7f3762ffd640 1 -- 172.21.15.37:0/1264849108 >> [v2:172.21.15.78:6800/89461,v1:172.21.15.78:6801/89461] conn(0x7f377c1398e0 msgr2=0x7f377c139cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.355+0000 7f3762ffd640 1 --2- 172.21.15.37:0/1264849108 >> [v2:172.21.15.78:6800/89461,v1:172.21.15.78:6801/89461] conn(0x7f377c1398e0 0x7f377c139cc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.355+0000 7f3762ffd640 1 -- 172.21.15.37:0/1264849108 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f376806a480 msgr2=0x7f376806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.355+0000 7f3762ffd640 1 --2- 172.21.15.37:0/1264849108 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f376806a480 0x7f376806c940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3770001640 tx=0x7f3770009040 comp rx=0 tx=0).stop 2023-12-19T16:07:08.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.355+0000 7f3762ffd640 1 -- 172.21.15.37:0/1264849108 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f377c14b170 msgr2=0x7f377c0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.355+0000 7f3762ffd640 1 --2- 172.21.15.37:0/1264849108 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f377c14b170 0x7f377c0702e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f376c00e9e0 tx=0x7f376c00eea0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.355+0000 7f378156f640 1 -- 172.21.15.37:0/1264849108 reap_dead start 2023-12-19T16:07:08.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.355+0000 7f3762ffd640 1 -- 172.21.15.37:0/1264849108 shutdown_connections 2023-12-19T16:07:08.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.355+0000 7f3762ffd640 1 -- 172.21.15.37:0/1264849108 >> 172.21.15.37:0/1264849108 conn(0x7f377c0c0090 msgr2=0x7f377c0b9670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.356+0000 7f3762ffd640 1 -- 172.21.15.37:0/1264849108 shutdown_connections 2023-12-19T16:07:08.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.356+0000 7f3762ffd640 1 -- 172.21.15.37:0/1264849108 wait complete. 2023-12-19T16:07:08.419 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-12-19T16:07:08.420 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-12-19T16:07:08.421 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-19T16:07:08.421 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-19T16:07:08.422 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-12-19T16:07:08.422 INFO:teuthology.orchestra.run.smithi037.stdout:55834574857 2023-12-19T16:07:08.423 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-19T16:07:08.423 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-19T16:07:08.424 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-12-19T16:07:08.424 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-19T16:07:08.425 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-12-19T16:07:08.425 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-19T16:07:08.426 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-12-19T16:07:08.426 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-19T16:07:08.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.642+0000 7f0850789640 1 Processor -- start 2023-12-19T16:07:08.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.642+0000 7fa5d01ab640 1 Processor -- start 2023-12-19T16:07:08.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.642+0000 7fa5d01ab640 1 -- start start 2023-12-19T16:07:08.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.643+0000 7f43b1ab9640 1 Processor -- start 2023-12-19T16:07:08.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.643+0000 7f87ad6fa640 1 Processor -- start 2023-12-19T16:07:08.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.643+0000 7f0c6d730640 1 Processor -- start 2023-12-19T16:07:08.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.643+0000 7fa5d01ab640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5c806cda0 0x7fa5c806bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.643+0000 7f43b1ab9640 1 -- start start 2023-12-19T16:07:08.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.643+0000 7fa25d215640 1 Processor -- start 2023-12-19T16:07:08.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.643+0000 7fa25d215640 1 -- start start 2023-12-19T16:07:08.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.643+0000 7fecf9ada640 1 Processor -- start 2023-12-19T16:07:08.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.643+0000 7fa5d01ab640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5c806e9e0 0x7fa5c806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.643+0000 7fa5d01ab640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c8071850 con 0x7fa5c8146a80 2023-12-19T16:07:08.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.643+0000 7fa5d01ab640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c8070680 con 0x7fa5c806e9e0 2023-12-19T16:07:08.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.643+0000 7fa5d01ab640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c806c190 con 0x7fa5c806cda0 2023-12-19T16:07:08.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.643+0000 7fa5cd746640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5c806e9e0 0x7fa5c806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7fa5cd746640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5c806e9e0 0x7fa5c806ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:40826/0 (socket says 172.21.15.37:40826) 2023-12-19T16:07:08.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7fa5cd746640 1 -- 172.21.15.37:0/493801004 learned_addr learned my addr 172.21.15.37:0/493801004 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f43b1ab9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43ac0b35b0 0x7f43ac152630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f43b1ab9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ac153000 con 0x7f43ac152b70 2023-12-19T16:07:08.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f43b1ab9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ac0bcaf0 con 0x7f43ac149020 2023-12-19T16:07:08.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f43b1ab9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac0b48d0 con 0x7f43ac0b35b0 2023-12-19T16:07:08.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.642+0000 7f0850789640 1 -- start start 2023-12-19T16:07:08.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f0850789640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f084813cff0 0x7f084813d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f0850789640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08480b6650 con 0x7f0848146fc0 2023-12-19T16:07:08.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f0850789640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f084814a8a0 con 0x7f08480b4ed0 2023-12-19T16:07:08.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f0850789640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084814ab80 con 0x7f084813cff0 2023-12-19T16:07:08.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f084dd24640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f084813cff0 0x7f084813d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.643+0000 7f87ad6fa640 1 -- start start 2023-12-19T16:07:08.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f87ad6fa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f87a003e210 0x7f87a00ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f87ad6fa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0043340 con 0x7f87a00084b0 2023-12-19T16:07:08.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f87ad6fa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0036f80 con 0x7f87a00ce9d0 2023-12-19T16:07:08.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f87ad6fa640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a0036cb0 con 0x7f87a003e210 2023-12-19T16:07:08.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f43aaffd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43ac0b35b0 0x7f43ac152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f43aaffd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43ac0b35b0 0x7f43ac152630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:45614/0 (socket says 172.21.15.37:45614) 2023-12-19T16:07:08.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f43aaffd640 1 -- 172.21.15.37:0/373144919 learned_addr learned my addr 172.21.15.37:0/373144919 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.643+0000 7f0c6d730640 1 -- start start 2023-12-19T16:07:08.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f0c6d730640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c6806fa70 0x7f0c68152a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f0c6d730640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c68071940 con 0x7f0c6806b480 2023-12-19T16:07:08.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f0c6d730640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c68071660 con 0x7f0c68152fc0 2023-12-19T16:07:08.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f0c6d730640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c68070200 con 0x7f0c6806fa70 2023-12-19T16:07:08.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7fa5cd746640 1 -- 172.21.15.37:0/493801004 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5c806cda0 msgr2=0x7fa5c806bc50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T16:07:08.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f0c677fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c6806fa70 0x7f0c68152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7fa25d215640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa250006b30 0x7fa2500d8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7fa25d215640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa2500d5940 0x7fa2500d5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7fa25d215640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2500d6330 con 0x7fa250028410 2023-12-19T16:07:08.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7fa5cd746640 1 --2- 172.21.15.37:0/493801004 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5c806cda0 0x7fa5c806bc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7f0c677fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c6806fa70 0x7f0c68152a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49658/0 (socket says 172.21.15.37:49658) 2023-12-19T16:07:08.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7fa25d215640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2500d9a20 con 0x7fa250006b30 2023-12-19T16:07:08.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7fa25d215640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500d9180 con 0x7fa2500d5940 2023-12-19T16:07:08.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7f0c677fe640 1 -- 172.21.15.37:0/1145355598 learned_addr learned my addr 172.21.15.37:0/1145355598 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7fa5cd746640 1 -- 172.21.15.37:0/493801004 >> v1:172.21.15.78:6789/0 conn(0x7fa5c8146a80 legacy=0x7fa5c8146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f084dd24640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f084813cff0 0x7f084813d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:40834/0 (socket says 172.21.15.37:40834) 2023-12-19T16:07:08.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7f084dd24640 1 -- 172.21.15.37:0/1076795419 learned_addr learned my addr 172.21.15.37:0/1076795419 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7f084dd24640 1 -- 172.21.15.37:0/1076795419 >> v1:172.21.15.78:6789/0 conn(0x7f08480b4ed0 legacy=0x7f0848149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7f084dd24640 1 -- 172.21.15.37:0/1076795419 >> v1:172.21.15.37:6789/0 conn(0x7f0848146fc0 legacy=0x7f0848151210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T16:07:08.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7fa5cd746640 1 -- 172.21.15.37:0/493801004 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c806fce0 con 0x7fa5c806e9e0 2023-12-19T16:07:08.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7f87a7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f87a003e210 0x7f87a00ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7f87a7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f87a003e210 0x7f87a00ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:40846/0 (socket says 172.21.15.37:40846) 2023-12-19T16:07:08.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7f084dd24640 1 -- 172.21.15.37:0/1076795419 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0848146aa0 con 0x7f084813cff0 2023-12-19T16:07:08.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7f43aaffd640 1 -- 172.21.15.37:0/373144919 >> v1:172.21.15.78:6789/0 conn(0x7f43ac149020 legacy=0x7f43ac0bc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7f43aaffd640 1 -- 172.21.15.37:0/373144919 >> v1:172.21.15.37:6789/0 conn(0x7f43ac152b70 legacy=0x7f43ac1595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7f87a7fff640 1 -- 172.21.15.37:0/216979850 learned_addr learned my addr 172.21.15.37:0/216979850 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.644+0000 7fecf9ada640 1 -- start start 2023-12-19T16:07:08.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7fecf9ada640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fecf406b480 0x7fecf4143c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7fecf9ada640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fecf406e9a0 0x7fecf4151250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7f87a7fff640 1 -- 172.21.15.37:0/216979850 >> v1:172.21.15.78:6789/0 conn(0x7f87a00ce9d0 legacy=0x7f87a0007da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7f87a7fff640 1 -- 172.21.15.37:0/216979850 >> v1:172.21.15.37:6789/0 conn(0x7f87a00084b0 legacy=0x7f87a00d8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7f87a7fff640 1 -- 172.21.15.37:0/216979850 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a0042cf0 con 0x7f87a003e210 2023-12-19T16:07:08.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7fecf9ada640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf414abc0 con 0x7fecf4144170 2023-12-19T16:07:08.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7fecf9ada640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf414a290 con 0x7fecf406e9a0 2023-12-19T16:07:08.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7fecf9ada640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf414a570 con 0x7fecf406b480 2023-12-19T16:07:08.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7fa5cd746640 1 --2- 172.21.15.37:0/493801004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c806e9e0 0x7fa5c806ee00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009e50 tx=0x7fa5c002bfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c05606779e384df server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7fecf8ad8640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fecf406b480 0x7fecf4143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7fecf8ad8640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fecf406b480 0x7fecf4143c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:45624/0 (socket says 172.21.15.37:45624) 2023-12-19T16:07:08.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7fecf8ad8640 1 -- 172.21.15.37:0/1353644308 learned_addr learned my addr 172.21.15.37:0/1353644308 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.646+0000 7fecf92d9640 1 --2- 172.21.15.37:0/1353644308 >> v2:172.21.15.78:3300/0 conn(0x7fecf406e9a0 0x7fecf4151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.646+0000 7fa5ccf45640 1 -- 172.21.15.37:0/493801004 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c002cb40 con 0x7fa5c806e9e0 2023-12-19T16:07:08.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7fa25ca14640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa2500d5940 0x7fa2500d5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7fa25ca14640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa2500d5940 0x7fa2500d5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:45620/0 (socket says 172.21.15.37:45620) 2023-12-19T16:07:08.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7fa25ca14640 1 -- 172.21.15.37:0/3453307113 learned_addr learned my addr 172.21.15.37:0/3453307113 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.646+0000 7fa25ca14640 1 -- 172.21.15.37:0/3453307113 >> v2:172.21.15.37:3300/0 conn(0x7fa250006b30 msgr2=0x7fa2500d8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.646+0000 7fa25ca14640 1 --2- 172.21.15.37:0/3453307113 >> v2:172.21.15.37:3300/0 conn(0x7fa250006b30 0x7fa2500d8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.646+0000 7fa25ca14640 1 -- 172.21.15.37:0/3453307113 >> v1:172.21.15.37:6789/0 conn(0x7fa250028410 legacy=0x7fa2500cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.646+0000 7fa25ca14640 1 -- 172.21.15.37:0/3453307113 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2500d9460 con 0x7fa2500d5940 2023-12-19T16:07:08.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.646+0000 7fa5ccf45640 1 -- 172.21.15.37:0/493801004 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c002cca0 con 0x7fa5c806e9e0 2023-12-19T16:07:08.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.646+0000 7fa5ccf45640 1 -- 172.21.15.37:0/493801004 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0034610 con 0x7fa5c806e9e0 2023-12-19T16:07:08.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.646+0000 7f0c66ffd640 1 -- 172.21.15.37:0/1145355598 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559632026 0 0) 0x7f0c68071940 con 0x7f0c6806b480 2023-12-19T16:07:08.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.645+0000 7f43aaffd640 1 -- 172.21.15.37:0/373144919 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac0b4bb0 con 0x7f43ac0b35b0 2023-12-19T16:07:08.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.646+0000 7fecf8ad8640 1 -- 172.21.15.37:0/1353644308 >> v2:172.21.15.78:3300/0 conn(0x7fecf406e9a0 msgr2=0x7fecf4151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.646+0000 7fecf8ad8640 1 --2- 172.21.15.37:0/1353644308 >> v2:172.21.15.78:3300/0 conn(0x7fecf406e9a0 0x7fecf4151250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.646+0000 7fecf8ad8640 1 -- 172.21.15.37:0/1353644308 >> v1:172.21.15.78:6789/0 conn(0x7fecf4144170 legacy=0x7fecf4146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.646+0000 7fecf8ad8640 1 -- 172.21.15.37:0/1353644308 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf414a850 con 0x7fecf406b480 2023-12-19T16:07:08.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.646+0000 7f0c66ffd640 1 -- 172.21.15.37:0/1145355598 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c50003520 con 0x7f0c6806b480 2023-12-19T16:07:08.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.646+0000 7f43aaffd640 1 --2- 172.21.15.37:0/373144919 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43ac0b35b0 0x7f43ac152630 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009e80 tx=0x7f43a402bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65ef5cbb73a67181 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.646+0000 7f43aa7fc640 1 -- 172.21.15.37:0/373144919 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a402cb70 con 0x7f43ac0b35b0 2023-12-19T16:07:08.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.646+0000 7f084dd24640 1 --2- 172.21.15.37:0/1076795419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f084813cff0 0x7f084813d460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f084000d370 tx=0x7f084002e310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4afc9f24f2a9031 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7f43aa7fc640 1 -- 172.21.15.37:0/373144919 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a402ccd0 con 0x7f43ac0b35b0 2023-12-19T16:07:08.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7f87a7fff640 1 --2- 172.21.15.37:0/216979850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a003e210 0x7f87a00ce490 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8794010bb0 tx=0x7f879402ffc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7732b2ede639454f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7f0c66ffd640 1 -- 172.21.15.37:0/1145355598 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382867421 0 0) 0x7f0c68071660 con 0x7f0c68152fc0 2023-12-19T16:07:08.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7f0c66ffd640 1 -- 172.21.15.37:0/1145355598 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c50003840 con 0x7f0c68152fc0 2023-12-19T16:07:08.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7f87a6ffd640 1 -- 172.21.15.37:0/216979850 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8794030d70 con 0x7f87a003e210 2023-12-19T16:07:08.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7f0c66ffd640 1 -- 172.21.15.37:0/1145355598 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2306999661 0 0) 0x7f0c50003520 con 0x7f0c6806b480 2023-12-19T16:07:08.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7f0c677fe640 1 -- 172.21.15.37:0/1145355598 >> v1:172.21.15.78:6789/0 conn(0x7f0c68152fc0 legacy=0x7f0c681597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7f0c677fe640 1 -- 172.21.15.37:0/1145355598 >> v1:172.21.15.37:6789/0 conn(0x7f0c6806b480 legacy=0x7f0c680b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7f0c677fe640 1 -- 172.21.15.37:0/1145355598 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6806f550 con 0x7f0c6806fa70 2023-12-19T16:07:08.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7fa25ca14640 1 --2- 172.21.15.37:0/3453307113 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa2500d5940 0x7fa2500d5df0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009870 tx=0x7fa24c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45e5d5b9d0cf026a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7f87a6ffd640 1 -- 172.21.15.37:0/216979850 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8794038440 con 0x7f87a003e210 2023-12-19T16:07:08.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7f43aa7fc640 1 -- 172.21.15.37:0/373144919 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4034610 con 0x7f43ac0b35b0 2023-12-19T16:07:08.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7fecf8ad8640 1 --2- 172.21.15.37:0/1353644308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fecf406b480 0x7fecf4143c30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fece400a910 tx=0x7fece4030100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c20db9db9e16637d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7fa5d01ab640 1 -- 172.21.15.37:0/493801004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c806e9e0 msgr2=0x7fa5c806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7fa5d01ab640 1 --2- 172.21.15.37:0/493801004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c806e9e0 0x7fa5c806ee00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009e50 tx=0x7fa5c002bfa0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7f084d523640 1 -- 172.21.15.37:0/1076795419 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840038600 con 0x7f084813cff0 2023-12-19T16:07:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7f084d523640 1 -- 172.21.15.37:0/1076795419 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0840032070 con 0x7f084813cff0 2023-12-19T16:07:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7f084d523640 1 -- 172.21.15.37:0/1076795419 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840038980 con 0x7f084813cff0 2023-12-19T16:07:08.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7fa256ffd640 1 -- 172.21.15.37:0/3453307113 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c031640 con 0x7fa2500d5940 2023-12-19T16:07:08.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7fa5d01ab640 1 -- 172.21.15.37:0/493801004 shutdown_connections 2023-12-19T16:07:08.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7fa5d01ab640 1 --2- 172.21.15.37:0/493801004 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c806e9e0 0x7fa5c806ee00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7fa5d01ab640 1 --2- 172.21.15.37:0/493801004 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5c806cda0 0x7fa5c806bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7fa5d01ab640 1 -- 172.21.15.37:0/493801004 >> 172.21.15.37:0/493801004 conn(0x7fa5c80bc0d0 msgr2=0x7fa5c80bc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7f43b1ab9640 1 -- 172.21.15.37:0/373144919 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43ac0b35b0 msgr2=0x7f43ac152630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7f43b1ab9640 1 --2- 172.21.15.37:0/373144919 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43ac0b35b0 0x7f43ac152630 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009e80 tx=0x7f43a402bfd0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7fa256ffd640 1 -- 172.21.15.37:0/3453307113 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24c0317a0 con 0x7fa2500d5940 2023-12-19T16:07:08.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.647+0000 7fa256ffd640 1 -- 172.21.15.37:0/3453307113 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c031b30 con 0x7fa2500d5940 2023-12-19T16:07:08.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.648+0000 7f87a6ffd640 1 -- 172.21.15.37:0/216979850 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87940387d0 con 0x7f87a003e210 2023-12-19T16:07:08.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.648+0000 7f43b1ab9640 1 -- 172.21.15.37:0/373144919 shutdown_connections 2023-12-19T16:07:08.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.648+0000 7f43b1ab9640 1 --2- 172.21.15.37:0/373144919 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43ac0b35b0 0x7f43ac152630 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.648+0000 7f43b1ab9640 1 -- 172.21.15.37:0/373144919 >> 172.21.15.37:0/373144919 conn(0x7f43ac06a2b0 msgr2=0x7f43ac0bbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.648+0000 7fa5d01ab640 1 -- 172.21.15.37:0/493801004 shutdown_connections 2023-12-19T16:07:08.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.648+0000 7f43b1ab9640 1 -- 172.21.15.37:0/373144919 shutdown_connections 2023-12-19T16:07:08.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.648+0000 7f87ad6fa640 1 -- 172.21.15.37:0/216979850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a003e210 msgr2=0x7f87a00ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.648+0000 7f87ad6fa640 1 --2- 172.21.15.37:0/216979850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a003e210 0x7f87a00ce490 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8794010bb0 tx=0x7f879402ffc0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.648+0000 7f43b1ab9640 1 -- 172.21.15.37:0/373144919 wait complete. 2023-12-19T16:07:08.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.648+0000 7fecf37fe640 1 -- 172.21.15.37:0/1353644308 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece403a400 con 0x7fecf406b480 2023-12-19T16:07:08.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.648+0000 7fecf37fe640 1 -- 172.21.15.37:0/1353644308 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece4034070 con 0x7fecf406b480 2023-12-19T16:07:08.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.648+0000 7fecf37fe640 1 -- 172.21.15.37:0/1353644308 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece403a780 con 0x7fecf406b480 2023-12-19T16:07:08.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.648+0000 7f87ad6fa640 1 -- 172.21.15.37:0/216979850 shutdown_connections 2023-12-19T16:07:08.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.648+0000 7f87ad6fa640 1 --2- 172.21.15.37:0/216979850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a003e210 0x7f87a00ce490 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.648+0000 7f87ad6fa640 1 -- 172.21.15.37:0/216979850 >> 172.21.15.37:0/216979850 conn(0x7f87a00400a0 msgr2=0x7f87a00404b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7f87ad6fa640 1 -- 172.21.15.37:0/216979850 shutdown_connections 2023-12-19T16:07:08.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7fa25d215640 1 -- 172.21.15.37:0/3453307113 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa2500d5940 msgr2=0x7fa2500d5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7fa25d215640 1 --2- 172.21.15.37:0/3453307113 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa2500d5940 0x7fa2500d5df0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009870 tx=0x7fa24c02b8f0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7f87ad6fa640 1 -- 172.21.15.37:0/216979850 wait complete. 2023-12-19T16:07:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7f0c677fe640 1 --2- 172.21.15.37:0/1145355598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6806fa70 0x7f0c68152a80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009870 tx=0x7f0c5802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcd2da38fad4167 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7fecf9ada640 1 -- 172.21.15.37:0/1353644308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fecf406b480 msgr2=0x7fecf4143c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7fecf9ada640 1 --2- 172.21.15.37:0/1353644308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fecf406b480 0x7fecf4143c30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fece400a910 tx=0x7fece4030100 comp rx=0 tx=0).stop 2023-12-19T16:07:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7fecf9ada640 1 -- 172.21.15.37:0/1353644308 shutdown_connections 2023-12-19T16:07:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7fecf9ada640 1 --2- 172.21.15.37:0/1353644308 >> v2:172.21.15.78:3300/0 conn(0x7fecf406e9a0 0x7fecf4151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7fecf9ada640 1 --2- 172.21.15.37:0/1353644308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fecf406b480 0x7fecf4143c30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7fecf9ada640 1 -- 172.21.15.37:0/1353644308 >> 172.21.15.37:0/1353644308 conn(0x7fecf40bbcf0 msgr2=0x7fecf40bc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7fecf9ada640 1 -- 172.21.15.37:0/1353644308 shutdown_connections 2023-12-19T16:07:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.648+0000 7f0850789640 1 -- 172.21.15.37:0/1076795419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f084813cff0 msgr2=0x7f084813d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.648+0000 7f0850789640 1 --2- 172.21.15.37:0/1076795419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f084813cff0 0x7f084813d460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f084000d370 tx=0x7f084002e310 comp rx=0 tx=0).stop 2023-12-19T16:07:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7f0c66ffd640 1 -- 172.21.15.37:0/1145355598 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c600019d0 con 0x7f0c6806fa70 2023-12-19T16:07:08.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7f0850789640 1 -- 172.21.15.37:0/1076795419 shutdown_connections 2023-12-19T16:07:08.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7f0850789640 1 --2- 172.21.15.37:0/1076795419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f084813cff0 0x7f084813d460 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7f0850789640 1 -- 172.21.15.37:0/1076795419 >> 172.21.15.37:0/1076795419 conn(0x7f08480bbcd0 msgr2=0x7f08480bc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7f0c66ffd640 1 -- 172.21.15.37:0/1145355598 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c580315d0 con 0x7f0c6806fa70 2023-12-19T16:07:08.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7fecf9ada640 1 -- 172.21.15.37:0/1353644308 wait complete. 2023-12-19T16:07:08.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7f0c66ffd640 1 -- 172.21.15.37:0/1145355598 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58031960 con 0x7f0c6806fa70 2023-12-19T16:07:08.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.648+0000 7fa5d01ab640 1 -- 172.21.15.37:0/493801004 wait complete. 2023-12-19T16:07:08.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7f43b1ab9640 1 Processor -- start 2023-12-19T16:07:08.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7fa25d215640 1 -- 172.21.15.37:0/3453307113 shutdown_connections 2023-12-19T16:07:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7fa25d215640 1 --2- 172.21.15.37:0/3453307113 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa2500d5940 0x7fa2500d5df0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7fa25d215640 1 --2- 172.21.15.37:0/3453307113 >> v2:172.21.15.37:3300/0 conn(0x7fa250006b30 0x7fa2500d8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7fa25d215640 1 -- 172.21.15.37:0/3453307113 >> 172.21.15.37:0/3453307113 conn(0x7fa250005da0 msgr2=0x7fa2500061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7f1834816640 1 Processor -- start 2023-12-19T16:07:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7fa25d215640 1 -- 172.21.15.37:0/3453307113 shutdown_connections 2023-12-19T16:07:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7fa25d215640 1 -- 172.21.15.37:0/3453307113 wait complete. 2023-12-19T16:07:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7f0c6d730640 1 -- 172.21.15.37:0/1145355598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6806fa70 msgr2=0x7f0c68152a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7f0c6d730640 1 --2- 172.21.15.37:0/1145355598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6806fa70 0x7f0c68152a80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009870 tx=0x7f0c5802b8f0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7f0c6d730640 1 -- 172.21.15.37:0/1145355598 shutdown_connections 2023-12-19T16:07:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7f0c6d730640 1 --2- 172.21.15.37:0/1145355598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6806fa70 0x7f0c68152a80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7f0c6d730640 1 -- 172.21.15.37:0/1145355598 >> 172.21.15.37:0/1145355598 conn(0x7f0c680bbed0 msgr2=0x7f0c680bc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7f87ad6fa640 1 Processor -- start 2023-12-19T16:07:08.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7f87ad6fa640 1 -- start start 2023-12-19T16:07:08.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7fecf9ada640 1 Processor -- start 2023-12-19T16:07:08.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7fa5d01ab640 1 Processor -- start 2023-12-19T16:07:08.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7fa5d01ab640 1 -- start start 2023-12-19T16:07:08.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7fa5d01ab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5c806cda0 0x7fa5c80bafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7fa5d01ab640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5c806e9e0 0x7fa5c812c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7fa5d01ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c8146a80 0x7fa5c812c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7fa5d01ab640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c80bb510 con 0x7fa5c806cda0 2023-12-19T16:07:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7fa5d01ab640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c8142fa0 con 0x7fa5c8146a80 2023-12-19T16:07:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7fa5d01ab640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c8143280 con 0x7fa5c806e9e0 2023-12-19T16:07:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7f43b1ab9640 1 -- start start 2023-12-19T16:07:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7f43b1ab9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43ac0b35b0 0x7f43ac0bbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7f43b1ab9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43ac149020 0x7f43ac0701d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7f43b1ab9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43ac152b70 0x7f43ac06f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7f0c6d730640 1 -- 172.21.15.37:0/1145355598 shutdown_connections 2023-12-19T16:07:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7f0850789640 1 -- 172.21.15.37:0/1076795419 shutdown_connections 2023-12-19T16:07:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.649+0000 7f1834816640 1 -- start start 2023-12-19T16:07:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7f1834816640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18280072b0 0x7f1828040780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7f1834816640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1828042fe0 con 0x7f1828042ac0 2023-12-19T16:07:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7f1834816640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182803dd90 con 0x7f18280cac20 2023-12-19T16:07:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7f1834816640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f182803e5b0 con 0x7f18280072b0 2023-12-19T16:07:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7f43b1ab9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac0bc430 con 0x7f43ac152b70 2023-12-19T16:07:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7f43b1ab9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac141430 con 0x7f43ac149020 2023-12-19T16:07:08.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7f43b1ab9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac070710 con 0x7f43ac0b35b0 2023-12-19T16:07:08.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7f182e59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1828042ac0 0x7f18280d0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37126/0 (socket says 172.21.15.37:37126) 2023-12-19T16:07:08.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7f0c6d730640 1 -- 172.21.15.37:0/1145355598 wait complete. 2023-12-19T16:07:08.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7f182e59c640 1 -- 172.21.15.37:0/614244783 learned_addr learned my addr 172.21.15.37:0/614244783 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:08.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7fa25d215640 1 Processor -- start 2023-12-19T16:07:08.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7f43ab7fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43ac0b35b0 0x7f43ac0bbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7fa5cd746640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5c806e9e0 0x7fa5c812c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7fa5cd746640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5c806e9e0 0x7fa5c812c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:45630/0 (socket says 172.21.15.37:45630) 2023-12-19T16:07:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7fa5cd746640 1 -- 172.21.15.37:0/3088969776 learned_addr learned my addr 172.21.15.37:0/3088969776 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7fa5ce748640 1 --2- 172.21.15.37:0/3088969776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c8146a80 0x7fa5c812c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7fa5cd746640 1 -- 172.21.15.37:0/3088969776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c8146a80 msgr2=0x7fa5c812c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7fa5cd746640 1 --2- 172.21.15.37:0/3088969776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c8146a80 0x7fa5c812c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7fa5cd746640 1 -- 172.21.15.37:0/3088969776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5c806cda0 msgr2=0x7fa5c80bafd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T16:07:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7fa5cdf47640 1 --2- 172.21.15.37:0/3088969776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5c806cda0 0x7fa5c80bafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7f43ab7fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43ac0b35b0 0x7f43ac0bbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:45640/0 (socket says 172.21.15.37:45640) 2023-12-19T16:07:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7f43ab7fe640 1 -- 172.21.15.37:0/4227123919 learned_addr learned my addr 172.21.15.37:0/4227123919 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7f43aaffd640 1 --2- 172.21.15.37:0/4227123919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43ac149020 0x7f43ac0701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7fa25d215640 1 -- start start 2023-12-19T16:07:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.651+0000 7f43abfff640 1 --2- 172.21.15.37:0/4227123919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43ac152b70 0x7f43ac06f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f182dd9b640 1 -- 172.21.15.37:0/614244783 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737060990 0 0) 0x7f182803dd90 con 0x7f18280cac20 2023-12-19T16:07:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f43ab7fe640 1 -- 172.21.15.37:0/4227123919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43ac149020 msgr2=0x7f43ac0701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f87ad6fa640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f87a00084b0 0x7f87a016b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f87ad6fa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a003e210 0x7f87a0035d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f87ad6fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87a00ce9d0 0x7f87a003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f87ad6fa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a016baa0 con 0x7f87a00ce9d0 2023-12-19T16:07:08.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f87ad6fa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a003d1a0 con 0x7f87a003e210 2023-12-19T16:07:08.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f87ad6fa640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a016ad60 con 0x7f87a00084b0 2023-12-19T16:07:08.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f182dd9b640 1 -- 172.21.15.37:0/614244783 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f181c003520 con 0x7f18280cac20 2023-12-19T16:07:08.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f0c6d730640 1 Processor -- start 2023-12-19T16:07:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.650+0000 7f0850789640 1 -- 172.21.15.37:0/1076795419 wait complete. 2023-12-19T16:07:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f0850789640 1 Processor -- start 2023-12-19T16:07:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7fa5cd746640 1 --2- 172.21.15.37:0/3088969776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5c806cda0 0x7fa5c80bafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7fa5cd746640 1 -- 172.21.15.37:0/3088969776 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c0009b30 con 0x7fa5c806e9e0 2023-12-19T16:07:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7fa5ce748640 1 --2- 172.21.15.37:0/3088969776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c8146a80 0x7fa5c812c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:07:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7fa25d215640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa250006b30 0x7fa250036030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7fa25d215640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa250028410 0x7fa250041c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7fa25d215640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2500d5940 0x7fa2500d8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7fa25d215640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500d87a0 con 0x7fa250006b30 2023-12-19T16:07:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7fa25d215640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa250040280 con 0x7fa2500d5940 2023-12-19T16:07:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7fa25d215640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25003eaf0 con 0x7fa250028410 2023-12-19T16:07:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f87a7fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f87a00084b0 0x7f87a016b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f87acef9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87a00ce9d0 0x7f87a003b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f87a77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a003e210 0x7f87a0035d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f87acef9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87a00ce9d0 0x7f87a003b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49708/0 (socket says 172.21.15.37:49708) 2023-12-19T16:07:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f87acef9640 1 -- 172.21.15.37:0/4108193684 learned_addr learned my addr 172.21.15.37:0/4108193684 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f87acef9640 1 -- 172.21.15.37:0/4108193684 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f87a00084b0 msgr2=0x7f87a016b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f87acef9640 1 --2- 172.21.15.37:0/4108193684 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f87a00084b0 0x7f87a016b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f87acef9640 1 -- 172.21.15.37:0/4108193684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a003e210 msgr2=0x7f87a0035d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f87acef9640 1 --2- 172.21.15.37:0/4108193684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a003e210 0x7f87a0035d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f87acef9640 1 -- 172.21.15.37:0/4108193684 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8794010810 con 0x7f87a00ce9d0 2023-12-19T16:07:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7fecf9ada640 1 -- start start 2023-12-19T16:07:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7fa5cdf47640 1 --2- 172.21.15.37:0/3088969776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5c806cda0 0x7fa5c80bafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7fa5cd746640 1 --2- 172.21.15.37:0/3088969776 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5c806e9e0 0x7fa5c812c3d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0036040 tx=0x7fa5c0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7fa5be7fc640 1 -- 172.21.15.37:0/3088969776 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c003e450 con 0x7fa5c806e9e0 2023-12-19T16:07:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7fa5d01ab640 1 -- 172.21.15.37:0/3088969776 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c8143560 con 0x7fa5c806e9e0 2023-12-19T16:07:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7fa5be7fc640 1 -- 172.21.15.37:0/3088969776 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c003e5b0 con 0x7fa5c806e9e0 2023-12-19T16:07:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7fa5be7fc640 1 -- 172.21.15.37:0/3088969776 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c003e920 con 0x7fa5c806e9e0 2023-12-19T16:07:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7fa5d01ab640 1 -- 172.21.15.37:0/3088969776 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c8143840 con 0x7fa5c806e9e0 2023-12-19T16:07:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f43ab7fe640 1 --2- 172.21.15.37:0/4227123919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43ac149020 0x7f43ac0701d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f43ab7fe640 1 -- 172.21.15.37:0/4227123919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43ac152b70 msgr2=0x7f43ac06f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f43ab7fe640 1 --2- 172.21.15.37:0/4227123919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43ac152b70 0x7f43ac06f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f43ab7fe640 1 -- 172.21.15.37:0/4227123919 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a4009b30 con 0x7f43ac0b35b0 2023-12-19T16:07:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f43abfff640 1 --2- 172.21.15.37:0/4227123919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43ac152b70 0x7f43ac06f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f43ab7fe640 1 --2- 172.21.15.37:0/4227123919 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43ac0b35b0 0x7f43ac0bbef0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f439c00c450 tx=0x7f439c00c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f0c6d730640 1 -- start start 2023-12-19T16:07:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f182ed9d640 1 --2- 172.21.15.37:0/614244783 >> v2:172.21.15.37:3300/0 conn(0x7f18280072b0 0x7f1828040780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f182dd9b640 1 -- 172.21.15.37:0/614244783 <== mon.1 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2422772775 0 0) 0x7f181c003520 con 0x7f18280cac20 2023-12-19T16:07:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f182dd9b640 1 -- 172.21.15.37:0/614244783 >> v2:172.21.15.37:3300/0 conn(0x7f18280072b0 msgr2=0x7f1828040780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f182dd9b640 1 --2- 172.21.15.37:0/614244783 >> v2:172.21.15.37:3300/0 conn(0x7f18280072b0 0x7f1828040780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f182dd9b640 1 -- 172.21.15.37:0/614244783 >> v1:172.21.15.37:6789/0 conn(0x7f1828042ac0 legacy=0x7f18280d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f182dd9b640 1 -- 172.21.15.37:0/614244783 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182803e7c0 con 0x7f18280cac20 2023-12-19T16:07:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f182dd9b640 1 -- 172.21.15.37:0/614244783 <== mon.1 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f1818001670 con 0x7f18280cac20 2023-12-19T16:07:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f182dd9b640 1 -- 172.21.15.37:0/614244783 >> v1:172.21.15.78:6789/0 conn(0x7f18280cac20 legacy=0x7f18280cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f182dd9b640 1 --2- 172.21.15.37:0/614244783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f181c003970 0x7f181c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f182dd9b640 1 --2- 172.21.15.37:0/614244783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f181c0047c0 0x7f181c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f182dd9b640 1 --2- 172.21.15.37:0/614244783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f181c0051d0 0x7f181c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7fa25ca14640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2500d5940 0x7fa2500d8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7fa25ca14640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2500d5940 0x7fa2500d8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:40910/0 (socket says 172.21.15.37:40910) 2023-12-19T16:07:08.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7fa25ca14640 1 -- 172.21.15.37:0/1004008227 learned_addr learned my addr 172.21.15.37:0/1004008227 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f4393fff640 1 -- 172.21.15.37:0/4227123919 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0052d0 con 0x7f43ac0b35b0 2023-12-19T16:07:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.652+0000 7f0850789640 1 -- start start 2023-12-19T16:07:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f0850789640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08480b4ed0 0x7f084813a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f182ed9d640 1 --2- 172.21.15.37:0/614244783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f181c003970 0x7f181c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f0850789640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f084813cff0 0x7f08480b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f0850789640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0848146fc0 0x7f08480b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f0850789640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084813a5a0 con 0x7f0848146fc0 2023-12-19T16:07:08.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f0850789640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08480b1120 con 0x7f08480b4ed0 2023-12-19T16:07:08.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f0850789640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08480b1aa0 con 0x7f084813cff0 2023-12-19T16:07:08.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f182e59c640 1 --2- 172.21.15.37:0/614244783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f181c0047c0 0x7f181c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f87acef9640 1 --2- 172.21.15.37:0/4108193684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87a00ce9d0 0x7f87a003b720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f879c00c390 tx=0x7f879c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f0c6d730640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c6806b480 0x7f0c680b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f0c6d730640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0c6806fa70 0x7f0c680b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f0c6d730640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c68152fc0 0x7f0c681e7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f0c6d730640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680b0f70 con 0x7f0c68152fc0 2023-12-19T16:07:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f0c6d730640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680b01a0 con 0x7f0c6806b480 2023-12-19T16:07:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f0c6d730640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680b0d20 con 0x7f0c6806fa70 2023-12-19T16:07:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f182dd9b640 1 -- 172.21.15.37:0/614244783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182803e5b0 con 0x7f181c0051d0 2023-12-19T16:07:08.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f43b1ab9640 1 -- 172.21.15.37:0/4227123919 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ac071110 con 0x7f43ac0b35b0 2023-12-19T16:07:08.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f43b1ab9640 1 -- 172.21.15.37:0/4227123919 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ac070970 con 0x7f43ac0b35b0 2023-12-19T16:07:08.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f182dd9b640 1 -- 172.21.15.37:0/614244783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c00c120 con 0x7f181c003970 2023-12-19T16:07:08.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f182dd9b640 1 -- 172.21.15.37:0/614244783 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181c00c2e0 con 0x7f181c0047c0 2023-12-19T16:07:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f4393fff640 1 -- 172.21.15.37:0/4227123919 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c005430 con 0x7f43ac0b35b0 2023-12-19T16:07:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f4393fff640 1 -- 172.21.15.37:0/4227123919 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c012870 con 0x7f43ac0b35b0 2023-12-19T16:07:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.653+0000 7f0c67fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c6806b480 0x7f0c680b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7fa257fff640 1 --2- 172.21.15.37:0/1004008227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa250006b30 0x7fa250036030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7f87a4ff9640 1 -- 172.21.15.37:0/4108193684 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c0035f0 con 0x7f87a00ce9d0 2023-12-19T16:07:08.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7f87ad6fa640 1 -- 172.21.15.37:0/4108193684 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a016b040 con 0x7f87a00ce9d0 2023-12-19T16:07:08.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7f87ad6fa640 1 -- 172.21.15.37:0/4108193684 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a00d2090 con 0x7f87a00ce9d0 2023-12-19T16:07:08.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7fa25ca14640 1 -- 172.21.15.37:0/1004008227 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa250028410 msgr2=0x7fa250041c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7fa25ca14640 1 --2- 172.21.15.37:0/1004008227 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa250028410 0x7fa250041c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7fa25ca14640 1 -- 172.21.15.37:0/1004008227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa250006b30 msgr2=0x7fa250036030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7fa25ca14640 1 --2- 172.21.15.37:0/1004008227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa250006b30 0x7fa250036030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7fa25ca14640 1 -- 172.21.15.37:0/1004008227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c0094d0 con 0x7fa2500d5940 2023-12-19T16:07:08.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7fecf9ada640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fecf406b480 0x7fecf41e7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7fecf9ada640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecf406e9a0 0x7fecf4145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7fecf9ada640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf4144170 0x7fecf41d78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7fecf9ada640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf41d7e00 con 0x7fecf406e9a0 2023-12-19T16:07:08.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7fecf9ada640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf4145710 con 0x7fecf4144170 2023-12-19T16:07:08.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7fecf9ada640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf4144c10 con 0x7fecf406b480 2023-12-19T16:07:08.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7fa25ca14640 1 --2- 172.21.15.37:0/1004008227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2500d5940 0x7fa2500d8260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009870 tx=0x7fa24c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7fecf3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecf406e9a0 0x7fecf4145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7fecf3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecf406e9a0 0x7fecf4145ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49752/0 (socket says 172.21.15.37:49752) 2023-12-19T16:07:08.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7fecf3fff640 1 -- 172.21.15.37:0/2328291338 learned_addr learned my addr 172.21.15.37:0/2328291338 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7f0c67fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c6806b480 0x7f0c680b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:40926/0 (socket says 172.21.15.37:40926) 2023-12-19T16:07:08.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7f0c67fff640 1 -- 172.21.15.37:0/3933772930 learned_addr learned my addr 172.21.15.37:0/3933772930 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7f0c6cf2f640 1 --2- 172.21.15.37:0/3933772930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c68152fc0 0x7f0c681e7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7f0c677fe640 1 --2- 172.21.15.37:0/3933772930 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0c6806fa70 0x7f0c680b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7f0c6cf2f640 1 -- 172.21.15.37:0/3933772930 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0c6806fa70 msgr2=0x7f0c680b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7f0c6cf2f640 1 --2- 172.21.15.37:0/3933772930 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0c6806fa70 0x7f0c680b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7f0c6cf2f640 1 -- 172.21.15.37:0/3933772930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c6806b480 msgr2=0x7f0c680b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7f0c6cf2f640 1 --2- 172.21.15.37:0/3933772930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c6806b480 0x7f0c680b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7f182ed9d640 1 -- 172.21.15.37:0/614244783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f181c0047c0 msgr2=0x7f181c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7f182ed9d640 1 --2- 172.21.15.37:0/614244783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f181c0047c0 0x7f181c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7f182ed9d640 1 -- 172.21.15.37:0/614244783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f181c0051d0 msgr2=0x7f181c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:08.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7f182ed9d640 1 --2- 172.21.15.37:0/614244783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f181c0051d0 0x7f181c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7f182ed9d640 1 -- 172.21.15.37:0/614244783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c003520 con 0x7f181c003970 2023-12-19T16:07:08.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7f182f59e640 1 -- 172.21.15.37:0/614244783 reap_dead start 2023-12-19T16:07:08.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7fecf8ad8640 1 --2- 172.21.15.37:0/2328291338 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fecf406b480 0x7fecf41e7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7f87a4ff9640 1 -- 172.21.15.37:0/4108193684 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c003750 con 0x7f87a00ce9d0 2023-12-19T16:07:08.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7fa254ff9640 1 -- 172.21.15.37:0/1004008227 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c03bb70 con 0x7fa2500d5940 2023-12-19T16:07:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7f87a4ff9640 1 -- 172.21.15.37:0/4108193684 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c0035f0 con 0x7f87a00ce9d0 2023-12-19T16:07:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7fa254ff9640 1 -- 172.21.15.37:0/1004008227 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24c03bcd0 con 0x7fa2500d5940 2023-12-19T16:07:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7fa254ff9640 1 -- 172.21.15.37:0/1004008227 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c045630 con 0x7fa2500d5940 2023-12-19T16:07:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7fa25d215640 1 -- 172.21.15.37:0/1004008227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2500404f0 con 0x7fa2500d5940 2023-12-19T16:07:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7fa25d215640 1 -- 172.21.15.37:0/1004008227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25003e5d0 con 0x7fa2500d5940 2023-12-19T16:07:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7fecf92d9640 1 --2- 172.21.15.37:0/2328291338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf4144170 0x7fecf41d78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7fecf3fff640 1 -- 172.21.15.37:0/2328291338 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fecf406b480 msgr2=0x7fecf41e7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7fecf3fff640 1 --2- 172.21.15.37:0/2328291338 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fecf406b480 0x7fecf41e7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7fa5d01ab640 1 -- 172.21.15.37:0/3088969776 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b0005250 con 0x7fa5c806e9e0 2023-12-19T16:07:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7f0c6cf2f640 1 -- 172.21.15.37:0/3933772930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c580094d0 con 0x7f0c68152fc0 2023-12-19T16:07:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7fecf3fff640 1 -- 172.21.15.37:0/2328291338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf4144170 msgr2=0x7fecf41d78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7fecf3fff640 1 --2- 172.21.15.37:0/2328291338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf4144170 0x7fecf41d78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.656+0000 7fecf3fff640 1 -- 172.21.15.37:0/2328291338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece400a570 con 0x7fecf406e9a0 2023-12-19T16:07:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7f084ed26640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0848146fc0 0x7f08480b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7f084e525640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08480b4ed0 0x7f084813a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7f084dd24640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f084813cff0 0x7f08480b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7f084e525640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08480b4ed0 0x7f084813a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:40916/0 (socket says 172.21.15.37:40916) 2023-12-19T16:07:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.656+0000 7f0c6cf2f640 1 --2- 172.21.15.37:0/3933772930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c68152fc0 0x7f0c681e7280 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c00c3c0 tx=0x7f0c5c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.654+0000 7f084e525640 1 -- 172.21.15.37:0/2003937890 learned_addr learned my addr 172.21.15.37:0/2003937890 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7f084e525640 1 -- 172.21.15.37:0/2003937890 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f084813cff0 msgr2=0x7f08480b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7f084e525640 1 --2- 172.21.15.37:0/2003937890 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f084813cff0 0x7f08480b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.655+0000 7f084e525640 1 -- 172.21.15.37:0/2003937890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0848146fc0 msgr2=0x7f08480b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.656+0000 7fecf92d9640 1 --2- 172.21.15.37:0/2328291338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf4144170 0x7fecf41d78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.656+0000 7f87ad6fa640 1 -- 172.21.15.37:0/4108193684 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8788005250 con 0x7f87a00ce9d0 2023-12-19T16:07:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.656+0000 7f43b1ab9640 1 -- 172.21.15.37:0/4227123919 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438c005250 con 0x7f43ac0b35b0 2023-12-19T16:07:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.656+0000 7fecf3fff640 1 --2- 172.21.15.37:0/2328291338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecf406e9a0 0x7fecf4145ba0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fece800c430 tx=0x7fece800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.656+0000 7f084e525640 1 --2- 172.21.15.37:0/2003937890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0848146fc0 0x7f08480b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.656+0000 7f084e525640 1 -- 172.21.15.37:0/2003937890 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084000d050 con 0x7f08480b4ed0 2023-12-19T16:07:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.656+0000 7fecf17fa640 1 -- 172.21.15.37:0/2328291338 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8011790 con 0x7fecf406e9a0 2023-12-19T16:07:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.656+0000 7f084ed26640 1 --2- 172.21.15.37:0/2003937890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0848146fc0 0x7f08480b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.656+0000 7f4393fff640 1 -- 172.21.15.37:0/4227123919 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f439c0129d0 con 0x7f43ac0b35b0 2023-12-19T16:07:08.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.657+0000 7f0c64ff9640 1 -- 172.21.15.37:0/3933772930 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c0052d0 con 0x7f0c68152fc0 2023-12-19T16:07:08.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.657+0000 7f084e525640 1 --2- 172.21.15.37:0/2003937890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08480b4ed0 0x7f084813a060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f084400c460 tx=0x7f084400c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.657+0000 7fecf9ada640 1 -- 172.21.15.37:0/2328291338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf41d1b80 con 0x7fecf406e9a0 2023-12-19T16:07:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.657+0000 7fecf9ada640 1 -- 172.21.15.37:0/2328291338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf41d1590 con 0x7fecf406e9a0 2023-12-19T16:07:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.657+0000 7fecf17fa640 1 -- 172.21.15.37:0/2328291338 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece80118f0 con 0x7fecf406e9a0 2023-12-19T16:07:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.657+0000 7fa25d215640 1 -- 172.21.15.37:0/1004008227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25003be00 con 0x7fa2500d5940 2023-12-19T16:07:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.657+0000 7fecf17fa640 1 -- 172.21.15.37:0/2328291338 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8011790 con 0x7fecf406e9a0 2023-12-19T16:07:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.657+0000 7f0c6d730640 1 -- 172.21.15.37:0/3933772930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c680ab1a0 con 0x7f0c68152fc0 2023-12-19T16:07:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.657+0000 7f0c6d730640 1 -- 172.21.15.37:0/3933772930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c680b1120 con 0x7f0c68152fc0 2023-12-19T16:07:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.657+0000 7f4393fff640 1 --2- 172.21.15.37:0/4227123919 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f439806a500 0x7f439806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.657+0000 7f0c64ff9640 1 -- 172.21.15.37:0/3933772930 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5c005450 con 0x7f0c68152fc0 2023-12-19T16:07:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.656+0000 7f182ed9d640 1 --2- 172.21.15.37:0/614244783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f181c003970 0x7f181c003d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f183004eda0 tx=0x7f181c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=999a0d793b6f7ab9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.657+0000 7f182dd9b640 1 -- 172.21.15.37:0/614244783 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18300aa710 con 0x7f181c003970 2023-12-19T16:07:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.657+0000 7f0c64ff9640 1 -- 172.21.15.37:0/3933772930 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c003830 con 0x7f0c68152fc0 2023-12-19T16:07:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.657+0000 7f182dd9b640 1 -- 172.21.15.37:0/614244783 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18300aa870 con 0x7f181c003970 2023-12-19T16:07:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.657+0000 7f083effd640 1 -- 172.21.15.37:0/2003937890 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0844012830 con 0x7f08480b4ed0 2023-12-19T16:07:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.657+0000 7f083effd640 1 -- 172.21.15.37:0/2003937890 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08440129d0 con 0x7f08480b4ed0 2023-12-19T16:07:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.657+0000 7f083effd640 1 -- 172.21.15.37:0/2003937890 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0844012d80 con 0x7f08480b4ed0 2023-12-19T16:07:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.658+0000 7f87a4ff9640 1 -- 172.21.15.37:0/4108193684 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f879c0038c0 con 0x7f87a00ce9d0 2023-12-19T16:07:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.658+0000 7f0c6d730640 1 -- 172.21.15.37:0/3933772930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c48005250 con 0x7f0c68152fc0 2023-12-19T16:07:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.658+0000 7f1834816640 1 -- 172.21.15.37:0/614244783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f181c003970 msgr2=0x7f181c003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.658+0000 7f1834816640 1 --2- 172.21.15.37:0/614244783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f181c003970 0x7f181c003d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f183004eda0 tx=0x7f181c0057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.658+0000 7f1834816640 1 -- 172.21.15.37:0/614244783 shutdown_connections 2023-12-19T16:07:08.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.658+0000 7f1834816640 1 --2- 172.21.15.37:0/614244783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f181c003970 0x7f181c003d50 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f183004eda0 tx=0x7f181c0057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.658+0000 7f1834816640 1 -- 172.21.15.37:0/614244783 >> 172.21.15.37:0/614244783 conn(0x7f18280432a0 msgr2=0x7f18280436b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:08.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.659+0000 7fa5be7fc640 1 -- 172.21.15.37:0/3088969776 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa5c003ea80 con 0x7fa5c806e9e0 2023-12-19T16:07:08.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.658+0000 7f0850789640 1 -- 172.21.15.37:0/2003937890 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084806f270 con 0x7f08480b4ed0 2023-12-19T16:07:08.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.658+0000 7f0850789640 1 -- 172.21.15.37:0/2003937890 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08480b1450 con 0x7f08480b4ed0 2023-12-19T16:07:08.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.659+0000 7f87a4ff9640 1 --2- 172.21.15.37:0/4108193684 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f878c06a4f0 0x7f878c06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.658+0000 7f4393fff640 1 -- 172.21.15.37:0/4227123919 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f439c088410 con 0x7f43ac0b35b0 2023-12-19T16:07:08.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.659+0000 7f87a4ff9640 1 -- 172.21.15.37:0/4108193684 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f879c087bd0 con 0x7f87a00ce9d0 2023-12-19T16:07:08.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.659+0000 7f1834816640 1 -- 172.21.15.37:0/614244783 shutdown_connections 2023-12-19T16:07:08.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.659+0000 7f87a7fff640 1 --2- 172.21.15.37:0/4108193684 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f878c06a4f0 0x7f878c06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.659+0000 7f1834816640 1 -- 172.21.15.37:0/614244783 wait complete. 2023-12-19T16:07:08.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.659+0000 7f43aaffd640 1 --2- 172.21.15.37:0/4227123919 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f439806a500 0x7f439806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.659+0000 7fa5be7fc640 1 --2- 172.21.15.37:0/3088969776 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa5ac06a500 0x7fa5ac06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.660+0000 7fa5be7fc640 1 -- 172.21.15.37:0/3088969776 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5c00ab660 con 0x7fa5c806e9e0 2023-12-19T16:07:08.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.659+0000 7fa254ff9640 1 -- 172.21.15.37:0/1004008227 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa24c02f050 con 0x7fa2500d5940 2023-12-19T16:07:08.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.660+0000 7fa5cdf47640 1 --2- 172.21.15.37:0/3088969776 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa5ac06a500 0x7fa5ac06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.660+0000 7fecf9ada640 1 -- 172.21.15.37:0/2328291338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd4005250 con 0x7fecf406e9a0 2023-12-19T16:07:08.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.660+0000 7f0850789640 1 -- 172.21.15.37:0/2003937890 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0848061880 con 0x7f08480b4ed0 2023-12-19T16:07:08.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.660+0000 7fa254ff9640 1 --2- 172.21.15.37:0/1004008227 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa23c06a500 0x7fa23c06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.660+0000 7f43aaffd640 1 --2- 172.21.15.37:0/4227123919 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f439806a500 0x7f439806c9c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f43a4035000 tx=0x7f43a4030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.660+0000 7f87a7fff640 1 --2- 172.21.15.37:0/4108193684 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f878c06a4f0 0x7f878c06c9b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f879403a000 tx=0x7f8794034000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.660+0000 7fa254ff9640 1 -- 172.21.15.37:0/1004008227 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa24c0aaa60 con 0x7fa2500d5940 2023-12-19T16:07:08.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.660+0000 7fa257fff640 1 --2- 172.21.15.37:0/1004008227 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa23c06a500 0x7fa23c06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.660+0000 7fa5cdf47640 1 --2- 172.21.15.37:0/3088969776 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa5ac06a500 0x7fa5ac06c9c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8006fd0 tx=0x7fa5b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.661+0000 7f083effd640 1 -- 172.21.15.37:0/2003937890 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f084401a3b0 con 0x7f08480b4ed0 2023-12-19T16:07:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.661+0000 7fa257fff640 1 --2- 172.21.15.37:0/1004008227 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa23c06a500 0x7fa23c06c9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa24400b810 tx=0x7fa244008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.661+0000 7f083effd640 1 --2- 172.21.15.37:0/2003937890 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f082c06a4b0 0x7f082c06c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.661+0000 7f1834816640 1 Processor -- start 2023-12-19T16:07:08.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.661+0000 7f1834816640 1 -- start start 2023-12-19T16:07:08.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.661+0000 7f083effd640 1 -- 172.21.15.37:0/2003937890 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08440883e0 con 0x7f08480b4ed0 2023-12-19T16:07:08.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.661+0000 7f084dd24640 1 --2- 172.21.15.37:0/2003937890 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f082c06a4b0 0x7f082c06c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.662+0000 7f084dd24640 1 --2- 172.21.15.37:0/2003937890 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f082c06a4b0 0x7f082c06c970 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0840039000 tx=0x7f084000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.662+0000 7f1834816640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280d3ca0 0x7f18280d4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.662+0000 7f1834816640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1828166920 0x7f1828166d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.662+0000 7f1834816640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18280bd090 0x7f18280bd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.662+0000 7f1834816640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18280bda50 con 0x7f18280bd090 2023-12-19T16:07:08.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.662+0000 7f1834816640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18281672a0 con 0x7f18280d3ca0 2023-12-19T16:07:08.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.662+0000 7f1834816640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18280d2bf0 con 0x7f1828166920 2023-12-19T16:07:08.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.662+0000 7f182f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18280bd090 0x7f18280bd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.662+0000 7f182ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280d3ca0 0x7f18280d4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.662+0000 7f182ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280d3ca0 0x7f18280d4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:40942/0 (socket says 172.21.15.37:40942) 2023-12-19T16:07:08.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.662+0000 7f182ed9d640 1 -- 172.21.15.37:0/879884073 learned_addr learned my addr 172.21.15.37:0/879884073 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:08.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.662+0000 7f182e59c640 1 --2- 172.21.15.37:0/879884073 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1828166920 0x7f1828166d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.662+0000 7f182f59e640 1 -- 172.21.15.37:0/879884073 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1828166920 msgr2=0x7f1828166d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.662+0000 7f182f59e640 1 --2- 172.21.15.37:0/879884073 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1828166920 0x7f1828166d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.662+0000 7f182f59e640 1 -- 172.21.15.37:0/879884073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280d3ca0 msgr2=0x7f18280d4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:08.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.662+0000 7f182f59e640 1 --2- 172.21.15.37:0/879884073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280d3ca0 0x7f18280d4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:08.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.662+0000 7f4393fff640 1 -- 172.21.15.37:0/4227123919 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f439c053950 con 0x7f43ac0b35b0 2023-12-19T16:07:08.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.662+0000 7f182f59e640 1 -- 172.21.15.37:0/879884073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18280d2630 con 0x7f18280bd090 2023-12-19T16:07:08.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.663+0000 7f182f59e640 1 --2- 172.21.15.37:0/879884073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18280bd090 0x7f18280bd510 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f18280440f0 tx=0x7f181800d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.663+0000 7f87a4ff9640 1 -- 172.21.15.37:0/4108193684 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f879c0531e0 con 0x7f87a00ce9d0 2023-12-19T16:07:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.664+0000 7f18277fe640 1 -- 172.21.15.37:0/879884073 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18180084e0 con 0x7f18280bd090 2023-12-19T16:07:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.664+0000 7f18277fe640 1 -- 172.21.15.37:0/879884073 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1818008660 con 0x7f18280bd090 2023-12-19T16:07:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.665+0000 7f1834816640 1 -- 172.21.15.37:0/879884073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18280d2910 con 0x7f18280bd090 2023-12-19T16:07:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.665+0000 7f18277fe640 1 -- 172.21.15.37:0/879884073 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18180059e0 con 0x7f18280bd090 2023-12-19T16:07:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.665+0000 7f1834816640 1 -- 172.21.15.37:0/879884073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18280d4080 con 0x7f18280bd090 2023-12-19T16:07:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.665+0000 7fa254ff9640 1 -- 172.21.15.37:0/1004008227 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa24c0761e0 con 0x7fa2500d5940 2023-12-19T16:07:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.665+0000 7f0c64ff9640 1 -- 172.21.15.37:0/3933772930 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0c5c003990 con 0x7f0c68152fc0 2023-12-19T16:07:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.665+0000 7fecf17fa640 1 -- 172.21.15.37:0/2328291338 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fece8011a60 con 0x7fecf406e9a0 2023-12-19T16:07:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.666+0000 7f0c64ff9640 1 --2- 172.21.15.37:0/3933772930 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0c5406a500 0x7f0c5406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.666+0000 7fecf17fa640 1 --2- 172.21.15.37:0/2328291338 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fece006a520 0x7fece006c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.666+0000 7f0c64ff9640 1 -- 172.21.15.37:0/3933772930 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c5c088160 con 0x7f0c68152fc0 2023-12-19T16:07:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.666+0000 7f0c67fff640 1 --2- 172.21.15.37:0/3933772930 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0c5406a500 0x7f0c5406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.666+0000 7fecf17fa640 1 -- 172.21.15.37:0/2328291338 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fece8088ff0 con 0x7fecf406e9a0 2023-12-19T16:07:08.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.666+0000 7fecf8ad8640 1 --2- 172.21.15.37:0/2328291338 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fece006a520 0x7fece006c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.666+0000 7f1834816640 1 -- 172.21.15.37:0/879884073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1828042460 con 0x7f18280bd090 2023-12-19T16:07:08.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.667+0000 7f0c67fff640 1 --2- 172.21.15.37:0/3933772930 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0c5406a500 0x7f0c5406c9c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0c600012e0 tx=0x7f0c60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.667+0000 7fecf8ad8640 1 --2- 172.21.15.37:0/2328291338 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fece006a520 0x7fece006c9e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fece403b000 tx=0x7fece400d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.667+0000 7fa5be7fc640 1 -- 172.21.15.37:0/3088969776 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa5c0076cc0 con 0x7fa5c806e9e0 2023-12-19T16:07:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.670+0000 7f083effd640 1 -- 172.21.15.37:0/2003937890 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0844053a40 con 0x7f08480b4ed0 2023-12-19T16:07:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.672+0000 7f0c64ff9640 1 -- 172.21.15.37:0/3933772930 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0c5c053870 con 0x7f0c68152fc0 2023-12-19T16:07:08.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.681+0000 7fecf17fa640 1 -- 172.21.15.37:0/2328291338 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fece8054560 con 0x7fecf406e9a0 2023-12-19T16:07:08.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.683+0000 7f18277fe640 1 -- 172.21.15.37:0/879884073 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1818005b40 con 0x7f18280bd090 2023-12-19T16:07:08.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.683+0000 7f18277fe640 1 --2- 172.21.15.37:0/879884073 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f181006a430 0x7f181006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:08.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.688+0000 7f18277fe640 1 -- 172.21.15.37:0/879884073 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1818088940 con 0x7f18280bd090 2023-12-19T16:07:08.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.690+0000 7f182ed9d640 1 --2- 172.21.15.37:0/879884073 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f181006a430 0x7f181006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:08.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.690+0000 7f18277fe640 1 -- 172.21.15.37:0/879884073 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1818053fd0 con 0x7f18280bd090 2023-12-19T16:07:08.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:08.701+0000 7f182ed9d640 1 --2- 172.21.15.37:0/879884073 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f181006a430 0x7f181006c8f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1830066a80 tx=0x7f183006e030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:09.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.057+0000 7f43b1ab9640 1 -- 172.21.15.37:0/4227123919 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f438c005500 con 0x7f43ac0b35b0 2023-12-19T16:07:09.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.057+0000 7f4393fff640 1 -- 172.21.15.37:0/4227123919 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f439c056f70 con 0x7f43ac0b35b0 2023-12-19T16:07:09.060 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2023-12-19T16:07:09.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.060+0000 7f4391ffb640 1 -- 172.21.15.37:0/4227123919 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f439806a500 msgr2=0x7f439806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:09.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.061+0000 7f4391ffb640 1 --2- 172.21.15.37:0/4227123919 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f439806a500 0x7f439806c9c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f43a4035000 tx=0x7f43a4030000 comp rx=0 tx=0).stop 2023-12-19T16:07:09.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.061+0000 7f4391ffb640 1 -- 172.21.15.37:0/4227123919 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43ac0b35b0 msgr2=0x7f43ac0bbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:09.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.061+0000 7f4391ffb640 1 --2- 172.21.15.37:0/4227123919 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43ac0b35b0 0x7f43ac0bbef0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f439c00c450 tx=0x7f439c00c910 comp rx=0 tx=0).stop 2023-12-19T16:07:09.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.061+0000 7f4391ffb640 1 -- 172.21.15.37:0/4227123919 shutdown_connections 2023-12-19T16:07:09.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.061+0000 7f4391ffb640 1 --2- 172.21.15.37:0/4227123919 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f439806a500 0x7f439806c9c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.061+0000 7f4391ffb640 1 --2- 172.21.15.37:0/4227123919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43ac152b70 0x7f43ac06f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.061+0000 7f4391ffb640 1 --2- 172.21.15.37:0/4227123919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43ac149020 0x7f43ac0701d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.061+0000 7f4391ffb640 1 --2- 172.21.15.37:0/4227123919 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43ac0b35b0 0x7f43ac0bbef0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.061+0000 7f4391ffb640 1 -- 172.21.15.37:0/4227123919 >> 172.21.15.37:0/4227123919 conn(0x7f43ac06a2b0 msgr2=0x7f43ac150250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:09.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.061+0000 7f4391ffb640 1 -- 172.21.15.37:0/4227123919 shutdown_connections 2023-12-19T16:07:09.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.061+0000 7f4391ffb640 1 -- 172.21.15.37:0/4227123919 wait complete. 2023-12-19T16:07:09.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.077+0000 7fa5d01ab640 1 -- 172.21.15.37:0/3088969776 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa5b0005500 con 0x7fa5c806e9e0 2023-12-19T16:07:09.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.2 2023-12-19T16:07:09.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.078+0000 7fa5be7fc640 1 -- 172.21.15.37:0/3088969776 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5c007a2e0 con 0x7fa5c806e9e0 2023-12-19T16:07:09.082 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-12-19T16:07:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.081+0000 7fa5d01ab640 1 -- 172.21.15.37:0/3088969776 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa5ac06a500 msgr2=0x7fa5ac06c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.081+0000 7fa5d01ab640 1 --2- 172.21.15.37:0/3088969776 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa5ac06a500 0x7fa5ac06c9c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8006fd0 tx=0x7fa5b8008040 comp rx=0 tx=0).stop 2023-12-19T16:07:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.081+0000 7fa5d01ab640 1 -- 172.21.15.37:0/3088969776 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5c806e9e0 msgr2=0x7fa5c812c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.081+0000 7fa5d01ab640 1 --2- 172.21.15.37:0/3088969776 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5c806e9e0 0x7fa5c812c3d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0036040 tx=0x7fa5c0004a40 comp rx=0 tx=0).stop 2023-12-19T16:07:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.081+0000 7fa5d01ab640 1 -- 172.21.15.37:0/3088969776 shutdown_connections 2023-12-19T16:07:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.081+0000 7fa5d01ab640 1 --2- 172.21.15.37:0/3088969776 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa5ac06a500 0x7fa5ac06c9c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.081+0000 7fa5d01ab640 1 --2- 172.21.15.37:0/3088969776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5c8146a80 0x7fa5c812c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.081+0000 7fa5d01ab640 1 --2- 172.21.15.37:0/3088969776 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa5c806e9e0 0x7fa5c812c3d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.081+0000 7fa5d01ab640 1 --2- 172.21.15.37:0/3088969776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5c806cda0 0x7fa5c80bafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.081+0000 7fa5d01ab640 1 -- 172.21.15.37:0/3088969776 >> 172.21.15.37:0/3088969776 conn(0x7fa5c80bc0d0 msgr2=0x7fa5c8133300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:09.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.081+0000 7fa5d01ab640 1 -- 172.21.15.37:0/3088969776 shutdown_connections 2023-12-19T16:07:09.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.081+0000 7fa5d01ab640 1 -- 172.21.15.37:0/3088969776 wait complete. 2023-12-19T16:07:09.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.081+0000 7f0850789640 1 -- 172.21.15.37:0/2003937890 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f08480b60e0 con 0x7f08480b4ed0 2023-12-19T16:07:09.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.081+0000 7fecf9ada640 1 -- 172.21.15.37:0/2328291338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fecd40057d0 con 0x7fecf406e9a0 2023-12-19T16:07:09.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.081+0000 7f87ad6fa640 1 -- 172.21.15.37:0/4108193684 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f87880057d0 con 0x7f87a00ce9d0 2023-12-19T16:07:09.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.082+0000 7fecf17fa640 1 -- 172.21.15.37:0/2328291338 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fece8057b80 con 0x7fecf406e9a0 2023-12-19T16:07:09.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.082+0000 7f083effd640 1 -- 172.21.15.37:0/2003937890 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0844057060 con 0x7f08480b4ed0 2023-12-19T16:07:09.088 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2023-12-19T16:07:09.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.082+0000 7f87a4ff9640 1 -- 172.21.15.37:0/4108193684 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f879c017020 con 0x7f87a00ce9d0 2023-12-19T16:07:09.089 INFO:teuthology.orchestra.run.smithi037.stdout:55834574852 2023-12-19T16:07:09.089 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-12-19T16:07:09.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.082+0000 7fa25d215640 1 -- 172.21.15.37:0/1004008227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa25003e7c0 con 0x7fa2500d5940 2023-12-19T16:07:09.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.083+0000 7f0c6d730640 1 -- 172.21.15.37:0/3933772930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0c480057d0 con 0x7f0c68152fc0 2023-12-19T16:07:09.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.083+0000 7f0c64ff9640 1 -- 172.21.15.37:0/3933772930 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0c5c017020 con 0x7f0c68152fc0 2023-12-19T16:07:09.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.084+0000 7fa254ff9640 1 -- 172.21.15.37:0/1004008227 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa24c02d040 con 0x7fa2500d5940 2023-12-19T16:07:09.091 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-12-19T16:07:09.091 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-12-19T16:07:09.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.085+0000 7f87ad6fa640 1 -- 172.21.15.37:0/4108193684 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f878c06a4f0 msgr2=0x7f878c06c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:09.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.085+0000 7f87ad6fa640 1 --2- 172.21.15.37:0/4108193684 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f878c06a4f0 0x7f878c06c9b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f879403a000 tx=0x7f8794034000 comp rx=0 tx=0).stop 2023-12-19T16:07:09.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.085+0000 7f87ad6fa640 1 -- 172.21.15.37:0/4108193684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87a00ce9d0 msgr2=0x7f87a003b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:09.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.085+0000 7f87ad6fa640 1 --2- 172.21.15.37:0/4108193684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87a00ce9d0 0x7f87a003b720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f879c00c390 tx=0x7f879c00c850 comp rx=0 tx=0).stop 2023-12-19T16:07:09.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.085+0000 7f87ad6fa640 1 -- 172.21.15.37:0/4108193684 shutdown_connections 2023-12-19T16:07:09.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.085+0000 7f87ad6fa640 1 --2- 172.21.15.37:0/4108193684 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f878c06a4f0 0x7f878c06c9b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.085+0000 7f87ad6fa640 1 --2- 172.21.15.37:0/4108193684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87a00ce9d0 0x7f87a003b720 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.085+0000 7f87ad6fa640 1 --2- 172.21.15.37:0/4108193684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a003e210 0x7f87a0035d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.085+0000 7f87ad6fa640 1 --2- 172.21.15.37:0/4108193684 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f87a00084b0 0x7f87a016b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.085+0000 7f87ad6fa640 1 -- 172.21.15.37:0/4108193684 >> 172.21.15.37:0/4108193684 conn(0x7f87a00400a0 msgr2=0x7f87a0023520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.085+0000 7fecf9ada640 1 -- 172.21.15.37:0/2328291338 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fece006a520 msgr2=0x7fece006c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.085+0000 7fecf9ada640 1 --2- 172.21.15.37:0/2328291338 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fece006a520 0x7fece006c9e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fece403b000 tx=0x7fece400d040 comp rx=0 tx=0).stop 2023-12-19T16:07:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.085+0000 7fecf9ada640 1 -- 172.21.15.37:0/2328291338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecf406e9a0 msgr2=0x7fecf4145ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.085+0000 7fecf9ada640 1 --2- 172.21.15.37:0/2328291338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecf406e9a0 0x7fecf4145ba0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fece800c430 tx=0x7fece800c8f0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7f87ad6fa640 1 -- 172.21.15.37:0/4108193684 shutdown_connections 2023-12-19T16:07:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7f87ad6fa640 1 -- 172.21.15.37:0/4108193684 wait complete. 2023-12-19T16:07:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7fecf9ada640 1 -- 172.21.15.37:0/2328291338 shutdown_connections 2023-12-19T16:07:09.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7fecf9ada640 1 --2- 172.21.15.37:0/2328291338 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fece006a520 0x7fece006c9e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7fecf9ada640 1 --2- 172.21.15.37:0/2328291338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecf4144170 0x7fecf41d78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7fecf9ada640 1 --2- 172.21.15.37:0/2328291338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecf406e9a0 0x7fecf4145ba0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7fecf9ada640 1 --2- 172.21.15.37:0/2328291338 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fecf406b480 0x7fecf41e7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7fecf9ada640 1 -- 172.21.15.37:0/2328291338 >> 172.21.15.37:0/2328291338 conn(0x7fecf40bbcf0 msgr2=0x7fecf40b9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:09.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7f0850789640 1 -- 172.21.15.37:0/2003937890 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f082c06a4b0 msgr2=0x7f082c06c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:09.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7f0850789640 1 --2- 172.21.15.37:0/2003937890 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f082c06a4b0 0x7f082c06c970 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0840039000 tx=0x7f084000b040 comp rx=0 tx=0).stop 2023-12-19T16:07:09.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7f0850789640 1 -- 172.21.15.37:0/2003937890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08480b4ed0 msgr2=0x7f084813a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:09.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7f0850789640 1 --2- 172.21.15.37:0/2003937890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08480b4ed0 0x7f084813a060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f084400c460 tx=0x7f084400c920 comp rx=0 tx=0).stop 2023-12-19T16:07:09.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7fecf9ada640 1 -- 172.21.15.37:0/2328291338 shutdown_connections 2023-12-19T16:07:09.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7fecf9ada640 1 -- 172.21.15.37:0/2328291338 wait complete. 2023-12-19T16:07:09.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7f0c6d730640 1 -- 172.21.15.37:0/3933772930 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0c5406a500 msgr2=0x7f0c5406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:09.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7f0c6d730640 1 --2- 172.21.15.37:0/3933772930 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0c5406a500 0x7f0c5406c9c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0c600012e0 tx=0x7f0c60009040 comp rx=0 tx=0).stop 2023-12-19T16:07:09.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7f0850789640 1 -- 172.21.15.37:0/2003937890 shutdown_connections 2023-12-19T16:07:09.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7f0850789640 1 --2- 172.21.15.37:0/2003937890 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f082c06a4b0 0x7f082c06c970 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0840039000 tx=0x7f084000b040 comp rx=0 tx=0).stop 2023-12-19T16:07:09.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7f0850789640 1 --2- 172.21.15.37:0/2003937890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0848146fc0 0x7f08480b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7f0850789640 1 --2- 172.21.15.37:0/2003937890 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f084813cff0 0x7f08480b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7f0850789640 1 --2- 172.21.15.37:0/2003937890 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08480b4ed0 0x7f084813a060 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.086+0000 7f0850789640 1 -- 172.21.15.37:0/2003937890 >> 172.21.15.37:0/2003937890 conn(0x7f08480bbcd0 msgr2=0x7f08480b67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:09.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7f0c6d730640 1 -- 172.21.15.37:0/3933772930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c68152fc0 msgr2=0x7f0c681e7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:09.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7f0c6d730640 1 --2- 172.21.15.37:0/3933772930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c68152fc0 0x7f0c681e7280 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c00c3c0 tx=0x7f0c5c001e70 comp rx=0 tx=0).stop 2023-12-19T16:07:09.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7f0c6d730640 1 -- 172.21.15.37:0/3933772930 shutdown_connections 2023-12-19T16:07:09.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7f0c6d730640 1 --2- 172.21.15.37:0/3933772930 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0c5406a500 0x7f0c5406c9c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7f0c6d730640 1 --2- 172.21.15.37:0/3933772930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c68152fc0 0x7f0c681e7280 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7f0c6d730640 1 --2- 172.21.15.37:0/3933772930 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0c6806fa70 0x7f0c680b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7f0c6d730640 1 --2- 172.21.15.37:0/3933772930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c6806b480 0x7f0c680b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7f0850789640 1 -- 172.21.15.37:0/2003937890 shutdown_connections 2023-12-19T16:07:09.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7f0c6d730640 1 -- 172.21.15.37:0/3933772930 >> 172.21.15.37:0/3933772930 conn(0x7f0c680bbed0 msgr2=0x7f0c681516f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:09.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7f0850789640 1 -- 172.21.15.37:0/2003937890 wait complete. 2023-12-19T16:07:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7f0c6d730640 1 -- 172.21.15.37:0/3933772930 shutdown_connections 2023-12-19T16:07:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7f0c6d730640 1 -- 172.21.15.37:0/3933772930 wait complete. 2023-12-19T16:07:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7fa25d215640 1 -- 172.21.15.37:0/1004008227 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa23c06a500 msgr2=0x7fa23c06c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7fa25d215640 1 --2- 172.21.15.37:0/1004008227 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa23c06a500 0x7fa23c06c9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa24400b810 tx=0x7fa244008040 comp rx=0 tx=0).stop 2023-12-19T16:07:09.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7fa25d215640 1 -- 172.21.15.37:0/1004008227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2500d5940 msgr2=0x7fa2500d8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:09.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7fa25d215640 1 --2- 172.21.15.37:0/1004008227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2500d5940 0x7fa2500d8260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009870 tx=0x7fa24c0046c0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7fa25d215640 1 -- 172.21.15.37:0/1004008227 shutdown_connections 2023-12-19T16:07:09.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7fa25d215640 1 --2- 172.21.15.37:0/1004008227 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa23c06a500 0x7fa23c06c9c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7fa25d215640 1 --2- 172.21.15.37:0/1004008227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2500d5940 0x7fa2500d8260 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7fa25d215640 1 --2- 172.21.15.37:0/1004008227 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa250028410 0x7fa250041c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7fa25d215640 1 --2- 172.21.15.37:0/1004008227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa250006b30 0x7fa250036030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7fa25d215640 1 -- 172.21.15.37:0/1004008227 >> 172.21.15.37:0/1004008227 conn(0x7fa250005da0 msgr2=0x7fa2500ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:09.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7fa25d215640 1 -- 172.21.15.37:0/1004008227 shutdown_connections 2023-12-19T16:07:09.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.087+0000 7fa25d215640 1 -- 172.21.15.37:0/1004008227 wait complete. 2023-12-19T16:07:09.102 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.4 2023-12-19T16:07:09.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.100+0000 7f1834816640 1 -- 172.21.15.37:0/879884073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f18280056b0 con 0x7f18280bd090 2023-12-19T16:07:09.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.101+0000 7f18277fe640 1 -- 172.21.15.37:0/879884073 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f18180575f0 con 0x7f18280bd090 2023-12-19T16:07:09.103 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2023-12-19T16:07:09.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.105+0000 7f1834816640 1 -- 172.21.15.37:0/879884073 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f181006a430 msgr2=0x7f181006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:09.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.105+0000 7f1834816640 1 --2- 172.21.15.37:0/879884073 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f181006a430 0x7f181006c8f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1830066a80 tx=0x7f183006e030 comp rx=0 tx=0).stop 2023-12-19T16:07:09.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.105+0000 7f1834816640 1 -- 172.21.15.37:0/879884073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18280bd090 msgr2=0x7f18280bd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:09.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.105+0000 7f1834816640 1 --2- 172.21.15.37:0/879884073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18280bd090 0x7f18280bd510 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f18280440f0 tx=0x7f181800d890 comp rx=0 tx=0).stop 2023-12-19T16:07:09.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.105+0000 7f1834816640 1 -- 172.21.15.37:0/879884073 shutdown_connections 2023-12-19T16:07:09.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.105+0000 7f1834816640 1 --2- 172.21.15.37:0/879884073 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f181006a430 0x7f181006c8f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.105+0000 7f1834816640 1 --2- 172.21.15.37:0/879884073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18280bd090 0x7f18280bd510 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.105+0000 7f1834816640 1 --2- 172.21.15.37:0/879884073 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1828166920 0x7f1828166d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.105+0000 7f1834816640 1 --2- 172.21.15.37:0/879884073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18280d3ca0 0x7f18280d4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:09.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.105+0000 7f1834816640 1 -- 172.21.15.37:0/879884073 >> 172.21.15.37:0/879884073 conn(0x7f18280432a0 msgr2=0x7f18280c7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:09.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.106+0000 7f1834816640 1 -- 172.21.15.37:0/879884073 shutdown_connections 2023-12-19T16:07:09.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:09.106+0000 7f1834816640 1 -- 172.21.15.37:0/879884073 wait complete. 2023-12-19T16:07:09.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.3 2023-12-19T16:07:09.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.7 2023-12-19T16:07:09.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.0 2023-12-19T16:07:09.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.5 2023-12-19T16:07:09.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.1 2023-12-19T16:07:09.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.6 2023-12-19T16:07:10.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-19T16:07:10.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-19T16:07:10.112 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-19T16:07:10.114 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-19T16:07:10.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-19T16:07:10.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-19T16:07:10.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-19T16:07:10.120 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-19T16:07:10.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.259+0000 7f526dd4f640 1 Processor -- start 2023-12-19T16:07:10.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.259+0000 7f526dd4f640 1 -- start start 2023-12-19T16:07:10.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.260+0000 7f526dd4f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f52680716d0 0x7f5268152260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.260+0000 7f526dd4f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526814abc0 con 0x7f526806b480 2023-12-19T16:07:10.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.260+0000 7f526dd4f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526814a290 con 0x7f526806e9a0 2023-12-19T16:07:10.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.260+0000 7f526dd4f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526814a570 con 0x7f52680716d0 2023-12-19T16:07:10.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.261+0000 7f526cd4d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f526806b480 0x7f5268143c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46388/0 (socket says 172.21.15.37:46388) 2023-12-19T16:07:10.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.261+0000 7f526cd4d640 1 -- 172.21.15.37:0/2136207771 learned_addr learned my addr 172.21.15.37:0/2136207771 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:10.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.261+0000 7f526d54e640 1 --2- 172.21.15.37:0/2136207771 >> v2:172.21.15.78:3300/0 conn(0x7f52680716d0 0x7f5268152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.262+0000 7f52677fe640 1 -- 172.21.15.37:0/2136207771 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840440993 0 0) 0x7f526814abc0 con 0x7f526806b480 2023-12-19T16:07:10.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.262+0000 7f52677fe640 1 -- 172.21.15.37:0/2136207771 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5250003520 con 0x7f526806b480 2023-12-19T16:07:10.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.262+0000 7f52677fe640 1 -- 172.21.15.37:0/2136207771 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2637595692 0 0) 0x7f5250003520 con 0x7f526806b480 2023-12-19T16:07:10.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.262+0000 7f52677fe640 1 -- 172.21.15.37:0/2136207771 >> v2:172.21.15.78:3300/0 conn(0x7f52680716d0 msgr2=0x7f5268152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.262+0000 7f52677fe640 1 --2- 172.21.15.37:0/2136207771 >> v2:172.21.15.78:3300/0 conn(0x7f52680716d0 0x7f5268152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.263+0000 7f52677fe640 1 -- 172.21.15.37:0/2136207771 >> v1:172.21.15.78:6789/0 conn(0x7f526806e9a0 legacy=0x7f5268146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.263+0000 7f52677fe640 1 -- 172.21.15.37:0/2136207771 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526814a850 con 0x7f526806b480 2023-12-19T16:07:10.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.263+0000 7f52677fe640 1 -- 172.21.15.37:0/2136207771 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f525c001670 con 0x7f526806b480 2023-12-19T16:07:10.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.263+0000 7f52677fe640 1 -- 172.21.15.37:0/2136207771 >> v1:172.21.15.37:6789/0 conn(0x7f526806b480 legacy=0x7f5268143c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.264+0000 7f52677fe640 1 --2- 172.21.15.37:0/2136207771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5250003a90 0x7f5250003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.264+0000 7f52677fe640 1 --2- 172.21.15.37:0/2136207771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52500047c0 0x7f5250004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.264+0000 7f526cd4d640 1 --2- 172.21.15.37:0/2136207771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5250003a90 0x7f5250003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.264+0000 7f52677fe640 1 --2- 172.21.15.37:0/2136207771 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52500052a0 0x7f525000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.264+0000 7f52677fe640 1 -- 172.21.15.37:0/2136207771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526814a570 con 0x7f5250003a90 2023-12-19T16:07:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.264+0000 7f52677fe640 1 -- 172.21.15.37:0/2136207771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525000c170 con 0x7f52500047c0 2023-12-19T16:07:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.264+0000 7f52677fe640 1 -- 172.21.15.37:0/2136207771 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525000c330 con 0x7f52500052a0 2023-12-19T16:07:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.265+0000 7f5267fff640 1 --2- 172.21.15.37:0/2136207771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52500047c0 0x7f5250004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.265+0000 7f526cd4d640 1 -- 172.21.15.37:0/2136207771 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52500052a0 msgr2=0x7f525000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.265+0000 7f526cd4d640 1 --2- 172.21.15.37:0/2136207771 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52500052a0 0x7f525000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.265+0000 7f526cd4d640 1 -- 172.21.15.37:0/2136207771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52500047c0 msgr2=0x7f5250004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.265+0000 7f526cd4d640 1 --2- 172.21.15.37:0/2136207771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52500047c0 0x7f5250004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.265+0000 7f526cd4d640 1 -- 172.21.15.37:0/2136207771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5250003520 con 0x7f5250003a90 2023-12-19T16:07:10.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.266+0000 7f526cd4d640 1 --2- 172.21.15.37:0/2136207771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5250003a90 0x7f5250003e70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f525c004ac0 tx=0x7f52500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e028bdb5a66ae4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.267+0000 7f52677fe640 1 -- 172.21.15.37:0/2136207771 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c005ad0 con 0x7f5250003a90 2023-12-19T16:07:10.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.267+0000 7f52677fe640 1 -- 172.21.15.37:0/2136207771 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525c005c50 con 0x7f5250003a90 2023-12-19T16:07:10.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.268+0000 7f526dd4f640 1 -- 172.21.15.37:0/2136207771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5250003a90 msgr2=0x7f5250003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.268+0000 7f526dd4f640 1 --2- 172.21.15.37:0/2136207771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5250003a90 0x7f5250003e70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f525c004ac0 tx=0x7f52500057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.268+0000 7f526d54e640 1 -- 172.21.15.37:0/2136207771 reap_dead start 2023-12-19T16:07:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.268+0000 7f526dd4f640 1 -- 172.21.15.37:0/2136207771 shutdown_connections 2023-12-19T16:07:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.268+0000 7f526dd4f640 1 -- 172.21.15.37:0/2136207771 >> 172.21.15.37:0/2136207771 conn(0x7f52680bbcf0 msgr2=0x7f52680bc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.269+0000 7f526dd4f640 1 -- 172.21.15.37:0/2136207771 shutdown_connections 2023-12-19T16:07:10.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.269+0000 7f526dd4f640 1 -- 172.21.15.37:0/2136207771 wait complete. 2023-12-19T16:07:10.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.270+0000 7f526dd4f640 1 Processor -- start 2023-12-19T16:07:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.271+0000 7f526dd4f640 1 -- start start 2023-12-19T16:07:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.272+0000 7f526dd4f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52680b4ff0 0x7f52680b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.272+0000 7f526dd4f640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5268145560 0x7f52681459c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.272+0000 7f526dd4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52681f07e0 0x7f52681f0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.272+0000 7f526dd4f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680afbb0 con 0x7f52681f07e0 2023-12-19T16:07:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.272+0000 7f526dd4f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680b04b0 con 0x7f52680b4ff0 2023-12-19T16:07:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.272+0000 7f526dd4f640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5268145f00 con 0x7f5268145560 2023-12-19T16:07:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.272+0000 7f526d54e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52681f07e0 0x7f52681f0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.272+0000 7f526d54e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52681f07e0 0x7f52681f0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47604/0 (socket says 172.21.15.37:47604) 2023-12-19T16:07:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.272+0000 7f526d54e640 1 -- 172.21.15.37:0/3898053889 learned_addr learned my addr 172.21.15.37:0/3898053889 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.272+0000 7f5267fff640 1 --2- 172.21.15.37:0/3898053889 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5268145560 0x7f52681459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.273+0000 7f526d54e640 1 -- 172.21.15.37:0/3898053889 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5268145560 msgr2=0x7f52681459c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.273+0000 7f526d54e640 1 --2- 172.21.15.37:0/3898053889 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5268145560 0x7f52681459c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.273+0000 7f526d54e640 1 -- 172.21.15.37:0/3898053889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52680b4ff0 msgr2=0x7f52680b53d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T16:07:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.273+0000 7f526d54e640 1 --2- 172.21.15.37:0/3898053889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52680b4ff0 0x7f52680b53d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.273+0000 7f526d54e640 1 -- 172.21.15.37:0/3898053889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5268146500 con 0x7f52681f07e0 2023-12-19T16:07:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.273+0000 7f526d54e640 1 --2- 172.21.15.37:0/3898053889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52681f07e0 0x7f52681f0c60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f52680b7a60 tx=0x7f526000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.274+0000 7f52657fa640 1 -- 172.21.15.37:0/3898053889 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260018070 con 0x7f52681f07e0 2023-12-19T16:07:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.274+0000 7f526dd4f640 1 -- 172.21.15.37:0/3898053889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52681450d0 con 0x7f52681f07e0 2023-12-19T16:07:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.274+0000 7f526dd4f640 1 -- 172.21.15.37:0/3898053889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52680b5a60 con 0x7f52681f07e0 2023-12-19T16:07:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.276+0000 7f526dd4f640 1 -- 172.21.15.37:0/3898053889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5268066200 con 0x7f52681f07e0 2023-12-19T16:07:10.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.287+0000 7f52657fa640 1 -- 172.21.15.37:0/3898053889 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5260007e50 con 0x7f52681f07e0 2023-12-19T16:07:10.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.287+0000 7f52657fa640 1 -- 172.21.15.37:0/3898053889 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526000ed50 con 0x7f52681f07e0 2023-12-19T16:07:10.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.287+0000 7f52657fa640 1 -- 172.21.15.37:0/3898053889 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5260003990 con 0x7f52681f07e0 2023-12-19T16:07:10.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.288+0000 7f52657fa640 1 --2- 172.21.15.37:0/3898053889 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f525006c340 0x7f525006e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.288+0000 7f52657fa640 1 -- 172.21.15.37:0/3898053889 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5260088e90 con 0x7f52681f07e0 2023-12-19T16:07:10.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.289+0000 7f526cd4d640 1 --2- 172.21.15.37:0/3898053889 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f525006c340 0x7f525006e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.289+0000 7f52657fa640 1 -- 172.21.15.37:0/3898053889 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f52600892c0 con 0x7f52681f07e0 2023-12-19T16:07:10.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.295+0000 7f526cd4d640 1 --2- 172.21.15.37:0/3898053889 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f525006c340 0x7f525006e800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f525c039000 tx=0x7f525c034000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.311+0000 7f2cd7fff640 1 Processor -- start 2023-12-19T16:07:10.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.311+0000 7f2cd7fff640 1 -- start start 2023-12-19T16:07:10.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.312+0000 7f7b8f75c640 1 Processor -- start 2023-12-19T16:07:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.312+0000 7f2cd7fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cd806b480 0x7f2cd8143c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.312+0000 7f7b8f75c640 1 -- start start 2023-12-19T16:07:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.312+0000 7f2cd7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2cd8144170 0x7f2cd8146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.312+0000 7f2cd7fff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd814abc0 con 0x7f2cd806e9a0 2023-12-19T16:07:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.312+0000 7f2cd7fff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd814a290 con 0x7f2cd8144170 2023-12-19T16:07:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.312+0000 7f2cd7fff640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd814a570 con 0x7f2cd806b480 2023-12-19T16:07:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.312+0000 7f2ccffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2cd8144170 0x7f2cd8146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.312+0000 7f2ccffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2cd8144170 0x7f2cd8146ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47610/0 (socket says 172.21.15.37:47610) 2023-12-19T16:07:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.312+0000 7f2ccffff640 1 -- 172.21.15.37:0/4104211464 learned_addr learned my addr 172.21.15.37:0/4104211464 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.313+0000 7f2cd6ffd640 1 --2- 172.21.15.37:0/4104211464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cd806b480 0x7f2cd8143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.313+0000 7f2ccffff640 1 -- 172.21.15.37:0/4104211464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cd806b480 msgr2=0x7f2cd8143c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.313+0000 7f2ccffff640 1 --2- 172.21.15.37:0/4104211464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cd806b480 0x7f2cd8143c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.313+0000 7f2ccffff640 1 -- 172.21.15.37:0/4104211464 >> v1:172.21.15.37:6789/0 conn(0x7f2cd806e9a0 legacy=0x7f2cd80b6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.313+0000 7f78a328a640 1 Processor -- start 2023-12-19T16:07:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.313+0000 7f7b8f75c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b8806ae20 0x7f7b8806f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.313+0000 7f78a328a640 1 -- start start 2023-12-19T16:07:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.314+0000 7f7b8f75c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b8814ac10 0x7f7b880b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.314+0000 7f7b8d4f8640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b8806ae20 0x7f7b8806f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.314+0000 7f7b8d4f8640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b8806ae20 0x7f7b8806f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:41630/0 (socket says 172.21.15.37:41630) 2023-12-19T16:07:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.314+0000 7f7b8ccf7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7b880b6350 0x7f7b8814a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46416/0 (socket says 172.21.15.37:46416) 2023-12-19T16:07:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.314+0000 7f7b8d4f8640 1 -- 172.21.15.37:0/1157528271 learned_addr learned my addr 172.21.15.37:0/1157528271 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.314+0000 7f7b8f75c640 1 -- 172.21.15.37:0/1157528271 --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b88070ae0 con 0x7f7b880b6350 2023-12-19T16:07:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.314+0000 7f7b8f75c640 1 -- 172.21.15.37:0/1157528271 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b88141670 con 0x7f7b8814ac10 2023-12-19T16:07:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.314+0000 7f7b8f75c640 1 -- 172.21.15.37:0/1157528271 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8806fac0 con 0x7f7b8806ae20 2023-12-19T16:07:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.313+0000 7f2ccffff640 1 -- 172.21.15.37:0/4104211464 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd814a850 con 0x7f2cd8144170 2023-12-19T16:07:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.314+0000 7f7b7ffff640 1 -- 172.21.15.37:0/1157528271 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578992286 0 0) 0x7f7b88070ae0 con 0x7f7b880b6350 2023-12-19T16:07:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.314+0000 7f7b7ffff640 1 -- 172.21.15.37:0/1157528271 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b74003520 con 0x7f7b880b6350 2023-12-19T16:07:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f7b8dcf9640 1 --2- 172.21.15.37:0/1157528271 >> v2:172.21.15.37:3300/0 conn(0x7f7b8814ac10 0x7f7b880b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f78a328a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7894036430 0x7f78940d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f78a328a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f789400adb0 0x7f78940d1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f78a328a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7894008200 con 0x7f78940cb730 2023-12-19T16:07:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f78a328a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f789403f660 con 0x7f789400adb0 2023-12-19T16:07:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f78a328a640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789403ee00 con 0x7f7894036430 2023-12-19T16:07:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f2ccffff640 1 --2- 172.21.15.37:0/4104211464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd8144170 0x7f2cd8146ab0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009870 tx=0x7f2cc802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c89b32916b856c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f7b7ffff640 1 -- 172.21.15.37:0/1157528271 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1287524285 0 0) 0x7f7b74003520 con 0x7f7b880b6350 2023-12-19T16:07:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f7b7ffff640 1 -- 172.21.15.37:0/1157528271 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b8806ae20 msgr2=0x7f7b8806f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f7b7ffff640 1 --2- 172.21.15.37:0/1157528271 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b8806ae20 0x7f7b8806f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f7b7ffff640 1 -- 172.21.15.37:0/1157528271 >> v2:172.21.15.37:3300/0 conn(0x7f7b8814ac10 msgr2=0x7f7b880b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f7b7ffff640 1 --2- 172.21.15.37:0/1157528271 >> v2:172.21.15.37:3300/0 conn(0x7f7b8814ac10 0x7f7b880b6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f7b7ffff640 1 -- 172.21.15.37:0/1157528271 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b88070d80 con 0x7f7b880b6350 2023-12-19T16:07:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f7b7ffff640 1 -- 172.21.15.37:0/1157528271 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f7b78001580 con 0x7f7b880b6350 2023-12-19T16:07:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f7b7ffff640 1 -- 172.21.15.37:0/1157528271 >> v1:172.21.15.37:6789/0 conn(0x7f7b880b6350 legacy=0x7f7b8814a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f7b7ffff640 1 --2- 172.21.15.37:0/1157528271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b740039a0 0x7f7b74003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f7b7ffff640 1 --2- 172.21.15.37:0/1157528271 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b8806ae20 0x7f7b740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f7b7ffff640 1 --2- 172.21.15.37:0/1157528271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b74004d00 0x7f7b74005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f2cd67fc640 1 -- 172.21.15.37:0/4104211464 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8030840 con 0x7f2cd8144170 2023-12-19T16:07:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f7b7ffff640 1 -- 172.21.15.37:0/1157528271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b88141670 con 0x7f7b74004d00 2023-12-19T16:07:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f7b7ffff640 1 -- 172.21.15.37:0/1157528271 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8806fac0 con 0x7f7b740039a0 2023-12-19T16:07:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f7b7ffff640 1 -- 172.21.15.37:0/1157528271 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7400b980 con 0x7f7b8806ae20 2023-12-19T16:07:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f78a2288640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f78940cb730 0x7f7894007af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46422/0 (socket says 172.21.15.37:46422) 2023-12-19T16:07:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f78a2288640 1 -- 172.21.15.37:0/1968975251 learned_addr learned my addr 172.21.15.37:0/1968975251 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f78a1a87640 1 --2- 172.21.15.37:0/1968975251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7894036430 0x7f78940d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f7b8d4f8640 1 --2- 172.21.15.37:0/1157528271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b740039a0 0x7f7b74003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.315+0000 7f7b8dcf9640 1 --2- 172.21.15.37:0/1157528271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b74004d00 0x7f7b74005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.316+0000 7f587b6c4640 1 Processor -- start 2023-12-19T16:07:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.316+0000 7f8ceb59e640 1 Processor -- start 2023-12-19T16:07:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.316+0000 7f78a2a89640 1 --2- 172.21.15.37:0/1968975251 >> v2:172.21.15.78:3300/0 conn(0x7f789400adb0 0x7f78940d1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.316+0000 7f78a1a87640 1 -- 172.21.15.37:0/1968975251 >> v2:172.21.15.78:3300/0 conn(0x7f789400adb0 msgr2=0x7f78940d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.316+0000 7f78a1a87640 1 --2- 172.21.15.37:0/1968975251 >> v2:172.21.15.78:3300/0 conn(0x7f789400adb0 0x7f78940d1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.316+0000 7f587b6c4640 1 -- start start 2023-12-19T16:07:10.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.316+0000 7f78a1a87640 1 -- 172.21.15.37:0/1968975251 >> v1:172.21.15.37:6789/0 conn(0x7f78940cb730 legacy=0x7f7894007af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.316+0000 7f78a1a87640 1 -- 172.21.15.37:0/1968975251 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789403f0a0 con 0x7f7894036430 2023-12-19T16:07:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.316+0000 7f7b8ccf7640 1 --2- 172.21.15.37:0/1157528271 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b8806ae20 0x7f7b740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.316+0000 7f7b8d4f8640 1 -- 172.21.15.37:0/1157528271 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b8806ae20 msgr2=0x7f7b740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.316+0000 7f7b8d4f8640 1 --2- 172.21.15.37:0/1157528271 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b8806ae20 0x7f7b740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.316+0000 7f7b8d4f8640 1 -- 172.21.15.37:0/1157528271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b74004d00 msgr2=0x7f7b74005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.317+0000 7f7b8d4f8640 1 --2- 172.21.15.37:0/1157528271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b74004d00 0x7f7b74005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.317+0000 7f7b8d4f8640 1 -- 172.21.15.37:0/1157528271 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b88070d80 con 0x7f7b740039a0 2023-12-19T16:07:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.317+0000 7f2cd67fc640 1 -- 172.21.15.37:0/4104211464 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc80309a0 con 0x7f2cd8144170 2023-12-19T16:07:10.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.317+0000 7f2cd67fc640 1 -- 172.21.15.37:0/4104211464 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8030d30 con 0x7f2cd8144170 2023-12-19T16:07:10.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.316+0000 7f8ceb59e640 1 -- start start 2023-12-19T16:07:10.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.317+0000 7f572148b640 1 Processor -- start 2023-12-19T16:07:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.317+0000 7f587b6c4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f587414c990 0x7f58741488c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.317+0000 7f587b6c4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587414beb0 con 0x7f5874070d60 2023-12-19T16:07:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.317+0000 7f587b6c4640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587414c190 con 0x7f5874071140 2023-12-19T16:07:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.317+0000 7f587b6c4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58741498a0 con 0x7f587414c990 2023-12-19T16:07:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.317+0000 7f8ceb59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ce4006f80 0x7f8ce40d5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.317+0000 7f8ceb59e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8ce40049d0 0x7f8ce403aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.317+0000 7f8ceb59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8ce40cf320 0x7f8ce403e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.317+0000 7f5878c5f640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5874071140 0x7f58740b5990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.37:52868/0 (socket says 172.21.15.37:52868) 2023-12-19T16:07:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.317+0000 7f5878c5f640 1 -- 172.21.15.37:0/1211870115 learned_addr learned my addr 172.21.15.37:0/1211870115 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.317+0000 7f8ceb59e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce403c7c0 con 0x7f8ce40cf320 2023-12-19T16:07:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.317+0000 7f8ceb59e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce403caa0 con 0x7f8ce4006f80 2023-12-19T16:07:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.317+0000 7f8ceb59e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce403a2b0 con 0x7f8ce40049d0 2023-12-19T16:07:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f8cead9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8ce40cf320 0x7f8ce403e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f8cead9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8ce40cf320 0x7f8ce403e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47648/0 (socket says 172.21.15.37:47648) 2023-12-19T16:07:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f8cead9d640 1 -- 172.21.15.37:0/4064039272 learned_addr learned my addr 172.21.15.37:0/4064039272 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f5879c61640 1 --2- 172.21.15.37:0/1211870115 >> v2:172.21.15.37:3300/0 conn(0x7f587414c990 0x7f58741488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f586bfff640 1 -- 172.21.15.37:0/1211870115 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966852207 0 0) 0x7f587414c190 con 0x7f5874071140 2023-12-19T16:07:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f586bfff640 1 -- 172.21.15.37:0/1211870115 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5860003520 con 0x7f5874071140 2023-12-19T16:07:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.317+0000 7f572148b640 1 -- start start 2023-12-19T16:07:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f2cd7fff640 1 -- 172.21.15.37:0/4104211464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd8144170 msgr2=0x7f2cd8146ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f2cd7fff640 1 --2- 172.21.15.37:0/4104211464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd8144170 0x7f2cd8146ab0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009870 tx=0x7f2cc802b980 comp rx=0 tx=0).stop 2023-12-19T16:07:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f2cd7fff640 1 -- 172.21.15.37:0/4104211464 shutdown_connections 2023-12-19T16:07:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f2cd7fff640 1 --2- 172.21.15.37:0/4104211464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd8144170 0x7f2cd8146ab0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f2cd7fff640 1 --2- 172.21.15.37:0/4104211464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cd806b480 0x7f2cd8143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f2cd7fff640 1 -- 172.21.15.37:0/4104211464 >> 172.21.15.37:0/4104211464 conn(0x7f2cd80bbcf0 msgr2=0x7f2cd80bc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f2cd7fff640 1 -- 172.21.15.37:0/4104211464 shutdown_connections 2023-12-19T16:07:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f2cd7fff640 1 -- 172.21.15.37:0/4104211464 wait complete. 2023-12-19T16:07:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f586bfff640 1 -- 172.21.15.37:0/1211870115 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862309221 0 0) 0x7f587414beb0 con 0x7f5874070d60 2023-12-19T16:07:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f572148b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f571c06af20 0x7f571c14ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f572148b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f571c141cb0 0x7f571c0b9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f572148b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f571c070480 con 0x7f571c06fc10 2023-12-19T16:07:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f572148b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571c071080 con 0x7f571c06af20 2023-12-19T16:07:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f572148b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571c0701a0 con 0x7f571c141cb0 2023-12-19T16:07:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f571a7fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f571c06fc10 0x7f571c1415a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.37:52876/0 (socket says 172.21.15.37:52876) 2023-12-19T16:07:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f571a7fc640 1 -- 172.21.15.37:0/2465483372 learned_addr learned my addr 172.21.15.37:0/2465483372 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f8ce9d9b640 1 --2- 172.21.15.37:0/4064039272 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8ce40049d0 0x7f8ce403aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f8cead9d640 1 -- 172.21.15.37:0/4064039272 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8ce40049d0 msgr2=0x7f8ce403aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f8cead9d640 1 --2- 172.21.15.37:0/4064039272 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8ce40049d0 0x7f8ce403aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f8cea59c640 1 --2- 172.21.15.37:0/4064039272 >> v2:172.21.15.78:3300/0 conn(0x7f8ce4006f80 0x7f8ce40d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f8cead9d640 1 -- 172.21.15.37:0/4064039272 >> v2:172.21.15.78:3300/0 conn(0x7f8ce4006f80 msgr2=0x7f8ce40d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f8cead9d640 1 --2- 172.21.15.37:0/4064039272 >> v2:172.21.15.78:3300/0 conn(0x7f8ce4006f80 0x7f8ce40d5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f8cead9d640 1 -- 172.21.15.37:0/4064039272 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce403a590 con 0x7f8ce40cf320 2023-12-19T16:07:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f586bfff640 1 -- 172.21.15.37:0/1211870115 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5860003840 con 0x7f5874070d60 2023-12-19T16:07:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f586bfff640 1 -- 172.21.15.37:0/1211870115 <== mon.1 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3068439342 0 0) 0x7f5860003520 con 0x7f5874071140 2023-12-19T16:07:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7f586bfff640 1 -- 172.21.15.37:0/1211870115 >> v2:172.21.15.37:3300/0 conn(0x7f587414c990 msgr2=0x7f58741488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f571affd640 1 --2- 172.21.15.37:0/2465483372 >> v2:172.21.15.37:3300/0 conn(0x7f571c06af20 0x7f571c14ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f586bfff640 1 --2- 172.21.15.37:0/1211870115 >> v2:172.21.15.37:3300/0 conn(0x7f587414c990 0x7f58741488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f586bfff640 1 -- 172.21.15.37:0/1211870115 >> v1:172.21.15.37:6789/0 conn(0x7f5874070d60 legacy=0x7f58740b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f5719ffb640 1 -- 172.21.15.37:0/2465483372 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143440816 0 0) 0x7f571c070480 con 0x7f571c06fc10 2023-12-19T16:07:10.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f5719ffb640 1 -- 172.21.15.37:0/2465483372 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5704003520 con 0x7f571c06fc10 2023-12-19T16:07:10.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f8cea59c640 1 --2- 172.21.15.37:0/4064039272 >> v2:172.21.15.78:3300/0 conn(0x7f8ce4006f80 0x7f8ce40d5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:10.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f586bfff640 1 -- 172.21.15.37:0/1211870115 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587414c470 con 0x7f5874071140 2023-12-19T16:07:10.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f571b7fe640 1 --2- 172.21.15.37:0/2465483372 >> v2:172.21.15.78:3300/0 conn(0x7f571c141cb0 0x7f571c0b9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f571affd640 1 -- 172.21.15.37:0/2465483372 >> v2:172.21.15.78:3300/0 conn(0x7f571c141cb0 msgr2=0x7f571c0b9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f78a1a87640 1 --2- 172.21.15.37:0/1968975251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7894036430 0x7f78940d1650 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f78980097a0 tx=0x7f789802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4001ad5ddc343dc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.317+0000 7fe296e83640 1 Processor -- start 2023-12-19T16:07:10.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.318+0000 7fe296e83640 1 -- start start 2023-12-19T16:07:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7fe296e83640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe29006d330 0x7fe290071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f571affd640 1 --2- 172.21.15.37:0/2465483372 >> v2:172.21.15.78:3300/0 conn(0x7f571c141cb0 0x7f571c0b9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f571affd640 1 -- 172.21.15.37:0/2465483372 >> v1:172.21.15.78:6789/0 conn(0x7f571c06fc10 legacy=0x7f571c1415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7fe296e83640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe29014ece0 0x7fe29014f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7fe296e83640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2900b8190 con 0x7fe290148fb0 2023-12-19T16:07:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7fe296e83640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2900708f0 con 0x7fe29006d330 2023-12-19T16:07:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7fe296e83640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2900700c0 con 0x7fe29014ece0 2023-12-19T16:07:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7fe295680640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe29006d330 0x7fe290071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7fe295e81640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe290148fb0 0x7fe29006f9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.37:52890/0 (socket says 172.21.15.37:52890) 2023-12-19T16:07:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7fe296682640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe29014ece0 0x7fe29014f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7fe295680640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe29006d330 0x7fe290071690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47682/0 (socket says 172.21.15.37:47682) 2023-12-19T16:07:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7fe295680640 1 -- 172.21.15.37:0/362267662 learned_addr learned my addr 172.21.15.37:0/362267662 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f78a1286640 1 -- 172.21.15.37:0/1968975251 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789802d040 con 0x7f7894036430 2023-12-19T16:07:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f78a1286640 1 -- 172.21.15.37:0/1968975251 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7898031810 con 0x7f7894036430 2023-12-19T16:07:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f78a1286640 1 -- 172.21.15.37:0/1968975251 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7898031ba0 con 0x7f7894036430 2023-12-19T16:07:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7f571affd640 1 -- 172.21.15.37:0/2465483372 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c070ca0 con 0x7f571c06af20 2023-12-19T16:07:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7f571b7fe640 1 --2- 172.21.15.37:0/2465483372 >> v2:172.21.15.78:3300/0 conn(0x7f571c141cb0 0x7f571c0b9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7f7b8d4f8640 1 --2- 172.21.15.37:0/1157528271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b740039a0 0x7f7b74003dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009c10 tx=0x7f7b740057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=621f65cb6e2bfa92 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f586bfff640 1 -- 172.21.15.37:0/1211870115 <== mon.1 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f5864001650 con 0x7f5874071140 2023-12-19T16:07:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7f8cead9d640 1 --2- 172.21.15.37:0/4064039272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce40cf320 0x7f8ce403e150 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8cec04f260 tx=0x7f8cec0a5950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3674d4f386fd34a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7f2cd7fff640 1 Processor -- start 2023-12-19T16:07:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7f2cd7fff640 1 -- start start 2023-12-19T16:07:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7f8ce959a640 1 -- 172.21.15.37:0/4064039272 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec0aa6d0 con 0x7f8ce40cf320 2023-12-19T16:07:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f586bfff640 1 -- 172.21.15.37:0/1211870115 >> v1:172.21.15.78:6789/0 conn(0x7f5874071140 legacy=0x7f58740b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7f8ce959a640 1 -- 172.21.15.37:0/4064039272 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec0aa830 con 0x7f8ce40cf320 2023-12-19T16:07:10.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7fe296682640 1 -- 172.21.15.37:0/362267662 >> v2:172.21.15.37:3300/0 conn(0x7fe29006d330 msgr2=0x7fe290071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7fe296682640 1 --2- 172.21.15.37:0/362267662 >> v2:172.21.15.37:3300/0 conn(0x7fe29006d330 0x7fe290071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7fe296682640 1 -- 172.21.15.37:0/362267662 >> v1:172.21.15.78:6789/0 conn(0x7fe290148fb0 legacy=0x7fe29006f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7fe296682640 1 -- 172.21.15.37:0/362267662 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2900b9540 con 0x7fe29014ece0 2023-12-19T16:07:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7f8ce959a640 1 -- 172.21.15.37:0/4064039272 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec0aac60 con 0x7f8ce40cf320 2023-12-19T16:07:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f586bfff640 1 --2- 172.21.15.37:0/1211870115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5860003cb0 0x7f5860004090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f586bfff640 1 --2- 172.21.15.37:0/1211870115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58600047c0 0x7f5860004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f586bfff640 1 --2- 172.21.15.37:0/1211870115 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f58600051f0 0x7f586000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f586bfff640 1 -- 172.21.15.37:0/1211870115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5870001260 con 0x7f5860003cb0 2023-12-19T16:07:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f586bfff640 1 -- 172.21.15.37:0/1211870115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58741498a0 con 0x7f58600047c0 2023-12-19T16:07:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f586bfff640 1 -- 172.21.15.37:0/1211870115 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586000c260 con 0x7f58600051f0 2023-12-19T16:07:10.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f5879460640 1 --2- 172.21.15.37:0/1211870115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5860003cb0 0x7f5860004090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f5878c5f640 1 --2- 172.21.15.37:0/1211870115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58600047c0 0x7f5860004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.319+0000 7f5879c61640 1 --2- 172.21.15.37:0/1211870115 >> v2:172.21.15.37:3300/0 conn(0x7f587414c990 0x7f58741488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:07:10.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7f5879c61640 1 --2- 172.21.15.37:0/1211870115 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f58600051f0 0x7f586000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7f5878c5f640 1 -- 172.21.15.37:0/1211870115 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f58600051f0 msgr2=0x7f586000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7f5878c5f640 1 --2- 172.21.15.37:0/1211870115 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f58600051f0 0x7f586000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7f5878c5f640 1 -- 172.21.15.37:0/1211870115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5860003cb0 msgr2=0x7f5860004090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7f5878c5f640 1 --2- 172.21.15.37:0/1211870115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5860003cb0 0x7f5860004090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7f5878c5f640 1 -- 172.21.15.37:0/1211870115 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5860003520 con 0x7f58600047c0 2023-12-19T16:07:10.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.320+0000 7f5879c61640 1 -- 172.21.15.37:0/1211870115 reap_dead start 2023-12-19T16:07:10.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f571affd640 1 --2- 172.21.15.37:0/2465483372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c06af20 0x7f571c14ad00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f571c1487c0 tx=0x7f571002b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f553a2b8b6971a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f7b7ffff640 1 -- 172.21.15.37:0/1157528271 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8402c770 con 0x7f7b740039a0 2023-12-19T16:07:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f7b7ffff640 1 -- 172.21.15.37:0/1157528271 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8402c8d0 con 0x7f7b740039a0 2023-12-19T16:07:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f5878c5f640 1 --2- 172.21.15.37:0/1211870115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58600047c0 0x7f5860004c40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5864007fd0 tx=0x7f58600057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dff365204937330 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f8ceb59e640 1 -- 172.21.15.37:0/4064039272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce40cf320 msgr2=0x7f8ce403e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f586bfff640 1 -- 172.21.15.37:0/1211870115 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586400e310 con 0x7f58600047c0 2023-12-19T16:07:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f8ceb59e640 1 --2- 172.21.15.37:0/4064039272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce40cf320 0x7f8ce403e150 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8cec04f260 tx=0x7f8cec0a5950 comp rx=0 tx=0).stop 2023-12-19T16:07:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f586bfff640 1 -- 172.21.15.37:0/1211870115 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5864037030 con 0x7f58600047c0 2023-12-19T16:07:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f5719ffb640 1 -- 172.21.15.37:0/2465483372 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c001670 con 0x7f571c06af20 2023-12-19T16:07:10.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f586bfff640 1 -- 172.21.15.37:0/1211870115 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586400e310 con 0x7f58600047c0 2023-12-19T16:07:10.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f8ceb59e640 1 -- 172.21.15.37:0/4064039272 shutdown_connections 2023-12-19T16:07:10.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f8ceb59e640 1 --2- 172.21.15.37:0/4064039272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce40cf320 0x7f8ce403e150 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f8ceb59e640 1 --2- 172.21.15.37:0/4064039272 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8ce40049d0 0x7f8ce403aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f8ceb59e640 1 --2- 172.21.15.37:0/4064039272 >> v2:172.21.15.78:3300/0 conn(0x7f8ce4006f80 0x7f8ce40d5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f8ceb59e640 1 -- 172.21.15.37:0/4064039272 >> 172.21.15.37:0/4064039272 conn(0x7f8ce40061f0 msgr2=0x7f8ce4006600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f2cd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd806b480 0x7f2cd80adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f2cd7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd806e9a0 0x7f2cd80b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f2cd7fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cd8144170 0x7f2cd80af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f2cd7fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd8145850 con 0x7f2cd806b480 2023-12-19T16:07:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f2cd7fff640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd80ae1d0 con 0x7f2cd806e9a0 2023-12-19T16:07:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f2cd7fff640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd80b0c80 con 0x7f2cd8144170 2023-12-19T16:07:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f2ccffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd806e9a0 0x7f2cd80b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f2ccffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd806e9a0 0x7f2cd80b51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:39840/0 (socket says 172.21.15.37:39840) 2023-12-19T16:07:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f2ccffff640 1 -- 172.21.15.37:0/2889338426 learned_addr learned my addr 172.21.15.37:0/2889338426 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f2cd77fe640 1 --2- 172.21.15.37:0/2889338426 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cd8144170 0x7f2cd80af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7fe296682640 1 --2- 172.21.15.37:0/362267662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe29014ece0 0x7fe29014f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe290070e20 tx=0x7fe28802bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad3a0b5dc69ae067 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f7b7ffff640 1 -- 172.21.15.37:0/1157528271 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8402cc60 con 0x7f7b740039a0 2023-12-19T16:07:10.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f78a328a640 1 -- 172.21.15.37:0/1968975251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7894036430 msgr2=0x7f78940d1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f78a328a640 1 --2- 172.21.15.37:0/1968975251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7894036430 0x7f78940d1650 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f78980097a0 tx=0x7f789802b8b0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f5719ffb640 1 -- 172.21.15.37:0/2465483372 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571002e050 con 0x7f571c06af20 2023-12-19T16:07:10.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.321+0000 7f8ceb59e640 1 -- 172.21.15.37:0/4064039272 shutdown_connections 2023-12-19T16:07:10.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f5719ffb640 1 -- 172.21.15.37:0/2465483372 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710030730 con 0x7f571c06af20 2023-12-19T16:07:10.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f2cd6ffd640 1 --2- 172.21.15.37:0/2889338426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd806b480 0x7f2cd80adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f2ccffff640 1 -- 172.21.15.37:0/2889338426 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cd8144170 msgr2=0x7f2cd80af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f2ccffff640 1 --2- 172.21.15.37:0/2889338426 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cd8144170 0x7f2cd80af820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f2ccffff640 1 -- 172.21.15.37:0/2889338426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd806b480 msgr2=0x7f2cd80adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f2ccffff640 1 --2- 172.21.15.37:0/2889338426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd806b480 0x7f2cd80adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f2ccffff640 1 -- 172.21.15.37:0/2889338426 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc80094d0 con 0x7f2cd806e9a0 2023-12-19T16:07:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7fe294e7f640 1 -- 172.21.15.37:0/362267662 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28802cc70 con 0x7fe29014ece0 2023-12-19T16:07:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7fe294e7f640 1 -- 172.21.15.37:0/362267662 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28802cdd0 con 0x7fe29014ece0 2023-12-19T16:07:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7fe294e7f640 1 -- 172.21.15.37:0/362267662 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe288034660 con 0x7fe29014ece0 2023-12-19T16:07:10.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f2cd6ffd640 1 --2- 172.21.15.37:0/2889338426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd806b480 0x7f2cd80adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:10.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f7b8f75c640 1 -- 172.21.15.37:0/1157528271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b740039a0 msgr2=0x7f7b74003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f7b8f75c640 1 --2- 172.21.15.37:0/1157528271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b740039a0 0x7f7b74003dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009c10 tx=0x7f7b740057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f7b8dcf9640 1 -- 172.21.15.37:0/1157528271 reap_dead start 2023-12-19T16:07:10.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f78a328a640 1 -- 172.21.15.37:0/1968975251 shutdown_connections 2023-12-19T16:07:10.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f78a328a640 1 --2- 172.21.15.37:0/1968975251 >> v2:172.21.15.78:3300/0 conn(0x7f789400adb0 0x7f78940d1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f78a328a640 1 --2- 172.21.15.37:0/1968975251 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7894036430 0x7f78940d1650 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f78a328a640 1 -- 172.21.15.37:0/1968975251 >> 172.21.15.37:0/1968975251 conn(0x7f7894009db0 msgr2=0x7f789400a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:10.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f7b8f75c640 1 -- 172.21.15.37:0/1157528271 shutdown_connections 2023-12-19T16:07:10.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f7b8f75c640 1 -- 172.21.15.37:0/1157528271 >> 172.21.15.37:0/1157528271 conn(0x7f7b880b9130 msgr2=0x7f7b880b9510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:10.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f78a328a640 1 -- 172.21.15.37:0/1968975251 shutdown_connections 2023-12-19T16:07:10.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f78a328a640 1 -- 172.21.15.37:0/1968975251 wait complete. 2023-12-19T16:07:10.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f2ccffff640 1 --2- 172.21.15.37:0/2889338426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd806e9a0 0x7f2cd80b51c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009870 tx=0x7f2cc8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f587b6c4640 1 -- 172.21.15.37:0/1211870115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58600047c0 msgr2=0x7f5860004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f587b6c4640 1 --2- 172.21.15.37:0/1211870115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58600047c0 0x7f5860004c40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5864007fd0 tx=0x7f58600057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f587b6c4640 1 -- 172.21.15.37:0/1211870115 shutdown_connections 2023-12-19T16:07:10.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f587b6c4640 1 --2- 172.21.15.37:0/1211870115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58600047c0 0x7f5860004c40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f587b6c4640 1 -- 172.21.15.37:0/1211870115 >> 172.21.15.37:0/1211870115 conn(0x7f58740b88a0 msgr2=0x7f58740b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.323+0000 7f2ccf7fe640 1 -- 172.21.15.37:0/2889338426 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8039a90 con 0x7f2cd806e9a0 2023-12-19T16:07:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.323+0000 7f7b8f75c640 1 -- 172.21.15.37:0/1157528271 shutdown_connections 2023-12-19T16:07:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.323+0000 7f7b8f75c640 1 -- 172.21.15.37:0/1157528271 wait complete. 2023-12-19T16:07:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.323+0000 7f2ccf7fe640 1 -- 172.21.15.37:0/2889338426 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc8039bf0 con 0x7f2cd806e9a0 2023-12-19T16:07:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.323+0000 7f572148b640 1 -- 172.21.15.37:0/2465483372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c06af20 msgr2=0x7f571c14ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.323+0000 7f572148b640 1 --2- 172.21.15.37:0/2465483372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c06af20 0x7f571c14ad00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f571c1487c0 tx=0x7f571002b630 comp rx=0 tx=0).stop 2023-12-19T16:07:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.323+0000 7fe296e83640 1 -- 172.21.15.37:0/362267662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe29014ece0 msgr2=0x7fe29014f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.323+0000 7fe296e83640 1 --2- 172.21.15.37:0/362267662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe29014ece0 0x7fe29014f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe290070e20 tx=0x7fe28802bec0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.323+0000 7f587b6c4640 1 -- 172.21.15.37:0/1211870115 shutdown_connections 2023-12-19T16:07:10.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.323+0000 7fe296e83640 1 -- 172.21.15.37:0/362267662 shutdown_connections 2023-12-19T16:07:10.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.323+0000 7fe296e83640 1 --2- 172.21.15.37:0/362267662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe29014ece0 0x7fe29014f110 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.323+0000 7fe296e83640 1 --2- 172.21.15.37:0/362267662 >> v2:172.21.15.37:3300/0 conn(0x7fe29006d330 0x7fe290071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.323+0000 7fe296e83640 1 -- 172.21.15.37:0/362267662 >> 172.21.15.37:0/362267662 conn(0x7fe2900b9890 msgr2=0x7fe2900b9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:10.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.323+0000 7fe296e83640 1 -- 172.21.15.37:0/362267662 shutdown_connections 2023-12-19T16:07:10.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.322+0000 7f8ceb59e640 1 -- 172.21.15.37:0/4064039272 wait complete. 2023-12-19T16:07:10.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.323+0000 7f8ceb59e640 1 Processor -- start 2023-12-19T16:07:10.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.323+0000 7fe296e83640 1 -- 172.21.15.37:0/362267662 wait complete. 2023-12-19T16:07:10.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.323+0000 7f2cd7fff640 1 -- 172.21.15.37:0/2889338426 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd8145da0 con 0x7f2cd806e9a0 2023-12-19T16:07:10.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.324+0000 7f572148b640 1 -- 172.21.15.37:0/2465483372 shutdown_connections 2023-12-19T16:07:10.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.324+0000 7f572148b640 1 --2- 172.21.15.37:0/2465483372 >> v2:172.21.15.78:3300/0 conn(0x7f571c141cb0 0x7f571c0b9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.324+0000 7f572148b640 1 --2- 172.21.15.37:0/2465483372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c06af20 0x7f571c14ad00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.324+0000 7f572148b640 1 -- 172.21.15.37:0/2465483372 >> 172.21.15.37:0/2465483372 conn(0x7f571c0b9c30 msgr2=0x7f571c0ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:10.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.324+0000 7f78a328a640 1 Processor -- start 2023-12-19T16:07:10.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.324+0000 7f587b6c4640 1 -- 172.21.15.37:0/1211870115 wait complete. 2023-12-19T16:07:10.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.323+0000 7f2ccf7fe640 1 -- 172.21.15.37:0/2889338426 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc80433f0 con 0x7f2cd806e9a0 2023-12-19T16:07:10.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.323+0000 7f2cd7fff640 1 -- 172.21.15.37:0/2889338426 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd80b2860 con 0x7f2cd806e9a0 2023-12-19T16:07:10.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.324+0000 7f7b8f75c640 1 Processor -- start 2023-12-19T16:07:10.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.324+0000 7f8ceb59e640 1 -- start start 2023-12-19T16:07:10.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.325+0000 7f2cd7fff640 1 -- 172.21.15.37:0/2889338426 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd806f490 con 0x7f2cd806e9a0 2023-12-19T16:07:10.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.325+0000 7f8ceb59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce40049d0 0x7f8ce40d19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.325+0000 7f8ceb59e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8ce4006f80 0x7f8ce4168f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.324+0000 7f7b8f75c640 1 -- start start 2023-12-19T16:07:10.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.325+0000 7f8ceb59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ce40cf320 0x7f8ce41694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.325+0000 7f8ceb59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce40d1ef0 con 0x7f8ce40049d0 2023-12-19T16:07:10.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.324+0000 7f78a328a640 1 -- start start 2023-12-19T16:07:10.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.325+0000 7f8ceb59e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce40cc560 con 0x7f8ce40cf320 2023-12-19T16:07:10.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.325+0000 7f8ceb59e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce40cbcc0 con 0x7f8ce4006f80 2023-12-19T16:07:10.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.325+0000 7f8ce9d9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8ce4006f80 0x7f8ce4168f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.325+0000 7f8ce9d9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8ce4006f80 0x7f8ce4168f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:41700/0 (socket says 172.21.15.37:41700) 2023-12-19T16:07:10.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.325+0000 7fe296e83640 1 Processor -- start 2023-12-19T16:07:10.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.325+0000 7f572148b640 1 -- 172.21.15.37:0/2465483372 shutdown_connections 2023-12-19T16:07:10.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.325+0000 7fe296e83640 1 -- start start 2023-12-19T16:07:10.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.325+0000 7f8ce9d9b640 1 -- 172.21.15.37:0/474958390 learned_addr learned my addr 172.21.15.37:0/474958390 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:10.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.325+0000 7f8cead9d640 1 --2- 172.21.15.37:0/474958390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ce40cf320 0x7f8ce41694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.325+0000 7f8cea59c640 1 --2- 172.21.15.37:0/474958390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce40049d0 0x7f8ce40d19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f2ccf7fe640 1 -- 172.21.15.37:0/2889338426 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2cc804c3b0 con 0x7f2cd806e9a0 2023-12-19T16:07:10.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f8ce9d9b640 1 -- 172.21.15.37:0/474958390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ce40cf320 msgr2=0x7f8ce41694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f2ccf7fe640 1 --2- 172.21.15.37:0/2889338426 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2cbc06a500 0x7f2cbc06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f7b8f75c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b740039a0 0x7f7b881e3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f7b8f75c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b880b3060 0x7f7b88141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f7b8f75c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b881e43a0 0x7f7b88141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f7b8f75c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b881e8310 con 0x7f7b881e43a0 2023-12-19T16:07:10.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f7b8f75c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b881e7550 con 0x7f7b880b3060 2023-12-19T16:07:10.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f7b8f75c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b881e7830 con 0x7f7b740039a0 2023-12-19T16:07:10.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f7b8ccf7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b880b3060 0x7f7b88141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f7b8ccf7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b880b3060 0x7f7b88141a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:39846/0 (socket says 172.21.15.37:39846) 2023-12-19T16:07:10.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f7b8ccf7640 1 -- 172.21.15.37:0/1390719204 learned_addr learned my addr 172.21.15.37:0/1390719204 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:10.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f587b6c4640 1 Processor -- start 2023-12-19T16:07:10.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f587b6c4640 1 -- start start 2023-12-19T16:07:10.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f2ccf7fe640 1 -- 172.21.15.37:0/2889338426 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cc80aadc0 con 0x7f2cd806e9a0 2023-12-19T16:07:10.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f2cd6ffd640 1 --2- 172.21.15.37:0/2889338426 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2cbc06a500 0x7f2cbc06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f78a328a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f789400adb0 0x7f78940371d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f78a328a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7894036430 0x7f7894037e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f78a328a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f78940cb730 0x7f7894025cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f78a328a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7894028b80 con 0x7f789400adb0 2023-12-19T16:07:10.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f78a328a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7894028930 con 0x7f7894036430 2023-12-19T16:07:10.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f78a328a640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78940387f0 con 0x7f78940cb730 2023-12-19T16:07:10.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f572148b640 1 -- 172.21.15.37:0/2465483372 wait complete. 2023-12-19T16:07:10.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f78a1a87640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7894036430 0x7f7894037e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f78a1a87640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7894036430 0x7f7894037e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:39854/0 (socket says 172.21.15.37:39854) 2023-12-19T16:07:10.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f78a1a87640 1 -- 172.21.15.37:0/2893577266 learned_addr learned my addr 172.21.15.37:0/2893577266 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:10.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f8ce9d9b640 1 --2- 172.21.15.37:0/474958390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ce40cf320 0x7f8ce41694d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f8ce9d9b640 1 -- 172.21.15.37:0/474958390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce40049d0 msgr2=0x7f8ce40d19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f8ce9d9b640 1 --2- 172.21.15.37:0/474958390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce40049d0 0x7f8ce40d19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f8ce9d9b640 1 -- 172.21.15.37:0/474958390 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec072d50 con 0x7f8ce4006f80 2023-12-19T16:07:10.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7fe296e83640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe29006d330 0x7fe2901498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f8ce9d9b640 1 --2- 172.21.15.37:0/474958390 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8ce4006f80 0x7f8ce4168f90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000e890 tx=0x7f8ce000ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7fe296e83640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe290148fb0 0x7fe2900b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.326+0000 7f7b8dcf9640 1 --2- 172.21.15.37:0/1390719204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b881e43a0 0x7f7b88141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7fe295e81640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe29006d330 0x7fe2901498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7fe296e83640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe29014ece0 0x7fe290131060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f7b8d4f8640 1 --2- 172.21.15.37:0/1390719204 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b740039a0 0x7f7b881e3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7fe295e81640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe29006d330 0x7fe2901498a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:39870/0 (socket says 172.21.15.37:39870) 2023-12-19T16:07:10.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7fe295e81640 1 -- 172.21.15.37:0/1906701101 learned_addr learned my addr 172.21.15.37:0/1906701101 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:10.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7fe296e83640 1 -- 172.21.15.37:0/1906701101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe290149de0 con 0x7fe290148fb0 2023-12-19T16:07:10.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7fe296e83640 1 -- 172.21.15.37:0/1906701101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900b6060 con 0x7fe29006d330 2023-12-19T16:07:10.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7fe296e83640 1 -- 172.21.15.37:0/1906701101 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe290151900 con 0x7fe29014ece0 2023-12-19T16:07:10.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f8cdaffd640 1 -- 172.21.15.37:0/474958390 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce000c940 con 0x7f8ce4006f80 2023-12-19T16:07:10.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f8cdaffd640 1 -- 172.21.15.37:0/474958390 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce000caa0 con 0x7f8ce4006f80 2023-12-19T16:07:10.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f8cdaffd640 1 -- 172.21.15.37:0/474958390 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce000ce30 con 0x7f8ce4006f80 2023-12-19T16:07:10.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7fe296682640 1 --2- 172.21.15.37:0/1906701101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe29014ece0 0x7fe290131060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7fe295680640 1 --2- 172.21.15.37:0/1906701101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe290148fb0 0x7fe2900b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f7b8ccf7640 1 -- 172.21.15.37:0/1390719204 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b740039a0 msgr2=0x7f7b881e3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f7b8ccf7640 1 --2- 172.21.15.37:0/1390719204 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b740039a0 0x7f7b881e3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f7b8ccf7640 1 -- 172.21.15.37:0/1390719204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b881e43a0 msgr2=0x7f7b88141f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f78a2288640 1 --2- 172.21.15.37:0/2893577266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f789400adb0 0x7f78940371d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f78a2a89640 1 --2- 172.21.15.37:0/2893577266 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f78940cb730 0x7f7894025cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f7b8d4f8640 1 --2- 172.21.15.37:0/1390719204 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b740039a0 0x7f7b881e3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:10.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f2cd6ffd640 1 --2- 172.21.15.37:0/2889338426 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2cbc06a500 0x7f2cbc06c9c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009ac0 tx=0x7f2cc0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f8ceb59e640 1 -- 172.21.15.37:0/474958390 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce40cbfa0 con 0x7f8ce4006f80 2023-12-19T16:07:10.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.328+0000 7f8ceb59e640 1 -- 172.21.15.37:0/474958390 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce416cfc0 con 0x7f8ce4006f80 2023-12-19T16:07:10.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7fe295e81640 1 -- 172.21.15.37:0/1906701101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe29014ece0 msgr2=0x7fe290131060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7fe295e81640 1 --2- 172.21.15.37:0/1906701101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe29014ece0 0x7fe290131060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7fe295e81640 1 -- 172.21.15.37:0/1906701101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe290148fb0 msgr2=0x7fe2900b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7fe295e81640 1 --2- 172.21.15.37:0/1906701101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe290148fb0 0x7fe2900b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7fe295e81640 1 -- 172.21.15.37:0/1906701101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe288009a70 con 0x7fe29006d330 2023-12-19T16:07:10.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f78a2288640 1 -- 172.21.15.37:0/2893577266 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f78940cb730 msgr2=0x7f7894025cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f78a2288640 1 --2- 172.21.15.37:0/2893577266 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f78940cb730 0x7f7894025cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f78a2288640 1 -- 172.21.15.37:0/2893577266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7894036430 msgr2=0x7f7894037e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.327+0000 7f78a2288640 1 --2- 172.21.15.37:0/2893577266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7894036430 0x7f7894037e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.328+0000 7f78a2288640 1 -- 172.21.15.37:0/2893577266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7898009400 con 0x7f789400adb0 2023-12-19T16:07:10.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.328+0000 7f572148b640 1 Processor -- start 2023-12-19T16:07:10.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.328+0000 7f7b8ccf7640 1 --2- 172.21.15.37:0/1390719204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b881e43a0 0x7f7b88141f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.328+0000 7f7b8ccf7640 1 -- 172.21.15.37:0/1390719204 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b881e7b10 con 0x7f7b880b3060 2023-12-19T16:07:10.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.328+0000 7f7b8dcf9640 1 --2- 172.21.15.37:0/1390719204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b881e43a0 0x7f7b88141f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:07:10.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.328+0000 7f78a2288640 1 --2- 172.21.15.37:0/2893577266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f789400adb0 0x7f78940371d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f789c074d70 tx=0x7f789c066fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.328+0000 7fe295e81640 1 --2- 172.21.15.37:0/1906701101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe29006d330 0x7fe2901498a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe28c00c400 tx=0x7fe28c00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.328+0000 7f7892ffd640 1 -- 172.21.15.37:0/2893577266 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c072360 con 0x7f789400adb0 2023-12-19T16:07:10.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.328+0000 7f572148b640 1 -- start start 2023-12-19T16:07:10.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.328+0000 7f78a328a640 1 -- 172.21.15.37:0/2893577266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7894038ad0 con 0x7f789400adb0 2023-12-19T16:07:10.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.328+0000 7f7b8ccf7640 1 --2- 172.21.15.37:0/1390719204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b880b3060 0x7f7b88141a20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800eb70 tx=0x7f7b7800c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.328+0000 7f78a328a640 1 -- 172.21.15.37:0/2893577266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7894038ef0 con 0x7f789400adb0 2023-12-19T16:07:10.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.328+0000 7f7892ffd640 1 -- 172.21.15.37:0/2893577266 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c08d070 con 0x7f789400adb0 2023-12-19T16:07:10.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.328+0000 7f7892ffd640 1 -- 172.21.15.37:0/2893577266 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c073700 con 0x7f789400adb0 2023-12-19T16:07:10.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.329+0000 7f587b6c4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58600047c0 0x7f587413dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.329+0000 7f587b6c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f587414a410 0x7f5874148000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.329+0000 7f587b6c4640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5874148540 0x7f5874139210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.329+0000 7f587b6c4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587413e2c0 con 0x7f58600047c0 2023-12-19T16:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.329+0000 7f587b6c4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587414a020 con 0x7f587414a410 2023-12-19T16:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.329+0000 7f587b6c4640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5874147b50 con 0x7f5874148540 2023-12-19T16:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.329+0000 7f5879460640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58600047c0 0x7f587413dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.329+0000 7f5879460640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58600047c0 0x7f587413dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47726/0 (socket says 172.21.15.37:47726) 2023-12-19T16:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.329+0000 7f5879460640 1 -- 172.21.15.37:0/2559577870 learned_addr learned my addr 172.21.15.37:0/2559577870 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.329+0000 7f572148b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f571c06af20 0x7f571c1e40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.329+0000 7f572148b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f571c06fc10 0x7f571c0b6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.329+0000 7f572148b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c141cb0 0x7f571c1ddbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.329+0000 7f572148b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c1e4610 con 0x7f571c141cb0 2023-12-19T16:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.329+0000 7f572148b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0bc530 con 0x7f571c06fc10 2023-12-19T16:07:10.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.329+0000 7f572148b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0b6ba0 con 0x7f571c06af20 2023-12-19T16:07:10.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.329+0000 7f5878c5f640 1 --2- 172.21.15.37:0/2559577870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f587414a410 0x7f5874148000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.329+0000 7f571a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f571c06fc10 0x7f571c0b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f571a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f571c06fc10 0x7f571c0b6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:39882/0 (socket says 172.21.15.37:39882) 2023-12-19T16:07:10.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f571a7fc640 1 -- 172.21.15.37:0/810287914 learned_addr learned my addr 172.21.15.37:0/810287914 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:10.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f8ceb59e640 1 -- 172.21.15.37:0/474958390 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce4176030 con 0x7f8ce4006f80 2023-12-19T16:07:10.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f571affd640 1 --2- 172.21.15.37:0/810287914 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f571c06af20 0x7f571c1e40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f571b7fe640 1 --2- 172.21.15.37:0/810287914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c141cb0 0x7f571c1ddbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f5879c61640 1 --2- 172.21.15.37:0/2559577870 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5874148540 0x7f5874139210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f5878c5f640 1 -- 172.21.15.37:0/2559577870 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5874148540 msgr2=0x7f5874139210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f5878c5f640 1 --2- 172.21.15.37:0/2559577870 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5874148540 0x7f5874139210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f5878c5f640 1 -- 172.21.15.37:0/2559577870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58600047c0 msgr2=0x7f587413dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f5878c5f640 1 --2- 172.21.15.37:0/2559577870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58600047c0 0x7f587413dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f5878c5f640 1 -- 172.21.15.37:0/2559577870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587414a9c0 con 0x7f587414a410 2023-12-19T16:07:10.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f571a7fc640 1 -- 172.21.15.37:0/810287914 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f571c06af20 msgr2=0x7f571c1e40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f571a7fc640 1 --2- 172.21.15.37:0/810287914 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f571c06af20 0x7f571c1e40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f571a7fc640 1 -- 172.21.15.37:0/810287914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c141cb0 msgr2=0x7f571c1ddbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f571a7fc640 1 --2- 172.21.15.37:0/810287914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c141cb0 0x7f571c1ddbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f8cdaffd640 1 -- 172.21.15.37:0/474958390 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8ce0013470 con 0x7f8ce4006f80 2023-12-19T16:07:10.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f571a7fc640 1 -- 172.21.15.37:0/810287914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5710009400 con 0x7f571c06fc10 2023-12-19T16:07:10.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f571b7fe640 1 --2- 172.21.15.37:0/810287914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c141cb0 0x7f571c1ddbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:10.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f5879460640 1 --2- 172.21.15.37:0/2559577870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58600047c0 0x7f587413dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:07:10.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f571a7fc640 1 --2- 172.21.15.37:0/810287914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f571c06fc10 0x7f571c0b6660 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f570c00c890 tx=0x7f570c00cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f8cdaffd640 1 --2- 172.21.15.37:0/474958390 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8ccc06a480 0x7f8ccc06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.330+0000 7f5878c5f640 1 --2- 172.21.15.37:0/2559577870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f587414a410 0x7f5874148000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5864037000 tx=0x7f5864001960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.331+0000 7f8cdaffd640 1 -- 172.21.15.37:0/474958390 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ce00889e0 con 0x7f8ce4006f80 2023-12-19T16:07:10.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.331+0000 7f8cea59c640 1 --2- 172.21.15.37:0/474958390 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8ccc06a480 0x7f8ccc06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.331+0000 7f7892ffd640 1 -- 172.21.15.37:0/2893577266 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f789c073860 con 0x7f789400adb0 2023-12-19T16:07:10.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.331+0000 7f78a328a640 1 -- 172.21.15.37:0/2893577266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7884005250 con 0x7f789400adb0 2023-12-19T16:07:10.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.331+0000 7f7892ffd640 1 --2- 172.21.15.37:0/2893577266 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f788006a430 0x7f788006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.331+0000 7f8cea59c640 1 --2- 172.21.15.37:0/474958390 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8ccc06a480 0x7f8ccc06c940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40280c0 tx=0x7f8cdc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.331+0000 7f57037fe640 1 -- 172.21.15.37:0/810287914 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c0074e0 con 0x7f571c06fc10 2023-12-19T16:07:10.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.331+0000 7fe2867fc640 1 -- 172.21.15.37:0/1906701101 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0074e0 con 0x7fe29006d330 2023-12-19T16:07:10.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.331+0000 7fe2867fc640 1 -- 172.21.15.37:0/1906701101 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c007640 con 0x7fe29006d330 2023-12-19T16:07:10.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.331+0000 7fe2867fc640 1 -- 172.21.15.37:0/1906701101 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c004a00 con 0x7fe29006d330 2023-12-19T16:07:10.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.332+0000 7f572148b640 1 -- 172.21.15.37:0/810287914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571c1de130 con 0x7f571c06fc10 2023-12-19T16:07:10.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.332+0000 7f572148b640 1 -- 172.21.15.37:0/810287914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571c1f0150 con 0x7f571c06fc10 2023-12-19T16:07:10.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.331+0000 7f78a1a87640 1 --2- 172.21.15.37:0/2893577266 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f788006a430 0x7f788006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.332+0000 7f7892ffd640 1 -- 172.21.15.37:0/2893577266 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f789c101ff0 con 0x7f789400adb0 2023-12-19T16:07:10.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.331+0000 7f5869ffb640 1 -- 172.21.15.37:0/2559577870 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586400e310 con 0x7f587414a410 2023-12-19T16:07:10.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.331+0000 7f587b6c4640 1 -- 172.21.15.37:0/2559577870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587414aca0 con 0x7f587414a410 2023-12-19T16:07:10.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.332+0000 7f587b6c4640 1 -- 172.21.15.37:0/2559577870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58740b7020 con 0x7f587414a410 2023-12-19T16:07:10.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.332+0000 7f57037fe640 1 -- 172.21.15.37:0/810287914 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570c007640 con 0x7f571c06fc10 2023-12-19T16:07:10.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.332+0000 7f5869ffb640 1 -- 172.21.15.37:0/2559577870 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5864001b40 con 0x7f587414a410 2023-12-19T16:07:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.332+0000 7f78a1a87640 1 --2- 172.21.15.37:0/2893577266 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f788006a430 0x7f788006c8f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f789802b8f0 tx=0x7f789803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.332+0000 7f5869ffb640 1 -- 172.21.15.37:0/2559577870 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864007770 con 0x7f587414a410 2023-12-19T16:07:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.331+0000 7f2ccf7fe640 1 -- 172.21.15.37:0/2889338426 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2cc8076440 con 0x7f2cd806e9a0 2023-12-19T16:07:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.333+0000 7fe296e83640 1 -- 172.21.15.37:0/1906701101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe290151be0 con 0x7fe29006d330 2023-12-19T16:07:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.331+0000 7f7b7dffb640 1 -- 172.21.15.37:0/1390719204 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7800ec60 con 0x7f7b880b3060 2023-12-19T16:07:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.331+0000 7f7b8f75c640 1 -- 172.21.15.37:0/1390719204 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b881e7df0 con 0x7f7b880b3060 2023-12-19T16:07:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.332+0000 7f7b8f75c640 1 -- 172.21.15.37:0/1390719204 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b88146c10 con 0x7f7b880b3060 2023-12-19T16:07:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.333+0000 7f7b7dffb640 1 -- 172.21.15.37:0/1390719204 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7800edc0 con 0x7f7b880b3060 2023-12-19T16:07:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.333+0000 7fe296e83640 1 -- 172.21.15.37:0/1906701101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2900b5b40 con 0x7fe29006d330 2023-12-19T16:07:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.333+0000 7f57037fe640 1 -- 172.21.15.37:0/810287914 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c0049e0 con 0x7f571c06fc10 2023-12-19T16:07:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.334+0000 7f57037fe640 1 -- 172.21.15.37:0/810287914 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f570c004b40 con 0x7f571c06fc10 2023-12-19T16:07:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.334+0000 7f7b7dffb640 1 -- 172.21.15.37:0/1390719204 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7800ce00 con 0x7f7b880b3060 2023-12-19T16:07:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.334+0000 7f587b6c4640 1 -- 172.21.15.37:0/2559577870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5854005250 con 0x7f587414a410 2023-12-19T16:07:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.334+0000 7fe296e83640 1 -- 172.21.15.37:0/1906701101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2900b5d30 con 0x7fe29006d330 2023-12-19T16:07:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.334+0000 7f5869ffb640 1 -- 172.21.15.37:0/2559577870 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f586400c450 con 0x7f587414a410 2023-12-19T16:07:10.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.334+0000 7f572148b640 1 -- 172.21.15.37:0/810287914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56fc005250 con 0x7f571c06fc10 2023-12-19T16:07:10.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.335+0000 7f57037fe640 1 --2- 172.21.15.37:0/810287914 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f570806a430 0x7f570806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.335+0000 7f57037fe640 1 -- 172.21.15.37:0/810287914 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f570c0880f0 con 0x7f571c06fc10 2023-12-19T16:07:10.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.335+0000 7f5869ffb640 1 --2- 172.21.15.37:0/2559577870 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f585806a430 0x7f585806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.335+0000 7f5869ffb640 1 -- 172.21.15.37:0/2559577870 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58640b2d30 con 0x7f587414a410 2023-12-19T16:07:10.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.335+0000 7f571affd640 1 --2- 172.21.15.37:0/810287914 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f570806a430 0x7f570806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.335+0000 7f5879460640 1 --2- 172.21.15.37:0/2559577870 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f585806a430 0x7f585806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.335+0000 7f571affd640 1 --2- 172.21.15.37:0/810287914 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f570806a430 0x7f570806c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5710034000 tx=0x7f5710008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.336+0000 7f7b7dffb640 1 -- 172.21.15.37:0/1390719204 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7b780058f0 con 0x7f7b880b3060 2023-12-19T16:07:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.336+0000 7f7b8f75c640 1 -- 172.21.15.37:0/1390719204 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b68005250 con 0x7f7b880b3060 2023-12-19T16:07:10.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.336+0000 7f5879460640 1 --2- 172.21.15.37:0/2559577870 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f585806a430 0x7f585806c8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5870001750 tx=0x7f5870009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.336+0000 7fe2867fc640 1 -- 172.21.15.37:0/1906701101 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe28c035be0 con 0x7fe29006d330 2023-12-19T16:07:10.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.337+0000 7f7b7dffb640 1 --2- 172.21.15.37:0/1390719204 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7b6c06a430 0x7f7b6c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.337+0000 7fe2867fc640 1 --2- 172.21.15.37:0/1906701101 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe27406a450 0x7fe27406c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.337+0000 7fe2867fc640 1 -- 172.21.15.37:0/1906701101 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe28c0883e0 con 0x7fe29006d330 2023-12-19T16:07:10.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.337+0000 7f8cdaffd640 1 -- 172.21.15.37:0/474958390 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8ce4176030 con 0x7f8ce4006f80 2023-12-19T16:07:10.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.337+0000 7f7b7dffb640 1 -- 172.21.15.37:0/1390719204 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b78088a10 con 0x7f7b880b3060 2023-12-19T16:07:10.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.337+0000 7f7b8d4f8640 1 --2- 172.21.15.37:0/1390719204 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7b6c06a430 0x7f7b6c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.337+0000 7fe295680640 1 --2- 172.21.15.37:0/1906701101 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe27406a450 0x7fe27406c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.337+0000 7f7b8d4f8640 1 --2- 172.21.15.37:0/1390719204 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7b6c06a430 0x7f7b6c06c8f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7b84036000 tx=0x7f7b84030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.338+0000 7fe295680640 1 --2- 172.21.15.37:0/1906701101 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe27406a450 0x7fe27406c910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe29006fa20 tx=0x7fe280009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.339+0000 7f5869ffb640 1 -- 172.21.15.37:0/2559577870 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5864081e60 con 0x7f587414a410 2023-12-19T16:07:10.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.341+0000 7f7892ffd640 1 -- 172.21.15.37:0/2893577266 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f789c0cd610 con 0x7f789400adb0 2023-12-19T16:07:10.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.344+0000 7f57037fe640 1 -- 172.21.15.37:0/810287914 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f570c053770 con 0x7f571c06fc10 2023-12-19T16:07:10.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.350+0000 7f7b7dffb640 1 -- 172.21.15.37:0/1390719204 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7b78053f80 con 0x7f7b880b3060 2023-12-19T16:07:10.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.355+0000 7fe2867fc640 1 -- 172.21.15.37:0/1906701101 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe28c053ad0 con 0x7fe29006d330 2023-12-19T16:07:10.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.687+0000 7f526dd4f640 1 -- 172.21.15.37:0/3898053889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5268061880 con 0x7f52681f07e0 2023-12-19T16:07:10.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.688+0000 7f52657fa640 1 -- 172.21.15.37:0/3898053889 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5260054460 con 0x7f52681f07e0 2023-12-19T16:07:10.690 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-12-19T16:07:10.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.691+0000 7f524effd640 1 -- 172.21.15.37:0/3898053889 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f525006c340 msgr2=0x7f525006e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.691+0000 7f524effd640 1 --2- 172.21.15.37:0/3898053889 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f525006c340 0x7f525006e800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f525c039000 tx=0x7f525c034000 comp rx=0 tx=0).stop 2023-12-19T16:07:10.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.691+0000 7f524effd640 1 -- 172.21.15.37:0/3898053889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52681f07e0 msgr2=0x7f52681f0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.691+0000 7f524effd640 1 --2- 172.21.15.37:0/3898053889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52681f07e0 0x7f52681f0c60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f52680b7a60 tx=0x7f526000e4b0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.692+0000 7f524effd640 1 -- 172.21.15.37:0/3898053889 shutdown_connections 2023-12-19T16:07:10.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.692+0000 7f524effd640 1 --2- 172.21.15.37:0/3898053889 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f525006c340 0x7f525006e800 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.692+0000 7f524effd640 1 --2- 172.21.15.37:0/3898053889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52681f07e0 0x7f52681f0c60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.692+0000 7f524effd640 1 --2- 172.21.15.37:0/3898053889 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5268145560 0x7f52681459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.692+0000 7f524effd640 1 --2- 172.21.15.37:0/3898053889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52680b4ff0 0x7f52680b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.692+0000 7f524effd640 1 -- 172.21.15.37:0/3898053889 >> 172.21.15.37:0/3898053889 conn(0x7f52680bbcf0 msgr2=0x7f5268141ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:10.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.692+0000 7f524effd640 1 -- 172.21.15.37:0/3898053889 shutdown_connections 2023-12-19T16:07:10.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.692+0000 7f524effd640 1 -- 172.21.15.37:0/3898053889 wait complete. 2023-12-19T16:07:10.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-12-19T16:07:10.711 DEBUG:teuthology.parallel:result is None 2023-12-19T16:07:10.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.727+0000 7f7b8f75c640 1 -- 172.21.15.37:0/1390719204 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7b68005500 con 0x7f7b880b3060 2023-12-19T16:07:10.730 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-12-19T16:07:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.727+0000 7f7b7dffb640 1 -- 172.21.15.37:0/1390719204 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7b780575a0 con 0x7f7b880b3060 2023-12-19T16:07:10.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.730+0000 7f7b8f75c640 1 -- 172.21.15.37:0/1390719204 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7b6c06a430 msgr2=0x7f7b6c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.730+0000 7f7b8f75c640 1 --2- 172.21.15.37:0/1390719204 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7b6c06a430 0x7f7b6c06c8f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7b84036000 tx=0x7f7b84030000 comp rx=0 tx=0).stop 2023-12-19T16:07:10.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.730+0000 7f7b8f75c640 1 -- 172.21.15.37:0/1390719204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b880b3060 msgr2=0x7f7b88141a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.730+0000 7f7b8f75c640 1 --2- 172.21.15.37:0/1390719204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b880b3060 0x7f7b88141a20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800eb70 tx=0x7f7b7800c4b0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.730+0000 7f7b8f75c640 1 -- 172.21.15.37:0/1390719204 shutdown_connections 2023-12-19T16:07:10.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.730+0000 7f7b8f75c640 1 --2- 172.21.15.37:0/1390719204 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7b6c06a430 0x7f7b6c06c8f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.730+0000 7f7b8f75c640 1 --2- 172.21.15.37:0/1390719204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b881e43a0 0x7f7b88141f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.730+0000 7f7b8f75c640 1 --2- 172.21.15.37:0/1390719204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b880b3060 0x7f7b88141a20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.730+0000 7f7b8f75c640 1 --2- 172.21.15.37:0/1390719204 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7b740039a0 0x7f7b881e3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.730+0000 7f7b8f75c640 1 -- 172.21.15.37:0/1390719204 >> 172.21.15.37:0/1390719204 conn(0x7f7b880b9130 msgr2=0x7f7b88148220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:10.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.731+0000 7f7b8f75c640 1 -- 172.21.15.37:0/1390719204 shutdown_connections 2023-12-19T16:07:10.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.731+0000 7f7b8f75c640 1 -- 172.21.15.37:0/1390719204 wait complete. 2023-12-19T16:07:10.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.737+0000 7f2cd7fff640 1 -- 172.21.15.37:0/2889338426 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2cd8061880 con 0x7f2cd806e9a0 2023-12-19T16:07:10.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.737+0000 7f78a328a640 1 -- 172.21.15.37:0/2893577266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7884005500 con 0x7f789400adb0 2023-12-19T16:07:10.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.738+0000 7f2ccf7fe640 1 -- 172.21.15.37:0/2889338426 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2cc8079a60 con 0x7f2cd806e9a0 2023-12-19T16:07:10.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.739+0000 7f7892ffd640 1 -- 172.21.15.37:0/2893577266 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f789c098090 con 0x7f789400adb0 2023-12-19T16:07:10.741 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-12-19T16:07:10.742 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-12-19T16:07:10.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.741+0000 7f2cd7fff640 1 -- 172.21.15.37:0/2889338426 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2cbc06a500 msgr2=0x7f2cbc06c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.741+0000 7f2cd7fff640 1 --2- 172.21.15.37:0/2889338426 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2cbc06a500 0x7f2cbc06c9c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0009ac0 tx=0x7f2cc0008040 comp rx=0 tx=0).stop 2023-12-19T16:07:10.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.741+0000 7f2cd7fff640 1 -- 172.21.15.37:0/2889338426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd806e9a0 msgr2=0x7f2cd80b51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.741+0000 7f2cd7fff640 1 --2- 172.21.15.37:0/2889338426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd806e9a0 0x7f2cd80b51c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009870 tx=0x7f2cc8004730 comp rx=0 tx=0).stop 2023-12-19T16:07:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.742+0000 7f78a328a640 1 -- 172.21.15.37:0/2893577266 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f788006a430 msgr2=0x7f788006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.742+0000 7f78a328a640 1 --2- 172.21.15.37:0/2893577266 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f788006a430 0x7f788006c8f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f789802b8f0 tx=0x7f789803c040 comp rx=0 tx=0).stop 2023-12-19T16:07:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.742+0000 7f78a328a640 1 -- 172.21.15.37:0/2893577266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f789400adb0 msgr2=0x7f78940371d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.742+0000 7f78a328a640 1 --2- 172.21.15.37:0/2893577266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f789400adb0 0x7f78940371d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f789c074d70 tx=0x7f789c066fc0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.741+0000 7f2cd7fff640 1 -- 172.21.15.37:0/2889338426 shutdown_connections 2023-12-19T16:07:10.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.741+0000 7f2cd7fff640 1 --2- 172.21.15.37:0/2889338426 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2cbc06a500 0x7f2cbc06c9c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.741+0000 7f2cd7fff640 1 --2- 172.21.15.37:0/2889338426 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2cd8144170 0x7f2cd80af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.741+0000 7f2cd7fff640 1 --2- 172.21.15.37:0/2889338426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cd806e9a0 0x7f2cd80b51c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.741+0000 7f2cd7fff640 1 --2- 172.21.15.37:0/2889338426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd806b480 0x7f2cd80adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.741+0000 7f2cd7fff640 1 -- 172.21.15.37:0/2889338426 >> 172.21.15.37:0/2889338426 conn(0x7f2cd80bbcf0 msgr2=0x7f2cd806ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:10.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.742+0000 7f78a328a640 1 -- 172.21.15.37:0/2893577266 shutdown_connections 2023-12-19T16:07:10.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.742+0000 7f78a328a640 1 --2- 172.21.15.37:0/2893577266 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f788006a430 0x7f788006c8f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.742+0000 7f78a328a640 1 --2- 172.21.15.37:0/2893577266 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f78940cb730 0x7f7894025cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.742+0000 7f2cd7fff640 1 -- 172.21.15.37:0/2889338426 shutdown_connections 2023-12-19T16:07:10.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.742+0000 7f78a328a640 1 --2- 172.21.15.37:0/2893577266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7894036430 0x7f7894037e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.742+0000 7f78a328a640 1 --2- 172.21.15.37:0/2893577266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f789400adb0 0x7f78940371d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.742+0000 7f78a328a640 1 -- 172.21.15.37:0/2893577266 >> 172.21.15.37:0/2893577266 conn(0x7f7894009db0 msgr2=0x7f78940240b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:10.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-12-19T16:07:10.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.743+0000 7f2cd7fff640 1 -- 172.21.15.37:0/2889338426 wait complete. 2023-12-19T16:07:10.748 DEBUG:teuthology.parallel:result is None 2023-12-19T16:07:10.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.743+0000 7f78a328a640 1 -- 172.21.15.37:0/2893577266 shutdown_connections 2023-12-19T16:07:10.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.743+0000 7f78a328a640 1 -- 172.21.15.37:0/2893577266 wait complete. 2023-12-19T16:07:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.753+0000 7f8ceb59e640 1 -- 172.21.15.37:0/474958390 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8ce4176030 con 0x7f8ce4006f80 2023-12-19T16:07:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.753+0000 7f572148b640 1 -- 172.21.15.37:0/810287914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f56fc0057d0 con 0x7f571c06fc10 2023-12-19T16:07:10.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.753+0000 7f8cdaffd640 1 -- 172.21.15.37:0/474958390 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ce4176030 con 0x7f8ce4006f80 2023-12-19T16:07:10.756 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-12-19T16:07:10.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.753+0000 7f57037fe640 1 -- 172.21.15.37:0/810287914 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f570c056d90 con 0x7f571c06fc10 2023-12-19T16:07:10.756 INFO:teuthology.orchestra.run.smithi037.stdout:55834574857 2023-12-19T16:07:10.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.754+0000 7fe296e83640 1 -- 172.21.15.37:0/1906701101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe290061880 con 0x7fe29006d330 2023-12-19T16:07:10.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.754+0000 7fe2867fc640 1 -- 172.21.15.37:0/1906701101 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe28c0570f0 con 0x7fe29006d330 2023-12-19T16:07:10.757 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-12-19T16:07:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.756+0000 7f587b6c4640 1 -- 172.21.15.37:0/2559577870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f58540057d0 con 0x7f587414a410 2023-12-19T16:07:10.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.756+0000 7f8ceb59e640 1 -- 172.21.15.37:0/474958390 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8ccc06a480 msgr2=0x7f8ccc06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.756+0000 7f8ceb59e640 1 --2- 172.21.15.37:0/474958390 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8ccc06a480 0x7f8ccc06c940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40280c0 tx=0x7f8cdc008040 comp rx=0 tx=0).stop 2023-12-19T16:07:10.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f8ceb59e640 1 -- 172.21.15.37:0/474958390 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8ce4006f80 msgr2=0x7f8ce4168f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f8ceb59e640 1 --2- 172.21.15.37:0/474958390 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8ce4006f80 0x7f8ce4168f90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000e890 tx=0x7f8ce000ed50 comp rx=0 tx=0).stop 2023-12-19T16:07:10.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.756+0000 7f5869ffb640 1 -- 172.21.15.37:0/2559577870 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f58640819f0 con 0x7f587414a410 2023-12-19T16:07:10.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f572148b640 1 -- 172.21.15.37:0/810287914 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f570806a430 msgr2=0x7f570806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f8ceb59e640 1 -- 172.21.15.37:0/474958390 shutdown_connections 2023-12-19T16:07:10.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f8ceb59e640 1 --2- 172.21.15.37:0/474958390 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8ccc06a480 0x7f8ccc06c940 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f8ceb59e640 1 --2- 172.21.15.37:0/474958390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ce40cf320 0x7f8ce41694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f8ceb59e640 1 --2- 172.21.15.37:0/474958390 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8ce4006f80 0x7f8ce4168f90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f8ceb59e640 1 --2- 172.21.15.37:0/474958390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ce40049d0 0x7f8ce40d19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f8ceb59e640 1 -- 172.21.15.37:0/474958390 >> 172.21.15.37:0/474958390 conn(0x7f8ce40061f0 msgr2=0x7f8ce40065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:10.760 INFO:teuthology.orchestra.run.smithi037.stdout:55834574856 2023-12-19T16:07:10.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f572148b640 1 --2- 172.21.15.37:0/810287914 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f570806a430 0x7f570806c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5710034000 tx=0x7f5710008030 comp rx=0 tx=0).stop 2023-12-19T16:07:10.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-12-19T16:07:10.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f572148b640 1 -- 172.21.15.37:0/810287914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f571c06fc10 msgr2=0x7f571c0b6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f572148b640 1 --2- 172.21.15.37:0/810287914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f571c06fc10 0x7f571c0b6660 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f570c00c890 tx=0x7f570c00cd50 comp rx=0 tx=0).stop 2023-12-19T16:07:10.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7fe296e83640 1 -- 172.21.15.37:0/1906701101 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe27406a450 msgr2=0x7fe27406c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7fe296e83640 1 --2- 172.21.15.37:0/1906701101 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe27406a450 0x7fe27406c910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe29006fa20 tx=0x7fe280009240 comp rx=0 tx=0).stop 2023-12-19T16:07:10.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7fe296e83640 1 -- 172.21.15.37:0/1906701101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe29006d330 msgr2=0x7fe2901498a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7fe296e83640 1 --2- 172.21.15.37:0/1906701101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe29006d330 0x7fe2901498a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe28c00c400 tx=0x7fe28c00c8c0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.762 DEBUG:teuthology.parallel:result is None 2023-12-19T16:07:10.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f572148b640 1 -- 172.21.15.37:0/810287914 shutdown_connections 2023-12-19T16:07:10.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f572148b640 1 --2- 172.21.15.37:0/810287914 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f570806a430 0x7f570806c8f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f572148b640 1 --2- 172.21.15.37:0/810287914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f571c141cb0 0x7f571c1ddbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f572148b640 1 --2- 172.21.15.37:0/810287914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f571c06fc10 0x7f571c0b6660 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f572148b640 1 --2- 172.21.15.37:0/810287914 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f571c06af20 0x7f571c1e40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7fe296e83640 1 -- 172.21.15.37:0/1906701101 shutdown_connections 2023-12-19T16:07:10.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7fe296e83640 1 --2- 172.21.15.37:0/1906701101 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe27406a450 0x7fe27406c910 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7fe296e83640 1 --2- 172.21.15.37:0/1906701101 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe29014ece0 0x7fe290131060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7fe296e83640 1 --2- 172.21.15.37:0/1906701101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe290148fb0 0x7fe2900b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7fe296e83640 1 --2- 172.21.15.37:0/1906701101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe29006d330 0x7fe2901498a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f572148b640 1 -- 172.21.15.37:0/810287914 >> 172.21.15.37:0/810287914 conn(0x7f571c0b9c30 msgr2=0x7f571c0b7eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:10.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7fe296e83640 1 -- 172.21.15.37:0/1906701101 >> 172.21.15.37:0/1906701101 conn(0x7fe2900b9890 msgr2=0x7fe29014cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:10.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f572148b640 1 -- 172.21.15.37:0/810287914 shutdown_connections 2023-12-19T16:07:10.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7fe296e83640 1 -- 172.21.15.37:0/1906701101 shutdown_connections 2023-12-19T16:07:10.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f572148b640 1 -- 172.21.15.37:0/810287914 wait complete. 2023-12-19T16:07:10.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7fe296e83640 1 -- 172.21.15.37:0/1906701101 wait complete. 2023-12-19T16:07:10.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f8ceb59e640 1 -- 172.21.15.37:0/474958390 shutdown_connections 2023-12-19T16:07:10.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.757+0000 7f8ceb59e640 1 -- 172.21.15.37:0/474958390 wait complete. 2023-12-19T16:07:10.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-12-19T16:07:10.766 DEBUG:teuthology.parallel:result is None 2023-12-19T16:07:10.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.760+0000 7f587b6c4640 1 -- 172.21.15.37:0/2559577870 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f585806a430 msgr2=0x7f585806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.760+0000 7f587b6c4640 1 --2- 172.21.15.37:0/2559577870 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f585806a430 0x7f585806c8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5870001750 tx=0x7f5870009040 comp rx=0 tx=0).stop 2023-12-19T16:07:10.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.760+0000 7f587b6c4640 1 -- 172.21.15.37:0/2559577870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f587414a410 msgr2=0x7f5874148000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.760+0000 7f587b6c4640 1 --2- 172.21.15.37:0/2559577870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f587414a410 0x7f5874148000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5864037000 tx=0x7f5864001960 comp rx=0 tx=0).stop 2023-12-19T16:07:10.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.760+0000 7f587b6c4640 1 -- 172.21.15.37:0/2559577870 shutdown_connections 2023-12-19T16:07:10.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.760+0000 7f587b6c4640 1 --2- 172.21.15.37:0/2559577870 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f585806a430 0x7f585806c8f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.760+0000 7f587b6c4640 1 --2- 172.21.15.37:0/2559577870 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5874148540 0x7f5874139210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.760+0000 7f587b6c4640 1 --2- 172.21.15.37:0/2559577870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f587414a410 0x7f5874148000 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.760+0000 7f587b6c4640 1 --2- 172.21.15.37:0/2559577870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58600047c0 0x7f587413dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.760+0000 7f587b6c4640 1 -- 172.21.15.37:0/2559577870 >> 172.21.15.37:0/2559577870 conn(0x7f58740b88a0 msgr2=0x7f58740bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:10.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.760+0000 7f587b6c4640 1 -- 172.21.15.37:0/2559577870 shutdown_connections 2023-12-19T16:07:10.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.760+0000 7f587b6c4640 1 -- 172.21.15.37:0/2559577870 wait complete. 2023-12-19T16:07:10.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2023-12-19T16:07:10.774 DEBUG:teuthology.parallel:result is None 2023-12-19T16:07:10.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2023-12-19T16:07:10.775 DEBUG:teuthology.parallel:result is None 2023-12-19T16:07:10.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-12-19T16:07:10.777 DEBUG:teuthology.parallel:result is None 2023-12-19T16:07:10.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-12-19T16:07:10.779 DEBUG:teuthology.parallel:result is None 2023-12-19T16:07:10.779 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-19T16:07:10.779 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:07:10.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.922+0000 7f2724abd640 1 Processor -- start 2023-12-19T16:07:10.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.922+0000 7f2724abd640 1 -- start start 2023-12-19T16:07:10.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.923+0000 7f2724abd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27200bcdd0 0x7f27200b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.923+0000 7f2724abd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27200bc6b0 con 0x7f2720144ea0 2023-12-19T16:07:10.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.923+0000 7f2724abd640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27200b6900 con 0x7f27200b64c0 2023-12-19T16:07:10.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.923+0000 7f2724abd640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27200a59f0 con 0x7f27200bcdd0 2023-12-19T16:07:10.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.923+0000 7f271ed9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2720144ea0 0x7f2720155340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46448/0 (socket says 172.21.15.37:46448) 2023-12-19T16:07:10.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.923+0000 7f271ed9d640 1 -- 172.21.15.37:0/2908066904 learned_addr learned my addr 172.21.15.37:0/2908066904 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:10.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271e59c640 1 --2- 172.21.15.37:0/2908066904 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27200bcdd0 0x7f27200b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271d59a640 1 -- 172.21.15.37:0/2908066904 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498603382 0 0) 0x7f27200bc6b0 con 0x7f2720144ea0 2023-12-19T16:07:10.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271d59a640 1 -- 172.21.15.37:0/2908066904 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2708003520 con 0x7f2720144ea0 2023-12-19T16:07:10.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271d59a640 1 -- 172.21.15.37:0/2908066904 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3820744375 0 0) 0x7f2708003520 con 0x7f2720144ea0 2023-12-19T16:07:10.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271d59a640 1 -- 172.21.15.37:0/2908066904 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27200bcdd0 msgr2=0x7f27200b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271d59a640 1 --2- 172.21.15.37:0/2908066904 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27200bcdd0 0x7f27200b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271d59a640 1 -- 172.21.15.37:0/2908066904 >> v1:172.21.15.78:6789/0 conn(0x7f27200b64c0 legacy=0x7f2720144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271d59a640 1 -- 172.21.15.37:0/2908066904 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27200bc0a0 con 0x7f2720144ea0 2023-12-19T16:07:10.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271d59a640 1 -- 172.21.15.37:0/2908066904 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f27100019f0 con 0x7f2720144ea0 2023-12-19T16:07:10.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271d59a640 1 -- 172.21.15.37:0/2908066904 >> v1:172.21.15.37:6789/0 conn(0x7f2720144ea0 legacy=0x7f2720155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271d59a640 1 --2- 172.21.15.37:0/2908066904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27080039a0 0x7f2708003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271d59a640 1 --2- 172.21.15.37:0/2908066904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27080047c0 0x7f2708004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271d59a640 1 --2- 172.21.15.37:0/2908066904 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27200bcdd0 0x7f2708005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271d59a640 1 -- 172.21.15.37:0/2908066904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27200a59f0 con 0x7f27080039a0 2023-12-19T16:07:10.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271d59a640 1 -- 172.21.15.37:0/2908066904 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270800ba30 con 0x7f27080047c0 2023-12-19T16:07:10.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271d59a640 1 -- 172.21.15.37:0/2908066904 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270800bba0 con 0x7f27200bcdd0 2023-12-19T16:07:10.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271e59c640 1 --2- 172.21.15.37:0/2908066904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27080039a0 0x7f2708003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271dd9b640 1 --2- 172.21.15.37:0/2908066904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27080047c0 0x7f2708004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271ed9d640 1 --2- 172.21.15.37:0/2908066904 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27200bcdd0 0x7f2708005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271e59c640 1 -- 172.21.15.37:0/2908066904 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27200bcdd0 msgr2=0x7f2708005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271e59c640 1 --2- 172.21.15.37:0/2908066904 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27200bcdd0 0x7f2708005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271e59c640 1 -- 172.21.15.37:0/2908066904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27080047c0 msgr2=0x7f2708004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:10.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271e59c640 1 --2- 172.21.15.37:0/2908066904 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27080047c0 0x7f2708004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.924+0000 7f271e59c640 1 -- 172.21.15.37:0/2908066904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2708003520 con 0x7f27080039a0 2023-12-19T16:07:10.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.925+0000 7f271e59c640 1 --2- 172.21.15.37:0/2908066904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27080039a0 0x7f2708003d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2718009a70 tx=0x7f27080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec40b724e870a42b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.925+0000 7f271d59a640 1 -- 172.21.15.37:0/2908066904 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271802c650 con 0x7f27080039a0 2023-12-19T16:07:10.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.925+0000 7f271d59a640 1 -- 172.21.15.37:0/2908066904 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271802c7b0 con 0x7f27080039a0 2023-12-19T16:07:10.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.925+0000 7f271d59a640 1 -- 172.21.15.37:0/2908066904 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271802cb60 con 0x7f27080039a0 2023-12-19T16:07:10.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.926+0000 7f2724abd640 1 -- 172.21.15.37:0/2908066904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27080039a0 msgr2=0x7f2708003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.926+0000 7f2724abd640 1 --2- 172.21.15.37:0/2908066904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27080039a0 0x7f2708003d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2718009a70 tx=0x7f27080057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.926+0000 7f271ed9d640 1 -- 172.21.15.37:0/2908066904 reap_dead start 2023-12-19T16:07:10.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.926+0000 7f2724abd640 1 -- 172.21.15.37:0/2908066904 shutdown_connections 2023-12-19T16:07:10.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.926+0000 7f2724abd640 1 -- 172.21.15.37:0/2908066904 >> 172.21.15.37:0/2908066904 conn(0x7f2720071e60 msgr2=0x7f27200c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:10.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.926+0000 7f2724abd640 1 -- 172.21.15.37:0/2908066904 shutdown_connections 2023-12-19T16:07:10.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.926+0000 7f2724abd640 1 -- 172.21.15.37:0/2908066904 wait complete. 2023-12-19T16:07:10.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.927+0000 7f2724abd640 1 Processor -- start 2023-12-19T16:07:10.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.927+0000 7f2724abd640 1 -- start start 2023-12-19T16:07:10.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.928+0000 7f2724abd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27080039a0 0x7f27200bf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.928+0000 7f2724abd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2720149260 0x7f27201496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.928+0000 7f2724abd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27201d3e40 0x7f27201d42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.928+0000 7f2724abd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27200bfe70 con 0x7f2720149260 2023-12-19T16:07:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.928+0000 7f2724abd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2720149c00 con 0x7f27201d3e40 2023-12-19T16:07:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.928+0000 7f2724abd640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272014aa50 con 0x7f27080039a0 2023-12-19T16:07:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.928+0000 7f271dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2720149260 0x7f27201496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.928+0000 7f271dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2720149260 0x7f27201496c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47750/0 (socket says 172.21.15.37:47750) 2023-12-19T16:07:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.928+0000 7f271dd9b640 1 -- 172.21.15.37:0/1492107718 learned_addr learned my addr 172.21.15.37:0/1492107718 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.928+0000 7f271e59c640 1 --2- 172.21.15.37:0/1492107718 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27080039a0 0x7f27200bf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.928+0000 7f271ed9d640 1 --2- 172.21.15.37:0/1492107718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27201d3e40 0x7f27201d42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.928+0000 7f271dd9b640 1 -- 172.21.15.37:0/1492107718 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27080039a0 msgr2=0x7f27200bf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.928+0000 7f271dd9b640 1 --2- 172.21.15.37:0/1492107718 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27080039a0 0x7f27200bf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.928+0000 7f271dd9b640 1 -- 172.21.15.37:0/1492107718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27201d3e40 msgr2=0x7f27201d42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.928+0000 7f271dd9b640 1 --2- 172.21.15.37:0/1492107718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27201d3e40 0x7f27201d42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:10.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.928+0000 7f271dd9b640 1 -- 172.21.15.37:0/1492107718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272014acc0 con 0x7f2720149260 2023-12-19T16:07:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.928+0000 7f271dd9b640 1 --2- 172.21.15.37:0/1492107718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2720149260 0x7f27201496c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f271400f780 tx=0x7f271400fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.928+0000 7f270effd640 1 -- 172.21.15.37:0/1492107718 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271400fe90 con 0x7f2720149260 2023-12-19T16:07:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.928+0000 7f270effd640 1 -- 172.21.15.37:0/1492107718 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27140052e0 con 0x7f2720149260 2023-12-19T16:07:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.929+0000 7f2724abd640 1 -- 172.21.15.37:0/1492107718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272014b410 con 0x7f2720149260 2023-12-19T16:07:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.929+0000 7f270effd640 1 -- 172.21.15.37:0/1492107718 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271400d730 con 0x7f2720149260 2023-12-19T16:07:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.929+0000 7f2724abd640 1 -- 172.21.15.37:0/1492107718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272014b9d0 con 0x7f2720149260 2023-12-19T16:07:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.929+0000 7f2724abd640 1 -- 172.21.15.37:0/1492107718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272014bb90 con 0x7f2720149260 2023-12-19T16:07:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.930+0000 7f270effd640 1 -- 172.21.15.37:0/1492107718 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f271400d890 con 0x7f2720149260 2023-12-19T16:07:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.930+0000 7f270effd640 1 --2- 172.21.15.37:0/1492107718 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f270006a460 0x7f270006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.930+0000 7f270effd640 1 -- 172.21.15.37:0/1492107718 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2714088830 con 0x7f2720149260 2023-12-19T16:07:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.930+0000 7f271e59c640 1 --2- 172.21.15.37:0/1492107718 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f270006a460 0x7f270006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.931+0000 7f271e59c640 1 --2- 172.21.15.37:0/1492107718 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f270006a460 0x7f270006c920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2718036000 tx=0x7f2718030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:10.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:10.934+0000 7f270effd640 1 -- 172.21.15.37:0/1492107718 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2714053e50 con 0x7f2720149260 2023-12-19T16:07:11.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.107+0000 7f2724abd640 1 -- 172.21.15.37:0/1492107718 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27200b5500 con 0x7f270006a460 2023-12-19T16:07:11.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.114+0000 7f270effd640 1 -- 172.21.15.37:0/1492107718 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264522 (secure 0 0 0) 0x7f27180483f0 con 0x7f270006a460 2023-12-19T16:07:11.119 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:11.121 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-19T16:07:11.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.117+0000 7f2724abd640 1 -- 172.21.15.37:0/1492107718 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f270006a460 msgr2=0x7f270006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:11.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.117+0000 7f2724abd640 1 --2- 172.21.15.37:0/1492107718 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f270006a460 0x7f270006c920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2718036000 tx=0x7f2718030000 comp rx=0 tx=0).stop 2023-12-19T16:07:11.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.117+0000 7f2724abd640 1 -- 172.21.15.37:0/1492107718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2720149260 msgr2=0x7f27201496c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:11.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.117+0000 7f2724abd640 1 --2- 172.21.15.37:0/1492107718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2720149260 0x7f27201496c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f271400f780 tx=0x7f271400fc40 comp rx=0 tx=0).stop 2023-12-19T16:07:11.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.117+0000 7f2724abd640 1 -- 172.21.15.37:0/1492107718 shutdown_connections 2023-12-19T16:07:11.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.117+0000 7f2724abd640 1 --2- 172.21.15.37:0/1492107718 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f270006a460 0x7f270006c920 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.117+0000 7f2724abd640 1 --2- 172.21.15.37:0/1492107718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27201d3e40 0x7f27201d42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.117+0000 7f2724abd640 1 --2- 172.21.15.37:0/1492107718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2720149260 0x7f27201496c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.117+0000 7f2724abd640 1 --2- 172.21.15.37:0/1492107718 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27080039a0 0x7f27200bf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.117+0000 7f2724abd640 1 -- 172.21.15.37:0/1492107718 >> 172.21.15.37:0/1492107718 conn(0x7f2720071e60 msgr2=0x7f27200b7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:11.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.117+0000 7f2724abd640 1 -- 172.21.15.37:0/1492107718 shutdown_connections 2023-12-19T16:07:11.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.117+0000 7f2724abd640 1 -- 172.21.15.37:0/1492107718 wait complete. 2023-12-19T16:07:11.130 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-12-19T16:07:10.633970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218440,"kb_used_data":2824,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756280,"statfs":{"total":773094113280,"available":772870430720,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.900443"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109838+0000","last_change":"2023-12-19T16:06:58.760625+0000","last_active":"2023-12-19T16:07:01.109838+0000","last_peered":"2023-12-19T16:07:01.109838+0000","last_clean":"2023-12-19T16:07:01.109838+0000","last_became_active":"2023-12-19T16:06:58.760229+0000","last_became_peered":"2023-12-19T16:06:58.760229+0000","last_unstale":"2023-12-19T16:07:01.109838+0000","last_undegraded":"2023-12-19T16:07:01.109838+0000","last_fullsized":"2023-12-19T16:07:01.109838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735747+0000","last_change":"2023-12-19T16:06:58.749173+0000","last_active":"2023-12-19T16:06:59.735747+0000","last_peered":"2023-12-19T16:06:59.735747+0000","last_clean":"2023-12-19T16:06:59.735747+0000","last_became_active":"2023-12-19T16:06:58.748736+0000","last_became_peered":"2023-12-19T16:06:58.748736+0000","last_unstale":"2023-12-19T16:06:59.735747+0000","last_undegraded":"2023-12-19T16:06:59.735747+0000","last_fullsized":"2023-12-19T16:06:59.735747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466127+0000","last_change":"2023-12-19T16:06:58.738858+0000","last_active":"2023-12-19T16:07:00.466127+0000","last_peered":"2023-12-19T16:07:00.466127+0000","last_clean":"2023-12-19T16:07:00.466127+0000","last_became_active":"2023-12-19T16:06:58.738178+0000","last_became_peered":"2023-12-19T16:06:58.738178+0000","last_unstale":"2023-12-19T16:07:00.466127+0000","last_undegraded":"2023-12-19T16:07:00.466127+0000","last_fullsized":"2023-12-19T16:07:00.466127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109498+0000","last_change":"2023-12-19T16:06:58.754766+0000","last_active":"2023-12-19T16:07:01.109498+0000","last_peered":"2023-12-19T16:07:01.109498+0000","last_clean":"2023-12-19T16:07:01.109498+0000","last_became_active":"2023-12-19T16:06:58.754289+0000","last_became_peered":"2023-12-19T16:06:58.754289+0000","last_unstale":"2023-12-19T16:07:01.109498+0000","last_undegraded":"2023-12-19T16:07:01.109498+0000","last_fullsized":"2023-12-19T16:07:01.109498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:26:37.888389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109413+0000","last_change":"2023-12-19T16:06:58.743609+0000","last_active":"2023-12-19T16:07:01.109413+0000","last_peered":"2023-12-19T16:07:01.109413+0000","last_clean":"2023-12-19T16:07:01.109413+0000","last_became_active":"2023-12-19T16:06:58.743331+0000","last_became_peered":"2023-12-19T16:06:58.743331+0000","last_unstale":"2023-12-19T16:07:01.109413+0000","last_undegraded":"2023-12-19T16:07:01.109413+0000","last_fullsized":"2023-12-19T16:07:01.109413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:11.108008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109102+0000","last_change":"2023-12-19T16:06:58.752778+0000","last_active":"2023-12-19T16:07:01.109102+0000","last_peered":"2023-12-19T16:07:01.109102+0000","last_clean":"2023-12-19T16:07:01.109102+0000","last_became_active":"2023-12-19T16:06:58.752519+0000","last_became_peered":"2023-12-19T16:06:58.752519+0000","last_unstale":"2023-12-19T16:07:01.109102+0000","last_undegraded":"2023-12-19T16:07:01.109102+0000","last_fullsized":"2023-12-19T16:07:01.109102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:17.210206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109322+0000","last_change":"2023-12-19T16:06:58.748834+0000","last_active":"2023-12-19T16:07:01.109322+0000","last_peered":"2023-12-19T16:07:01.109322+0000","last_clean":"2023-12-19T16:07:01.109322+0000","last_became_active":"2023-12-19T16:06:58.748039+0000","last_became_peered":"2023-12-19T16:06:58.748039+0000","last_unstale":"2023-12-19T16:07:01.109322+0000","last_undegraded":"2023-12-19T16:07:01.109322+0000","last_fullsized":"2023-12-19T16:07:01.109322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:26:37.888389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429554+0000","last_change":"2023-12-19T16:06:58.754746+0000","last_active":"2023-12-19T16:07:00.429554+0000","last_peered":"2023-12-19T16:07:00.429554+0000","last_clean":"2023-12-19T16:07:00.429554+0000","last_became_active":"2023-12-19T16:06:58.754477+0000","last_became_peered":"2023-12-19T16:06:58.754477+0000","last_unstale":"2023-12-19T16:07:00.429554+0000","last_undegraded":"2023-12-19T16:07:00.429554+0000","last_fullsized":"2023-12-19T16:07:00.429554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:02.578194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109955+0000","last_change":"2023-12-19T16:06:58.755823+0000","last_active":"2023-12-19T16:07:01.109955+0000","last_peered":"2023-12-19T16:07:01.109955+0000","last_clean":"2023-12-19T16:07:01.109955+0000","last_became_active":"2023-12-19T16:06:58.755519+0000","last_became_peered":"2023-12-19T16:06:58.755519+0000","last_unstale":"2023-12-19T16:07:01.109955+0000","last_undegraded":"2023-12-19T16:07:01.109955+0000","last_fullsized":"2023-12-19T16:07:01.109955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:17.210206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594076+0000","last_change":"2023-12-19T16:06:58.757791+0000","last_active":"2023-12-19T16:07:00.594076+0000","last_peered":"2023-12-19T16:07:00.594076+0000","last_clean":"2023-12-19T16:07:00.594076+0000","last_became_active":"2023-12-19T16:06:58.757519+0000","last_became_peered":"2023-12-19T16:06:58.757519+0000","last_unstale":"2023-12-19T16:07:00.594076+0000","last_undegraded":"2023-12-19T16:07:00.594076+0000","last_fullsized":"2023-12-19T16:07:00.594076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593880+0000","last_change":"2023-12-19T16:06:58.757323+0000","last_active":"2023-12-19T16:07:00.593880+0000","last_peered":"2023-12-19T16:07:00.593880+0000","last_clean":"2023-12-19T16:07:00.593880+0000","last_became_active":"2023-12-19T16:06:58.757070+0000","last_became_peered":"2023-12-19T16:06:58.757070+0000","last_unstale":"2023-12-19T16:07:00.593880+0000","last_undegraded":"2023-12-19T16:07:00.593880+0000","last_fullsized":"2023-12-19T16:07:00.593880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735789+0000","last_change":"2023-12-19T16:06:58.748826+0000","last_active":"2023-12-19T16:06:59.735789+0000","last_peered":"2023-12-19T16:06:59.735789+0000","last_clean":"2023-12-19T16:06:59.735789+0000","last_became_active":"2023-12-19T16:06:58.748455+0000","last_became_peered":"2023-12-19T16:06:58.748455+0000","last_unstale":"2023-12-19T16:06:59.735789+0000","last_undegraded":"2023-12-19T16:06:59.735789+0000","last_fullsized":"2023-12-19T16:06:59.735789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:45:54.216383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429773+0000","last_change":"2023-12-19T16:06:58.746487+0000","last_active":"2023-12-19T16:07:00.429773+0000","last_peered":"2023-12-19T16:07:00.429773+0000","last_clean":"2023-12-19T16:07:00.429773+0000","last_became_active":"2023-12-19T16:06:58.746251+0000","last_became_peered":"2023-12-19T16:06:58.746251+0000","last_unstale":"2023-12-19T16:07:00.429773+0000","last_undegraded":"2023-12-19T16:07:00.429773+0000","last_fullsized":"2023-12-19T16:07:00.429773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.465948+0000","last_change":"2023-12-19T16:06:58.749166+0000","last_active":"2023-12-19T16:07:00.465948+0000","last_peered":"2023-12-19T16:07:00.465948+0000","last_clean":"2023-12-19T16:07:00.465948+0000","last_became_active":"2023-12-19T16:06:58.748884+0000","last_became_peered":"2023-12-19T16:06:58.748884+0000","last_unstale":"2023-12-19T16:07:00.465948+0000","last_undegraded":"2023-12-19T16:07:00.465948+0000","last_fullsized":"2023-12-19T16:07:00.465948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735398+0000","last_change":"2023-12-19T16:06:58.744455+0000","last_active":"2023-12-19T16:06:59.735398+0000","last_peered":"2023-12-19T16:06:59.735398+0000","last_clean":"2023-12-19T16:06:59.735398+0000","last_became_active":"2023-12-19T16:06:58.744204+0000","last_became_peered":"2023-12-19T16:06:58.744204+0000","last_unstale":"2023-12-19T16:06:59.735398+0000","last_undegraded":"2023-12-19T16:06:59.735398+0000","last_fullsized":"2023-12-19T16:06:59.735398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109012+0000","last_change":"2023-12-19T16:06:58.751725+0000","last_active":"2023-12-19T16:07:01.109012+0000","last_peered":"2023-12-19T16:07:01.109012+0000","last_clean":"2023-12-19T16:07:01.109012+0000","last_became_active":"2023-12-19T16:06:58.751476+0000","last_became_peered":"2023-12-19T16:06:58.751476+0000","last_unstale":"2023-12-19T16:07:01.109012+0000","last_undegraded":"2023-12-19T16:07:01.109012+0000","last_fullsized":"2023-12-19T16:07:01.109012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:49.465099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109749+0000","last_change":"2023-12-19T16:06:58.752816+0000","last_active":"2023-12-19T16:07:01.109749+0000","last_peered":"2023-12-19T16:07:01.109749+0000","last_clean":"2023-12-19T16:07:01.109749+0000","last_became_active":"2023-12-19T16:06:58.752475+0000","last_became_peered":"2023-12-19T16:06:58.752475+0000","last_unstale":"2023-12-19T16:07:01.109749+0000","last_undegraded":"2023-12-19T16:07:01.109749+0000","last_fullsized":"2023-12-19T16:07:01.109749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736208+0000","last_change":"2023-12-19T16:06:58.745867+0000","last_active":"2023-12-19T16:06:59.736208+0000","last_peered":"2023-12-19T16:06:59.736208+0000","last_clean":"2023-12-19T16:06:59.736208+0000","last_became_active":"2023-12-19T16:06:58.745603+0000","last_became_peered":"2023-12-19T16:06:58.745603+0000","last_unstale":"2023-12-19T16:06:59.736208+0000","last_undegraded":"2023-12-19T16:06:59.736208+0000","last_fullsized":"2023-12-19T16:06:59.736208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:45:54.216383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109763+0000","last_change":"2023-12-19T16:06:58.744080+0000","last_active":"2023-12-19T16:07:01.109763+0000","last_peered":"2023-12-19T16:07:01.109763+0000","last_clean":"2023-12-19T16:07:01.109763+0000","last_became_active":"2023-12-19T16:06:58.743129+0000","last_became_peered":"2023-12-19T16:06:58.743129+0000","last_unstale":"2023-12-19T16:07:01.109763+0000","last_undegraded":"2023-12-19T16:07:01.109763+0000","last_fullsized":"2023-12-19T16:07:01.109763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593848+0000","last_change":"2023-12-19T16:06:58.754725+0000","last_active":"2023-12-19T16:07:00.593848+0000","last_peered":"2023-12-19T16:07:00.593848+0000","last_clean":"2023-12-19T16:07:00.593848+0000","last_became_active":"2023-12-19T16:06:58.754476+0000","last_became_peered":"2023-12-19T16:06:58.754476+0000","last_unstale":"2023-12-19T16:07:00.593848+0000","last_undegraded":"2023-12-19T16:07:00.593848+0000","last_fullsized":"2023-12-19T16:07:00.593848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466100+0000","last_change":"2023-12-19T16:06:58.744917+0000","last_active":"2023-12-19T16:07:00.466100+0000","last_peered":"2023-12-19T16:07:00.466100+0000","last_clean":"2023-12-19T16:07:00.466100+0000","last_became_active":"2023-12-19T16:06:58.744663+0000","last_became_peered":"2023-12-19T16:06:58.744663+0000","last_unstale":"2023-12-19T16:07:00.466100+0000","last_undegraded":"2023-12-19T16:07:00.466100+0000","last_fullsized":"2023-12-19T16:07:00.466100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109326+0000","last_change":"2023-12-19T16:06:58.752295+0000","last_active":"2023-12-19T16:07:01.109326+0000","last_peered":"2023-12-19T16:07:01.109326+0000","last_clean":"2023-12-19T16:07:01.109326+0000","last_became_active":"2023-12-19T16:06:58.752030+0000","last_became_peered":"2023-12-19T16:06:58.752030+0000","last_unstale":"2023-12-19T16:07:01.109326+0000","last_undegraded":"2023-12-19T16:07:01.109326+0000","last_fullsized":"2023-12-19T16:07:01.109326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:02.578194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429607+0000","last_change":"2023-12-19T16:06:58.737261+0000","last_active":"2023-12-19T16:07:00.429607+0000","last_peered":"2023-12-19T16:07:00.429607+0000","last_clean":"2023-12-19T16:07:00.429607+0000","last_became_active":"2023-12-19T16:06:58.736978+0000","last_became_peered":"2023-12-19T16:06:58.736978+0000","last_unstale":"2023-12-19T16:07:00.429607+0000","last_undegraded":"2023-12-19T16:07:00.429607+0000","last_fullsized":"2023-12-19T16:07:00.429607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109099+0000","last_change":"2023-12-19T16:06:58.751235+0000","last_active":"2023-12-19T16:07:01.109099+0000","last_peered":"2023-12-19T16:07:01.109099+0000","last_clean":"2023-12-19T16:07:01.109099+0000","last_became_active":"2023-12-19T16:06:58.750410+0000","last_became_peered":"2023-12-19T16:06:58.750410+0000","last_unstale":"2023-12-19T16:07:01.109099+0000","last_undegraded":"2023-12-19T16:07:01.109099+0000","last_fullsized":"2023-12-19T16:07:01.109099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:56:59.199473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429968+0000","last_change":"2023-12-19T16:06:58.744478+0000","last_active":"2023-12-19T16:07:00.429968+0000","last_peered":"2023-12-19T16:07:00.429968+0000","last_clean":"2023-12-19T16:07:00.429968+0000","last_became_active":"2023-12-19T16:06:58.742838+0000","last_became_peered":"2023-12-19T16:06:58.742838+0000","last_unstale":"2023-12-19T16:07:00.429968+0000","last_undegraded":"2023-12-19T16:07:00.429968+0000","last_fullsized":"2023-12-19T16:07:00.429968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594088+0000","last_change":"2023-12-19T16:06:58.746043+0000","last_active":"2023-12-19T16:07:00.594088+0000","last_peered":"2023-12-19T16:07:00.594088+0000","last_clean":"2023-12-19T16:07:00.594088+0000","last_became_active":"2023-12-19T16:06:58.745779+0000","last_became_peered":"2023-12-19T16:06:58.745779+0000","last_unstale":"2023-12-19T16:07:00.594088+0000","last_undegraded":"2023-12-19T16:07:00.594088+0000","last_fullsized":"2023-12-19T16:07:00.594088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:04.102120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735628+0000","last_change":"2023-12-19T16:06:58.749441+0000","last_active":"2023-12-19T16:06:59.735628+0000","last_peered":"2023-12-19T16:06:59.735628+0000","last_clean":"2023-12-19T16:06:59.735628+0000","last_became_active":"2023-12-19T16:06:58.748234+0000","last_became_peered":"2023-12-19T16:06:58.748234+0000","last_unstale":"2023-12-19T16:06:59.735628+0000","last_undegraded":"2023-12-19T16:06:59.735628+0000","last_fullsized":"2023-12-19T16:06:59.735628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429935+0000","last_change":"2023-12-19T16:06:58.744976+0000","last_active":"2023-12-19T16:07:00.429935+0000","last_peered":"2023-12-19T16:07:00.429935+0000","last_clean":"2023-12-19T16:07:00.429935+0000","last_became_active":"2023-12-19T16:06:58.744731+0000","last_became_peered":"2023-12-19T16:06:58.744731+0000","last_unstale":"2023-12-19T16:07:00.429935+0000","last_undegraded":"2023-12-19T16:07:00.429935+0000","last_fullsized":"2023-12-19T16:07:00.429935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466162+0000","last_change":"2023-12-19T16:06:58.748370+0000","last_active":"2023-12-19T16:07:00.466162+0000","last_peered":"2023-12-19T16:07:00.466162+0000","last_clean":"2023-12-19T16:07:00.466162+0000","last_became_active":"2023-12-19T16:06:58.748079+0000","last_became_peered":"2023-12-19T16:06:58.748079+0000","last_unstale":"2023-12-19T16:07:00.466162+0000","last_undegraded":"2023-12-19T16:07:00.466162+0000","last_fullsized":"2023-12-19T16:07:00.466162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109837+0000","last_change":"2023-12-19T16:06:58.751906+0000","last_active":"2023-12-19T16:07:01.109837+0000","last_peered":"2023-12-19T16:07:01.109837+0000","last_clean":"2023-12-19T16:07:01.109837+0000","last_became_active":"2023-12-19T16:06:58.750803+0000","last_became_peered":"2023-12-19T16:06:58.750803+0000","last_unstale":"2023-12-19T16:07:01.109837+0000","last_undegraded":"2023-12-19T16:07:01.109837+0000","last_fullsized":"2023-12-19T16:07:01.109837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:34:52.231787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736199+0000","last_change":"2023-12-19T16:06:58.753386+0000","last_active":"2023-12-19T16:06:59.736199+0000","last_peered":"2023-12-19T16:06:59.736199+0000","last_clean":"2023-12-19T16:06:59.736199+0000","last_became_active":"2023-12-19T16:06:58.753213+0000","last_became_peered":"2023-12-19T16:06:58.753213+0000","last_unstale":"2023-12-19T16:06:59.736199+0000","last_undegraded":"2023-12-19T16:06:59.736199+0000","last_fullsized":"2023-12-19T16:06:59.736199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:56.721659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593758+0000","last_change":"2023-12-19T16:06:58.753896+0000","last_active":"2023-12-19T16:07:00.593758+0000","last_peered":"2023-12-19T16:07:00.593758+0000","last_clean":"2023-12-19T16:07:00.593758+0000","last_became_active":"2023-12-19T16:06:58.753594+0000","last_became_peered":"2023-12-19T16:06:58.753594+0000","last_unstale":"2023-12-19T16:07:00.593758+0000","last_undegraded":"2023-12-19T16:07:00.593758+0000","last_fullsized":"2023-12-19T16:07:00.593758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:49.465099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735526+0000","last_change":"2023-12-19T16:06:58.749736+0000","last_active":"2023-12-19T16:06:59.735526+0000","last_peered":"2023-12-19T16:06:59.735526+0000","last_clean":"2023-12-19T16:06:59.735526+0000","last_became_active":"2023-12-19T16:06:58.749468+0000","last_became_peered":"2023-12-19T16:06:58.749468+0000","last_unstale":"2023-12-19T16:06:59.735526+0000","last_undegraded":"2023-12-19T16:06:59.735526+0000","last_fullsized":"2023-12-19T16:06:59.735526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:17.323789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429911+0000","last_change":"2023-12-19T16:06:58.304535+0000","last_active":"2023-12-19T16:07:00.429911+0000","last_peered":"2023-12-19T16:07:00.429911+0000","last_clean":"2023-12-19T16:07:00.429911+0000","last_became_active":"2023-12-19T16:06:58.304271+0000","last_became_peered":"2023-12-19T16:06:58.304271+0000","last_unstale":"2023-12-19T16:07:00.429911+0000","last_undegraded":"2023-12-19T16:07:00.429911+0000","last_fullsized":"2023-12-19T16:07:00.429911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466191+0000","last_change":"2023-12-19T16:06:58.741261+0000","last_active":"2023-12-19T16:07:00.466191+0000","last_peered":"2023-12-19T16:07:00.466191+0000","last_clean":"2023-12-19T16:07:00.466191+0000","last_became_active":"2023-12-19T16:06:58.741000+0000","last_became_peered":"2023-12-19T16:06:58.741000+0000","last_unstale":"2023-12-19T16:07:00.466191+0000","last_undegraded":"2023-12-19T16:07:00.466191+0000","last_fullsized":"2023-12-19T16:07:00.466191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:21:27.003991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593812+0000","last_change":"2023-12-19T16:06:58.304385+0000","last_active":"2023-12-19T16:07:00.593812+0000","last_peered":"2023-12-19T16:07:00.593812+0000","last_clean":"2023-12-19T16:07:00.593812+0000","last_became_active":"2023-12-19T16:06:58.304091+0000","last_became_peered":"2023-12-19T16:06:58.304091+0000","last_unstale":"2023-12-19T16:07:00.593812+0000","last_undegraded":"2023-12-19T16:07:00.593812+0000","last_fullsized":"2023-12-19T16:07:00.593812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429698+0000","last_change":"2023-12-19T16:06:58.305822+0000","last_active":"2023-12-19T16:07:00.429698+0000","last_peered":"2023-12-19T16:07:00.429698+0000","last_clean":"2023-12-19T16:07:00.429698+0000","last_became_active":"2023-12-19T16:06:58.305070+0000","last_became_peered":"2023-12-19T16:06:58.305070+0000","last_unstale":"2023-12-19T16:07:00.429698+0000","last_undegraded":"2023-12-19T16:07:00.429698+0000","last_fullsized":"2023-12-19T16:07:00.429698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429590+0000","last_change":"2023-12-19T16:06:58.741414+0000","last_active":"2023-12-19T16:07:00.429590+0000","last_peered":"2023-12-19T16:07:00.429590+0000","last_clean":"2023-12-19T16:07:00.429590+0000","last_became_active":"2023-12-19T16:06:58.741166+0000","last_became_peered":"2023-12-19T16:06:58.741166+0000","last_unstale":"2023-12-19T16:07:00.429590+0000","last_undegraded":"2023-12-19T16:07:00.429590+0000","last_fullsized":"2023-12-19T16:07:00.429590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109102+0000","last_change":"2023-12-19T16:06:58.304842+0000","last_active":"2023-12-19T16:07:01.109102+0000","last_peered":"2023-12-19T16:07:01.109102+0000","last_clean":"2023-12-19T16:07:01.109102+0000","last_became_active":"2023-12-19T16:06:58.302883+0000","last_became_peered":"2023-12-19T16:06:58.302883+0000","last_unstale":"2023-12-19T16:07:01.109102+0000","last_undegraded":"2023-12-19T16:07:01.109102+0000","last_fullsized":"2023-12-19T16:07:01.109102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735403+0000","last_change":"2023-12-19T16:06:58.750010+0000","last_active":"2023-12-19T16:06:59.735403+0000","last_peered":"2023-12-19T16:06:59.735403+0000","last_clean":"2023-12-19T16:06:59.735403+0000","last_became_active":"2023-12-19T16:06:58.749766+0000","last_became_peered":"2023-12-19T16:06:58.749766+0000","last_unstale":"2023-12-19T16:06:59.735403+0000","last_undegraded":"2023-12-19T16:06:59.735403+0000","last_fullsized":"2023-12-19T16:06:59.735403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594040+0000","last_change":"2023-12-19T16:06:58.307494+0000","last_active":"2023-12-19T16:07:00.594040+0000","last_peered":"2023-12-19T16:07:00.594040+0000","last_clean":"2023-12-19T16:07:00.594040+0000","last_became_active":"2023-12-19T16:06:58.307191+0000","last_became_peered":"2023-12-19T16:06:58.307191+0000","last_unstale":"2023-12-19T16:07:00.594040+0000","last_undegraded":"2023-12-19T16:07:00.594040+0000","last_fullsized":"2023-12-19T16:07:00.594040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109823+0000","last_change":"2023-12-19T16:06:58.752792+0000","last_active":"2023-12-19T16:07:01.109823+0000","last_peered":"2023-12-19T16:07:01.109823+0000","last_clean":"2023-12-19T16:07:01.109823+0000","last_became_active":"2023-12-19T16:06:58.752494+0000","last_became_peered":"2023-12-19T16:06:58.752494+0000","last_unstale":"2023-12-19T16:07:01.109823+0000","last_undegraded":"2023-12-19T16:07:01.109823+0000","last_fullsized":"2023-12-19T16:07:01.109823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109839+0000","last_change":"2023-12-19T16:06:58.309509+0000","last_active":"2023-12-19T16:07:01.109839+0000","last_peered":"2023-12-19T16:07:01.109839+0000","last_clean":"2023-12-19T16:07:01.109839+0000","last_became_active":"2023-12-19T16:06:58.309139+0000","last_became_peered":"2023-12-19T16:06:58.309139+0000","last_unstale":"2023-12-19T16:07:01.109839+0000","last_undegraded":"2023-12-19T16:07:01.109839+0000","last_fullsized":"2023-12-19T16:07:01.109839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466307+0000","last_change":"2023-12-19T16:06:58.756009+0000","last_active":"2023-12-19T16:07:00.466307+0000","last_peered":"2023-12-19T16:07:00.466307+0000","last_clean":"2023-12-19T16:07:00.466307+0000","last_became_active":"2023-12-19T16:06:58.755610+0000","last_became_peered":"2023-12-19T16:06:58.755610+0000","last_unstale":"2023-12-19T16:07:00.466307+0000","last_undegraded":"2023-12-19T16:07:00.466307+0000","last_fullsized":"2023-12-19T16:07:00.466307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735683+0000","last_change":"2023-12-19T16:06:58.312257+0000","last_active":"2023-12-19T16:06:59.735683+0000","last_peered":"2023-12-19T16:06:59.735683+0000","last_clean":"2023-12-19T16:06:59.735683+0000","last_became_active":"2023-12-19T16:06:58.311988+0000","last_became_peered":"2023-12-19T16:06:58.311988+0000","last_unstale":"2023-12-19T16:06:59.735683+0000","last_undegraded":"2023-12-19T16:06:59.735683+0000","last_fullsized":"2023-12-19T16:06:59.735683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:55.716735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735863+0000","last_change":"2023-12-19T16:06:58.743459+0000","last_active":"2023-12-19T16:06:59.735863+0000","last_peered":"2023-12-19T16:06:59.735863+0000","last_clean":"2023-12-19T16:06:59.735863+0000","last_became_active":"2023-12-19T16:06:58.743184+0000","last_became_peered":"2023-12-19T16:06:58.743184+0000","last_unstale":"2023-12-19T16:06:59.735863+0000","last_undegraded":"2023-12-19T16:06:59.735863+0000","last_fullsized":"2023-12-19T16:06:59.735863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:56.721659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593958+0000","last_change":"2023-12-19T16:06:58.310349+0000","last_active":"2023-12-19T16:07:00.593958+0000","last_peered":"2023-12-19T16:07:00.593958+0000","last_clean":"2023-12-19T16:07:00.593958+0000","last_became_active":"2023-12-19T16:06:58.310059+0000","last_became_peered":"2023-12-19T16:06:58.310059+0000","last_unstale":"2023-12-19T16:07:00.593958+0000","last_undegraded":"2023-12-19T16:07:00.593958+0000","last_fullsized":"2023-12-19T16:07:00.593958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:35.961254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109478+0000","last_change":"2023-12-19T16:06:58.751190+0000","last_active":"2023-12-19T16:07:01.109478+0000","last_peered":"2023-12-19T16:07:01.109478+0000","last_clean":"2023-12-19T16:07:01.109478+0000","last_became_active":"2023-12-19T16:06:58.748432+0000","last_became_peered":"2023-12-19T16:06:58.748432+0000","last_unstale":"2023-12-19T16:07:01.109478+0000","last_undegraded":"2023-12-19T16:07:01.109478+0000","last_fullsized":"2023-12-19T16:07:01.109478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:30.281031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466247+0000","last_change":"2023-12-19T16:06:58.307849+0000","last_active":"2023-12-19T16:07:00.466247+0000","last_peered":"2023-12-19T16:07:00.466247+0000","last_clean":"2023-12-19T16:07:00.466247+0000","last_became_active":"2023-12-19T16:06:58.307562+0000","last_became_peered":"2023-12-19T16:06:58.307562+0000","last_unstale":"2023-12-19T16:07:00.466247+0000","last_undegraded":"2023-12-19T16:07:00.466247+0000","last_fullsized":"2023-12-19T16:07:00.466247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466011+0000","last_change":"2023-12-19T16:06:58.744304+0000","last_active":"2023-12-19T16:07:00.466011+0000","last_peered":"2023-12-19T16:07:00.466011+0000","last_clean":"2023-12-19T16:07:00.466011+0000","last_became_active":"2023-12-19T16:06:58.744034+0000","last_became_peered":"2023-12-19T16:06:58.744034+0000","last_unstale":"2023-12-19T16:07:00.466011+0000","last_undegraded":"2023-12-19T16:07:00.466011+0000","last_fullsized":"2023-12-19T16:07:00.466011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:04.102120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109966+0000","last_change":"2023-12-19T16:06:58.310576+0000","last_active":"2023-12-19T16:07:01.109966+0000","last_peered":"2023-12-19T16:07:01.109966+0000","last_clean":"2023-12-19T16:07:01.109966+0000","last_became_active":"2023-12-19T16:06:58.310298+0000","last_became_peered":"2023-12-19T16:06:58.310298+0000","last_unstale":"2023-12-19T16:07:01.109966+0000","last_undegraded":"2023-12-19T16:07:01.109966+0000","last_fullsized":"2023-12-19T16:07:01.109966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:06.572806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109450+0000","last_change":"2023-12-19T16:06:58.746329+0000","last_active":"2023-12-19T16:07:01.109450+0000","last_peered":"2023-12-19T16:07:01.109450+0000","last_clean":"2023-12-19T16:07:01.109450+0000","last_became_active":"2023-12-19T16:06:58.746010+0000","last_became_peered":"2023-12-19T16:06:58.746010+0000","last_unstale":"2023-12-19T16:07:01.109450+0000","last_undegraded":"2023-12-19T16:07:01.109450+0000","last_fullsized":"2023-12-19T16:07:01.109450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:34:52.231787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593805+0000","last_change":"2023-12-19T16:06:58.309330+0000","last_active":"2023-12-19T16:07:00.593805+0000","last_peered":"2023-12-19T16:07:00.593805+0000","last_clean":"2023-12-19T16:07:00.593805+0000","last_became_active":"2023-12-19T16:06:58.309039+0000","last_became_peered":"2023-12-19T16:06:58.309039+0000","last_unstale":"2023-12-19T16:07:00.593805+0000","last_undegraded":"2023-12-19T16:07:00.593805+0000","last_fullsized":"2023-12-19T16:07:00.593805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593766+0000","last_change":"2023-12-19T16:06:58.752891+0000","last_active":"2023-12-19T16:07:00.593766+0000","last_peered":"2023-12-19T16:07:00.593766+0000","last_clean":"2023-12-19T16:07:00.593766+0000","last_became_active":"2023-12-19T16:06:58.752582+0000","last_became_peered":"2023-12-19T16:06:58.752582+0000","last_unstale":"2023-12-19T16:07:00.593766+0000","last_undegraded":"2023-12-19T16:07:00.593766+0000","last_fullsized":"2023-12-19T16:07:00.593766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:07:12.391535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736116+0000","last_change":"2023-12-19T16:06:58.308799+0000","last_active":"2023-12-19T16:06:59.736116+0000","last_peered":"2023-12-19T16:06:59.736116+0000","last_clean":"2023-12-19T16:06:59.736116+0000","last_became_active":"2023-12-19T16:06:58.308452+0000","last_became_peered":"2023-12-19T16:06:58.308452+0000","last_unstale":"2023-12-19T16:06:59.736116+0000","last_undegraded":"2023-12-19T16:06:59.736116+0000","last_fullsized":"2023-12-19T16:06:59.736116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109274+0000","last_change":"2023-12-19T16:06:58.746864+0000","last_active":"2023-12-19T16:07:01.109274+0000","last_peered":"2023-12-19T16:07:01.109274+0000","last_clean":"2023-12-19T16:07:01.109274+0000","last_became_active":"2023-12-19T16:06:58.746614+0000","last_became_peered":"2023-12-19T16:06:58.746614+0000","last_unstale":"2023-12-19T16:07:01.109274+0000","last_undegraded":"2023-12-19T16:07:01.109274+0000","last_fullsized":"2023-12-19T16:07:01.109274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:08:43.126506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735933+0000","last_change":"2023-12-19T16:06:58.308443+0000","last_active":"2023-12-19T16:06:59.735933+0000","last_peered":"2023-12-19T16:06:59.735933+0000","last_clean":"2023-12-19T16:06:59.735933+0000","last_became_active":"2023-12-19T16:06:58.308138+0000","last_became_peered":"2023-12-19T16:06:58.308138+0000","last_unstale":"2023-12-19T16:06:59.735933+0000","last_undegraded":"2023-12-19T16:06:59.735933+0000","last_fullsized":"2023-12-19T16:06:59.735933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:45:16.445340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109774+0000","last_change":"2023-12-19T16:06:58.743581+0000","last_active":"2023-12-19T16:07:01.109774+0000","last_peered":"2023-12-19T16:07:01.109774+0000","last_clean":"2023-12-19T16:07:01.109774+0000","last_became_active":"2023-12-19T16:06:58.743215+0000","last_became_peered":"2023-12-19T16:06:58.743215+0000","last_unstale":"2023-12-19T16:07:01.109774+0000","last_undegraded":"2023-12-19T16:07:01.109774+0000","last_fullsized":"2023-12-19T16:07:01.109774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:56:59.199473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736253+0000","last_change":"2023-12-19T16:06:58.301431+0000","last_active":"2023-12-19T16:06:59.736253+0000","last_peered":"2023-12-19T16:06:59.736253+0000","last_clean":"2023-12-19T16:06:59.736253+0000","last_became_active":"2023-12-19T16:06:58.301154+0000","last_became_peered":"2023-12-19T16:06:58.301154+0000","last_unstale":"2023-12-19T16:06:59.736253+0000","last_undegraded":"2023-12-19T16:06:59.736253+0000","last_fullsized":"2023-12-19T16:06:59.736253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109948+0000","last_change":"2023-12-19T16:06:58.747109+0000","last_active":"2023-12-19T16:07:01.109948+0000","last_peered":"2023-12-19T16:07:01.109948+0000","last_clean":"2023-12-19T16:07:01.109948+0000","last_became_active":"2023-12-19T16:06:58.746296+0000","last_became_peered":"2023-12-19T16:06:58.746296+0000","last_unstale":"2023-12-19T16:07:01.109948+0000","last_undegraded":"2023-12-19T16:07:01.109948+0000","last_fullsized":"2023-12-19T16:07:01.109948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:02.578194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735717+0000","last_change":"2023-12-19T16:06:58.314755+0000","last_active":"2023-12-19T16:06:59.735717+0000","last_peered":"2023-12-19T16:06:59.735717+0000","last_clean":"2023-12-19T16:06:59.735717+0000","last_became_active":"2023-12-19T16:06:58.314554+0000","last_became_peered":"2023-12-19T16:06:58.314554+0000","last_unstale":"2023-12-19T16:06:59.735717+0000","last_undegraded":"2023-12-19T16:06:59.735717+0000","last_fullsized":"2023-12-19T16:06:59.735717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:16.318865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.110048+0000","last_change":"2023-12-19T16:06:58.751149+0000","last_active":"2023-12-19T16:07:01.110048+0000","last_peered":"2023-12-19T16:07:01.110048+0000","last_clean":"2023-12-19T16:07:01.110048+0000","last_became_active":"2023-12-19T16:06:58.750741+0000","last_became_peered":"2023-12-19T16:06:58.750741+0000","last_unstale":"2023-12-19T16:07:01.110048+0000","last_undegraded":"2023-12-19T16:07:01.110048+0000","last_fullsized":"2023-12-19T16:07:01.110048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:30.281031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736230+0000","last_change":"2023-12-19T16:06:58.301782+0000","last_active":"2023-12-19T16:06:59.736230+0000","last_peered":"2023-12-19T16:06:59.736230+0000","last_clean":"2023-12-19T16:06:59.736230+0000","last_became_active":"2023-12-19T16:06:58.300855+0000","last_became_peered":"2023-12-19T16:06:58.300855+0000","last_unstale":"2023-12-19T16:06:59.736230+0000","last_undegraded":"2023-12-19T16:06:59.736230+0000","last_fullsized":"2023-12-19T16:06:59.736230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109583+0000","last_change":"2023-12-19T16:06:58.755507+0000","last_active":"2023-12-19T16:07:01.109583+0000","last_peered":"2023-12-19T16:07:01.109583+0000","last_clean":"2023-12-19T16:07:01.109583+0000","last_became_active":"2023-12-19T16:06:58.755176+0000","last_became_peered":"2023-12-19T16:06:58.755176+0000","last_unstale":"2023-12-19T16:07:01.109583+0000","last_undegraded":"2023-12-19T16:07:01.109583+0000","last_fullsized":"2023-12-19T16:07:01.109583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:59:45.402539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T16:06:58.733783+0000","last_change":"2023-12-19T16:06:47.761389+0000","last_active":"2023-12-19T16:06:58.733783+0000","last_peered":"2023-12-19T16:06:58.733783+0000","last_clean":"2023-12-19T16:06:58.733783+0000","last_became_active":"2023-12-19T16:06:47.760252+0000","last_became_peered":"2023-12-19T16:06:47.760252+0000","last_unstale":"2023-12-19T16:06:58.733783+0000","last_undegraded":"2023-12-19T16:06:58.733783+0000","last_fullsized":"2023-12-19T16:06:58.733783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_clean_scrub_stamp":"2023-12-19T16:06:46.706871+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:09.167979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109217+0000","last_change":"2023-12-19T16:06:58.300900+0000","last_active":"2023-12-19T16:07:01.109217+0000","last_peered":"2023-12-19T16:07:01.109217+0000","last_clean":"2023-12-19T16:07:01.109217+0000","last_became_active":"2023-12-19T16:06:58.300641+0000","last_became_peered":"2023-12-19T16:06:58.300641+0000","last_unstale":"2023-12-19T16:07:01.109217+0000","last_undegraded":"2023-12-19T16:07:01.109217+0000","last_fullsized":"2023-12-19T16:07:01.109217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:07.531619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429774+0000","last_change":"2023-12-19T16:06:58.755362+0000","last_active":"2023-12-19T16:07:00.429774+0000","last_peered":"2023-12-19T16:07:00.429774+0000","last_clean":"2023-12-19T16:07:00.429774+0000","last_became_active":"2023-12-19T16:06:58.755055+0000","last_became_peered":"2023-12-19T16:06:58.755055+0000","last_unstale":"2023-12-19T16:07:00.429774+0000","last_undegraded":"2023-12-19T16:07:00.429774+0000","last_fullsized":"2023-12-19T16:07:00.429774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:08:43.126506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109035+0000","last_change":"2023-12-19T16:06:58.310316+0000","last_active":"2023-12-19T16:07:01.109035+0000","last_peered":"2023-12-19T16:07:01.109035+0000","last_clean":"2023-12-19T16:07:01.109035+0000","last_became_active":"2023-12-19T16:06:58.310035+0000","last_became_peered":"2023-12-19T16:06:58.310035+0000","last_unstale":"2023-12-19T16:07:01.109035+0000","last_undegraded":"2023-12-19T16:07:01.109035+0000","last_fullsized":"2023-12-19T16:07:01.109035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:07.531619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466062+0000","last_change":"2023-12-19T16:06:58.741676+0000","last_active":"2023-12-19T16:07:00.466062+0000","last_peered":"2023-12-19T16:07:00.466062+0000","last_clean":"2023-12-19T16:07:00.466062+0000","last_became_active":"2023-12-19T16:06:58.741422+0000","last_became_peered":"2023-12-19T16:06:58.741422+0000","last_unstale":"2023-12-19T16:07:00.466062+0000","last_undegraded":"2023-12-19T16:07:00.466062+0000","last_fullsized":"2023-12-19T16:07:00.466062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:46:27.205690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736299+0000","last_change":"2023-12-19T16:06:58.296822+0000","last_active":"2023-12-19T16:06:59.736299+0000","last_peered":"2023-12-19T16:06:59.736299+0000","last_clean":"2023-12-19T16:06:59.736299+0000","last_became_active":"2023-12-19T16:06:58.296555+0000","last_became_peered":"2023-12-19T16:06:58.296555+0000","last_unstale":"2023-12-19T16:06:59.736299+0000","last_undegraded":"2023-12-19T16:06:59.736299+0000","last_fullsized":"2023-12-19T16:06:59.736299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735354+0000","last_change":"2023-12-19T16:06:58.750259+0000","last_active":"2023-12-19T16:06:59.735354+0000","last_peered":"2023-12-19T16:06:59.735354+0000","last_clean":"2023-12-19T16:06:59.735354+0000","last_became_active":"2023-12-19T16:06:58.749971+0000","last_became_peered":"2023-12-19T16:06:58.749971+0000","last_unstale":"2023-12-19T16:06:59.735354+0000","last_undegraded":"2023-12-19T16:06:59.735354+0000","last_fullsized":"2023-12-19T16:06:59.735354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109975+0000","last_change":"2023-12-19T16:06:58.308334+0000","last_active":"2023-12-19T16:07:01.109975+0000","last_peered":"2023-12-19T16:07:01.109975+0000","last_clean":"2023-12-19T16:07:01.109975+0000","last_became_active":"2023-12-19T16:06:58.307997+0000","last_became_peered":"2023-12-19T16:06:58.307997+0000","last_unstale":"2023-12-19T16:07:01.109975+0000","last_undegraded":"2023-12-19T16:07:01.109975+0000","last_fullsized":"2023-12-19T16:07:01.109975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735908+0000","last_change":"2023-12-19T16:06:58.749875+0000","last_active":"2023-12-19T16:06:59.735908+0000","last_peered":"2023-12-19T16:06:59.735908+0000","last_clean":"2023-12-19T16:06:59.735908+0000","last_became_active":"2023-12-19T16:06:58.749604+0000","last_became_peered":"2023-12-19T16:06:58.749604+0000","last_unstale":"2023-12-19T16:06:59.735908+0000","last_undegraded":"2023-12-19T16:06:59.735908+0000","last_fullsized":"2023-12-19T16:06:59.735908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:07.695345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735602+0000","last_change":"2023-12-19T16:06:58.310432+0000","last_active":"2023-12-19T16:06:59.735602+0000","last_peered":"2023-12-19T16:06:59.735602+0000","last_clean":"2023-12-19T16:06:59.735602+0000","last_became_active":"2023-12-19T16:06:58.310052+0000","last_became_peered":"2023-12-19T16:06:58.310052+0000","last_unstale":"2023-12-19T16:06:59.735602+0000","last_undegraded":"2023-12-19T16:06:59.735602+0000","last_fullsized":"2023-12-19T16:06:59.735602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:07.531619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109764+0000","last_change":"2023-12-19T16:06:58.755050+0000","last_active":"2023-12-19T16:07:01.109764+0000","last_peered":"2023-12-19T16:07:01.109764+0000","last_clean":"2023-12-19T16:07:01.109764+0000","last_became_active":"2023-12-19T16:06:58.754666+0000","last_became_peered":"2023-12-19T16:06:58.754666+0000","last_unstale":"2023-12-19T16:07:01.109764+0000","last_undegraded":"2023-12-19T16:07:01.109764+0000","last_fullsized":"2023-12-19T16:07:01.109764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:11.108008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109843+0000","last_change":"2023-12-19T16:06:58.311812+0000","last_active":"2023-12-19T16:07:01.109843+0000","last_peered":"2023-12-19T16:07:01.109843+0000","last_clean":"2023-12-19T16:07:01.109843+0000","last_became_active":"2023-12-19T16:06:58.311423+0000","last_became_peered":"2023-12-19T16:06:58.311423+0000","last_unstale":"2023-12-19T16:07:01.109843+0000","last_undegraded":"2023-12-19T16:07:01.109843+0000","last_fullsized":"2023-12-19T16:07:01.109843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735591+0000","last_change":"2023-12-19T16:06:58.747297+0000","last_active":"2023-12-19T16:06:59.735591+0000","last_peered":"2023-12-19T16:06:59.735591+0000","last_clean":"2023-12-19T16:06:59.735591+0000","last_became_active":"2023-12-19T16:06:58.747025+0000","last_became_peered":"2023-12-19T16:06:58.747025+0000","last_unstale":"2023-12-19T16:06:59.735591+0000","last_undegraded":"2023-12-19T16:06:59.735591+0000","last_fullsized":"2023-12-19T16:06:59.735591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.651770+0000","last_change":"2023-12-19T16:06:58.309515+0000","last_active":"2023-12-19T16:07:01.651770+0000","last_peered":"2023-12-19T16:07:01.651770+0000","last_clean":"2023-12-19T16:07:01.651770+0000","last_became_active":"2023-12-19T16:06:58.309120+0000","last_became_peered":"2023-12-19T16:06:58.309120+0000","last_unstale":"2023-12-19T16:07:01.651770+0000","last_undegraded":"2023-12-19T16:07:01.651770+0000","last_fullsized":"2023-12-19T16:07:01.651770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:06.572806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429995+0000","last_change":"2023-12-19T16:06:58.744382+0000","last_active":"2023-12-19T16:07:00.429995+0000","last_peered":"2023-12-19T16:07:00.429995+0000","last_clean":"2023-12-19T16:07:00.429995+0000","last_became_active":"2023-12-19T16:06:58.744125+0000","last_became_peered":"2023-12-19T16:06:58.744125+0000","last_unstale":"2023-12-19T16:07:00.429995+0000","last_undegraded":"2023-12-19T16:07:00.429995+0000","last_fullsized":"2023-12-19T16:07:00.429995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:17.210206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594111+0000","last_change":"2023-12-19T16:06:58.306697+0000","last_active":"2023-12-19T16:07:00.594111+0000","last_peered":"2023-12-19T16:07:00.594111+0000","last_clean":"2023-12-19T16:07:00.594111+0000","last_became_active":"2023-12-19T16:06:58.306411+0000","last_became_peered":"2023-12-19T16:06:58.306411+0000","last_unstale":"2023-12-19T16:07:00.594111+0000","last_undegraded":"2023-12-19T16:07:00.594111+0000","last_fullsized":"2023-12-19T16:07:00.594111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466265+0000","last_change":"2023-12-19T16:06:58.749375+0000","last_active":"2023-12-19T16:07:00.466265+0000","last_peered":"2023-12-19T16:07:00.466265+0000","last_clean":"2023-12-19T16:07:00.466265+0000","last_became_active":"2023-12-19T16:06:58.749123+0000","last_became_peered":"2023-12-19T16:06:58.749123+0000","last_unstale":"2023-12-19T16:07:00.466265+0000","last_undegraded":"2023-12-19T16:07:00.466265+0000","last_fullsized":"2023-12-19T16:07:00.466265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109074+0000","last_change":"2023-12-19T16:06:58.311689+0000","last_active":"2023-12-19T16:07:01.109074+0000","last_peered":"2023-12-19T16:07:01.109074+0000","last_clean":"2023-12-19T16:07:01.109074+0000","last_became_active":"2023-12-19T16:06:58.311443+0000","last_became_peered":"2023-12-19T16:06:58.311443+0000","last_unstale":"2023-12-19T16:07:01.109074+0000","last_undegraded":"2023-12-19T16:07:01.109074+0000","last_fullsized":"2023-12-19T16:07:01.109074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:16.318865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735579+0000","last_change":"2023-12-19T16:06:58.737013+0000","last_active":"2023-12-19T16:06:59.735579+0000","last_peered":"2023-12-19T16:06:59.735579+0000","last_clean":"2023-12-19T16:06:59.735579+0000","last_became_active":"2023-12-19T16:06:58.736732+0000","last_became_peered":"2023-12-19T16:06:58.736732+0000","last_unstale":"2023-12-19T16:06:59.735579+0000","last_undegraded":"2023-12-19T16:06:59.735579+0000","last_fullsized":"2023-12-19T16:06:59.735579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:08.536543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735494+0000","last_change":"2023-12-19T16:06:58.311956+0000","last_active":"2023-12-19T16:06:59.735494+0000","last_peered":"2023-12-19T16:06:59.735494+0000","last_clean":"2023-12-19T16:06:59.735494+0000","last_became_active":"2023-12-19T16:06:58.311426+0000","last_became_peered":"2023-12-19T16:06:58.311426+0000","last_unstale":"2023-12-19T16:06:59.735494+0000","last_undegraded":"2023-12-19T16:06:59.735494+0000","last_fullsized":"2023-12-19T16:06:59.735494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429662+0000","last_change":"2023-12-19T16:06:58.751593+0000","last_active":"2023-12-19T16:07:00.429662+0000","last_peered":"2023-12-19T16:07:00.429662+0000","last_clean":"2023-12-19T16:07:00.429662+0000","last_became_active":"2023-12-19T16:06:58.751335+0000","last_became_peered":"2023-12-19T16:06:58.751335+0000","last_unstale":"2023-12-19T16:07:00.429662+0000","last_undegraded":"2023-12-19T16:07:00.429662+0000","last_fullsized":"2023-12-19T16:07:00.429662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735607+0000","last_change":"2023-12-19T16:06:58.310478+0000","last_active":"2023-12-19T16:06:59.735607+0000","last_peered":"2023-12-19T16:06:59.735607+0000","last_clean":"2023-12-19T16:06:59.735607+0000","last_became_active":"2023-12-19T16:06:58.310172+0000","last_became_peered":"2023-12-19T16:06:58.310172+0000","last_unstale":"2023-12-19T16:06:59.735607+0000","last_undegraded":"2023-12-19T16:06:59.735607+0000","last_fullsized":"2023-12-19T16:06:59.735607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429817+0000","last_change":"2023-12-19T16:06:58.745013+0000","last_active":"2023-12-19T16:07:00.429817+0000","last_peered":"2023-12-19T16:07:00.429817+0000","last_clean":"2023-12-19T16:07:00.429817+0000","last_became_active":"2023-12-19T16:06:58.744739+0000","last_became_peered":"2023-12-19T16:06:58.744739+0000","last_unstale":"2023-12-19T16:07:00.429817+0000","last_undegraded":"2023-12-19T16:07:00.429817+0000","last_fullsized":"2023-12-19T16:07:00.429817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:59:45.402539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109787+0000","last_change":"2023-12-19T16:06:58.314931+0000","last_active":"2023-12-19T16:07:01.109787+0000","last_peered":"2023-12-19T16:07:01.109787+0000","last_clean":"2023-12-19T16:07:01.109787+0000","last_became_active":"2023-12-19T16:06:58.314637+0000","last_became_peered":"2023-12-19T16:06:58.314637+0000","last_unstale":"2023-12-19T16:07:01.109787+0000","last_undegraded":"2023-12-19T16:07:01.109787+0000","last_fullsized":"2023-12-19T16:07:01.109787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593737+0000","last_change":"2023-12-19T16:06:58.753329+0000","last_active":"2023-12-19T16:07:00.593737+0000","last_peered":"2023-12-19T16:07:00.593737+0000","last_clean":"2023-12-19T16:07:00.593737+0000","last_became_active":"2023-12-19T16:06:58.749183+0000","last_became_peered":"2023-12-19T16:06:58.749183+0000","last_unstale":"2023-12-19T16:07:00.593737+0000","last_undegraded":"2023-12-19T16:07:00.593737+0000","last_fullsized":"2023-12-19T16:07:00.593737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109649+0000","last_change":"2023-12-19T16:06:58.751468+0000","last_active":"2023-12-19T16:07:01.109649+0000","last_peered":"2023-12-19T16:07:01.109649+0000","last_clean":"2023-12-19T16:07:01.109649+0000","last_became_active":"2023-12-19T16:06:58.750502+0000","last_became_peered":"2023-12-19T16:06:58.750502+0000","last_unstale":"2023-12-19T16:07:01.109649+0000","last_undegraded":"2023-12-19T16:07:01.109649+0000","last_fullsized":"2023-12-19T16:07:01.109649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:59:45.402539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109568+0000","last_change":"2023-12-19T16:06:58.311983+0000","last_active":"2023-12-19T16:07:01.109568+0000","last_peered":"2023-12-19T16:07:01.109568+0000","last_clean":"2023-12-19T16:07:01.109568+0000","last_became_active":"2023-12-19T16:06:58.311706+0000","last_became_peered":"2023-12-19T16:06:58.311706+0000","last_unstale":"2023-12-19T16:07:01.109568+0000","last_undegraded":"2023-12-19T16:07:01.109568+0000","last_fullsized":"2023-12-19T16:07:01.109568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:55.716735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109940+0000","last_change":"2023-12-19T16:06:58.751294+0000","last_active":"2023-12-19T16:07:01.109940+0000","last_peered":"2023-12-19T16:07:01.109940+0000","last_clean":"2023-12-19T16:07:01.109940+0000","last_became_active":"2023-12-19T16:06:58.751039+0000","last_became_peered":"2023-12-19T16:06:58.751039+0000","last_unstale":"2023-12-19T16:07:01.109940+0000","last_undegraded":"2023-12-19T16:07:01.109940+0000","last_fullsized":"2023-12-19T16:07:01.109940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:08:43.126506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109669+0000","last_change":"2023-12-19T16:06:58.309418+0000","last_active":"2023-12-19T16:07:01.109669+0000","last_peered":"2023-12-19T16:07:01.109669+0000","last_clean":"2023-12-19T16:07:01.109669+0000","last_became_active":"2023-12-19T16:06:58.309108+0000","last_became_peered":"2023-12-19T16:06:58.309108+0000","last_unstale":"2023-12-19T16:07:01.109669+0000","last_undegraded":"2023-12-19T16:07:01.109669+0000","last_fullsized":"2023-12-19T16:07:01.109669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:06.572806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466323+0000","last_change":"2023-12-19T16:06:58.755879+0000","last_active":"2023-12-19T16:07:00.466323+0000","last_peered":"2023-12-19T16:07:00.466323+0000","last_clean":"2023-12-19T16:07:00.466323+0000","last_became_active":"2023-12-19T16:06:58.755019+0000","last_became_peered":"2023-12-19T16:06:58.755019+0000","last_unstale":"2023-12-19T16:07:00.466323+0000","last_undegraded":"2023-12-19T16:07:00.466323+0000","last_fullsized":"2023-12-19T16:07:00.466323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.430019+0000","last_change":"2023-12-19T16:06:58.308088+0000","last_active":"2023-12-19T16:07:00.430019+0000","last_peered":"2023-12-19T16:07:00.430019+0000","last_clean":"2023-12-19T16:07:00.430019+0000","last_became_active":"2023-12-19T16:06:58.307702+0000","last_became_peered":"2023-12-19T16:06:58.307702+0000","last_unstale":"2023-12-19T16:07:00.430019+0000","last_undegraded":"2023-12-19T16:07:00.430019+0000","last_fullsized":"2023-12-19T16:07:00.430019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429908+0000","last_change":"2023-12-19T16:06:58.745962+0000","last_active":"2023-12-19T16:07:00.429908+0000","last_peered":"2023-12-19T16:07:00.429908+0000","last_clean":"2023-12-19T16:07:00.429908+0000","last_became_active":"2023-12-19T16:06:58.745668+0000","last_became_peered":"2023-12-19T16:06:58.745668+0000","last_unstale":"2023-12-19T16:07:00.429908+0000","last_undegraded":"2023-12-19T16:07:00.429908+0000","last_fullsized":"2023-12-19T16:07:00.429908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466374+0000","last_change":"2023-12-19T16:06:58.307135+0000","last_active":"2023-12-19T16:07:00.466374+0000","last_peered":"2023-12-19T16:07:00.466374+0000","last_clean":"2023-12-19T16:07:00.466374+0000","last_became_active":"2023-12-19T16:06:58.306810+0000","last_became_peered":"2023-12-19T16:06:58.306810+0000","last_unstale":"2023-12-19T16:07:00.466374+0000","last_undegraded":"2023-12-19T16:07:00.466374+0000","last_fullsized":"2023-12-19T16:07:00.466374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:35.961254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:07:11.136 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:07:11.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.273+0000 7f94c853e640 1 Processor -- start 2023-12-19T16:07:11.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.273+0000 7f94c853e640 1 -- start start 2023-12-19T16:07:11.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.274+0000 7f94c853e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f94c00bcdd0 0x7f94c00b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:11.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.274+0000 7f94c853e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c00bc6b0 con 0x7f94c00b64c0 2023-12-19T16:07:11.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.274+0000 7f94c853e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c00b6900 con 0x7f94c0144ea0 2023-12-19T16:07:11.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.274+0000 7f94c853e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c00a59f0 con 0x7f94c00bcdd0 2023-12-19T16:07:11.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.274+0000 7f94c62da640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f94c00bcdd0 0x7f94c00b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:11.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.274+0000 7f94c5ad9640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f94c00b64c0 0x7f94c0144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46454/0 (socket says 172.21.15.37:46454) 2023-12-19T16:07:11.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.274+0000 7f94c62da640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f94c00bcdd0 0x7f94c00b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47758/0 (socket says 172.21.15.37:47758) 2023-12-19T16:07:11.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.274+0000 7f94c5ad9640 1 -- 172.21.15.37:0/1766959537 learned_addr learned my addr 172.21.15.37:0/1766959537 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:11.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.274+0000 7f94c62da640 1 -- 172.21.15.37:0/1766959537 >> v1:172.21.15.78:6789/0 conn(0x7f94c0144ea0 legacy=0x7f94c0155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:11.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.274+0000 7f94c62da640 1 -- 172.21.15.37:0/1766959537 >> v1:172.21.15.37:6789/0 conn(0x7f94c00b64c0 legacy=0x7f94c0144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:11.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.274+0000 7f94c52d8640 1 -- 172.21.15.37:0/1766959537 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706220166 0 0) 0x7f94c00bc6b0 con 0x7f94c00b64c0 2023-12-19T16:07:11.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.274+0000 7f94c62da640 1 -- 172.21.15.37:0/1766959537 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c00bc0a0 con 0x7f94c00bcdd0 2023-12-19T16:07:11.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.275+0000 7f94c62da640 1 --2- 172.21.15.37:0/1766959537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94c00bcdd0 0x7f94c00b5f80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f94b80097a0 tx=0x7f94b802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb8a2325c612873 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:11.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.275+0000 7f94c52d8640 1 -- 172.21.15.37:0/1766959537 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b802f810 con 0x7f94c00bcdd0 2023-12-19T16:07:11.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.275+0000 7f94c52d8640 1 -- 172.21.15.37:0/1766959537 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b802f970 con 0x7f94c00bcdd0 2023-12-19T16:07:11.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.275+0000 7f94c52d8640 1 -- 172.21.15.37:0/1766959537 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b802fd00 con 0x7f94c00bcdd0 2023-12-19T16:07:11.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.276+0000 7f94c853e640 1 -- 172.21.15.37:0/1766959537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94c00bcdd0 msgr2=0x7f94c00b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:11.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.276+0000 7f94c853e640 1 --2- 172.21.15.37:0/1766959537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94c00bcdd0 0x7f94c00b5f80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f94b80097a0 tx=0x7f94b802b9f0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.276+0000 7f94c853e640 1 -- 172.21.15.37:0/1766959537 shutdown_connections 2023-12-19T16:07:11.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.276+0000 7f94c853e640 1 --2- 172.21.15.37:0/1766959537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94c00bcdd0 0x7f94c00b5f80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.276+0000 7f94c853e640 1 -- 172.21.15.37:0/1766959537 >> 172.21.15.37:0/1766959537 conn(0x7f94c0071e60 msgr2=0x7f94c00c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.276+0000 7f94c853e640 1 -- 172.21.15.37:0/1766959537 shutdown_connections 2023-12-19T16:07:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.276+0000 7f94c853e640 1 -- 172.21.15.37:0/1766959537 wait complete. 2023-12-19T16:07:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.277+0000 7f94c853e640 1 Processor -- start 2023-12-19T16:07:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.277+0000 7f94c853e640 1 -- start start 2023-12-19T16:07:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c853e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c00b64c0 0x7f94c00bb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c853e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94c00bcdd0 0x7f94c01d4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c853e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94c0144ea0 0x7f94c01dfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c853e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c00bb560 con 0x7f94c0144ea0 2023-12-19T16:07:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c853e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c01d4ea0 con 0x7f94c00b64c0 2023-12-19T16:07:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c853e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c0145a70 con 0x7f94c00bcdd0 2023-12-19T16:07:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c6adb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94c0144ea0 0x7f94c01dfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c6adb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94c0144ea0 0x7f94c01dfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47760/0 (socket says 172.21.15.37:47760) 2023-12-19T16:07:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c6adb640 1 -- 172.21.15.37:0/3756509598 learned_addr learned my addr 172.21.15.37:0/3756509598 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c62da640 1 --2- 172.21.15.37:0/3756509598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c00b64c0 0x7f94c00bb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c5ad9640 1 --2- 172.21.15.37:0/3756509598 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94c00bcdd0 0x7f94c01d4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c6adb640 1 -- 172.21.15.37:0/3756509598 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94c00bcdd0 msgr2=0x7f94c01d4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c6adb640 1 --2- 172.21.15.37:0/3756509598 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94c00bcdd0 0x7f94c01d4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c6adb640 1 -- 172.21.15.37:0/3756509598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c00b64c0 msgr2=0x7f94c00bb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c6adb640 1 --2- 172.21.15.37:0/3756509598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c00b64c0 0x7f94c00bb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c6adb640 1 -- 172.21.15.37:0/3756509598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b8009400 con 0x7f94c0144ea0 2023-12-19T16:07:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c62da640 1 --2- 172.21.15.37:0/3756509598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c00b64c0 0x7f94c00bb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:11.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c6adb640 1 --2- 172.21.15.37:0/3756509598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94c0144ea0 0x7f94c01dfb80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f94b000c6e0 tx=0x7f94b000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94beffd640 1 -- 172.21.15.37:0/3756509598 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0003b70 con 0x7f94c0144ea0 2023-12-19T16:07:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94beffd640 1 -- 172.21.15.37:0/3756509598 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b0003cf0 con 0x7f94c0144ea0 2023-12-19T16:07:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c853e640 1 -- 172.21.15.37:0/3756509598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c01d4550 con 0x7f94c0144ea0 2023-12-19T16:07:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94beffd640 1 -- 172.21.15.37:0/3756509598 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0005310 con 0x7f94c0144ea0 2023-12-19T16:07:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.278+0000 7f94c853e640 1 -- 172.21.15.37:0/3756509598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c0145790 con 0x7f94c0144ea0 2023-12-19T16:07:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.279+0000 7f94c853e640 1 -- 172.21.15.37:0/3756509598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c004e840 con 0x7f94c0144ea0 2023-12-19T16:07:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.280+0000 7f94beffd640 1 -- 172.21.15.37:0/3756509598 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f94b0005470 con 0x7f94c0144ea0 2023-12-19T16:07:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.280+0000 7f94beffd640 1 --2- 172.21.15.37:0/3756509598 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f94ac06a460 0x7f94ac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.280+0000 7f94beffd640 1 -- 172.21.15.37:0/3756509598 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94b00886a0 con 0x7f94c0144ea0 2023-12-19T16:07:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.280+0000 7f94c62da640 1 --2- 172.21.15.37:0/3756509598 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f94ac06a460 0x7f94ac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.281+0000 7f94c62da640 1 --2- 172.21.15.37:0/3756509598 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f94ac06a460 0x7f94ac06c920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f94b8036000 tx=0x7f94b8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.284+0000 7f94beffd640 1 -- 172.21.15.37:0/3756509598 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f94b0053c80 con 0x7f94c0144ea0 2023-12-19T16:07:11.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.461+0000 7f94c853e640 1 -- 172.21.15.37:0/3756509598 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94c00b5500 con 0x7f94ac06a460 2023-12-19T16:07:11.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.468+0000 7f94beffd640 1 -- 172.21.15.37:0/3756509598 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264522 (secure 0 0 0) 0x7f94b802fc60 con 0x7f94ac06a460 2023-12-19T16:07:11.473 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:11.474 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-19T16:07:11.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.471+0000 7f94c853e640 1 -- 172.21.15.37:0/3756509598 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f94ac06a460 msgr2=0x7f94ac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:11.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.471+0000 7f94c853e640 1 --2- 172.21.15.37:0/3756509598 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f94ac06a460 0x7f94ac06c920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f94b8036000 tx=0x7f94b8008030 comp rx=0 tx=0).stop 2023-12-19T16:07:11.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.471+0000 7f94c853e640 1 -- 172.21.15.37:0/3756509598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94c0144ea0 msgr2=0x7f94c01dfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:11.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.471+0000 7f94c853e640 1 --2- 172.21.15.37:0/3756509598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94c0144ea0 0x7f94c01dfb80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f94b000c6e0 tx=0x7f94b000cba0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.471+0000 7f94c853e640 1 -- 172.21.15.37:0/3756509598 shutdown_connections 2023-12-19T16:07:11.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.471+0000 7f94c853e640 1 --2- 172.21.15.37:0/3756509598 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f94ac06a460 0x7f94ac06c920 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.471+0000 7f94c853e640 1 --2- 172.21.15.37:0/3756509598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94c0144ea0 0x7f94c01dfb80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.471+0000 7f94c853e640 1 --2- 172.21.15.37:0/3756509598 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94c00bcdd0 0x7f94c01d4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.471+0000 7f94c853e640 1 --2- 172.21.15.37:0/3756509598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94c00b64c0 0x7f94c00bb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.471+0000 7f94c853e640 1 -- 172.21.15.37:0/3756509598 >> 172.21.15.37:0/3756509598 conn(0x7f94c0071e60 msgr2=0x7f94c0140750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:11.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.471+0000 7f94c853e640 1 -- 172.21.15.37:0/3756509598 shutdown_connections 2023-12-19T16:07:11.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.471+0000 7f94c853e640 1 -- 172.21.15.37:0/3756509598 wait complete. 2023-12-19T16:07:11.484 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-12-19T16:07:10.633970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218440,"kb_used_data":2824,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756280,"statfs":{"total":773094113280,"available":772870430720,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.900443"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109838+0000","last_change":"2023-12-19T16:06:58.760625+0000","last_active":"2023-12-19T16:07:01.109838+0000","last_peered":"2023-12-19T16:07:01.109838+0000","last_clean":"2023-12-19T16:07:01.109838+0000","last_became_active":"2023-12-19T16:06:58.760229+0000","last_became_peered":"2023-12-19T16:06:58.760229+0000","last_unstale":"2023-12-19T16:07:01.109838+0000","last_undegraded":"2023-12-19T16:07:01.109838+0000","last_fullsized":"2023-12-19T16:07:01.109838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735747+0000","last_change":"2023-12-19T16:06:58.749173+0000","last_active":"2023-12-19T16:06:59.735747+0000","last_peered":"2023-12-19T16:06:59.735747+0000","last_clean":"2023-12-19T16:06:59.735747+0000","last_became_active":"2023-12-19T16:06:58.748736+0000","last_became_peered":"2023-12-19T16:06:58.748736+0000","last_unstale":"2023-12-19T16:06:59.735747+0000","last_undegraded":"2023-12-19T16:06:59.735747+0000","last_fullsized":"2023-12-19T16:06:59.735747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466127+0000","last_change":"2023-12-19T16:06:58.738858+0000","last_active":"2023-12-19T16:07:00.466127+0000","last_peered":"2023-12-19T16:07:00.466127+0000","last_clean":"2023-12-19T16:07:00.466127+0000","last_became_active":"2023-12-19T16:06:58.738178+0000","last_became_peered":"2023-12-19T16:06:58.738178+0000","last_unstale":"2023-12-19T16:07:00.466127+0000","last_undegraded":"2023-12-19T16:07:00.466127+0000","last_fullsized":"2023-12-19T16:07:00.466127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109498+0000","last_change":"2023-12-19T16:06:58.754766+0000","last_active":"2023-12-19T16:07:01.109498+0000","last_peered":"2023-12-19T16:07:01.109498+0000","last_clean":"2023-12-19T16:07:01.109498+0000","last_became_active":"2023-12-19T16:06:58.754289+0000","last_became_peered":"2023-12-19T16:06:58.754289+0000","last_unstale":"2023-12-19T16:07:01.109498+0000","last_undegraded":"2023-12-19T16:07:01.109498+0000","last_fullsized":"2023-12-19T16:07:01.109498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:26:37.888389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109413+0000","last_change":"2023-12-19T16:06:58.743609+0000","last_active":"2023-12-19T16:07:01.109413+0000","last_peered":"2023-12-19T16:07:01.109413+0000","last_clean":"2023-12-19T16:07:01.109413+0000","last_became_active":"2023-12-19T16:06:58.743331+0000","last_became_peered":"2023-12-19T16:06:58.743331+0000","last_unstale":"2023-12-19T16:07:01.109413+0000","last_undegraded":"2023-12-19T16:07:01.109413+0000","last_fullsized":"2023-12-19T16:07:01.109413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:11.108008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109102+0000","last_change":"2023-12-19T16:06:58.752778+0000","last_active":"2023-12-19T16:07:01.109102+0000","last_peered":"2023-12-19T16:07:01.109102+0000","last_clean":"2023-12-19T16:07:01.109102+0000","last_became_active":"2023-12-19T16:06:58.752519+0000","last_became_peered":"2023-12-19T16:06:58.752519+0000","last_unstale":"2023-12-19T16:07:01.109102+0000","last_undegraded":"2023-12-19T16:07:01.109102+0000","last_fullsized":"2023-12-19T16:07:01.109102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:17.210206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109322+0000","last_change":"2023-12-19T16:06:58.748834+0000","last_active":"2023-12-19T16:07:01.109322+0000","last_peered":"2023-12-19T16:07:01.109322+0000","last_clean":"2023-12-19T16:07:01.109322+0000","last_became_active":"2023-12-19T16:06:58.748039+0000","last_became_peered":"2023-12-19T16:06:58.748039+0000","last_unstale":"2023-12-19T16:07:01.109322+0000","last_undegraded":"2023-12-19T16:07:01.109322+0000","last_fullsized":"2023-12-19T16:07:01.109322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:26:37.888389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429554+0000","last_change":"2023-12-19T16:06:58.754746+0000","last_active":"2023-12-19T16:07:00.429554+0000","last_peered":"2023-12-19T16:07:00.429554+0000","last_clean":"2023-12-19T16:07:00.429554+0000","last_became_active":"2023-12-19T16:06:58.754477+0000","last_became_peered":"2023-12-19T16:06:58.754477+0000","last_unstale":"2023-12-19T16:07:00.429554+0000","last_undegraded":"2023-12-19T16:07:00.429554+0000","last_fullsized":"2023-12-19T16:07:00.429554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:02.578194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109955+0000","last_change":"2023-12-19T16:06:58.755823+0000","last_active":"2023-12-19T16:07:01.109955+0000","last_peered":"2023-12-19T16:07:01.109955+0000","last_clean":"2023-12-19T16:07:01.109955+0000","last_became_active":"2023-12-19T16:06:58.755519+0000","last_became_peered":"2023-12-19T16:06:58.755519+0000","last_unstale":"2023-12-19T16:07:01.109955+0000","last_undegraded":"2023-12-19T16:07:01.109955+0000","last_fullsized":"2023-12-19T16:07:01.109955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:17.210206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594076+0000","last_change":"2023-12-19T16:06:58.757791+0000","last_active":"2023-12-19T16:07:00.594076+0000","last_peered":"2023-12-19T16:07:00.594076+0000","last_clean":"2023-12-19T16:07:00.594076+0000","last_became_active":"2023-12-19T16:06:58.757519+0000","last_became_peered":"2023-12-19T16:06:58.757519+0000","last_unstale":"2023-12-19T16:07:00.594076+0000","last_undegraded":"2023-12-19T16:07:00.594076+0000","last_fullsized":"2023-12-19T16:07:00.594076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593880+0000","last_change":"2023-12-19T16:06:58.757323+0000","last_active":"2023-12-19T16:07:00.593880+0000","last_peered":"2023-12-19T16:07:00.593880+0000","last_clean":"2023-12-19T16:07:00.593880+0000","last_became_active":"2023-12-19T16:06:58.757070+0000","last_became_peered":"2023-12-19T16:06:58.757070+0000","last_unstale":"2023-12-19T16:07:00.593880+0000","last_undegraded":"2023-12-19T16:07:00.593880+0000","last_fullsized":"2023-12-19T16:07:00.593880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735789+0000","last_change":"2023-12-19T16:06:58.748826+0000","last_active":"2023-12-19T16:06:59.735789+0000","last_peered":"2023-12-19T16:06:59.735789+0000","last_clean":"2023-12-19T16:06:59.735789+0000","last_became_active":"2023-12-19T16:06:58.748455+0000","last_became_peered":"2023-12-19T16:06:58.748455+0000","last_unstale":"2023-12-19T16:06:59.735789+0000","last_undegraded":"2023-12-19T16:06:59.735789+0000","last_fullsized":"2023-12-19T16:06:59.735789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:45:54.216383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429773+0000","last_change":"2023-12-19T16:06:58.746487+0000","last_active":"2023-12-19T16:07:00.429773+0000","last_peered":"2023-12-19T16:07:00.429773+0000","last_clean":"2023-12-19T16:07:00.429773+0000","last_became_active":"2023-12-19T16:06:58.746251+0000","last_became_peered":"2023-12-19T16:06:58.746251+0000","last_unstale":"2023-12-19T16:07:00.429773+0000","last_undegraded":"2023-12-19T16:07:00.429773+0000","last_fullsized":"2023-12-19T16:07:00.429773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.465948+0000","last_change":"2023-12-19T16:06:58.749166+0000","last_active":"2023-12-19T16:07:00.465948+0000","last_peered":"2023-12-19T16:07:00.465948+0000","last_clean":"2023-12-19T16:07:00.465948+0000","last_became_active":"2023-12-19T16:06:58.748884+0000","last_became_peered":"2023-12-19T16:06:58.748884+0000","last_unstale":"2023-12-19T16:07:00.465948+0000","last_undegraded":"2023-12-19T16:07:00.465948+0000","last_fullsized":"2023-12-19T16:07:00.465948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735398+0000","last_change":"2023-12-19T16:06:58.744455+0000","last_active":"2023-12-19T16:06:59.735398+0000","last_peered":"2023-12-19T16:06:59.735398+0000","last_clean":"2023-12-19T16:06:59.735398+0000","last_became_active":"2023-12-19T16:06:58.744204+0000","last_became_peered":"2023-12-19T16:06:58.744204+0000","last_unstale":"2023-12-19T16:06:59.735398+0000","last_undegraded":"2023-12-19T16:06:59.735398+0000","last_fullsized":"2023-12-19T16:06:59.735398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109012+0000","last_change":"2023-12-19T16:06:58.751725+0000","last_active":"2023-12-19T16:07:01.109012+0000","last_peered":"2023-12-19T16:07:01.109012+0000","last_clean":"2023-12-19T16:07:01.109012+0000","last_became_active":"2023-12-19T16:06:58.751476+0000","last_became_peered":"2023-12-19T16:06:58.751476+0000","last_unstale":"2023-12-19T16:07:01.109012+0000","last_undegraded":"2023-12-19T16:07:01.109012+0000","last_fullsized":"2023-12-19T16:07:01.109012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:49.465099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109749+0000","last_change":"2023-12-19T16:06:58.752816+0000","last_active":"2023-12-19T16:07:01.109749+0000","last_peered":"2023-12-19T16:07:01.109749+0000","last_clean":"2023-12-19T16:07:01.109749+0000","last_became_active":"2023-12-19T16:06:58.752475+0000","last_became_peered":"2023-12-19T16:06:58.752475+0000","last_unstale":"2023-12-19T16:07:01.109749+0000","last_undegraded":"2023-12-19T16:07:01.109749+0000","last_fullsized":"2023-12-19T16:07:01.109749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736208+0000","last_change":"2023-12-19T16:06:58.745867+0000","last_active":"2023-12-19T16:06:59.736208+0000","last_peered":"2023-12-19T16:06:59.736208+0000","last_clean":"2023-12-19T16:06:59.736208+0000","last_became_active":"2023-12-19T16:06:58.745603+0000","last_became_peered":"2023-12-19T16:06:58.745603+0000","last_unstale":"2023-12-19T16:06:59.736208+0000","last_undegraded":"2023-12-19T16:06:59.736208+0000","last_fullsized":"2023-12-19T16:06:59.736208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:45:54.216383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109763+0000","last_change":"2023-12-19T16:06:58.744080+0000","last_active":"2023-12-19T16:07:01.109763+0000","last_peered":"2023-12-19T16:07:01.109763+0000","last_clean":"2023-12-19T16:07:01.109763+0000","last_became_active":"2023-12-19T16:06:58.743129+0000","last_became_peered":"2023-12-19T16:06:58.743129+0000","last_unstale":"2023-12-19T16:07:01.109763+0000","last_undegraded":"2023-12-19T16:07:01.109763+0000","last_fullsized":"2023-12-19T16:07:01.109763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593848+0000","last_change":"2023-12-19T16:06:58.754725+0000","last_active":"2023-12-19T16:07:00.593848+0000","last_peered":"2023-12-19T16:07:00.593848+0000","last_clean":"2023-12-19T16:07:00.593848+0000","last_became_active":"2023-12-19T16:06:58.754476+0000","last_became_peered":"2023-12-19T16:06:58.754476+0000","last_unstale":"2023-12-19T16:07:00.593848+0000","last_undegraded":"2023-12-19T16:07:00.593848+0000","last_fullsized":"2023-12-19T16:07:00.593848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466100+0000","last_change":"2023-12-19T16:06:58.744917+0000","last_active":"2023-12-19T16:07:00.466100+0000","last_peered":"2023-12-19T16:07:00.466100+0000","last_clean":"2023-12-19T16:07:00.466100+0000","last_became_active":"2023-12-19T16:06:58.744663+0000","last_became_peered":"2023-12-19T16:06:58.744663+0000","last_unstale":"2023-12-19T16:07:00.466100+0000","last_undegraded":"2023-12-19T16:07:00.466100+0000","last_fullsized":"2023-12-19T16:07:00.466100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109326+0000","last_change":"2023-12-19T16:06:58.752295+0000","last_active":"2023-12-19T16:07:01.109326+0000","last_peered":"2023-12-19T16:07:01.109326+0000","last_clean":"2023-12-19T16:07:01.109326+0000","last_became_active":"2023-12-19T16:06:58.752030+0000","last_became_peered":"2023-12-19T16:06:58.752030+0000","last_unstale":"2023-12-19T16:07:01.109326+0000","last_undegraded":"2023-12-19T16:07:01.109326+0000","last_fullsized":"2023-12-19T16:07:01.109326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:02.578194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429607+0000","last_change":"2023-12-19T16:06:58.737261+0000","last_active":"2023-12-19T16:07:00.429607+0000","last_peered":"2023-12-19T16:07:00.429607+0000","last_clean":"2023-12-19T16:07:00.429607+0000","last_became_active":"2023-12-19T16:06:58.736978+0000","last_became_peered":"2023-12-19T16:06:58.736978+0000","last_unstale":"2023-12-19T16:07:00.429607+0000","last_undegraded":"2023-12-19T16:07:00.429607+0000","last_fullsized":"2023-12-19T16:07:00.429607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109099+0000","last_change":"2023-12-19T16:06:58.751235+0000","last_active":"2023-12-19T16:07:01.109099+0000","last_peered":"2023-12-19T16:07:01.109099+0000","last_clean":"2023-12-19T16:07:01.109099+0000","last_became_active":"2023-12-19T16:06:58.750410+0000","last_became_peered":"2023-12-19T16:06:58.750410+0000","last_unstale":"2023-12-19T16:07:01.109099+0000","last_undegraded":"2023-12-19T16:07:01.109099+0000","last_fullsized":"2023-12-19T16:07:01.109099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:56:59.199473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429968+0000","last_change":"2023-12-19T16:06:58.744478+0000","last_active":"2023-12-19T16:07:00.429968+0000","last_peered":"2023-12-19T16:07:00.429968+0000","last_clean":"2023-12-19T16:07:00.429968+0000","last_became_active":"2023-12-19T16:06:58.742838+0000","last_became_peered":"2023-12-19T16:06:58.742838+0000","last_unstale":"2023-12-19T16:07:00.429968+0000","last_undegraded":"2023-12-19T16:07:00.429968+0000","last_fullsized":"2023-12-19T16:07:00.429968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594088+0000","last_change":"2023-12-19T16:06:58.746043+0000","last_active":"2023-12-19T16:07:00.594088+0000","last_peered":"2023-12-19T16:07:00.594088+0000","last_clean":"2023-12-19T16:07:00.594088+0000","last_became_active":"2023-12-19T16:06:58.745779+0000","last_became_peered":"2023-12-19T16:06:58.745779+0000","last_unstale":"2023-12-19T16:07:00.594088+0000","last_undegraded":"2023-12-19T16:07:00.594088+0000","last_fullsized":"2023-12-19T16:07:00.594088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:04.102120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735628+0000","last_change":"2023-12-19T16:06:58.749441+0000","last_active":"2023-12-19T16:06:59.735628+0000","last_peered":"2023-12-19T16:06:59.735628+0000","last_clean":"2023-12-19T16:06:59.735628+0000","last_became_active":"2023-12-19T16:06:58.748234+0000","last_became_peered":"2023-12-19T16:06:58.748234+0000","last_unstale":"2023-12-19T16:06:59.735628+0000","last_undegraded":"2023-12-19T16:06:59.735628+0000","last_fullsized":"2023-12-19T16:06:59.735628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:14.166660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429935+0000","last_change":"2023-12-19T16:06:58.744976+0000","last_active":"2023-12-19T16:07:00.429935+0000","last_peered":"2023-12-19T16:07:00.429935+0000","last_clean":"2023-12-19T16:07:00.429935+0000","last_became_active":"2023-12-19T16:06:58.744731+0000","last_became_peered":"2023-12-19T16:06:58.744731+0000","last_unstale":"2023-12-19T16:07:00.429935+0000","last_undegraded":"2023-12-19T16:07:00.429935+0000","last_fullsized":"2023-12-19T16:07:00.429935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466162+0000","last_change":"2023-12-19T16:06:58.748370+0000","last_active":"2023-12-19T16:07:00.466162+0000","last_peered":"2023-12-19T16:07:00.466162+0000","last_clean":"2023-12-19T16:07:00.466162+0000","last_became_active":"2023-12-19T16:06:58.748079+0000","last_became_peered":"2023-12-19T16:06:58.748079+0000","last_unstale":"2023-12-19T16:07:00.466162+0000","last_undegraded":"2023-12-19T16:07:00.466162+0000","last_fullsized":"2023-12-19T16:07:00.466162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109837+0000","last_change":"2023-12-19T16:06:58.751906+0000","last_active":"2023-12-19T16:07:01.109837+0000","last_peered":"2023-12-19T16:07:01.109837+0000","last_clean":"2023-12-19T16:07:01.109837+0000","last_became_active":"2023-12-19T16:06:58.750803+0000","last_became_peered":"2023-12-19T16:06:58.750803+0000","last_unstale":"2023-12-19T16:07:01.109837+0000","last_undegraded":"2023-12-19T16:07:01.109837+0000","last_fullsized":"2023-12-19T16:07:01.109837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:34:52.231787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736199+0000","last_change":"2023-12-19T16:06:58.753386+0000","last_active":"2023-12-19T16:06:59.736199+0000","last_peered":"2023-12-19T16:06:59.736199+0000","last_clean":"2023-12-19T16:06:59.736199+0000","last_became_active":"2023-12-19T16:06:58.753213+0000","last_became_peered":"2023-12-19T16:06:58.753213+0000","last_unstale":"2023-12-19T16:06:59.736199+0000","last_undegraded":"2023-12-19T16:06:59.736199+0000","last_fullsized":"2023-12-19T16:06:59.736199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:56.721659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593758+0000","last_change":"2023-12-19T16:06:58.753896+0000","last_active":"2023-12-19T16:07:00.593758+0000","last_peered":"2023-12-19T16:07:00.593758+0000","last_clean":"2023-12-19T16:07:00.593758+0000","last_became_active":"2023-12-19T16:06:58.753594+0000","last_became_peered":"2023-12-19T16:06:58.753594+0000","last_unstale":"2023-12-19T16:07:00.593758+0000","last_undegraded":"2023-12-19T16:07:00.593758+0000","last_fullsized":"2023-12-19T16:07:00.593758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:08:49.465099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735526+0000","last_change":"2023-12-19T16:06:58.749736+0000","last_active":"2023-12-19T16:06:59.735526+0000","last_peered":"2023-12-19T16:06:59.735526+0000","last_clean":"2023-12-19T16:06:59.735526+0000","last_became_active":"2023-12-19T16:06:58.749468+0000","last_became_peered":"2023-12-19T16:06:58.749468+0000","last_unstale":"2023-12-19T16:06:59.735526+0000","last_undegraded":"2023-12-19T16:06:59.735526+0000","last_fullsized":"2023-12-19T16:06:59.735526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:17.323789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429911+0000","last_change":"2023-12-19T16:06:58.304535+0000","last_active":"2023-12-19T16:07:00.429911+0000","last_peered":"2023-12-19T16:07:00.429911+0000","last_clean":"2023-12-19T16:07:00.429911+0000","last_became_active":"2023-12-19T16:06:58.304271+0000","last_became_peered":"2023-12-19T16:06:58.304271+0000","last_unstale":"2023-12-19T16:07:00.429911+0000","last_undegraded":"2023-12-19T16:07:00.429911+0000","last_fullsized":"2023-12-19T16:07:00.429911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466191+0000","last_change":"2023-12-19T16:06:58.741261+0000","last_active":"2023-12-19T16:07:00.466191+0000","last_peered":"2023-12-19T16:07:00.466191+0000","last_clean":"2023-12-19T16:07:00.466191+0000","last_became_active":"2023-12-19T16:06:58.741000+0000","last_became_peered":"2023-12-19T16:06:58.741000+0000","last_unstale":"2023-12-19T16:07:00.466191+0000","last_undegraded":"2023-12-19T16:07:00.466191+0000","last_fullsized":"2023-12-19T16:07:00.466191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:21:27.003991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593812+0000","last_change":"2023-12-19T16:06:58.304385+0000","last_active":"2023-12-19T16:07:00.593812+0000","last_peered":"2023-12-19T16:07:00.593812+0000","last_clean":"2023-12-19T16:07:00.593812+0000","last_became_active":"2023-12-19T16:06:58.304091+0000","last_became_peered":"2023-12-19T16:06:58.304091+0000","last_unstale":"2023-12-19T16:07:00.593812+0000","last_undegraded":"2023-12-19T16:07:00.593812+0000","last_fullsized":"2023-12-19T16:07:00.593812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429698+0000","last_change":"2023-12-19T16:06:58.305822+0000","last_active":"2023-12-19T16:07:00.429698+0000","last_peered":"2023-12-19T16:07:00.429698+0000","last_clean":"2023-12-19T16:07:00.429698+0000","last_became_active":"2023-12-19T16:06:58.305070+0000","last_became_peered":"2023-12-19T16:06:58.305070+0000","last_unstale":"2023-12-19T16:07:00.429698+0000","last_undegraded":"2023-12-19T16:07:00.429698+0000","last_fullsized":"2023-12-19T16:07:00.429698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429590+0000","last_change":"2023-12-19T16:06:58.741414+0000","last_active":"2023-12-19T16:07:00.429590+0000","last_peered":"2023-12-19T16:07:00.429590+0000","last_clean":"2023-12-19T16:07:00.429590+0000","last_became_active":"2023-12-19T16:06:58.741166+0000","last_became_peered":"2023-12-19T16:06:58.741166+0000","last_unstale":"2023-12-19T16:07:00.429590+0000","last_undegraded":"2023-12-19T16:07:00.429590+0000","last_fullsized":"2023-12-19T16:07:00.429590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109102+0000","last_change":"2023-12-19T16:06:58.304842+0000","last_active":"2023-12-19T16:07:01.109102+0000","last_peered":"2023-12-19T16:07:01.109102+0000","last_clean":"2023-12-19T16:07:01.109102+0000","last_became_active":"2023-12-19T16:06:58.302883+0000","last_became_peered":"2023-12-19T16:06:58.302883+0000","last_unstale":"2023-12-19T16:07:01.109102+0000","last_undegraded":"2023-12-19T16:07:01.109102+0000","last_fullsized":"2023-12-19T16:07:01.109102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735403+0000","last_change":"2023-12-19T16:06:58.750010+0000","last_active":"2023-12-19T16:06:59.735403+0000","last_peered":"2023-12-19T16:06:59.735403+0000","last_clean":"2023-12-19T16:06:59.735403+0000","last_became_active":"2023-12-19T16:06:58.749766+0000","last_became_peered":"2023-12-19T16:06:58.749766+0000","last_unstale":"2023-12-19T16:06:59.735403+0000","last_undegraded":"2023-12-19T16:06:59.735403+0000","last_fullsized":"2023-12-19T16:06:59.735403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594040+0000","last_change":"2023-12-19T16:06:58.307494+0000","last_active":"2023-12-19T16:07:00.594040+0000","last_peered":"2023-12-19T16:07:00.594040+0000","last_clean":"2023-12-19T16:07:00.594040+0000","last_became_active":"2023-12-19T16:06:58.307191+0000","last_became_peered":"2023-12-19T16:06:58.307191+0000","last_unstale":"2023-12-19T16:07:00.594040+0000","last_undegraded":"2023-12-19T16:07:00.594040+0000","last_fullsized":"2023-12-19T16:07:00.594040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109823+0000","last_change":"2023-12-19T16:06:58.752792+0000","last_active":"2023-12-19T16:07:01.109823+0000","last_peered":"2023-12-19T16:07:01.109823+0000","last_clean":"2023-12-19T16:07:01.109823+0000","last_became_active":"2023-12-19T16:06:58.752494+0000","last_became_peered":"2023-12-19T16:06:58.752494+0000","last_unstale":"2023-12-19T16:07:01.109823+0000","last_undegraded":"2023-12-19T16:07:01.109823+0000","last_fullsized":"2023-12-19T16:07:01.109823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109839+0000","last_change":"2023-12-19T16:06:58.309509+0000","last_active":"2023-12-19T16:07:01.109839+0000","last_peered":"2023-12-19T16:07:01.109839+0000","last_clean":"2023-12-19T16:07:01.109839+0000","last_became_active":"2023-12-19T16:06:58.309139+0000","last_became_peered":"2023-12-19T16:06:58.309139+0000","last_unstale":"2023-12-19T16:07:01.109839+0000","last_undegraded":"2023-12-19T16:07:01.109839+0000","last_fullsized":"2023-12-19T16:07:01.109839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466307+0000","last_change":"2023-12-19T16:06:58.756009+0000","last_active":"2023-12-19T16:07:00.466307+0000","last_peered":"2023-12-19T16:07:00.466307+0000","last_clean":"2023-12-19T16:07:00.466307+0000","last_became_active":"2023-12-19T16:06:58.755610+0000","last_became_peered":"2023-12-19T16:06:58.755610+0000","last_unstale":"2023-12-19T16:07:00.466307+0000","last_undegraded":"2023-12-19T16:07:00.466307+0000","last_fullsized":"2023-12-19T16:07:00.466307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:09:36.514144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735683+0000","last_change":"2023-12-19T16:06:58.312257+0000","last_active":"2023-12-19T16:06:59.735683+0000","last_peered":"2023-12-19T16:06:59.735683+0000","last_clean":"2023-12-19T16:06:59.735683+0000","last_became_active":"2023-12-19T16:06:58.311988+0000","last_became_peered":"2023-12-19T16:06:58.311988+0000","last_unstale":"2023-12-19T16:06:59.735683+0000","last_undegraded":"2023-12-19T16:06:59.735683+0000","last_fullsized":"2023-12-19T16:06:59.735683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:55.716735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735863+0000","last_change":"2023-12-19T16:06:58.743459+0000","last_active":"2023-12-19T16:06:59.735863+0000","last_peered":"2023-12-19T16:06:59.735863+0000","last_clean":"2023-12-19T16:06:59.735863+0000","last_became_active":"2023-12-19T16:06:58.743184+0000","last_became_peered":"2023-12-19T16:06:58.743184+0000","last_unstale":"2023-12-19T16:06:59.735863+0000","last_undegraded":"2023-12-19T16:06:59.735863+0000","last_fullsized":"2023-12-19T16:06:59.735863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:56.721659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593958+0000","last_change":"2023-12-19T16:06:58.310349+0000","last_active":"2023-12-19T16:07:00.593958+0000","last_peered":"2023-12-19T16:07:00.593958+0000","last_clean":"2023-12-19T16:07:00.593958+0000","last_became_active":"2023-12-19T16:06:58.310059+0000","last_became_peered":"2023-12-19T16:06:58.310059+0000","last_unstale":"2023-12-19T16:07:00.593958+0000","last_undegraded":"2023-12-19T16:07:00.593958+0000","last_fullsized":"2023-12-19T16:07:00.593958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:35.961254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109478+0000","last_change":"2023-12-19T16:06:58.751190+0000","last_active":"2023-12-19T16:07:01.109478+0000","last_peered":"2023-12-19T16:07:01.109478+0000","last_clean":"2023-12-19T16:07:01.109478+0000","last_became_active":"2023-12-19T16:06:58.748432+0000","last_became_peered":"2023-12-19T16:06:58.748432+0000","last_unstale":"2023-12-19T16:07:01.109478+0000","last_undegraded":"2023-12-19T16:07:01.109478+0000","last_fullsized":"2023-12-19T16:07:01.109478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:30.281031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466247+0000","last_change":"2023-12-19T16:06:58.307849+0000","last_active":"2023-12-19T16:07:00.466247+0000","last_peered":"2023-12-19T16:07:00.466247+0000","last_clean":"2023-12-19T16:07:00.466247+0000","last_became_active":"2023-12-19T16:06:58.307562+0000","last_became_peered":"2023-12-19T16:06:58.307562+0000","last_unstale":"2023-12-19T16:07:00.466247+0000","last_undegraded":"2023-12-19T16:07:00.466247+0000","last_fullsized":"2023-12-19T16:07:00.466247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466011+0000","last_change":"2023-12-19T16:06:58.744304+0000","last_active":"2023-12-19T16:07:00.466011+0000","last_peered":"2023-12-19T16:07:00.466011+0000","last_clean":"2023-12-19T16:07:00.466011+0000","last_became_active":"2023-12-19T16:06:58.744034+0000","last_became_peered":"2023-12-19T16:06:58.744034+0000","last_unstale":"2023-12-19T16:07:00.466011+0000","last_undegraded":"2023-12-19T16:07:00.466011+0000","last_fullsized":"2023-12-19T16:07:00.466011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:04.102120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109966+0000","last_change":"2023-12-19T16:06:58.310576+0000","last_active":"2023-12-19T16:07:01.109966+0000","last_peered":"2023-12-19T16:07:01.109966+0000","last_clean":"2023-12-19T16:07:01.109966+0000","last_became_active":"2023-12-19T16:06:58.310298+0000","last_became_peered":"2023-12-19T16:06:58.310298+0000","last_unstale":"2023-12-19T16:07:01.109966+0000","last_undegraded":"2023-12-19T16:07:01.109966+0000","last_fullsized":"2023-12-19T16:07:01.109966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:06.572806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109450+0000","last_change":"2023-12-19T16:06:58.746329+0000","last_active":"2023-12-19T16:07:01.109450+0000","last_peered":"2023-12-19T16:07:01.109450+0000","last_clean":"2023-12-19T16:07:01.109450+0000","last_became_active":"2023-12-19T16:06:58.746010+0000","last_became_peered":"2023-12-19T16:06:58.746010+0000","last_unstale":"2023-12-19T16:07:01.109450+0000","last_undegraded":"2023-12-19T16:07:01.109450+0000","last_fullsized":"2023-12-19T16:07:01.109450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:34:52.231787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593805+0000","last_change":"2023-12-19T16:06:58.309330+0000","last_active":"2023-12-19T16:07:00.593805+0000","last_peered":"2023-12-19T16:07:00.593805+0000","last_clean":"2023-12-19T16:07:00.593805+0000","last_became_active":"2023-12-19T16:06:58.309039+0000","last_became_peered":"2023-12-19T16:06:58.309039+0000","last_unstale":"2023-12-19T16:07:00.593805+0000","last_undegraded":"2023-12-19T16:07:00.593805+0000","last_fullsized":"2023-12-19T16:07:00.593805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593766+0000","last_change":"2023-12-19T16:06:58.752891+0000","last_active":"2023-12-19T16:07:00.593766+0000","last_peered":"2023-12-19T16:07:00.593766+0000","last_clean":"2023-12-19T16:07:00.593766+0000","last_became_active":"2023-12-19T16:06:58.752582+0000","last_became_peered":"2023-12-19T16:06:58.752582+0000","last_unstale":"2023-12-19T16:07:00.593766+0000","last_undegraded":"2023-12-19T16:07:00.593766+0000","last_fullsized":"2023-12-19T16:07:00.593766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:07:12.391535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736116+0000","last_change":"2023-12-19T16:06:58.308799+0000","last_active":"2023-12-19T16:06:59.736116+0000","last_peered":"2023-12-19T16:06:59.736116+0000","last_clean":"2023-12-19T16:06:59.736116+0000","last_became_active":"2023-12-19T16:06:58.308452+0000","last_became_peered":"2023-12-19T16:06:58.308452+0000","last_unstale":"2023-12-19T16:06:59.736116+0000","last_undegraded":"2023-12-19T16:06:59.736116+0000","last_fullsized":"2023-12-19T16:06:59.736116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109274+0000","last_change":"2023-12-19T16:06:58.746864+0000","last_active":"2023-12-19T16:07:01.109274+0000","last_peered":"2023-12-19T16:07:01.109274+0000","last_clean":"2023-12-19T16:07:01.109274+0000","last_became_active":"2023-12-19T16:06:58.746614+0000","last_became_peered":"2023-12-19T16:06:58.746614+0000","last_unstale":"2023-12-19T16:07:01.109274+0000","last_undegraded":"2023-12-19T16:07:01.109274+0000","last_fullsized":"2023-12-19T16:07:01.109274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:08:43.126506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735933+0000","last_change":"2023-12-19T16:06:58.308443+0000","last_active":"2023-12-19T16:06:59.735933+0000","last_peered":"2023-12-19T16:06:59.735933+0000","last_clean":"2023-12-19T16:06:59.735933+0000","last_became_active":"2023-12-19T16:06:58.308138+0000","last_became_peered":"2023-12-19T16:06:58.308138+0000","last_unstale":"2023-12-19T16:06:59.735933+0000","last_undegraded":"2023-12-19T16:06:59.735933+0000","last_fullsized":"2023-12-19T16:06:59.735933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:45:16.445340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109774+0000","last_change":"2023-12-19T16:06:58.743581+0000","last_active":"2023-12-19T16:07:01.109774+0000","last_peered":"2023-12-19T16:07:01.109774+0000","last_clean":"2023-12-19T16:07:01.109774+0000","last_became_active":"2023-12-19T16:06:58.743215+0000","last_became_peered":"2023-12-19T16:06:58.743215+0000","last_unstale":"2023-12-19T16:07:01.109774+0000","last_undegraded":"2023-12-19T16:07:01.109774+0000","last_fullsized":"2023-12-19T16:07:01.109774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:56:59.199473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736253+0000","last_change":"2023-12-19T16:06:58.301431+0000","last_active":"2023-12-19T16:06:59.736253+0000","last_peered":"2023-12-19T16:06:59.736253+0000","last_clean":"2023-12-19T16:06:59.736253+0000","last_became_active":"2023-12-19T16:06:58.301154+0000","last_became_peered":"2023-12-19T16:06:58.301154+0000","last_unstale":"2023-12-19T16:06:59.736253+0000","last_undegraded":"2023-12-19T16:06:59.736253+0000","last_fullsized":"2023-12-19T16:06:59.736253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109948+0000","last_change":"2023-12-19T16:06:58.747109+0000","last_active":"2023-12-19T16:07:01.109948+0000","last_peered":"2023-12-19T16:07:01.109948+0000","last_clean":"2023-12-19T16:07:01.109948+0000","last_became_active":"2023-12-19T16:06:58.746296+0000","last_became_peered":"2023-12-19T16:06:58.746296+0000","last_unstale":"2023-12-19T16:07:01.109948+0000","last_undegraded":"2023-12-19T16:07:01.109948+0000","last_fullsized":"2023-12-19T16:07:01.109948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:01:02.578194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735717+0000","last_change":"2023-12-19T16:06:58.314755+0000","last_active":"2023-12-19T16:06:59.735717+0000","last_peered":"2023-12-19T16:06:59.735717+0000","last_clean":"2023-12-19T16:06:59.735717+0000","last_became_active":"2023-12-19T16:06:58.314554+0000","last_became_peered":"2023-12-19T16:06:58.314554+0000","last_unstale":"2023-12-19T16:06:59.735717+0000","last_undegraded":"2023-12-19T16:06:59.735717+0000","last_fullsized":"2023-12-19T16:06:59.735717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:16.318865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.110048+0000","last_change":"2023-12-19T16:06:58.751149+0000","last_active":"2023-12-19T16:07:01.110048+0000","last_peered":"2023-12-19T16:07:01.110048+0000","last_clean":"2023-12-19T16:07:01.110048+0000","last_became_active":"2023-12-19T16:06:58.750741+0000","last_became_peered":"2023-12-19T16:06:58.750741+0000","last_unstale":"2023-12-19T16:07:01.110048+0000","last_undegraded":"2023-12-19T16:07:01.110048+0000","last_fullsized":"2023-12-19T16:07:01.110048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:30.281031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736230+0000","last_change":"2023-12-19T16:06:58.301782+0000","last_active":"2023-12-19T16:06:59.736230+0000","last_peered":"2023-12-19T16:06:59.736230+0000","last_clean":"2023-12-19T16:06:59.736230+0000","last_became_active":"2023-12-19T16:06:58.300855+0000","last_became_peered":"2023-12-19T16:06:58.300855+0000","last_unstale":"2023-12-19T16:06:59.736230+0000","last_undegraded":"2023-12-19T16:06:59.736230+0000","last_fullsized":"2023-12-19T16:06:59.736230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109583+0000","last_change":"2023-12-19T16:06:58.755507+0000","last_active":"2023-12-19T16:07:01.109583+0000","last_peered":"2023-12-19T16:07:01.109583+0000","last_clean":"2023-12-19T16:07:01.109583+0000","last_became_active":"2023-12-19T16:06:58.755176+0000","last_became_peered":"2023-12-19T16:06:58.755176+0000","last_unstale":"2023-12-19T16:07:01.109583+0000","last_undegraded":"2023-12-19T16:07:01.109583+0000","last_fullsized":"2023-12-19T16:07:01.109583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:59:45.402539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T16:06:58.733783+0000","last_change":"2023-12-19T16:06:47.761389+0000","last_active":"2023-12-19T16:06:58.733783+0000","last_peered":"2023-12-19T16:06:58.733783+0000","last_clean":"2023-12-19T16:06:58.733783+0000","last_became_active":"2023-12-19T16:06:47.760252+0000","last_became_peered":"2023-12-19T16:06:47.760252+0000","last_unstale":"2023-12-19T16:06:58.733783+0000","last_undegraded":"2023-12-19T16:06:58.733783+0000","last_fullsized":"2023-12-19T16:06:58.733783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_clean_scrub_stamp":"2023-12-19T16:06:46.706871+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:09.167979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109217+0000","last_change":"2023-12-19T16:06:58.300900+0000","last_active":"2023-12-19T16:07:01.109217+0000","last_peered":"2023-12-19T16:07:01.109217+0000","last_clean":"2023-12-19T16:07:01.109217+0000","last_became_active":"2023-12-19T16:06:58.300641+0000","last_became_peered":"2023-12-19T16:06:58.300641+0000","last_unstale":"2023-12-19T16:07:01.109217+0000","last_undegraded":"2023-12-19T16:07:01.109217+0000","last_fullsized":"2023-12-19T16:07:01.109217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:07.531619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429774+0000","last_change":"2023-12-19T16:06:58.755362+0000","last_active":"2023-12-19T16:07:00.429774+0000","last_peered":"2023-12-19T16:07:00.429774+0000","last_clean":"2023-12-19T16:07:00.429774+0000","last_became_active":"2023-12-19T16:06:58.755055+0000","last_became_peered":"2023-12-19T16:06:58.755055+0000","last_unstale":"2023-12-19T16:07:00.429774+0000","last_undegraded":"2023-12-19T16:07:00.429774+0000","last_fullsized":"2023-12-19T16:07:00.429774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:08:43.126506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109035+0000","last_change":"2023-12-19T16:06:58.310316+0000","last_active":"2023-12-19T16:07:01.109035+0000","last_peered":"2023-12-19T16:07:01.109035+0000","last_clean":"2023-12-19T16:07:01.109035+0000","last_became_active":"2023-12-19T16:06:58.310035+0000","last_became_peered":"2023-12-19T16:06:58.310035+0000","last_unstale":"2023-12-19T16:07:01.109035+0000","last_undegraded":"2023-12-19T16:07:01.109035+0000","last_fullsized":"2023-12-19T16:07:01.109035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:07.531619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466062+0000","last_change":"2023-12-19T16:06:58.741676+0000","last_active":"2023-12-19T16:07:00.466062+0000","last_peered":"2023-12-19T16:07:00.466062+0000","last_clean":"2023-12-19T16:07:00.466062+0000","last_became_active":"2023-12-19T16:06:58.741422+0000","last_became_peered":"2023-12-19T16:06:58.741422+0000","last_unstale":"2023-12-19T16:07:00.466062+0000","last_undegraded":"2023-12-19T16:07:00.466062+0000","last_fullsized":"2023-12-19T16:07:00.466062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:46:27.205690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.736299+0000","last_change":"2023-12-19T16:06:58.296822+0000","last_active":"2023-12-19T16:06:59.736299+0000","last_peered":"2023-12-19T16:06:59.736299+0000","last_clean":"2023-12-19T16:06:59.736299+0000","last_became_active":"2023-12-19T16:06:58.296555+0000","last_became_peered":"2023-12-19T16:06:58.296555+0000","last_unstale":"2023-12-19T16:06:59.736299+0000","last_undegraded":"2023-12-19T16:06:59.736299+0000","last_fullsized":"2023-12-19T16:06:59.736299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735354+0000","last_change":"2023-12-19T16:06:58.750259+0000","last_active":"2023-12-19T16:06:59.735354+0000","last_peered":"2023-12-19T16:06:59.735354+0000","last_clean":"2023-12-19T16:06:59.735354+0000","last_became_active":"2023-12-19T16:06:58.749971+0000","last_became_peered":"2023-12-19T16:06:58.749971+0000","last_unstale":"2023-12-19T16:06:59.735354+0000","last_undegraded":"2023-12-19T16:06:59.735354+0000","last_fullsized":"2023-12-19T16:06:59.735354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109975+0000","last_change":"2023-12-19T16:06:58.308334+0000","last_active":"2023-12-19T16:07:01.109975+0000","last_peered":"2023-12-19T16:07:01.109975+0000","last_clean":"2023-12-19T16:07:01.109975+0000","last_became_active":"2023-12-19T16:06:58.307997+0000","last_became_peered":"2023-12-19T16:06:58.307997+0000","last_unstale":"2023-12-19T16:07:01.109975+0000","last_undegraded":"2023-12-19T16:07:01.109975+0000","last_fullsized":"2023-12-19T16:07:01.109975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735908+0000","last_change":"2023-12-19T16:06:58.749875+0000","last_active":"2023-12-19T16:06:59.735908+0000","last_peered":"2023-12-19T16:06:59.735908+0000","last_clean":"2023-12-19T16:06:59.735908+0000","last_became_active":"2023-12-19T16:06:58.749604+0000","last_became_peered":"2023-12-19T16:06:58.749604+0000","last_unstale":"2023-12-19T16:06:59.735908+0000","last_undegraded":"2023-12-19T16:06:59.735908+0000","last_fullsized":"2023-12-19T16:06:59.735908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:07.695345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735602+0000","last_change":"2023-12-19T16:06:58.310432+0000","last_active":"2023-12-19T16:06:59.735602+0000","last_peered":"2023-12-19T16:06:59.735602+0000","last_clean":"2023-12-19T16:06:59.735602+0000","last_became_active":"2023-12-19T16:06:58.310052+0000","last_became_peered":"2023-12-19T16:06:58.310052+0000","last_unstale":"2023-12-19T16:06:59.735602+0000","last_undegraded":"2023-12-19T16:06:59.735602+0000","last_fullsized":"2023-12-19T16:06:59.735602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:07.531619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109764+0000","last_change":"2023-12-19T16:06:58.755050+0000","last_active":"2023-12-19T16:07:01.109764+0000","last_peered":"2023-12-19T16:07:01.109764+0000","last_clean":"2023-12-19T16:07:01.109764+0000","last_became_active":"2023-12-19T16:06:58.754666+0000","last_became_peered":"2023-12-19T16:06:58.754666+0000","last_unstale":"2023-12-19T16:07:01.109764+0000","last_undegraded":"2023-12-19T16:07:01.109764+0000","last_fullsized":"2023-12-19T16:07:01.109764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:11.108008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109843+0000","last_change":"2023-12-19T16:06:58.311812+0000","last_active":"2023-12-19T16:07:01.109843+0000","last_peered":"2023-12-19T16:07:01.109843+0000","last_clean":"2023-12-19T16:07:01.109843+0000","last_became_active":"2023-12-19T16:06:58.311423+0000","last_became_peered":"2023-12-19T16:06:58.311423+0000","last_unstale":"2023-12-19T16:07:01.109843+0000","last_undegraded":"2023-12-19T16:07:01.109843+0000","last_fullsized":"2023-12-19T16:07:01.109843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:40.200624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735591+0000","last_change":"2023-12-19T16:06:58.747297+0000","last_active":"2023-12-19T16:06:59.735591+0000","last_peered":"2023-12-19T16:06:59.735591+0000","last_clean":"2023-12-19T16:06:59.735591+0000","last_became_active":"2023-12-19T16:06:58.747025+0000","last_became_peered":"2023-12-19T16:06:58.747025+0000","last_unstale":"2023-12-19T16:06:59.735591+0000","last_undegraded":"2023-12-19T16:06:59.735591+0000","last_fullsized":"2023-12-19T16:06:59.735591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:45:08.936385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.651770+0000","last_change":"2023-12-19T16:06:58.309515+0000","last_active":"2023-12-19T16:07:01.651770+0000","last_peered":"2023-12-19T16:07:01.651770+0000","last_clean":"2023-12-19T16:07:01.651770+0000","last_became_active":"2023-12-19T16:06:58.309120+0000","last_became_peered":"2023-12-19T16:06:58.309120+0000","last_unstale":"2023-12-19T16:07:01.651770+0000","last_undegraded":"2023-12-19T16:07:01.651770+0000","last_fullsized":"2023-12-19T16:07:01.651770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:06.572806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429995+0000","last_change":"2023-12-19T16:06:58.744382+0000","last_active":"2023-12-19T16:07:00.429995+0000","last_peered":"2023-12-19T16:07:00.429995+0000","last_clean":"2023-12-19T16:07:00.429995+0000","last_became_active":"2023-12-19T16:06:58.744125+0000","last_became_peered":"2023-12-19T16:06:58.744125+0000","last_unstale":"2023-12-19T16:07:00.429995+0000","last_undegraded":"2023-12-19T16:07:00.429995+0000","last_fullsized":"2023-12-19T16:07:00.429995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:17.210206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.594111+0000","last_change":"2023-12-19T16:06:58.306697+0000","last_active":"2023-12-19T16:07:00.594111+0000","last_peered":"2023-12-19T16:07:00.594111+0000","last_clean":"2023-12-19T16:07:00.594111+0000","last_became_active":"2023-12-19T16:06:58.306411+0000","last_became_peered":"2023-12-19T16:06:58.306411+0000","last_unstale":"2023-12-19T16:07:00.594111+0000","last_undegraded":"2023-12-19T16:07:00.594111+0000","last_fullsized":"2023-12-19T16:07:00.594111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466265+0000","last_change":"2023-12-19T16:06:58.749375+0000","last_active":"2023-12-19T16:07:00.466265+0000","last_peered":"2023-12-19T16:07:00.466265+0000","last_clean":"2023-12-19T16:07:00.466265+0000","last_became_active":"2023-12-19T16:06:58.749123+0000","last_became_peered":"2023-12-19T16:06:58.749123+0000","last_unstale":"2023-12-19T16:07:00.466265+0000","last_undegraded":"2023-12-19T16:07:00.466265+0000","last_fullsized":"2023-12-19T16:07:00.466265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109074+0000","last_change":"2023-12-19T16:06:58.311689+0000","last_active":"2023-12-19T16:07:01.109074+0000","last_peered":"2023-12-19T16:07:01.109074+0000","last_clean":"2023-12-19T16:07:01.109074+0000","last_became_active":"2023-12-19T16:06:58.311443+0000","last_became_peered":"2023-12-19T16:06:58.311443+0000","last_unstale":"2023-12-19T16:07:01.109074+0000","last_undegraded":"2023-12-19T16:07:01.109074+0000","last_fullsized":"2023-12-19T16:07:01.109074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:16.318865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735579+0000","last_change":"2023-12-19T16:06:58.737013+0000","last_active":"2023-12-19T16:06:59.735579+0000","last_peered":"2023-12-19T16:06:59.735579+0000","last_clean":"2023-12-19T16:06:59.735579+0000","last_became_active":"2023-12-19T16:06:58.736732+0000","last_became_peered":"2023-12-19T16:06:58.736732+0000","last_unstale":"2023-12-19T16:06:59.735579+0000","last_undegraded":"2023-12-19T16:06:59.735579+0000","last_fullsized":"2023-12-19T16:06:59.735579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:52:08.536543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735494+0000","last_change":"2023-12-19T16:06:58.311956+0000","last_active":"2023-12-19T16:06:59.735494+0000","last_peered":"2023-12-19T16:06:59.735494+0000","last_clean":"2023-12-19T16:06:59.735494+0000","last_became_active":"2023-12-19T16:06:58.311426+0000","last_became_peered":"2023-12-19T16:06:58.311426+0000","last_unstale":"2023-12-19T16:06:59.735494+0000","last_undegraded":"2023-12-19T16:06:59.735494+0000","last_fullsized":"2023-12-19T16:06:59.735494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:08.184167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429662+0000","last_change":"2023-12-19T16:06:58.751593+0000","last_active":"2023-12-19T16:07:00.429662+0000","last_peered":"2023-12-19T16:07:00.429662+0000","last_clean":"2023-12-19T16:07:00.429662+0000","last_became_active":"2023-12-19T16:06:58.751335+0000","last_became_peered":"2023-12-19T16:06:58.751335+0000","last_unstale":"2023-12-19T16:07:00.429662+0000","last_undegraded":"2023-12-19T16:07:00.429662+0000","last_fullsized":"2023-12-19T16:07:00.429662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:02.711211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:06:59.735607+0000","last_change":"2023-12-19T16:06:58.310478+0000","last_active":"2023-12-19T16:06:59.735607+0000","last_peered":"2023-12-19T16:06:59.735607+0000","last_clean":"2023-12-19T16:06:59.735607+0000","last_became_active":"2023-12-19T16:06:58.310172+0000","last_became_peered":"2023-12-19T16:06:58.310172+0000","last_unstale":"2023-12-19T16:06:59.735607+0000","last_undegraded":"2023-12-19T16:06:59.735607+0000","last_fullsized":"2023-12-19T16:06:59.735607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429817+0000","last_change":"2023-12-19T16:06:58.745013+0000","last_active":"2023-12-19T16:07:00.429817+0000","last_peered":"2023-12-19T16:07:00.429817+0000","last_clean":"2023-12-19T16:07:00.429817+0000","last_became_active":"2023-12-19T16:06:58.744739+0000","last_became_peered":"2023-12-19T16:06:58.744739+0000","last_unstale":"2023-12-19T16:07:00.429817+0000","last_undegraded":"2023-12-19T16:07:00.429817+0000","last_fullsized":"2023-12-19T16:07:00.429817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:59:45.402539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109787+0000","last_change":"2023-12-19T16:06:58.314931+0000","last_active":"2023-12-19T16:07:01.109787+0000","last_peered":"2023-12-19T16:07:01.109787+0000","last_clean":"2023-12-19T16:07:01.109787+0000","last_became_active":"2023-12-19T16:06:58.314637+0000","last_became_peered":"2023-12-19T16:06:58.314637+0000","last_unstale":"2023-12-19T16:07:01.109787+0000","last_undegraded":"2023-12-19T16:07:01.109787+0000","last_fullsized":"2023-12-19T16:07:01.109787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:31.208204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.593737+0000","last_change":"2023-12-19T16:06:58.753329+0000","last_active":"2023-12-19T16:07:00.593737+0000","last_peered":"2023-12-19T16:07:00.593737+0000","last_clean":"2023-12-19T16:07:00.593737+0000","last_became_active":"2023-12-19T16:06:58.749183+0000","last_became_peered":"2023-12-19T16:06:58.749183+0000","last_unstale":"2023-12-19T16:07:00.593737+0000","last_undegraded":"2023-12-19T16:07:00.593737+0000","last_fullsized":"2023-12-19T16:07:00.593737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:21.982202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109649+0000","last_change":"2023-12-19T16:06:58.751468+0000","last_active":"2023-12-19T16:07:01.109649+0000","last_peered":"2023-12-19T16:07:01.109649+0000","last_clean":"2023-12-19T16:07:01.109649+0000","last_became_active":"2023-12-19T16:06:58.750502+0000","last_became_peered":"2023-12-19T16:06:58.750502+0000","last_unstale":"2023-12-19T16:07:01.109649+0000","last_undegraded":"2023-12-19T16:07:01.109649+0000","last_fullsized":"2023-12-19T16:07:01.109649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:59:45.402539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109568+0000","last_change":"2023-12-19T16:06:58.311983+0000","last_active":"2023-12-19T16:07:01.109568+0000","last_peered":"2023-12-19T16:07:01.109568+0000","last_clean":"2023-12-19T16:07:01.109568+0000","last_became_active":"2023-12-19T16:06:58.311706+0000","last_became_peered":"2023-12-19T16:06:58.311706+0000","last_unstale":"2023-12-19T16:07:01.109568+0000","last_undegraded":"2023-12-19T16:07:01.109568+0000","last_fullsized":"2023-12-19T16:07:01.109568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:01:55.716735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109940+0000","last_change":"2023-12-19T16:06:58.751294+0000","last_active":"2023-12-19T16:07:01.109940+0000","last_peered":"2023-12-19T16:07:01.109940+0000","last_clean":"2023-12-19T16:07:01.109940+0000","last_became_active":"2023-12-19T16:06:58.751039+0000","last_became_peered":"2023-12-19T16:06:58.751039+0000","last_unstale":"2023-12-19T16:07:01.109940+0000","last_undegraded":"2023-12-19T16:07:01.109940+0000","last_fullsized":"2023-12-19T16:07:01.109940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:08:43.126506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:01.109669+0000","last_change":"2023-12-19T16:06:58.309418+0000","last_active":"2023-12-19T16:07:01.109669+0000","last_peered":"2023-12-19T16:07:01.109669+0000","last_clean":"2023-12-19T16:07:01.109669+0000","last_became_active":"2023-12-19T16:06:58.309108+0000","last_became_peered":"2023-12-19T16:06:58.309108+0000","last_unstale":"2023-12-19T16:07:01.109669+0000","last_undegraded":"2023-12-19T16:07:01.109669+0000","last_fullsized":"2023-12-19T16:07:01.109669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:06.572806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466323+0000","last_change":"2023-12-19T16:06:58.755879+0000","last_active":"2023-12-19T16:07:00.466323+0000","last_peered":"2023-12-19T16:07:00.466323+0000","last_clean":"2023-12-19T16:07:00.466323+0000","last_became_active":"2023-12-19T16:06:58.755019+0000","last_became_peered":"2023-12-19T16:06:58.755019+0000","last_unstale":"2023-12-19T16:07:00.466323+0000","last_undegraded":"2023-12-19T16:07:00.466323+0000","last_fullsized":"2023-12-19T16:07:00.466323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:57.598583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.430019+0000","last_change":"2023-12-19T16:06:58.308088+0000","last_active":"2023-12-19T16:07:00.430019+0000","last_peered":"2023-12-19T16:07:00.430019+0000","last_clean":"2023-12-19T16:07:00.430019+0000","last_became_active":"2023-12-19T16:06:58.307702+0000","last_became_peered":"2023-12-19T16:06:58.307702+0000","last_unstale":"2023-12-19T16:07:00.430019+0000","last_undegraded":"2023-12-19T16:07:00.430019+0000","last_fullsized":"2023-12-19T16:07:00.430019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:02:39.423047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.429908+0000","last_change":"2023-12-19T16:06:58.745962+0000","last_active":"2023-12-19T16:07:00.429908+0000","last_peered":"2023-12-19T16:07:00.429908+0000","last_clean":"2023-12-19T16:07:00.429908+0000","last_became_active":"2023-12-19T16:06:58.745668+0000","last_became_peered":"2023-12-19T16:06:58.745668+0000","last_unstale":"2023-12-19T16:07:00.429908+0000","last_undegraded":"2023-12-19T16:07:00.429908+0000","last_fullsized":"2023-12-19T16:07:00.429908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:58.277242+0000","last_clean_scrub_stamp":"2023-12-19T16:06:58.277242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:16:22.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T16:07:00.466374+0000","last_change":"2023-12-19T16:06:58.307135+0000","last_active":"2023-12-19T16:07:00.466374+0000","last_peered":"2023-12-19T16:07:00.466374+0000","last_clean":"2023-12-19T16:07:00.466374+0000","last_became_active":"2023-12-19T16:06:58.306810+0000","last_became_peered":"2023-12-19T16:06:58.306810+0000","last_unstale":"2023-12-19T16:07:00.466374+0000","last_undegraded":"2023-12-19T16:07:00.466374+0000","last_fullsized":"2023-12-19T16:07:00.466374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:57.272318+0000","last_clean_scrub_stamp":"2023-12-19T16:06:57.272318+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:35.961254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:07:11.488 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-19T16:07:11.488 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-19T16:07:11.488 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-19T16:07:11.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-19T16:07:11.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.627+0000 7f8a54032640 1 Processor -- start 2023-12-19T16:07:11.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.628+0000 7f8a54032640 1 -- start start 2023-12-19T16:07:11.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.628+0000 7f8a54032640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8a4c0b74e0 0x7f8a4c14a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:11.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.628+0000 7f8a54032640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8a4c0b78c0 0x7f8a4c14ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:11.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.628+0000 7f8a54032640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4c0b6750 con 0x7f8a4c0b2ee0 2023-12-19T16:07:11.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.628+0000 7f8a54032640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4c070870 con 0x7f8a4c0b78c0 2023-12-19T16:07:11.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.628+0000 7f8a54032640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c070b50 con 0x7f8a4c0b74e0 2023-12-19T16:07:11.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.629+0000 7f8a51dce640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8a4c0b74e0 0x7f8a4c14a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:11.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.629+0000 7f8a525cf640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8a4c0b78c0 0x7f8a4c14ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:11.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.629+0000 7f8a515cd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8a4c0b2ee0 0x7f8a4c146f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.37:52912/0 (socket says 172.21.15.37:52912) 2023-12-19T16:07:11.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.629+0000 7f8a515cd640 1 -- 172.21.15.37:0/3625472846 learned_addr learned my addr 172.21.15.37:0/3625472846 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:11.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.629+0000 7f8a50dcc640 1 -- 172.21.15.37:0/3625472846 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3562939616 0 0) 0x7f8a4c0b6750 con 0x7f8a4c0b2ee0 2023-12-19T16:07:11.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.629+0000 7f8a50dcc640 1 -- 172.21.15.37:0/3625472846 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a34003520 con 0x7f8a4c0b2ee0 2023-12-19T16:07:11.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.629+0000 7f8a525cf640 1 -- 172.21.15.37:0/3625472846 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8a4c0b74e0 msgr2=0x7f8a4c14a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:11.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.629+0000 7f8a525cf640 1 --2- 172.21.15.37:0/3625472846 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8a4c0b74e0 0x7f8a4c14a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.629+0000 7f8a525cf640 1 -- 172.21.15.37:0/3625472846 >> v1:172.21.15.78:6789/0 conn(0x7f8a4c0b2ee0 legacy=0x7f8a4c146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:11.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.629+0000 7f8a525cf640 1 -- 172.21.15.37:0/3625472846 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c070e30 con 0x7f8a4c0b78c0 2023-12-19T16:07:11.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.629+0000 7f8a51dce640 1 --2- 172.21.15.37:0/3625472846 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8a4c0b74e0 0x7f8a4c14a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:07:11.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.630+0000 7f8a525cf640 1 --2- 172.21.15.37:0/3625472846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a4c0b78c0 0x7f8a4c14ad90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009dc0 tx=0x7f8a3c02bf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=483a703fc856418a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:11.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.630+0000 7f8a50dcc640 1 -- 172.21.15.37:0/3625472846 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c02ccd0 con 0x7f8a4c0b78c0 2023-12-19T16:07:11.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.630+0000 7f8a50dcc640 1 -- 172.21.15.37:0/3625472846 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c02ce30 con 0x7f8a4c0b78c0 2023-12-19T16:07:11.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.630+0000 7f8a50dcc640 1 -- 172.21.15.37:0/3625472846 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c034640 con 0x7f8a4c0b78c0 2023-12-19T16:07:11.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.630+0000 7f8a54032640 1 -- 172.21.15.37:0/3625472846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a4c0b78c0 msgr2=0x7f8a4c14ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:11.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.630+0000 7f8a54032640 1 --2- 172.21.15.37:0/3625472846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a4c0b78c0 0x7f8a4c14ad90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009dc0 tx=0x7f8a3c02bf20 comp rx=0 tx=0).stop 2023-12-19T16:07:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.630+0000 7f8a54032640 1 -- 172.21.15.37:0/3625472846 shutdown_connections 2023-12-19T16:07:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.630+0000 7f8a54032640 1 --2- 172.21.15.37:0/3625472846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a4c0b78c0 0x7f8a4c14ad90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.630+0000 7f8a54032640 1 --2- 172.21.15.37:0/3625472846 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8a4c0b74e0 0x7f8a4c14a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.630+0000 7f8a54032640 1 -- 172.21.15.37:0/3625472846 >> 172.21.15.37:0/3625472846 conn(0x7f8a4c0bc2d0 msgr2=0x7f8a4c0bc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.631+0000 7f8a54032640 1 -- 172.21.15.37:0/3625472846 shutdown_connections 2023-12-19T16:07:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.631+0000 7f8a54032640 1 -- 172.21.15.37:0/3625472846 wait complete. 2023-12-19T16:07:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.632+0000 7f8a54032640 1 Processor -- start 2023-12-19T16:07:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.632+0000 7f8a54032640 1 -- start start 2023-12-19T16:07:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.632+0000 7f8a54032640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8a4c0b2ee0 0x7f8a4c140300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.632+0000 7f8a54032640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a4c0b74e0 0x7f8a4c1419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.632+0000 7f8a54032640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a4c0b78c0 0x7f8a4c13ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.632+0000 7f8a54032640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c140840 con 0x7f8a4c0b74e0 2023-12-19T16:07:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.632+0000 7f8a54032640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c13c860 con 0x7f8a4c0b78c0 2023-12-19T16:07:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.632+0000 7f8a54032640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c141f30 con 0x7f8a4c0b2ee0 2023-12-19T16:07:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.632+0000 7f8a515cd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a4c0b74e0 0x7f8a4c1419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.632+0000 7f8a515cd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a4c0b74e0 0x7f8a4c1419f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47774/0 (socket says 172.21.15.37:47774) 2023-12-19T16:07:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.632+0000 7f8a515cd640 1 -- 172.21.15.37:0/3483082813 learned_addr learned my addr 172.21.15.37:0/3483082813 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.632+0000 7f8a51dce640 1 --2- 172.21.15.37:0/3483082813 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8a4c0b2ee0 0x7f8a4c140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.632+0000 7f8a525cf640 1 --2- 172.21.15.37:0/3483082813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a4c0b78c0 0x7f8a4c13ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.633+0000 7f8a515cd640 1 -- 172.21.15.37:0/3483082813 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8a4c0b2ee0 msgr2=0x7f8a4c140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.633+0000 7f8a515cd640 1 --2- 172.21.15.37:0/3483082813 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8a4c0b2ee0 0x7f8a4c140300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.633+0000 7f8a515cd640 1 -- 172.21.15.37:0/3483082813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a4c0b78c0 msgr2=0x7f8a4c13ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.633+0000 7f8a515cd640 1 --2- 172.21.15.37:0/3483082813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a4c0b78c0 0x7f8a4c13ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.633+0000 7f8a515cd640 1 -- 172.21.15.37:0/3483082813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a44009400 con 0x7f8a4c0b74e0 2023-12-19T16:07:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.633+0000 7f8a515cd640 1 --2- 172.21.15.37:0/3483082813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a4c0b74e0 0x7f8a4c1419f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000c430 tx=0x7f8a4000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.633+0000 7f8a4a7fc640 1 -- 172.21.15.37:0/3483082813 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40005ce0 con 0x7f8a4c0b74e0 2023-12-19T16:07:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.633+0000 7f8a4a7fc640 1 -- 172.21.15.37:0/3483082813 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a40005e60 con 0x7f8a4c0b74e0 2023-12-19T16:07:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.633+0000 7f8a4a7fc640 1 -- 172.21.15.37:0/3483082813 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40007310 con 0x7f8a4c0b74e0 2023-12-19T16:07:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.633+0000 7f8a54032640 1 -- 172.21.15.37:0/3483082813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3c009a70 con 0x7f8a4c0b74e0 2023-12-19T16:07:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.633+0000 7f8a54032640 1 -- 172.21.15.37:0/3483082813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4c13c2a0 con 0x7f8a4c0b74e0 2023-12-19T16:07:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.634+0000 7f8a54032640 1 -- 172.21.15.37:0/3483082813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4c0b7260 con 0x7f8a4c0b74e0 2023-12-19T16:07:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.634+0000 7f8a4a7fc640 1 -- 172.21.15.37:0/3483082813 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8a40007470 con 0x7f8a4c0b74e0 2023-12-19T16:07:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.635+0000 7f8a4a7fc640 1 --2- 172.21.15.37:0/3483082813 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8a3806a430 0x7f8a3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.635+0000 7f8a4a7fc640 1 -- 172.21.15.37:0/3483082813 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a40087ec0 con 0x7f8a4c0b74e0 2023-12-19T16:07:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.635+0000 7f8a51dce640 1 --2- 172.21.15.37:0/3483082813 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8a3806a430 0x7f8a3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.636+0000 7f8a51dce640 1 --2- 172.21.15.37:0/3483082813 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8a3806a430 0x7f8a3806c8f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009cd0 tx=0x7f8a44009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.639+0000 7f8a4a7fc640 1 -- 172.21.15.37:0/3483082813 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8a40053560 con 0x7f8a4c0b74e0 2023-12-19T16:07:11.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.850+0000 7f8a54032640 1 -- 172.21.15.37:0/3483082813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8a4c04e840 con 0x7f8a4c0b74e0 2023-12-19T16:07:11.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.850+0000 7f8a4a7fc640 1 -- 172.21.15.37:0/3483082813 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8a40017040 con 0x7f8a4c0b74e0 2023-12-19T16:07:11.853 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:11.853 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-19T16:07:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.852+0000 7f8a54032640 1 -- 172.21.15.37:0/3483082813 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8a3806a430 msgr2=0x7f8a3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.852+0000 7f8a54032640 1 --2- 172.21.15.37:0/3483082813 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8a3806a430 0x7f8a3806c8f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009cd0 tx=0x7f8a44009190 comp rx=0 tx=0).stop 2023-12-19T16:07:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.852+0000 7f8a54032640 1 -- 172.21.15.37:0/3483082813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a4c0b74e0 msgr2=0x7f8a4c1419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.852+0000 7f8a54032640 1 --2- 172.21.15.37:0/3483082813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a4c0b74e0 0x7f8a4c1419f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000c430 tx=0x7f8a4000c8f0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.852+0000 7f8a54032640 1 -- 172.21.15.37:0/3483082813 shutdown_connections 2023-12-19T16:07:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.852+0000 7f8a54032640 1 --2- 172.21.15.37:0/3483082813 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8a3806a430 0x7f8a3806c8f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.852+0000 7f8a54032640 1 --2- 172.21.15.37:0/3483082813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a4c0b78c0 0x7f8a4c13ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.852+0000 7f8a54032640 1 --2- 172.21.15.37:0/3483082813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a4c0b74e0 0x7f8a4c1419f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.852+0000 7f8a54032640 1 --2- 172.21.15.37:0/3483082813 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8a4c0b2ee0 0x7f8a4c140300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.852+0000 7f8a54032640 1 -- 172.21.15.37:0/3483082813 >> 172.21.15.37:0/3483082813 conn(0x7f8a4c0bc2d0 msgr2=0x7f8a4c0b6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.852+0000 7f8a54032640 1 -- 172.21.15.37:0/3483082813 shutdown_connections 2023-12-19T16:07:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.852+0000 7f8a54032640 1 -- 172.21.15.37:0/3483082813 wait complete. 2023-12-19T16:07:11.865 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-19T16:07:11.866 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:07:11.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.968+0000 7f1d6b282640 1 Processor -- start 2023-12-19T16:07:11.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.969+0000 7f1d6b282640 1 -- start start 2023-12-19T16:07:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.969+0000 7f1d6b282640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1d640b6690 0x7f1d64144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.969+0000 7f1d6b282640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d64144cd0 0x7f1d64155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.969+0000 7f1d6b282640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d640bc6b0 con 0x7f1d640bcdd0 2023-12-19T16:07:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.969+0000 7f1d6b282640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d640a59f0 con 0x7f1d64144cd0 2023-12-19T16:07:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.969+0000 7f1d6b282640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d640bc0a0 con 0x7f1d640b6690 2023-12-19T16:07:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.969+0000 7f1d6981f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d64144cd0 0x7f1d64155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.969+0000 7f1d6981f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d64144cd0 0x7f1d64155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47788/0 (socket says 172.21.15.37:47788) 2023-12-19T16:07:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.969+0000 7f1d6981f640 1 -- 172.21.15.37:0/3482739412 learned_addr learned my addr 172.21.15.37:0/3482739412 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.970+0000 7f1d6981f640 1 -- 172.21.15.37:0/3482739412 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1d640b6690 msgr2=0x7f1d64144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.970+0000 7f1d6881d640 1 --2- 172.21.15.37:0/3482739412 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1d640b6690 0x7f1d64144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.970+0000 7f1d6981f640 1 --2- 172.21.15.37:0/3482739412 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1d640b6690 0x7f1d64144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.970+0000 7f1d6981f640 1 -- 172.21.15.37:0/3482739412 >> v1:172.21.15.78:6789/0 conn(0x7f1d640bcdd0 legacy=0x7f1d640b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.970+0000 7f1d6981f640 1 -- 172.21.15.37:0/3482739412 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d640bc340 con 0x7f1d64144cd0 2023-12-19T16:07:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.970+0000 7f1d6881d640 1 --2- 172.21.15.37:0/3482739412 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1d640b6690 0x7f1d64144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.971+0000 7f1d6981f640 1 --2- 172.21.15.37:0/3482739412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d64144cd0 0x7f1d64155340 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c009e50 tx=0x7f1d5c02bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94211bb342c13fe0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.971+0000 7f1d5bfff640 1 -- 172.21.15.37:0/3482739412 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c02cb90 con 0x7f1d64144cd0 2023-12-19T16:07:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.971+0000 7f1d5bfff640 1 -- 172.21.15.37:0/3482739412 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c02ccf0 con 0x7f1d64144cd0 2023-12-19T16:07:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.971+0000 7f1d5bfff640 1 -- 172.21.15.37:0/3482739412 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c034610 con 0x7f1d64144cd0 2023-12-19T16:07:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.971+0000 7f1d6b282640 1 -- 172.21.15.37:0/3482739412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d64144cd0 msgr2=0x7f1d64155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.971+0000 7f1d6b282640 1 --2- 172.21.15.37:0/3482739412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d64144cd0 0x7f1d64155340 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c009e50 tx=0x7f1d5c02bff0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.971+0000 7f1d6b282640 1 -- 172.21.15.37:0/3482739412 shutdown_connections 2023-12-19T16:07:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.971+0000 7f1d6b282640 1 --2- 172.21.15.37:0/3482739412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d64144cd0 0x7f1d64155340 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.971+0000 7f1d6b282640 1 --2- 172.21.15.37:0/3482739412 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1d640b6690 0x7f1d64144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.971+0000 7f1d6b282640 1 -- 172.21.15.37:0/3482739412 >> 172.21.15.37:0/3482739412 conn(0x7f1d64071e60 msgr2=0x7f1d640c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.971+0000 7f1d6b282640 1 -- 172.21.15.37:0/3482739412 shutdown_connections 2023-12-19T16:07:11.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.971+0000 7f1d6b282640 1 -- 172.21.15.37:0/3482739412 wait complete. 2023-12-19T16:07:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.972+0000 7f1d6b282640 1 Processor -- start 2023-12-19T16:07:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.972+0000 7f1d6b282640 1 -- start start 2023-12-19T16:07:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.973+0000 7f1d6b282640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1d640b6690 0x7f1d64147a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.973+0000 7f1d6b282640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d640bcdd0 0x7f1d64149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.973+0000 7f1d6b282640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d64144cd0 0x7f1d641e3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:11.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.973+0000 7f1d6b282640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d64147fd0 con 0x7f1d64144cd0 2023-12-19T16:07:11.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.973+0000 7f1d6b282640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6414a420 con 0x7f1d640bcdd0 2023-12-19T16:07:11.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.973+0000 7f1d6b282640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6414bae0 con 0x7f1d640b6690 2023-12-19T16:07:11.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.973+0000 7f1d6981f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d64144cd0 0x7f1d641e3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:11.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.973+0000 7f1d6981f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d64144cd0 0x7f1d641e3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47794/0 (socket says 172.21.15.37:47794) 2023-12-19T16:07:11.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.973+0000 7f1d6981f640 1 -- 172.21.15.37:0/2606920659 learned_addr learned my addr 172.21.15.37:0/2606920659 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:11.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.973+0000 7f1d6881d640 1 --2- 172.21.15.37:0/2606920659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d640bcdd0 0x7f1d64149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:11.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.973+0000 7f1d6901e640 1 --2- 172.21.15.37:0/2606920659 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1d640b6690 0x7f1d64147a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:11.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.973+0000 7f1d6981f640 1 -- 172.21.15.37:0/2606920659 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1d640b6690 msgr2=0x7f1d64147a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:11.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.973+0000 7f1d6981f640 1 --2- 172.21.15.37:0/2606920659 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1d640b6690 0x7f1d64147a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.973+0000 7f1d6981f640 1 -- 172.21.15.37:0/2606920659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d640bcdd0 msgr2=0x7f1d64149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:11.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.973+0000 7f1d6981f640 1 --2- 172.21.15.37:0/2606920659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d640bcdd0 0x7f1d64149ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:11.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.973+0000 7f1d6981f640 1 -- 172.21.15.37:0/2606920659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5c009b30 con 0x7f1d64144cd0 2023-12-19T16:07:11.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.973+0000 7f1d6901e640 1 --2- 172.21.15.37:0/2606920659 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1d640b6690 0x7f1d64147a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:11.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.974+0000 7f1d6981f640 1 --2- 172.21.15.37:0/2606920659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d64144cd0 0x7f1d641e3420 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c036040 tx=0x7f1d5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:11.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.974+0000 7f1d59ffb640 1 -- 172.21.15.37:0/2606920659 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c03e450 con 0x7f1d64144cd0 2023-12-19T16:07:11.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.974+0000 7f1d59ffb640 1 -- 172.21.15.37:0/2606920659 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c03e5d0 con 0x7f1d64144cd0 2023-12-19T16:07:11.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.974+0000 7f1d6b282640 1 -- 172.21.15.37:0/2606920659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d641e3d80 con 0x7f1d64144cd0 2023-12-19T16:07:11.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.974+0000 7f1d59ffb640 1 -- 172.21.15.37:0/2606920659 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c03e980 con 0x7f1d64144cd0 2023-12-19T16:07:11.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.974+0000 7f1d6b282640 1 -- 172.21.15.37:0/2606920659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6414a980 con 0x7f1d64144cd0 2023-12-19T16:07:11.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.975+0000 7f1d6b282640 1 -- 172.21.15.37:0/2606920659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d6414ab10 con 0x7f1d64144cd0 2023-12-19T16:07:11.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.975+0000 7f1d59ffb640 1 -- 172.21.15.37:0/2606920659 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1d5c03eae0 con 0x7f1d64144cd0 2023-12-19T16:07:11.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.976+0000 7f1d59ffb640 1 --2- 172.21.15.37:0/2606920659 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f1d4806a430 0x7f1d4806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:11.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.976+0000 7f1d59ffb640 1 -- 172.21.15.37:0/2606920659 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d5c0ab500 con 0x7f1d64144cd0 2023-12-19T16:07:11.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.976+0000 7f1d6901e640 1 --2- 172.21.15.37:0/2606920659 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f1d4806a430 0x7f1d4806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:11.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.976+0000 7f1d6901e640 1 --2- 172.21.15.37:0/2606920659 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f1d4806a430 0x7f1d4806c8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1d60007fd0 tx=0x7f1d60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:11.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:11.980+0000 7f1d59ffb640 1 -- 172.21.15.37:0/2606920659 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1d5c076b80 con 0x7f1d64144cd0 2023-12-19T16:07:12.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.156+0000 7f1d6b282640 1 -- 172.21.15.37:0/2606920659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d6404e840 con 0x7f1d64144cd0 2023-12-19T16:07:12.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.157+0000 7f1d59ffb640 1 -- 172.21.15.37:0/2606920659 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f1d5c02ce60 con 0x7f1d64144cd0 2023-12-19T16:07:12.159 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:12.159 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:59.728935+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:06:56.758166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:06:57.635291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:07:12.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.158+0000 7f1d6b282640 1 -- 172.21.15.37:0/2606920659 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f1d4806a430 msgr2=0x7f1d4806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:12.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.158+0000 7f1d6b282640 1 --2- 172.21.15.37:0/2606920659 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f1d4806a430 0x7f1d4806c8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1d60007fd0 tx=0x7f1d60009040 comp rx=0 tx=0).stop 2023-12-19T16:07:12.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.158+0000 7f1d6b282640 1 -- 172.21.15.37:0/2606920659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d64144cd0 msgr2=0x7f1d641e3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:12.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.158+0000 7f1d6b282640 1 --2- 172.21.15.37:0/2606920659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d64144cd0 0x7f1d641e3420 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c036040 tx=0x7f1d5c004a40 comp rx=0 tx=0).stop 2023-12-19T16:07:12.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.159+0000 7f1d6b282640 1 -- 172.21.15.37:0/2606920659 shutdown_connections 2023-12-19T16:07:12.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.159+0000 7f1d6b282640 1 --2- 172.21.15.37:0/2606920659 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f1d4806a430 0x7f1d4806c8f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.159+0000 7f1d6b282640 1 --2- 172.21.15.37:0/2606920659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d64144cd0 0x7f1d641e3420 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.159+0000 7f1d6b282640 1 --2- 172.21.15.37:0/2606920659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d640bcdd0 0x7f1d64149ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.159+0000 7f1d6b282640 1 --2- 172.21.15.37:0/2606920659 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1d640b6690 0x7f1d64147a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.159+0000 7f1d6b282640 1 -- 172.21.15.37:0/2606920659 >> 172.21.15.37:0/2606920659 conn(0x7f1d64071e60 msgr2=0x7f1d640b88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:12.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.159+0000 7f1d6b282640 1 -- 172.21.15.37:0/2606920659 shutdown_connections 2023-12-19T16:07:12.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.159+0000 7f1d6b282640 1 -- 172.21.15.37:0/2606920659 wait complete. 2023-12-19T16:07:12.171 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:06:46.684027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:06:56.758166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:06:57.635291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:07:12.172 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:07:12.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.278+0000 7f4a761b9640 1 Processor -- start 2023-12-19T16:07:12.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.278+0000 7f4a761b9640 1 -- start start 2023-12-19T16:07:12.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.279+0000 7f4a761b9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4a700bf510 0x7f4a700be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:12.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.279+0000 7f4a761b9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a700bfa50 con 0x7f4a700bb140 2023-12-19T16:07:12.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.279+0000 7f4a761b9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7006b040 con 0x7f4a7006a950 2023-12-19T16:07:12.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.279+0000 7f4a761b9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a700bbda0 con 0x7f4a700bf510 2023-12-19T16:07:12.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.279+0000 7f4a6f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4a700bb140 0x7f4a700bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46460/0 (socket says 172.21.15.37:46460) 2023-12-19T16:07:12.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.279+0000 7f4a6f7fe640 1 -- 172.21.15.37:0/672087768 learned_addr learned my addr 172.21.15.37:0/672087768 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:12.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.279+0000 7f4a6effd640 1 --2- 172.21.15.37:0/672087768 >> v2:172.21.15.37:3300/0 conn(0x7f4a700bf510 0x7f4a700be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:12.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.279+0000 7f4a6e7fc640 1 -- 172.21.15.37:0/672087768 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820259482 0 0) 0x7f4a700bfa50 con 0x7f4a700bb140 2023-12-19T16:07:12.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.279+0000 7f4a6e7fc640 1 -- 172.21.15.37:0/672087768 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a58003520 con 0x7f4a700bb140 2023-12-19T16:07:12.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.279+0000 7f4a6effd640 1 -- 172.21.15.37:0/672087768 >> v1:172.21.15.78:6789/0 conn(0x7f4a7006a950 legacy=0x7f4a70155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:12.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.279+0000 7f4a6effd640 1 -- 172.21.15.37:0/672087768 >> v1:172.21.15.37:6789/0 conn(0x7f4a700bb140 legacy=0x7f4a700bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:12.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.279+0000 7f4a6effd640 1 -- 172.21.15.37:0/672087768 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a700bb520 con 0x7f4a700bf510 2023-12-19T16:07:12.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.280+0000 7f4a6effd640 1 --2- 172.21.15.37:0/672087768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a700bf510 0x7f4a700be350 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4a640097a0 tx=0x7f4a6402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37626bc15fccfbd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:12.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.280+0000 7f4a6e7fc640 1 -- 172.21.15.37:0/672087768 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a64030610 con 0x7f4a700bf510 2023-12-19T16:07:12.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.280+0000 7f4a6e7fc640 1 -- 172.21.15.37:0/672087768 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a64030770 con 0x7f4a700bf510 2023-12-19T16:07:12.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.280+0000 7f4a6e7fc640 1 -- 172.21.15.37:0/672087768 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a64030b00 con 0x7f4a700bf510 2023-12-19T16:07:12.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.281+0000 7f4a761b9640 1 -- 172.21.15.37:0/672087768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a700bf510 msgr2=0x7f4a700be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:12.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.281+0000 7f4a761b9640 1 --2- 172.21.15.37:0/672087768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a700bf510 0x7f4a700be350 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4a640097a0 tx=0x7f4a6402b960 comp rx=0 tx=0).stop 2023-12-19T16:07:12.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.281+0000 7f4a761b9640 1 -- 172.21.15.37:0/672087768 shutdown_connections 2023-12-19T16:07:12.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.281+0000 7f4a761b9640 1 --2- 172.21.15.37:0/672087768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a700bf510 0x7f4a700be350 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.281+0000 7f4a761b9640 1 -- 172.21.15.37:0/672087768 >> 172.21.15.37:0/672087768 conn(0x7f4a700bcfd0 msgr2=0x7f4a700bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:12.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.281+0000 7f4a761b9640 1 -- 172.21.15.37:0/672087768 shutdown_connections 2023-12-19T16:07:12.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.281+0000 7f4a761b9640 1 -- 172.21.15.37:0/672087768 wait complete. 2023-12-19T16:07:12.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.282+0000 7f4a761b9640 1 Processor -- start 2023-12-19T16:07:12.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.282+0000 7f4a761b9640 1 -- start start 2023-12-19T16:07:12.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.282+0000 7f4a761b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a7006a950 0x7f4a7014dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:12.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a761b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a700bb140 0x7f4a700a22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:12.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a761b9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a700bf510 0x7f4a70149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:12.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a761b9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a700a2820 con 0x7f4a700bb140 2023-12-19T16:07:12.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a761b9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a701480d0 con 0x7f4a7006a950 2023-12-19T16:07:12.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a761b9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a70149760 con 0x7f4a700bf510 2023-12-19T16:07:12.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a6effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a700bb140 0x7f4a700a22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:12.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a6effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a700bb140 0x7f4a700a22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47826/0 (socket says 172.21.15.37:47826) 2023-12-19T16:07:12.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a6effd640 1 -- 172.21.15.37:0/3848365260 learned_addr learned my addr 172.21.15.37:0/3848365260 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:12.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a6f7fe640 1 --2- 172.21.15.37:0/3848365260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a7006a950 0x7f4a7014dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:12.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a6ffff640 1 --2- 172.21.15.37:0/3848365260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a700bf510 0x7f4a70149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:12.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a6effd640 1 -- 172.21.15.37:0/3848365260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a700bf510 msgr2=0x7f4a70149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:12.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a6effd640 1 --2- 172.21.15.37:0/3848365260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a700bf510 0x7f4a70149db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a6effd640 1 -- 172.21.15.37:0/3848365260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a7006a950 msgr2=0x7f4a7014dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:12.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a6effd640 1 --2- 172.21.15.37:0/3848365260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a7006a950 0x7f4a7014dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a6effd640 1 -- 172.21.15.37:0/3848365260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a64009400 con 0x7f4a700bb140 2023-12-19T16:07:12.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a6effd640 1 --2- 172.21.15.37:0/3848365260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a700bb140 0x7f4a700a22e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4a64009890 tx=0x7f4a64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:12.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a57fff640 1 -- 172.21.15.37:0/3848365260 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6403e040 con 0x7f4a700bb140 2023-12-19T16:07:12.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a57fff640 1 -- 172.21.15.37:0/3848365260 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a64039ce0 con 0x7f4a700bb140 2023-12-19T16:07:12.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a761b9640 1 -- 172.21.15.37:0/3848365260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7014d9c0 con 0x7f4a700bb140 2023-12-19T16:07:12.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a57fff640 1 -- 172.21.15.37:0/3848365260 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a64043680 con 0x7f4a700bb140 2023-12-19T16:07:12.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.283+0000 7f4a761b9640 1 -- 172.21.15.37:0/3848365260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a701483d0 con 0x7f4a700bb140 2023-12-19T16:07:12.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.284+0000 7f4a761b9640 1 -- 172.21.15.37:0/3848365260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a700740a0 con 0x7f4a700bb140 2023-12-19T16:07:12.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.285+0000 7f4a57fff640 1 -- 172.21.15.37:0/3848365260 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4a640423e0 con 0x7f4a700bb140 2023-12-19T16:07:12.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.285+0000 7f4a57fff640 1 --2- 172.21.15.37:0/3848365260 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4a5c06a460 0x7f4a5c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:12.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.285+0000 7f4a57fff640 1 -- 172.21.15.37:0/3848365260 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a640aa9e0 con 0x7f4a700bb140 2023-12-19T16:07:12.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.285+0000 7f4a6f7fe640 1 --2- 172.21.15.37:0/3848365260 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4a5c06a460 0x7f4a5c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:12.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.286+0000 7f4a6f7fe640 1 --2- 172.21.15.37:0/3848365260 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4a5c06a460 0x7f4a5c06c920 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4a600011e0 tx=0x7f4a60007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:12.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.289+0000 7f4a57fff640 1 -- 172.21.15.37:0/3848365260 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4a64076110 con 0x7f4a700bb140 2023-12-19T16:07:12.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.463+0000 7f4a761b9640 1 -- 172.21.15.37:0/3848365260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a700ba4a0 con 0x7f4a700bb140 2023-12-19T16:07:12.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.464+0000 7f4a57fff640 1 -- 172.21.15.37:0/3848365260 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a64079730 con 0x7f4a700bb140 2023-12-19T16:07:12.466 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-19T16:07:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.465+0000 7f4a761b9640 1 -- 172.21.15.37:0/3848365260 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4a5c06a460 msgr2=0x7f4a5c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.465+0000 7f4a761b9640 1 --2- 172.21.15.37:0/3848365260 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4a5c06a460 0x7f4a5c06c920 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4a600011e0 tx=0x7f4a60007d30 comp rx=0 tx=0).stop 2023-12-19T16:07:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.465+0000 7f4a761b9640 1 -- 172.21.15.37:0/3848365260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a700bb140 msgr2=0x7f4a700a22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.465+0000 7f4a761b9640 1 --2- 172.21.15.37:0/3848365260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a700bb140 0x7f4a700a22e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4a64009890 tx=0x7f4a64004730 comp rx=0 tx=0).stop 2023-12-19T16:07:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.465+0000 7f4a761b9640 1 -- 172.21.15.37:0/3848365260 shutdown_connections 2023-12-19T16:07:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.465+0000 7f4a761b9640 1 --2- 172.21.15.37:0/3848365260 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4a5c06a460 0x7f4a5c06c920 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.465+0000 7f4a761b9640 1 --2- 172.21.15.37:0/3848365260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a700bf510 0x7f4a70149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.465+0000 7f4a761b9640 1 --2- 172.21.15.37:0/3848365260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a700bb140 0x7f4a700a22e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.465+0000 7f4a761b9640 1 --2- 172.21.15.37:0/3848365260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a7006a950 0x7f4a7014dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.466+0000 7f4a761b9640 1 -- 172.21.15.37:0/3848365260 >> 172.21.15.37:0/3848365260 conn(0x7f4a700bcfd0 msgr2=0x7f4a700a5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.466+0000 7f4a761b9640 1 -- 172.21.15.37:0/3848365260 shutdown_connections 2023-12-19T16:07:12.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.466+0000 7f4a761b9640 1 -- 172.21.15.37:0/3848365260 wait complete. 2023-12-19T16:07:12.478 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:07:12.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.584+0000 7f6d0a941640 1 Processor -- start 2023-12-19T16:07:12.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.584+0000 7f6d0a941640 1 -- start start 2023-12-19T16:07:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.585+0000 7f6d0a941640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6d041476b0 0x7f6d0406f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.585+0000 7f6d0a941640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d041416f0 con 0x7f6d040b6770 2023-12-19T16:07:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.585+0000 7f6d0a941640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d04070600 con 0x7f6d0406f510 2023-12-19T16:07:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.585+0000 7f6d0a941640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d0406b2c0 con 0x7f6d041476b0 2023-12-19T16:07:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.585+0000 7f6d08ede640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6d041476b0 0x7f6d0406f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.585+0000 7f6d08ede640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6d041476b0 0x7f6d0406f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47840/0 (socket says 172.21.15.37:47840) 2023-12-19T16:07:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.585+0000 7f6d03fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6d040b6770 0x7f6d0406abb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46462/0 (socket says 172.21.15.37:46462) 2023-12-19T16:07:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.585+0000 7f6d08ede640 1 -- 172.21.15.37:0/4398058 learned_addr learned my addr 172.21.15.37:0/4398058 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.586+0000 7f6d08ede640 1 -- 172.21.15.37:0/4398058 >> v1:172.21.15.78:6789/0 conn(0x7f6d0406f510 legacy=0x7f6d04146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.586+0000 7f6d08ede640 1 -- 172.21.15.37:0/4398058 >> v1:172.21.15.37:6789/0 conn(0x7f6d040b6770 legacy=0x7f6d0406abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:12.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.586+0000 7f6d08ede640 1 -- 172.21.15.37:0/4398058 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d040b6b50 con 0x7f6d041476b0 2023-12-19T16:07:12.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.586+0000 7f6d02ffd640 1 -- 172.21.15.37:0/4398058 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966694476 0 0) 0x7f6d041416f0 con 0x7f6d040b6770 2023-12-19T16:07:12.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.586+0000 7f6d08ede640 1 --2- 172.21.15.37:0/4398058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d041476b0 0x7f6d0406f950 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc009e50 tx=0x7f6cfc02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c4a21681cb218a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:12.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.586+0000 7f6d02ffd640 1 -- 172.21.15.37:0/4398058 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc02cbb0 con 0x7f6d041476b0 2023-12-19T16:07:12.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.587+0000 7f6d02ffd640 1 -- 172.21.15.37:0/4398058 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cfc02cd10 con 0x7f6d041476b0 2023-12-19T16:07:12.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.587+0000 7f6d02ffd640 1 -- 172.21.15.37:0/4398058 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc034610 con 0x7f6d041476b0 2023-12-19T16:07:12.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.587+0000 7f6d0a941640 1 -- 172.21.15.37:0/4398058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d041476b0 msgr2=0x7f6d0406f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:12.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.587+0000 7f6d0a941640 1 --2- 172.21.15.37:0/4398058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d041476b0 0x7f6d0406f950 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc009e50 tx=0x7f6cfc02c010 comp rx=0 tx=0).stop 2023-12-19T16:07:12.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.587+0000 7f6d0a941640 1 -- 172.21.15.37:0/4398058 shutdown_connections 2023-12-19T16:07:12.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.587+0000 7f6d0a941640 1 --2- 172.21.15.37:0/4398058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d041476b0 0x7f6d0406f950 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.587+0000 7f6d0a941640 1 -- 172.21.15.37:0/4398058 >> 172.21.15.37:0/4398058 conn(0x7f6d040b91b0 msgr2=0x7f6d040b95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:12.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.587+0000 7f6d0a941640 1 -- 172.21.15.37:0/4398058 shutdown_connections 2023-12-19T16:07:12.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.587+0000 7f6d0a941640 1 -- 172.21.15.37:0/4398058 wait complete. 2023-12-19T16:07:12.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.588+0000 7f6d0a941640 1 Processor -- start 2023-12-19T16:07:12.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.588+0000 7f6d0a941640 1 -- start start 2023-12-19T16:07:12.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.589+0000 7f6d0a941640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d0406f510 0x7f6d0413af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:12.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.589+0000 7f6d0a941640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d040b6770 0x7f6d040b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:12.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.589+0000 7f6d0a941640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d040b27c0 0x7f6d04137ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:12.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.589+0000 7f6d0a941640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0413b4c0 con 0x7f6d040b6770 2023-12-19T16:07:12.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.589+0000 7f6d0a941640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040b09c0 con 0x7f6d0406f510 2023-12-19T16:07:12.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.589+0000 7f6d0a941640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040b15d0 con 0x7f6d040b27c0 2023-12-19T16:07:12.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.589+0000 7f6d037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d040b6770 0x7f6d040b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:12.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.589+0000 7f6d037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d040b6770 0x7f6d040b2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47846/0 (socket says 172.21.15.37:47846) 2023-12-19T16:07:12.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.589+0000 7f6d037fe640 1 -- 172.21.15.37:0/3217983881 learned_addr learned my addr 172.21.15.37:0/3217983881 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:12.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.589+0000 7f6d03fff640 1 --2- 172.21.15.37:0/3217983881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d0406f510 0x7f6d0413af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:12.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.589+0000 7f6d08ede640 1 --2- 172.21.15.37:0/3217983881 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d040b27c0 0x7f6d04137ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:12.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.589+0000 7f6d037fe640 1 -- 172.21.15.37:0/3217983881 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d040b27c0 msgr2=0x7f6d04137ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:12.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.589+0000 7f6d037fe640 1 --2- 172.21.15.37:0/3217983881 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d040b27c0 0x7f6d04137ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.589+0000 7f6d037fe640 1 -- 172.21.15.37:0/3217983881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d0406f510 msgr2=0x7f6d0413af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:12.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.589+0000 7f6d037fe640 1 --2- 172.21.15.37:0/3217983881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d0406f510 0x7f6d0413af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.589+0000 7f6d037fe640 1 -- 172.21.15.37:0/3217983881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc009b30 con 0x7f6d040b6770 2023-12-19T16:07:12.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.589+0000 7f6d08ede640 1 --2- 172.21.15.37:0/3217983881 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d040b27c0 0x7f6d04137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:12.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.589+0000 7f6d037fe640 1 --2- 172.21.15.37:0/3217983881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d040b6770 0x7f6d040b2280 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800c480 tx=0x7f6cf800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:12.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.590+0000 7f6d00ff9640 1 -- 172.21.15.37:0/3217983881 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf80052d0 con 0x7f6d040b6770 2023-12-19T16:07:12.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.590+0000 7f6d00ff9640 1 -- 172.21.15.37:0/3217983881 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf8005430 con 0x7f6d040b6770 2023-12-19T16:07:12.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.590+0000 7f6d0a941640 1 -- 172.21.15.37:0/3217983881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d040b00d0 con 0x7f6d040b6770 2023-12-19T16:07:12.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.590+0000 7f6d00ff9640 1 -- 172.21.15.37:0/3217983881 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8012870 con 0x7f6d040b6770 2023-12-19T16:07:12.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.590+0000 7f6d0a941640 1 -- 172.21.15.37:0/3217983881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d040b0370 con 0x7f6d040b6770 2023-12-19T16:07:12.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.591+0000 7f6d0a941640 1 -- 172.21.15.37:0/3217983881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d040740a0 con 0x7f6d040b6770 2023-12-19T16:07:12.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.591+0000 7f6d00ff9640 1 -- 172.21.15.37:0/3217983881 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6cf80129d0 con 0x7f6d040b6770 2023-12-19T16:07:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.591+0000 7f6d00ff9640 1 --2- 172.21.15.37:0/3217983881 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6cf006a430 0x7f6cf006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.591+0000 7f6d00ff9640 1 -- 172.21.15.37:0/3217983881 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cf80884a0 con 0x7f6d040b6770 2023-12-19T16:07:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.592+0000 7f6d03fff640 1 --2- 172.21.15.37:0/3217983881 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6cf006a430 0x7f6cf006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.592+0000 7f6d03fff640 1 --2- 172.21.15.37:0/3217983881 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6cf006a430 0x7f6cf006c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4000f60 tx=0x7f6cf4007b90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:12.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.596+0000 7f6d00ff9640 1 -- 172.21.15.37:0/3217983881 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6cf8053b20 con 0x7f6d040b6770 2023-12-19T16:07:12.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.770+0000 7f6d0a941640 1 -- 172.21.15.37:0/3217983881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6d04071a90 con 0x7f6d040b6770 2023-12-19T16:07:12.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.770+0000 7f6d00ff9640 1 -- 172.21.15.37:0/3217983881 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6cf8057140 con 0x7f6d040b6770 2023-12-19T16:07:12.772 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-19T16:07:12.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.772+0000 7f6d0a941640 1 -- 172.21.15.37:0/3217983881 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6cf006a430 msgr2=0x7f6cf006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:12.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.772+0000 7f6d0a941640 1 --2- 172.21.15.37:0/3217983881 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6cf006a430 0x7f6cf006c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4000f60 tx=0x7f6cf4007b90 comp rx=0 tx=0).stop 2023-12-19T16:07:12.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.772+0000 7f6d0a941640 1 -- 172.21.15.37:0/3217983881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d040b6770 msgr2=0x7f6d040b2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:12.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.772+0000 7f6d0a941640 1 --2- 172.21.15.37:0/3217983881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d040b6770 0x7f6d040b2280 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800c480 tx=0x7f6cf800c940 comp rx=0 tx=0).stop 2023-12-19T16:07:12.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.772+0000 7f6d0a941640 1 -- 172.21.15.37:0/3217983881 shutdown_connections 2023-12-19T16:07:12.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.772+0000 7f6d0a941640 1 --2- 172.21.15.37:0/3217983881 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6cf006a430 0x7f6cf006c8f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.772+0000 7f6d0a941640 1 --2- 172.21.15.37:0/3217983881 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6d040b27c0 0x7f6d04137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.772+0000 7f6d0a941640 1 --2- 172.21.15.37:0/3217983881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d040b6770 0x7f6d040b2280 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.772+0000 7f6d0a941640 1 --2- 172.21.15.37:0/3217983881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6d0406f510 0x7f6d0413af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.772+0000 7f6d0a941640 1 -- 172.21.15.37:0/3217983881 >> 172.21.15.37:0/3217983881 conn(0x7f6d040b91b0 msgr2=0x7f6d04072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:12.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.772+0000 7f6d0a941640 1 -- 172.21.15.37:0/3217983881 shutdown_connections 2023-12-19T16:07:12.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.772+0000 7f6d0a941640 1 -- 172.21.15.37:0/3217983881 wait complete. 2023-12-19T16:07:12.785 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:07:12.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.892+0000 7fbf8a73e640 1 Processor -- start 2023-12-19T16:07:12.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.892+0000 7fbf8a73e640 1 -- start start 2023-12-19T16:07:12.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.893+0000 7fbf8a73e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf840bb140 0x7fbf840be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:12.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.893+0000 7fbf8a73e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf8406a950 0x7fbf840bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:12.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.893+0000 7fbf8a73e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf840bfa50 con 0x7fbf840bee00 2023-12-19T16:07:12.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.893+0000 7fbf8a73e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf840bbda0 con 0x7fbf840bb140 2023-12-19T16:07:12.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.893+0000 7fbf8a73e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8406b040 con 0x7fbf8406a950 2023-12-19T16:07:12.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.893+0000 7fbf83fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf840bb140 0x7fbf840be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:12.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.893+0000 7fbf83fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf840bb140 0x7fbf840be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47858/0 (socket says 172.21.15.37:47858) 2023-12-19T16:07:12.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.893+0000 7fbf83fff640 1 -- 172.21.15.37:0/1338573819 learned_addr learned my addr 172.21.15.37:0/1338573819 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:12.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.893+0000 7fbf837fe640 1 --2- 172.21.15.37:0/1338573819 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf8406a950 0x7fbf840bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:12.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.893+0000 7fbf83fff640 1 -- 172.21.15.37:0/1338573819 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf8406a950 msgr2=0x7fbf840bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:12.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.893+0000 7fbf83fff640 1 --2- 172.21.15.37:0/1338573819 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf8406a950 0x7fbf840bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.893+0000 7fbf83fff640 1 -- 172.21.15.37:0/1338573819 >> v1:172.21.15.78:6789/0 conn(0x7fbf840bee00 legacy=0x7fbf8414e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:12.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.893+0000 7fbf83fff640 1 -- 172.21.15.37:0/1338573819 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf840bb520 con 0x7fbf840bb140 2023-12-19T16:07:12.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.894+0000 7fbf83fff640 1 --2- 172.21.15.37:0/1338573819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf840bb140 0x7fbf840be350 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbf78009870 tx=0x7fbf7802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77362f362fd44bc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:12.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.894+0000 7fbf82ffd640 1 -- 172.21.15.37:0/1338573819 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf780317c0 con 0x7fbf840bb140 2023-12-19T16:07:12.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.894+0000 7fbf82ffd640 1 -- 172.21.15.37:0/1338573819 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf78031920 con 0x7fbf840bb140 2023-12-19T16:07:12.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.894+0000 7fbf82ffd640 1 -- 172.21.15.37:0/1338573819 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78031cb0 con 0x7fbf840bb140 2023-12-19T16:07:12.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.895+0000 7fbf8a73e640 1 -- 172.21.15.37:0/1338573819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf840bb140 msgr2=0x7fbf840be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:12.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.895+0000 7fbf8a73e640 1 --2- 172.21.15.37:0/1338573819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf840bb140 0x7fbf840be350 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbf78009870 tx=0x7fbf7802b860 comp rx=0 tx=0).stop 2023-12-19T16:07:12.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.895+0000 7fbf8a73e640 1 -- 172.21.15.37:0/1338573819 shutdown_connections 2023-12-19T16:07:12.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.895+0000 7fbf8a73e640 1 --2- 172.21.15.37:0/1338573819 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf8406a950 0x7fbf840bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.895+0000 7fbf8a73e640 1 --2- 172.21.15.37:0/1338573819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf840bb140 0x7fbf840be350 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.895+0000 7fbf8a73e640 1 -- 172.21.15.37:0/1338573819 >> 172.21.15.37:0/1338573819 conn(0x7fbf840bcfd0 msgr2=0x7fbf840bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:12.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.895+0000 7fbf8a73e640 1 -- 172.21.15.37:0/1338573819 shutdown_connections 2023-12-19T16:07:12.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.895+0000 7fbf8a73e640 1 -- 172.21.15.37:0/1338573819 wait complete. 2023-12-19T16:07:12.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.896+0000 7fbf8a73e640 1 Processor -- start 2023-12-19T16:07:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.896+0000 7fbf8a73e640 1 -- start start 2023-12-19T16:07:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.896+0000 7fbf8a73e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf8406a950 0x7fbf840a1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.896+0000 7fbf8a73e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf840bb140 0x7fbf84148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.896+0000 7fbf8a73e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf840bee00 0x7fbf841e3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.896+0000 7fbf8a73e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf840a1ea0 con 0x7fbf840bee00 2023-12-19T16:07:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.896+0000 7fbf8a73e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf841453e0 con 0x7fbf8406a950 2023-12-19T16:07:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.896+0000 7fbf8a73e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf841480b0 con 0x7fbf840bb140 2023-12-19T16:07:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.897+0000 7fbf88cdb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf840bee00 0x7fbf841e3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.897+0000 7fbf88cdb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf840bee00 0x7fbf841e3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47866/0 (socket says 172.21.15.37:47866) 2023-12-19T16:07:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.897+0000 7fbf88cdb640 1 -- 172.21.15.37:0/973349672 learned_addr learned my addr 172.21.15.37:0/973349672 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.897+0000 7fbf837fe640 1 --2- 172.21.15.37:0/973349672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf840bb140 0x7fbf84148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.897+0000 7fbf83fff640 1 --2- 172.21.15.37:0/973349672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf8406a950 0x7fbf840a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.897+0000 7fbf88cdb640 1 -- 172.21.15.37:0/973349672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf840bb140 msgr2=0x7fbf84148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.897+0000 7fbf88cdb640 1 --2- 172.21.15.37:0/973349672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf840bb140 0x7fbf84148890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.897+0000 7fbf88cdb640 1 -- 172.21.15.37:0/973349672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf8406a950 msgr2=0x7fbf840a1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.897+0000 7fbf88cdb640 1 --2- 172.21.15.37:0/973349672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf8406a950 0x7fbf840a1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.897+0000 7fbf88cdb640 1 -- 172.21.15.37:0/973349672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf780094d0 con 0x7fbf840bee00 2023-12-19T16:07:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.897+0000 7fbf837fe640 1 --2- 172.21.15.37:0/973349672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf840bb140 0x7fbf84148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.897+0000 7fbf83fff640 1 --2- 172.21.15.37:0/973349672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf8406a950 0x7fbf840a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.897+0000 7fbf88cdb640 1 --2- 172.21.15.37:0/973349672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf840bee00 0x7fbf841e3830 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00c780 tx=0x7fbf7c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.897+0000 7fbf80ff9640 1 -- 172.21.15.37:0/973349672 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c004b60 con 0x7fbf840bee00 2023-12-19T16:07:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.897+0000 7fbf80ff9640 1 -- 172.21.15.37:0/973349672 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7c00ce90 con 0x7fbf840bee00 2023-12-19T16:07:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.897+0000 7fbf8a73e640 1 -- 172.21.15.37:0/973349672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf84147820 con 0x7fbf840bee00 2023-12-19T16:07:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.897+0000 7fbf80ff9640 1 -- 172.21.15.37:0/973349672 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c00a7f0 con 0x7fbf840bee00 2023-12-19T16:07:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.897+0000 7fbf8a73e640 1 -- 172.21.15.37:0/973349672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf84147d40 con 0x7fbf840bee00 2023-12-19T16:07:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.898+0000 7fbf8a73e640 1 -- 172.21.15.37:0/973349672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf840740a0 con 0x7fbf840bee00 2023-12-19T16:07:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.899+0000 7fbf80ff9640 1 -- 172.21.15.37:0/973349672 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbf7c00a950 con 0x7fbf840bee00 2023-12-19T16:07:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.899+0000 7fbf80ff9640 1 --2- 172.21.15.37:0/973349672 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbf7006a430 0x7fbf7006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.899+0000 7fbf80ff9640 1 -- 172.21.15.37:0/973349672 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf7c088840 con 0x7fbf840bee00 2023-12-19T16:07:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.899+0000 7fbf83fff640 1 --2- 172.21.15.37:0/973349672 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbf7006a430 0x7fbf7006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.900+0000 7fbf83fff640 1 --2- 172.21.15.37:0/973349672 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbf7006a430 0x7fbf7006c8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbf78036000 tx=0x7fbf7803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:12.903+0000 7fbf80ff9640 1 -- 172.21.15.37:0/973349672 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbf7c053ec0 con 0x7fbf840bee00 2023-12-19T16:07:13.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.081+0000 7fbf8a73e640 1 -- 172.21.15.37:0/973349672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbf840b4220 con 0x7fbf840bee00 2023-12-19T16:07:13.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.081+0000 7fbf80ff9640 1 -- 172.21.15.37:0/973349672 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbf840b4220 con 0x7fbf840bee00 2023-12-19T16:07:13.083 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-19T16:07:13.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.083+0000 7fbf8a73e640 1 -- 172.21.15.37:0/973349672 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbf7006a430 msgr2=0x7fbf7006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:13.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.083+0000 7fbf8a73e640 1 --2- 172.21.15.37:0/973349672 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbf7006a430 0x7fbf7006c8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbf78036000 tx=0x7fbf7803d040 comp rx=0 tx=0).stop 2023-12-19T16:07:13.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.083+0000 7fbf8a73e640 1 -- 172.21.15.37:0/973349672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf840bee00 msgr2=0x7fbf841e3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.083+0000 7fbf8a73e640 1 --2- 172.21.15.37:0/973349672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf840bee00 0x7fbf841e3830 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00c780 tx=0x7fbf7c00cc40 comp rx=0 tx=0).stop 2023-12-19T16:07:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.083+0000 7fbf8a73e640 1 -- 172.21.15.37:0/973349672 shutdown_connections 2023-12-19T16:07:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.083+0000 7fbf8a73e640 1 --2- 172.21.15.37:0/973349672 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbf7006a430 0x7fbf7006c8f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.083+0000 7fbf8a73e640 1 --2- 172.21.15.37:0/973349672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf840bee00 0x7fbf841e3830 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.083+0000 7fbf8a73e640 1 --2- 172.21.15.37:0/973349672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf840bb140 0x7fbf84148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.083+0000 7fbf8a73e640 1 --2- 172.21.15.37:0/973349672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf8406a950 0x7fbf840a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.083+0000 7fbf8a73e640 1 -- 172.21.15.37:0/973349672 >> 172.21.15.37:0/973349672 conn(0x7fbf840bcfd0 msgr2=0x7fbf840a4560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.083+0000 7fbf8a73e640 1 -- 172.21.15.37:0/973349672 shutdown_connections 2023-12-19T16:07:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.083+0000 7fbf8a73e640 1 -- 172.21.15.37:0/973349672 wait complete. 2023-12-19T16:07:13.097 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:07:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.200+0000 7f2e45ff0640 1 Processor -- start 2023-12-19T16:07:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.201+0000 7f2e45ff0640 1 -- start start 2023-12-19T16:07:13.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.201+0000 7f2e45ff0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2e400bcdd0 0x7f2e400b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.201+0000 7f2e45ff0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2e40144ea0 0x7f2e40155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.201+0000 7f2e45ff0640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e400bc6b0 con 0x7f2e400b64c0 2023-12-19T16:07:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.201+0000 7f2e45ff0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e400b6900 con 0x7f2e400bcdd0 2023-12-19T16:07:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.201+0000 7f2e45ff0640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e400a59f0 con 0x7f2e40144ea0 2023-12-19T16:07:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.201+0000 7f2e3f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2e400bcdd0 0x7f2e400b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.201+0000 7f2e3f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2e400bcdd0 0x7f2e400b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47878/0 (socket says 172.21.15.37:47878) 2023-12-19T16:07:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.201+0000 7f2e3f7fe640 1 -- 172.21.15.37:0/2143001092 learned_addr learned my addr 172.21.15.37:0/2143001092 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.202+0000 7f2e3ffff640 1 --2- 172.21.15.37:0/2143001092 >> v2:172.21.15.78:3300/0 conn(0x7f2e40144ea0 0x7f2e40155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.202+0000 7f2e3f7fe640 1 -- 172.21.15.37:0/2143001092 >> v2:172.21.15.78:3300/0 conn(0x7f2e40144ea0 msgr2=0x7f2e40155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.202+0000 7f2e3f7fe640 1 --2- 172.21.15.37:0/2143001092 >> v2:172.21.15.78:3300/0 conn(0x7f2e40144ea0 0x7f2e40155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.202+0000 7f2e3f7fe640 1 -- 172.21.15.37:0/2143001092 >> v1:172.21.15.78:6789/0 conn(0x7f2e400b64c0 legacy=0x7f2e40144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.202+0000 7f2e3f7fe640 1 -- 172.21.15.37:0/2143001092 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e400bc0a0 con 0x7f2e400bcdd0 2023-12-19T16:07:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.202+0000 7f2e3f7fe640 1 --2- 172.21.15.37:0/2143001092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e400bcdd0 0x7f2e400b5f80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2e4006a090 tx=0x7f2e3002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e479d8f66542559a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.202+0000 7f2e3e7fc640 1 -- 172.21.15.37:0/2143001092 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e30030860 con 0x7f2e400bcdd0 2023-12-19T16:07:13.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.203+0000 7f2e3e7fc640 1 -- 172.21.15.37:0/2143001092 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e300309c0 con 0x7f2e400bcdd0 2023-12-19T16:07:13.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.203+0000 7f2e3e7fc640 1 -- 172.21.15.37:0/2143001092 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e30030d50 con 0x7f2e400bcdd0 2023-12-19T16:07:13.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.203+0000 7f2e45ff0640 1 -- 172.21.15.37:0/2143001092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e400bcdd0 msgr2=0x7f2e400b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:13.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.203+0000 7f2e45ff0640 1 --2- 172.21.15.37:0/2143001092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e400bcdd0 0x7f2e400b5f80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2e4006a090 tx=0x7f2e3002b9a0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.203+0000 7f2e45ff0640 1 -- 172.21.15.37:0/2143001092 shutdown_connections 2023-12-19T16:07:13.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.203+0000 7f2e45ff0640 1 --2- 172.21.15.37:0/2143001092 >> v2:172.21.15.78:3300/0 conn(0x7f2e40144ea0 0x7f2e40155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.203+0000 7f2e45ff0640 1 --2- 172.21.15.37:0/2143001092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e400bcdd0 0x7f2e400b5f80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.203+0000 7f2e45ff0640 1 -- 172.21.15.37:0/2143001092 >> 172.21.15.37:0/2143001092 conn(0x7f2e40071e60 msgr2=0x7f2e400c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:13.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.203+0000 7f2e45ff0640 1 -- 172.21.15.37:0/2143001092 shutdown_connections 2023-12-19T16:07:13.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.203+0000 7f2e45ff0640 1 -- 172.21.15.37:0/2143001092 wait complete. 2023-12-19T16:07:13.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.204+0000 7f2e45ff0640 1 Processor -- start 2023-12-19T16:07:13.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.204+0000 7f2e45ff0640 1 -- start start 2023-12-19T16:07:13.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.205+0000 7f2e45ff0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e400b64c0 0x7f2e4014af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.205+0000 7f2e45ff0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e400bcdd0 0x7f2e401491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.205+0000 7f2e45ff0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e40144ea0 0x7f2e401e3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.205+0000 7f2e45ff0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e401e3590 con 0x7f2e400bcdd0 2023-12-19T16:07:13.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.205+0000 7f2e45ff0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e40148d10 con 0x7f2e40144ea0 2023-12-19T16:07:13.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.205+0000 7f2e45ff0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4014a300 con 0x7f2e400b64c0 2023-12-19T16:07:13.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.205+0000 7f2e3effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e400bcdd0 0x7f2e401491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.205+0000 7f2e3effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e400bcdd0 0x7f2e401491a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47892/0 (socket says 172.21.15.37:47892) 2023-12-19T16:07:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.205+0000 7f2e3effd640 1 -- 172.21.15.37:0/2734411333 learned_addr learned my addr 172.21.15.37:0/2734411333 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.205+0000 7f2e3ffff640 1 --2- 172.21.15.37:0/2734411333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e40144ea0 0x7f2e401e3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.205+0000 7f2e3f7fe640 1 --2- 172.21.15.37:0/2734411333 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e400b64c0 0x7f2e4014af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.205+0000 7f2e3effd640 1 -- 172.21.15.37:0/2734411333 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e400b64c0 msgr2=0x7f2e4014af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.205+0000 7f2e3effd640 1 --2- 172.21.15.37:0/2734411333 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e400b64c0 0x7f2e4014af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.205+0000 7f2e3effd640 1 -- 172.21.15.37:0/2734411333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e40144ea0 msgr2=0x7f2e401e3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.205+0000 7f2e3effd640 1 --2- 172.21.15.37:0/2734411333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e40144ea0 0x7f2e401e3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.205+0000 7f2e3effd640 1 -- 172.21.15.37:0/2734411333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e300094d0 con 0x7f2e400bcdd0 2023-12-19T16:07:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.205+0000 7f2e3f7fe640 1 --2- 172.21.15.37:0/2734411333 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e400b64c0 0x7f2e4014af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.206+0000 7f2e3effd640 1 --2- 172.21.15.37:0/2734411333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e400bcdd0 0x7f2e401491a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400c430 tx=0x7f2e3400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.206+0000 7f2e27fff640 1 -- 172.21.15.37:0/2734411333 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34011790 con 0x7f2e400bcdd0 2023-12-19T16:07:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.206+0000 7f2e27fff640 1 -- 172.21.15.37:0/2734411333 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e340118f0 con 0x7f2e400bcdd0 2023-12-19T16:07:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.206+0000 7f2e45ff0640 1 -- 172.21.15.37:0/2734411333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4014a570 con 0x7f2e400bcdd0 2023-12-19T16:07:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.206+0000 7f2e27fff640 1 -- 172.21.15.37:0/2734411333 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34011ce0 con 0x7f2e400bcdd0 2023-12-19T16:07:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.206+0000 7f2e45ff0640 1 -- 172.21.15.37:0/2734411333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e401489a0 con 0x7f2e400bcdd0 2023-12-19T16:07:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.207+0000 7f2e45ff0640 1 -- 172.21.15.37:0/2734411333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4014b640 con 0x7f2e400bcdd0 2023-12-19T16:07:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.207+0000 7f2e27fff640 1 -- 172.21.15.37:0/2734411333 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2e3401c460 con 0x7f2e400bcdd0 2023-12-19T16:07:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.208+0000 7f2e27fff640 1 --2- 172.21.15.37:0/2734411333 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2e2c06a460 0x7f2e2c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.208+0000 7f2e27fff640 1 -- 172.21.15.37:0/2734411333 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e34088740 con 0x7f2e400bcdd0 2023-12-19T16:07:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.208+0000 7f2e3f7fe640 1 --2- 172.21.15.37:0/2734411333 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2e2c06a460 0x7f2e2c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.208+0000 7f2e3f7fe640 1 --2- 172.21.15.37:0/2734411333 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2e2c06a460 0x7f2e2c06c920 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2e30036000 tx=0x7f2e30008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.212+0000 7f2e27fff640 1 -- 172.21.15.37:0/2734411333 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2e34053d30 con 0x7f2e400bcdd0 2023-12-19T16:07:13.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.423+0000 7f2e45ff0640 1 -- 172.21.15.37:0/2734411333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e400b9640 con 0x7f2e400bcdd0 2023-12-19T16:07:13.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.424+0000 7f2e27fff640 1 -- 172.21.15.37:0/2734411333 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3947 (secure 0 0 0) 0x7f2e34057350 con 0x7f2e400bcdd0 2023-12-19T16:07:13.426 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:13.426 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4079311036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4079311036},{"type":"v1","addr":"172.21.15.37:6834","nonce":4079311036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1300485428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1300485428},{"type":"v1","addr":"172.21.15.37:6835","nonce":1300485428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:06:58.727746+0000","modified":"2023-12-19T16:07:01.300113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/3319636422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3319636422},{"type":"v1","addr":"172.21.15.78:6835","nonce":3319636422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:07:13.427 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-12-19T16:07:13.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.426+0000 7f2e45ff0640 1 -- 172.21.15.37:0/2734411333 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2e2c06a460 msgr2=0x7f2e2c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:13.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.426+0000 7f2e45ff0640 1 --2- 172.21.15.37:0/2734411333 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2e2c06a460 0x7f2e2c06c920 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2e30036000 tx=0x7f2e30008030 comp rx=0 tx=0).stop 2023-12-19T16:07:13.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.426+0000 7f2e45ff0640 1 -- 172.21.15.37:0/2734411333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e400bcdd0 msgr2=0x7f2e401491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:13.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.426+0000 7f2e45ff0640 1 --2- 172.21.15.37:0/2734411333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e400bcdd0 0x7f2e401491a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400c430 tx=0x7f2e3400c8f0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.426+0000 7f2e45ff0640 1 -- 172.21.15.37:0/2734411333 shutdown_connections 2023-12-19T16:07:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.426+0000 7f2e45ff0640 1 --2- 172.21.15.37:0/2734411333 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2e2c06a460 0x7f2e2c06c920 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.426+0000 7f2e45ff0640 1 --2- 172.21.15.37:0/2734411333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e40144ea0 0x7f2e401e3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.426+0000 7f2e45ff0640 1 --2- 172.21.15.37:0/2734411333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e400bcdd0 0x7f2e401491a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.426+0000 7f2e45ff0640 1 --2- 172.21.15.37:0/2734411333 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e400b64c0 0x7f2e4014af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.426+0000 7f2e45ff0640 1 -- 172.21.15.37:0/2734411333 >> 172.21.15.37:0/2734411333 conn(0x7f2e40071e60 msgr2=0x7f2e400b5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.426+0000 7f2e45ff0640 1 -- 172.21.15.37:0/2734411333 shutdown_connections 2023-12-19T16:07:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.426+0000 7f2e45ff0640 1 -- 172.21.15.37:0/2734411333 wait complete. 2023-12-19T16:07:13.439 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:07:13.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.543+0000 7f5bdff16640 1 Processor -- start 2023-12-19T16:07:13.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.543+0000 7f5bdff16640 1 -- start start 2023-12-19T16:07:13.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.543+0000 7f5bdff16640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5bd80b6690 0x7f5bd8144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.543+0000 7f5bdff16640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5bd8144cd0 0x7f5bd8155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.543+0000 7f5bdff16640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd80bc6b0 con 0x7f5bd80bcdd0 2023-12-19T16:07:13.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.543+0000 7f5bdff16640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd80a59f0 con 0x7f5bd80b6690 2023-12-19T16:07:13.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bdff16640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80bc0a0 con 0x7f5bd8144cd0 2023-12-19T16:07:13.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bddcb2640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5bd80bcdd0 0x7f5bd80b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46478/0 (socket says 172.21.15.37:46478) 2023-12-19T16:07:13.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bddcb2640 1 -- 172.21.15.37:0/3746565180 learned_addr learned my addr 172.21.15.37:0/3746565180 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:13.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bdccb0640 1 -- 172.21.15.37:0/3746565180 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201064802 0 0) 0x7f5bd80bc6b0 con 0x7f5bd80bcdd0 2023-12-19T16:07:13.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bdccb0640 1 -- 172.21.15.37:0/3746565180 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bc4003520 con 0x7f5bd80bcdd0 2023-12-19T16:07:13.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bdd4b1640 1 --2- 172.21.15.37:0/3746565180 >> v2:172.21.15.78:3300/0 conn(0x7f5bd80b6690 0x7f5bd8144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bde4b3640 1 --2- 172.21.15.37:0/3746565180 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5bd8144cd0 0x7f5bd8155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bdccb0640 1 -- 172.21.15.37:0/3746565180 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3097976030 0 0) 0x7f5bc4003520 con 0x7f5bd80bcdd0 2023-12-19T16:07:13.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bdccb0640 1 -- 172.21.15.37:0/3746565180 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5bd8144cd0 msgr2=0x7f5bd8155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:13.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bdccb0640 1 --2- 172.21.15.37:0/3746565180 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5bd8144cd0 0x7f5bd8155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bdccb0640 1 -- 172.21.15.37:0/3746565180 >> v2:172.21.15.78:3300/0 conn(0x7f5bd80b6690 msgr2=0x7f5bd8144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:13.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bdccb0640 1 --2- 172.21.15.37:0/3746565180 >> v2:172.21.15.78:3300/0 conn(0x7f5bd80b6690 0x7f5bd8144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bdccb0640 1 -- 172.21.15.37:0/3746565180 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd80bc340 con 0x7f5bd80bcdd0 2023-12-19T16:07:13.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bdccb0640 1 -- 172.21.15.37:0/3746565180 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f5bd4001670 con 0x7f5bd80bcdd0 2023-12-19T16:07:13.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bdccb0640 1 -- 172.21.15.37:0/3746565180 >> v1:172.21.15.37:6789/0 conn(0x7f5bd80bcdd0 legacy=0x7f5bd80b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:13.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bdccb0640 1 --2- 172.21.15.37:0/3746565180 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5bd8144cd0 0x7f5bc4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bdccb0640 1 --2- 172.21.15.37:0/3746565180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bc4003ef0 0x7f5bc40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bdccb0640 1 --2- 172.21.15.37:0/3746565180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bc4004d00 0x7f5bc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bdccb0640 1 -- 172.21.15.37:0/3746565180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80a59f0 con 0x7f5bc4003ef0 2023-12-19T16:07:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bdccb0640 1 -- 172.21.15.37:0/3746565180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80bc0a0 con 0x7f5bc4004d00 2023-12-19T16:07:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bdccb0640 1 -- 172.21.15.37:0/3746565180 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc400b9b0 con 0x7f5bd8144cd0 2023-12-19T16:07:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bdd4b1640 1 --2- 172.21.15.37:0/3746565180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bc4003ef0 0x7f5bc40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bddcb2640 1 --2- 172.21.15.37:0/3746565180 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5bd8144cd0 0x7f5bc4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.544+0000 7f5bde4b3640 1 --2- 172.21.15.37:0/3746565180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bc4004d00 0x7f5bc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.545+0000 7f5bdd4b1640 1 -- 172.21.15.37:0/3746565180 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5bd8144cd0 msgr2=0x7f5bc4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.545+0000 7f5bdd4b1640 1 --2- 172.21.15.37:0/3746565180 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5bd8144cd0 0x7f5bc4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.545+0000 7f5bdd4b1640 1 -- 172.21.15.37:0/3746565180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bc4004d00 msgr2=0x7f5bc4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.545+0000 7f5bdd4b1640 1 --2- 172.21.15.37:0/3746565180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bc4004d00 0x7f5bc4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.545+0000 7f5bdd4b1640 1 -- 172.21.15.37:0/3746565180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc4003520 con 0x7f5bc4003ef0 2023-12-19T16:07:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.545+0000 7f5bdd4b1640 1 --2- 172.21.15.37:0/3746565180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bc4003ef0 0x7f5bc40047c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8009ac0 tx=0x7f5bc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638516965f08f7af server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.546+0000 7f5bdccb0640 1 -- 172.21.15.37:0/3746565180 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc802c710 con 0x7f5bc4003ef0 2023-12-19T16:07:13.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.546+0000 7f5bdccb0640 1 -- 172.21.15.37:0/3746565180 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc802c870 con 0x7f5bc4003ef0 2023-12-19T16:07:13.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.546+0000 7f5bdccb0640 1 -- 172.21.15.37:0/3746565180 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc802cc00 con 0x7f5bc4003ef0 2023-12-19T16:07:13.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.546+0000 7f5bdff16640 1 -- 172.21.15.37:0/3746565180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bc4003ef0 msgr2=0x7f5bc40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:13.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.546+0000 7f5bdff16640 1 --2- 172.21.15.37:0/3746565180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bc4003ef0 0x7f5bc40047c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8009ac0 tx=0x7f5bc40057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.546+0000 7f5bde4b3640 1 -- 172.21.15.37:0/3746565180 reap_dead start 2023-12-19T16:07:13.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.546+0000 7f5bdff16640 1 -- 172.21.15.37:0/3746565180 shutdown_connections 2023-12-19T16:07:13.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.546+0000 7f5bdff16640 1 -- 172.21.15.37:0/3746565180 >> 172.21.15.37:0/3746565180 conn(0x7f5bd8071e60 msgr2=0x7f5bd80c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:13.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.546+0000 7f5bdff16640 1 -- 172.21.15.37:0/3746565180 shutdown_connections 2023-12-19T16:07:13.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.546+0000 7f5bdff16640 1 -- 172.21.15.37:0/3746565180 wait complete. 2023-12-19T16:07:13.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.547+0000 7f5bdff16640 1 Processor -- start 2023-12-19T16:07:13.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.547+0000 7f5bdff16640 1 -- start start 2023-12-19T16:07:13.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.548+0000 7f5bdff16640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5bc4003ef0 0x7f5bd80bb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.548+0000 7f5bdff16640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bd8148260 0x7f5bd81e2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.548+0000 7f5bdff16640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd81e34d0 0x7f5bd813fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.548+0000 7f5bdff16640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80bbb50 con 0x7f5bd8148260 2023-12-19T16:07:13.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.548+0000 7f5bdff16640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd81e3960 con 0x7f5bd81e34d0 2023-12-19T16:07:13.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.548+0000 7f5bdff16640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd8148720 con 0x7f5bc4003ef0 2023-12-19T16:07:13.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.548+0000 7f5bdd4b1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bd8148260 0x7f5bd81e2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.548+0000 7f5bdd4b1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bd8148260 0x7f5bd81e2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47918/0 (socket says 172.21.15.37:47918) 2023-12-19T16:07:13.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.548+0000 7f5bdd4b1640 1 -- 172.21.15.37:0/3108229219 learned_addr learned my addr 172.21.15.37:0/3108229219 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:13.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.548+0000 7f5bde4b3640 1 --2- 172.21.15.37:0/3108229219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd81e34d0 0x7f5bd813fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.548+0000 7f5bddcb2640 1 --2- 172.21.15.37:0/3108229219 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5bc4003ef0 0x7f5bd80bb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.548+0000 7f5bdd4b1640 1 -- 172.21.15.37:0/3108229219 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5bc4003ef0 msgr2=0x7f5bd80bb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:13.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.548+0000 7f5bdd4b1640 1 --2- 172.21.15.37:0/3108229219 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5bc4003ef0 0x7f5bd80bb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.548+0000 7f5bdd4b1640 1 -- 172.21.15.37:0/3108229219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd81e34d0 msgr2=0x7f5bd813fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:13.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.548+0000 7f5bdd4b1640 1 --2- 172.21.15.37:0/3108229219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd81e34d0 0x7f5bd813fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.548+0000 7f5bdd4b1640 1 -- 172.21.15.37:0/3108229219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd8146cd0 con 0x7f5bd8148260 2023-12-19T16:07:13.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.548+0000 7f5bdd4b1640 1 --2- 172.21.15.37:0/3108229219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bd8148260 0x7f5bd81e2f90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5bc802c2b0 tx=0x7f5bc8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:13.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.549+0000 7f5bce7fc640 1 -- 172.21.15.37:0/3108229219 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8003810 con 0x7f5bd8148260 2023-12-19T16:07:13.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.549+0000 7f5bce7fc640 1 -- 172.21.15.37:0/3108229219 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc802de90 con 0x7f5bd8148260 2023-12-19T16:07:13.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.549+0000 7f5bdff16640 1 -- 172.21.15.37:0/3108229219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd8146fb0 con 0x7f5bd8148260 2023-12-19T16:07:13.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.549+0000 7f5bce7fc640 1 -- 172.21.15.37:0/3108229219 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8003b70 con 0x7f5bd8148260 2023-12-19T16:07:13.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.549+0000 7f5bdff16640 1 -- 172.21.15.37:0/3108229219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd8147570 con 0x7f5bd8148260 2023-12-19T16:07:13.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.549+0000 7f5bdff16640 1 -- 172.21.15.37:0/3108229219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd804e840 con 0x7f5bd8148260 2023-12-19T16:07:13.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.550+0000 7f5bce7fc640 1 -- 172.21.15.37:0/3108229219 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5bc8003cd0 con 0x7f5bd8148260 2023-12-19T16:07:13.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.550+0000 7f5bce7fc640 1 --2- 172.21.15.37:0/3108229219 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5bbc06a460 0x7f5bbc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.550+0000 7f5bce7fc640 1 -- 172.21.15.37:0/3108229219 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bc80aa770 con 0x7f5bd8148260 2023-12-19T16:07:13.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.551+0000 7f5bddcb2640 1 --2- 172.21.15.37:0/3108229219 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5bbc06a460 0x7f5bbc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.551+0000 7f5bddcb2640 1 --2- 172.21.15.37:0/3108229219 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5bbc06a460 0x7f5bbc06c920 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4001050 tx=0x7f5bd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:13.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.555+0000 7f5bce7fc640 1 -- 172.21.15.37:0/3108229219 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5bc8075d50 con 0x7f5bd8148260 2023-12-19T16:07:13.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.730+0000 7f5bdff16640 1 -- 172.21.15.37:0/3108229219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bd80b9310 con 0x7f5bd8148260 2023-12-19T16:07:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.731+0000 7f5bce7fc640 1 -- 172.21.15.37:0/3108229219 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f5bc8079370 con 0x7f5bd8148260 2023-12-19T16:07:13.733 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:13.733 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:59.728935+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:06:56.758166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:06:57.635291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:07:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.733+0000 7f5bdff16640 1 -- 172.21.15.37:0/3108229219 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5bbc06a460 msgr2=0x7f5bbc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.733+0000 7f5bdff16640 1 --2- 172.21.15.37:0/3108229219 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5bbc06a460 0x7f5bbc06c920 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4001050 tx=0x7f5bd4009040 comp rx=0 tx=0).stop 2023-12-19T16:07:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.733+0000 7f5bdff16640 1 -- 172.21.15.37:0/3108229219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bd8148260 msgr2=0x7f5bd81e2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.733+0000 7f5bdff16640 1 --2- 172.21.15.37:0/3108229219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bd8148260 0x7f5bd81e2f90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5bc802c2b0 tx=0x7f5bc8004730 comp rx=0 tx=0).stop 2023-12-19T16:07:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.733+0000 7f5bdff16640 1 -- 172.21.15.37:0/3108229219 shutdown_connections 2023-12-19T16:07:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.733+0000 7f5bdff16640 1 --2- 172.21.15.37:0/3108229219 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5bbc06a460 0x7f5bbc06c920 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.733+0000 7f5bdff16640 1 --2- 172.21.15.37:0/3108229219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd81e34d0 0x7f5bd813fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.733+0000 7f5bdff16640 1 --2- 172.21.15.37:0/3108229219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5bd8148260 0x7f5bd81e2f90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.733+0000 7f5bdff16640 1 --2- 172.21.15.37:0/3108229219 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5bc4003ef0 0x7f5bd80bb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.733+0000 7f5bdff16640 1 -- 172.21.15.37:0/3108229219 >> 172.21.15.37:0/3108229219 conn(0x7f5bd8071e60 msgr2=0x7f5bd81d2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.733+0000 7f5bdff16640 1 -- 172.21.15.37:0/3108229219 shutdown_connections 2023-12-19T16:07:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.733+0000 7f5bdff16640 1 -- 172.21.15.37:0/3108229219 wait complete. 2023-12-19T16:07:13.746 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:06:46.684027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:06:56.758166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:06:57.635291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:07:13.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:07:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.853+0000 7f3b2b999640 1 Processor -- start 2023-12-19T16:07:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.853+0000 7f3b2b999640 1 -- start start 2023-12-19T16:07:13.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.854+0000 7f3b2b999640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b2406a950 0x7f3b240be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.854+0000 7f3b2b999640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b240bfa50 con 0x7f3b240bf510 2023-12-19T16:07:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.854+0000 7f3b2b999640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2406b040 con 0x7f3b240bb140 2023-12-19T16:07:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.854+0000 7f3b2b999640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b240bbda0 con 0x7f3b2406a950 2023-12-19T16:07:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.854+0000 7f3b29f36640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b2406a950 0x7f3b240be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.854+0000 7f3b29f36640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b2406a950 0x7f3b240be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47928/0 (socket says 172.21.15.37:47928) 2023-12-19T16:07:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.854+0000 7f3b29f36640 1 -- 172.21.15.37:0/880561232 learned_addr learned my addr 172.21.15.37:0/880561232 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.854+0000 7f3b29f36640 1 -- 172.21.15.37:0/880561232 >> v1:172.21.15.78:6789/0 conn(0x7f3b240bb140 legacy=0x7f3b240bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.854+0000 7f3b29f36640 1 -- 172.21.15.37:0/880561232 >> v1:172.21.15.37:6789/0 conn(0x7f3b240bf510 legacy=0x7f3b241534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.854+0000 7f3b29f36640 1 -- 172.21.15.37:0/880561232 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b240bb520 con 0x7f3b2406a950 2023-12-19T16:07:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.854+0000 7f3b23fff640 1 -- 172.21.15.37:0/880561232 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783303862 0 0) 0x7f3b240bfa50 con 0x7f3b240bf510 2023-12-19T16:07:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.855+0000 7f3b29f36640 1 --2- 172.21.15.37:0/880561232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b2406a950 0x7f3b240be350 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c009870 tx=0x7f3b1c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2371881b5777d075 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.855+0000 7f3b23fff640 1 -- 172.21.15.37:0/880561232 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c030860 con 0x7f3b2406a950 2023-12-19T16:07:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.855+0000 7f3b23fff640 1 -- 172.21.15.37:0/880561232 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c0309c0 con 0x7f3b2406a950 2023-12-19T16:07:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.855+0000 7f3b23fff640 1 -- 172.21.15.37:0/880561232 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c030d50 con 0x7f3b2406a950 2023-12-19T16:07:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.856+0000 7f3b2b999640 1 -- 172.21.15.37:0/880561232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b2406a950 msgr2=0x7f3b240be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.856+0000 7f3b2b999640 1 --2- 172.21.15.37:0/880561232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b2406a950 0x7f3b240be350 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c009870 tx=0x7f3b1c02b9a0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.856+0000 7f3b2b999640 1 -- 172.21.15.37:0/880561232 shutdown_connections 2023-12-19T16:07:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.856+0000 7f3b2b999640 1 --2- 172.21.15.37:0/880561232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b2406a950 0x7f3b240be350 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.856+0000 7f3b2b999640 1 -- 172.21.15.37:0/880561232 >> 172.21.15.37:0/880561232 conn(0x7f3b240bcfd0 msgr2=0x7f3b240bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.856+0000 7f3b2b999640 1 -- 172.21.15.37:0/880561232 shutdown_connections 2023-12-19T16:07:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.856+0000 7f3b2b999640 1 -- 172.21.15.37:0/880561232 wait complete. 2023-12-19T16:07:13.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.857+0000 7f3b2b999640 1 Processor -- start 2023-12-19T16:07:13.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.857+0000 7f3b2b999640 1 -- start start 2023-12-19T16:07:13.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.857+0000 7f3b2b999640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b2406a950 0x7f3b241dfab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.857+0000 7f3b2b999640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b240bb140 0x7f3b241426e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.857+0000 7f3b2b999640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b240bf510 0x7f3b24146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.857+0000 7f3b2b999640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b24144000 con 0x7f3b240bb140 2023-12-19T16:07:13.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.858+0000 7f3b2b999640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b24143580 con 0x7f3b240bf510 2023-12-19T16:07:13.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.858+0000 7f3b2b999640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b24142c20 con 0x7f3b2406a950 2023-12-19T16:07:13.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.858+0000 7f3b28f34640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b240bb140 0x7f3b241426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.858+0000 7f3b28f34640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b240bb140 0x7f3b241426e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47934/0 (socket says 172.21.15.37:47934) 2023-12-19T16:07:13.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.858+0000 7f3b28f34640 1 -- 172.21.15.37:0/2423603123 learned_addr learned my addr 172.21.15.37:0/2423603123 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:13.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.858+0000 7f3b29735640 1 --2- 172.21.15.37:0/2423603123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b2406a950 0x7f3b241dfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.858+0000 7f3b29f36640 1 --2- 172.21.15.37:0/2423603123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b240bf510 0x7f3b24146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.858+0000 7f3b28f34640 1 -- 172.21.15.37:0/2423603123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b2406a950 msgr2=0x7f3b241dfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:13.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.858+0000 7f3b28f34640 1 --2- 172.21.15.37:0/2423603123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b2406a950 0x7f3b241dfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.858+0000 7f3b28f34640 1 -- 172.21.15.37:0/2423603123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b240bf510 msgr2=0x7f3b24146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:13.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.858+0000 7f3b28f34640 1 --2- 172.21.15.37:0/2423603123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b240bf510 0x7f3b24146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:13.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.858+0000 7f3b28f34640 1 -- 172.21.15.37:0/2423603123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1c0094d0 con 0x7f3b240bb140 2023-12-19T16:07:13.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.858+0000 7f3b28f34640 1 --2- 172.21.15.37:0/2423603123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b240bb140 0x7f3b241426e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800c450 tx=0x7f3b1800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:13.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.858+0000 7f3b21ffb640 1 -- 172.21.15.37:0/2423603123 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b180035f0 con 0x7f3b240bb140 2023-12-19T16:07:13.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.858+0000 7f3b21ffb640 1 -- 172.21.15.37:0/2423603123 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b18003750 con 0x7f3b240bb140 2023-12-19T16:07:13.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.858+0000 7f3b2b999640 1 -- 172.21.15.37:0/2423603123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b24147070 con 0x7f3b240bb140 2023-12-19T16:07:13.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.858+0000 7f3b21ffb640 1 -- 172.21.15.37:0/2423603123 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18003b00 con 0x7f3b240bb140 2023-12-19T16:07:13.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.859+0000 7f3b2b999640 1 -- 172.21.15.37:0/2423603123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b241421c0 con 0x7f3b240bb140 2023-12-19T16:07:13.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.860+0000 7f3b2b999640 1 -- 172.21.15.37:0/2423603123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b24144bf0 con 0x7f3b240bb140 2023-12-19T16:07:13.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.860+0000 7f3b21ffb640 1 -- 172.21.15.37:0/2423603123 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3b18003c60 con 0x7f3b240bb140 2023-12-19T16:07:13.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.861+0000 7f3b21ffb640 1 --2- 172.21.15.37:0/2423603123 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3b1006a400 0x7f3b1006c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:13.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.861+0000 7f3b21ffb640 1 -- 172.21.15.37:0/2423603123 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b18087ec0 con 0x7f3b240bb140 2023-12-19T16:07:13.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.861+0000 7f3b29735640 1 --2- 172.21.15.37:0/2423603123 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3b1006a400 0x7f3b1006c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:13.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.861+0000 7f3b29735640 1 --2- 172.21.15.37:0/2423603123 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3b1006a400 0x7f3b1006c8c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3b14005660 tx=0x7f3b14003d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:13.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:13.865+0000 7f3b21ffb640 1 -- 172.21.15.37:0/2423603123 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3b18053550 con 0x7f3b240bb140 2023-12-19T16:07:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.042+0000 7f3b2b999640 1 -- 172.21.15.37:0/2423603123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b2409fbb0 con 0x7f3b240bb140 2023-12-19T16:07:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.043+0000 7f3b21ffb640 1 -- 172.21.15.37:0/2423603123 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b180170a0 con 0x7f3b240bb140 2023-12-19T16:07:14.045 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-19T16:07:14.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.045+0000 7f3b2b999640 1 -- 172.21.15.37:0/2423603123 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3b1006a400 msgr2=0x7f3b1006c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.045+0000 7f3b2b999640 1 --2- 172.21.15.37:0/2423603123 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3b1006a400 0x7f3b1006c8c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3b14005660 tx=0x7f3b14003d90 comp rx=0 tx=0).stop 2023-12-19T16:07:14.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.045+0000 7f3b2b999640 1 -- 172.21.15.37:0/2423603123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b240bb140 msgr2=0x7f3b241426e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.045+0000 7f3b2b999640 1 --2- 172.21.15.37:0/2423603123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b240bb140 0x7f3b241426e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800c450 tx=0x7f3b1800c910 comp rx=0 tx=0).stop 2023-12-19T16:07:14.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.045+0000 7f3b2b999640 1 -- 172.21.15.37:0/2423603123 shutdown_connections 2023-12-19T16:07:14.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.045+0000 7f3b2b999640 1 --2- 172.21.15.37:0/2423603123 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3b1006a400 0x7f3b1006c8c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.045+0000 7f3b2b999640 1 --2- 172.21.15.37:0/2423603123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b240bf510 0x7f3b24146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.045+0000 7f3b2b999640 1 --2- 172.21.15.37:0/2423603123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b240bb140 0x7f3b241426e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.045+0000 7f3b2b999640 1 --2- 172.21.15.37:0/2423603123 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b2406a950 0x7f3b241dfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.045+0000 7f3b2b999640 1 -- 172.21.15.37:0/2423603123 >> 172.21.15.37:0/2423603123 conn(0x7f3b240bcfd0 msgr2=0x7f3b240a5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:14.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.045+0000 7f3b2b999640 1 -- 172.21.15.37:0/2423603123 shutdown_connections 2023-12-19T16:07:14.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.045+0000 7f3b2b999640 1 -- 172.21.15.37:0/2423603123 wait complete. 2023-12-19T16:07:14.058 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:07:14.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.163+0000 7f6cac947640 1 Processor -- start 2023-12-19T16:07:14.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.163+0000 7f6cac947640 1 -- start start 2023-12-19T16:07:14.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.164+0000 7f6cac947640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6ca80b97f0 0x7f6ca80ba150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.164+0000 7f6cac947640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca814be40 con 0x7f6ca8142c80 2023-12-19T16:07:14.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.164+0000 7f6cac947640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca814c9c0 con 0x7f6ca80b6860 2023-12-19T16:07:14.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.164+0000 7f6cac947640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca80700f0 con 0x7f6ca80b97f0 2023-12-19T16:07:14.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.164+0000 7f6ca6d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6ca8142c80 0x7f6ca8148870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46498/0 (socket says 172.21.15.37:46498) 2023-12-19T16:07:14.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.164+0000 7f6ca6d9d640 1 -- 172.21.15.37:0/619550743 learned_addr learned my addr 172.21.15.37:0/619550743 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:14.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca5d9b640 1 --2- 172.21.15.37:0/619550743 >> v2:172.21.15.78:3300/0 conn(0x7f6ca80b97f0 0x7f6ca80ba150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca559a640 1 -- 172.21.15.37:0/619550743 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742956114 0 0) 0x7f6ca814be40 con 0x7f6ca8142c80 2023-12-19T16:07:14.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca559a640 1 -- 172.21.15.37:0/619550743 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c90003520 con 0x7f6ca8142c80 2023-12-19T16:07:14.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca559a640 1 -- 172.21.15.37:0/619550743 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3116026147 0 0) 0x7f6c90003520 con 0x7f6ca8142c80 2023-12-19T16:07:14.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca559a640 1 -- 172.21.15.37:0/619550743 >> v2:172.21.15.78:3300/0 conn(0x7f6ca80b97f0 msgr2=0x7f6ca80ba150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:14.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca559a640 1 --2- 172.21.15.37:0/619550743 >> v2:172.21.15.78:3300/0 conn(0x7f6ca80b97f0 0x7f6ca80ba150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca559a640 1 -- 172.21.15.37:0/619550743 >> v1:172.21.15.78:6789/0 conn(0x7f6ca80b6860 legacy=0x7f6ca8142570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca559a640 1 -- 172.21.15.37:0/619550743 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca80b4060 con 0x7f6ca8142c80 2023-12-19T16:07:14.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca559a640 1 -- 172.21.15.37:0/619550743 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f6ca00019f0 con 0x7f6ca8142c80 2023-12-19T16:07:14.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca559a640 1 -- 172.21.15.37:0/619550743 >> v1:172.21.15.37:6789/0 conn(0x7f6ca8142c80 legacy=0x7f6ca8148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca559a640 1 --2- 172.21.15.37:0/619550743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c90003970 0x7f6c90003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca559a640 1 --2- 172.21.15.37:0/619550743 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c90004370 0x7f6c90004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca559a640 1 --2- 172.21.15.37:0/619550743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c900050e0 0x7f6c9000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca559a640 1 -- 172.21.15.37:0/619550743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9000bff0 con 0x7f6c900050e0 2023-12-19T16:07:14.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca559a640 1 -- 172.21.15.37:0/619550743 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9000c160 con 0x7f6c90003970 2023-12-19T16:07:14.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca559a640 1 -- 172.21.15.37:0/619550743 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9000c320 con 0x7f6c90004370 2023-12-19T16:07:14.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca6d9d640 1 --2- 172.21.15.37:0/619550743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c900050e0 0x7f6c9000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca659c640 1 --2- 172.21.15.37:0/619550743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c90003970 0x7f6c90003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca5d9b640 1 --2- 172.21.15.37:0/619550743 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c90004370 0x7f6c90004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca6d9d640 1 -- 172.21.15.37:0/619550743 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c90004370 msgr2=0x7f6c90004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:14.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca6d9d640 1 --2- 172.21.15.37:0/619550743 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c90004370 0x7f6c90004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca6d9d640 1 -- 172.21.15.37:0/619550743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c90003970 msgr2=0x7f6c90003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:14.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca6d9d640 1 --2- 172.21.15.37:0/619550743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c90003970 0x7f6c90003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.165+0000 7f6ca6d9d640 1 -- 172.21.15.37:0/619550743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c90003520 con 0x7f6c900050e0 2023-12-19T16:07:14.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.166+0000 7f6ca6d9d640 1 -- 172.21.15.37:0/619550743 reap_dead start 2023-12-19T16:07:14.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.166+0000 7f6ca6d9d640 1 --2- 172.21.15.37:0/619550743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c900050e0 0x7f6c9000b980 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000a840 tx=0x7f6c900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b3daa5a4e08d49 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:14.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.166+0000 7f6ca559a640 1 -- 172.21.15.37:0/619550743 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca002cea0 con 0x7f6c900050e0 2023-12-19T16:07:14.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.166+0000 7f6ca559a640 1 -- 172.21.15.37:0/619550743 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca002f070 con 0x7f6c900050e0 2023-12-19T16:07:14.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.166+0000 7f6ca559a640 1 -- 172.21.15.37:0/619550743 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca00348b0 con 0x7f6c900050e0 2023-12-19T16:07:14.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.167+0000 7f6cac947640 1 -- 172.21.15.37:0/619550743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c900050e0 msgr2=0x7f6c9000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.167+0000 7f6cac947640 1 --2- 172.21.15.37:0/619550743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c900050e0 0x7f6c9000b980 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000a840 tx=0x7f6c900057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.167+0000 7f6cac947640 1 -- 172.21.15.37:0/619550743 shutdown_connections 2023-12-19T16:07:14.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.167+0000 7f6cac947640 1 --2- 172.21.15.37:0/619550743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c900050e0 0x7f6c9000b980 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.167+0000 7f6cac947640 1 -- 172.21.15.37:0/619550743 >> 172.21.15.37:0/619550743 conn(0x7f6ca80bcfe0 msgr2=0x7f6ca80bd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:14.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.167+0000 7f6cac947640 1 -- 172.21.15.37:0/619550743 shutdown_connections 2023-12-19T16:07:14.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.167+0000 7f6cac947640 1 -- 172.21.15.37:0/619550743 wait complete. 2023-12-19T16:07:14.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.168+0000 7f6cac947640 1 Processor -- start 2023-12-19T16:07:14.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.168+0000 7f6cac947640 1 -- start start 2023-12-19T16:07:14.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6cac947640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c900050e0 0x7f6ca80b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6cac947640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ca81df900 0x7f6ca80b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6cac947640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6ca80b2d80 0x7f6ca81487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6cac947640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80b60c0 con 0x7f6c900050e0 2023-12-19T16:07:14.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6cac947640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8148300 con 0x7f6ca81df900 2023-12-19T16:07:14.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6cac947640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80b31e0 con 0x7f6ca80b2d80 2023-12-19T16:07:14.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6ca659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c900050e0 0x7f6ca80b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6ca659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c900050e0 0x7f6ca80b4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47952/0 (socket says 172.21.15.37:47952) 2023-12-19T16:07:14.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6ca659c640 1 -- 172.21.15.37:0/2105047932 learned_addr learned my addr 172.21.15.37:0/2105047932 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:14.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6ca5d9b640 1 --2- 172.21.15.37:0/2105047932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ca81df900 0x7f6ca80b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6ca6d9d640 1 --2- 172.21.15.37:0/2105047932 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6ca80b2d80 0x7f6ca81487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6ca659c640 1 -- 172.21.15.37:0/2105047932 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6ca80b2d80 msgr2=0x7f6ca81487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6ca659c640 1 --2- 172.21.15.37:0/2105047932 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6ca80b2d80 0x7f6ca81487f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6ca659c640 1 -- 172.21.15.37:0/2105047932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ca81df900 msgr2=0x7f6ca80b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6ca659c640 1 --2- 172.21.15.37:0/2105047932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ca81df900 0x7f6ca80b2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6ca659c640 1 -- 172.21.15.37:0/2105047932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca81485a0 con 0x7f6c900050e0 2023-12-19T16:07:14.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6ca659c640 1 --2- 172.21.15.37:0/2105047932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c900050e0 0x7f6ca80b4f20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800f7c0 tx=0x7f6c9800fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:14.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6c96ffd640 1 -- 172.21.15.37:0/2105047932 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9800fe70 con 0x7f6c900050e0 2023-12-19T16:07:14.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6c96ffd640 1 -- 172.21.15.37:0/2105047932 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c980052e0 con 0x7f6c900050e0 2023-12-19T16:07:14.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.169+0000 7f6c96ffd640 1 -- 172.21.15.37:0/2105047932 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9800d970 con 0x7f6c900050e0 2023-12-19T16:07:14.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.170+0000 7f6cac947640 1 -- 172.21.15.37:0/2105047932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca80b4720 con 0x7f6c900050e0 2023-12-19T16:07:14.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.170+0000 7f6cac947640 1 -- 172.21.15.37:0/2105047932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca81dfd60 con 0x7f6c900050e0 2023-12-19T16:07:14.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.170+0000 7f6cac947640 1 -- 172.21.15.37:0/2105047932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca80b4c40 con 0x7f6c900050e0 2023-12-19T16:07:14.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.171+0000 7f6c96ffd640 1 -- 172.21.15.37:0/2105047932 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6c9800dad0 con 0x7f6c900050e0 2023-12-19T16:07:14.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.171+0000 7f6c96ffd640 1 --2- 172.21.15.37:0/2105047932 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6c8806a460 0x7f6c8806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.172+0000 7f6c96ffd640 1 -- 172.21.15.37:0/2105047932 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c98088910 con 0x7f6c900050e0 2023-12-19T16:07:14.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.172+0000 7f6ca5d9b640 1 --2- 172.21.15.37:0/2105047932 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6c8806a460 0x7f6c8806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.172+0000 7f6ca5d9b640 1 --2- 172.21.15.37:0/2105047932 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6c8806a460 0x7f6c8806c920 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ca814bb30 tx=0x7f6c9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:14.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.176+0000 7f6c96ffd640 1 -- 172.21.15.37:0/2105047932 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6ca80b4c40 con 0x7f6c900050e0 2023-12-19T16:07:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.352+0000 7f6cac947640 1 -- 172.21.15.37:0/2105047932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ca80b4c40 con 0x7f6c900050e0 2023-12-19T16:07:14.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.352+0000 7f6c96ffd640 1 -- 172.21.15.37:0/2105047932 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ca80b4c40 con 0x7f6c900050e0 2023-12-19T16:07:14.355 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-19T16:07:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.355+0000 7f6cac947640 1 -- 172.21.15.37:0/2105047932 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6c8806a460 msgr2=0x7f6c8806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.355+0000 7f6cac947640 1 --2- 172.21.15.37:0/2105047932 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6c8806a460 0x7f6c8806c920 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ca814bb30 tx=0x7f6c9c008040 comp rx=0 tx=0).stop 2023-12-19T16:07:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.355+0000 7f6cac947640 1 -- 172.21.15.37:0/2105047932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c900050e0 msgr2=0x7f6ca80b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.355+0000 7f6cac947640 1 --2- 172.21.15.37:0/2105047932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c900050e0 0x7f6ca80b4f20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800f7c0 tx=0x7f6c9800fc80 comp rx=0 tx=0).stop 2023-12-19T16:07:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.355+0000 7f6cac947640 1 -- 172.21.15.37:0/2105047932 shutdown_connections 2023-12-19T16:07:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.355+0000 7f6cac947640 1 --2- 172.21.15.37:0/2105047932 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6c8806a460 0x7f6c8806c920 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.355+0000 7f6cac947640 1 --2- 172.21.15.37:0/2105047932 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6ca80b2d80 0x7f6ca81487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.355+0000 7f6cac947640 1 --2- 172.21.15.37:0/2105047932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ca81df900 0x7f6ca80b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.355+0000 7f6cac947640 1 --2- 172.21.15.37:0/2105047932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c900050e0 0x7f6ca80b4f20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.355+0000 7f6cac947640 1 -- 172.21.15.37:0/2105047932 >> 172.21.15.37:0/2105047932 conn(0x7f6ca80bcfe0 msgr2=0x7f6ca806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.355+0000 7f6cac947640 1 -- 172.21.15.37:0/2105047932 shutdown_connections 2023-12-19T16:07:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.355+0000 7f6cac947640 1 -- 172.21.15.37:0/2105047932 wait complete. 2023-12-19T16:07:14.368 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:07:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.474+0000 7fcb779c9640 1 Processor -- start 2023-12-19T16:07:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.474+0000 7fcb779c9640 1 -- start start 2023-12-19T16:07:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.475+0000 7fcb779c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcb700bb140 0x7fcb700be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.475+0000 7fcb779c9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb7006a950 0x7fcb700bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.475+0000 7fcb779c9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb700bfa50 con 0x7fcb700bee00 2023-12-19T16:07:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.475+0000 7fcb779c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb700bbda0 con 0x7fcb700bb140 2023-12-19T16:07:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.475+0000 7fcb779c9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7006b040 con 0x7fcb7006a950 2023-12-19T16:07:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.475+0000 7fcb75f66640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcb700bee00 0x7fcb7014e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46506/0 (socket says 172.21.15.37:46506) 2023-12-19T16:07:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.475+0000 7fcb75f66640 1 -- 172.21.15.37:0/1100043371 learned_addr learned my addr 172.21.15.37:0/1100043371 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.475+0000 7fcb67fff640 1 -- 172.21.15.37:0/1100043371 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701452607 0 0) 0x7fcb700bfa50 con 0x7fcb700bee00 2023-12-19T16:07:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.475+0000 7fcb74f64640 1 --2- 172.21.15.37:0/1100043371 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb7006a950 0x7fcb700bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.475+0000 7fcb75765640 1 --2- 172.21.15.37:0/1100043371 >> v2:172.21.15.78:3300/0 conn(0x7fcb700bb140 0x7fcb700be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.475+0000 7fcb67fff640 1 -- 172.21.15.37:0/1100043371 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb5c003520 con 0x7fcb700bee00 2023-12-19T16:07:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb67fff640 1 -- 172.21.15.37:0/1100043371 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4251471242 0 0) 0x7fcb5c003520 con 0x7fcb700bee00 2023-12-19T16:07:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb67fff640 1 -- 172.21.15.37:0/1100043371 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb7006a950 msgr2=0x7fcb700bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb67fff640 1 --2- 172.21.15.37:0/1100043371 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb7006a950 0x7fcb700bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb67fff640 1 -- 172.21.15.37:0/1100043371 >> v2:172.21.15.78:3300/0 conn(0x7fcb700bb140 msgr2=0x7fcb700be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb67fff640 1 --2- 172.21.15.37:0/1100043371 >> v2:172.21.15.78:3300/0 conn(0x7fcb700bb140 0x7fcb700be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb67fff640 1 -- 172.21.15.37:0/1100043371 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb700bb520 con 0x7fcb700bee00 2023-12-19T16:07:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb67fff640 1 -- 172.21.15.37:0/1100043371 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7fcb680019f0 con 0x7fcb700bee00 2023-12-19T16:07:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb67fff640 1 -- 172.21.15.37:0/1100043371 >> v1:172.21.15.37:6789/0 conn(0x7fcb700bee00 legacy=0x7fcb7014e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb67fff640 1 --2- 172.21.15.37:0/1100043371 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb7006a950 0x7fcb5c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb67fff640 1 --2- 172.21.15.37:0/1100043371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb5c003ef0 0x7fcb5c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb67fff640 1 --2- 172.21.15.37:0/1100043371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb5c004d00 0x7fcb5c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb67fff640 1 -- 172.21.15.37:0/1100043371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7006b040 con 0x7fcb5c004d00 2023-12-19T16:07:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb67fff640 1 -- 172.21.15.37:0/1100043371 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c00b980 con 0x7fcb5c003ef0 2023-12-19T16:07:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb67fff640 1 -- 172.21.15.37:0/1100043371 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c00bb10 con 0x7fcb7006a950 2023-12-19T16:07:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb75f66640 1 --2- 172.21.15.37:0/1100043371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb5c004d00 0x7fcb5c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb75765640 1 --2- 172.21.15.37:0/1100043371 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb7006a950 0x7fcb5c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb74f64640 1 --2- 172.21.15.37:0/1100043371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb5c003ef0 0x7fcb5c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb75f66640 1 -- 172.21.15.37:0/1100043371 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb7006a950 msgr2=0x7fcb5c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb75f66640 1 --2- 172.21.15.37:0/1100043371 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb7006a950 0x7fcb5c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb75f66640 1 -- 172.21.15.37:0/1100043371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb5c003ef0 msgr2=0x7fcb5c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb75f66640 1 --2- 172.21.15.37:0/1100043371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb5c003ef0 0x7fcb5c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.476+0000 7fcb75f66640 1 -- 172.21.15.37:0/1100043371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c003520 con 0x7fcb5c004d00 2023-12-19T16:07:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.477+0000 7fcb75f66640 1 --2- 172.21.15.37:0/1100043371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb5c004d00 0x7fcb5c005180 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800a900 tx=0x7fcb5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa936eb44046d830 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.477+0000 7fcb67fff640 1 -- 172.21.15.37:0/1100043371 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb68034630 con 0x7fcb5c004d00 2023-12-19T16:07:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.477+0000 7fcb67fff640 1 -- 172.21.15.37:0/1100043371 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6802f070 con 0x7fcb5c004d00 2023-12-19T16:07:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.477+0000 7fcb67fff640 1 -- 172.21.15.37:0/1100043371 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb680349d0 con 0x7fcb5c004d00 2023-12-19T16:07:14.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.477+0000 7fcb779c9640 1 -- 172.21.15.37:0/1100043371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb5c004d00 msgr2=0x7fcb5c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.477+0000 7fcb779c9640 1 --2- 172.21.15.37:0/1100043371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb5c004d00 0x7fcb5c005180 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800a900 tx=0x7fcb5c0057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.477+0000 7fcb75f66640 1 -- 172.21.15.37:0/1100043371 reap_dead start 2023-12-19T16:07:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.477+0000 7fcb779c9640 1 -- 172.21.15.37:0/1100043371 shutdown_connections 2023-12-19T16:07:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.477+0000 7fcb779c9640 1 -- 172.21.15.37:0/1100043371 >> 172.21.15.37:0/1100043371 conn(0x7fcb700bcfd0 msgr2=0x7fcb700bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.478+0000 7fcb779c9640 1 -- 172.21.15.37:0/1100043371 shutdown_connections 2023-12-19T16:07:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.478+0000 7fcb779c9640 1 -- 172.21.15.37:0/1100043371 wait complete. 2023-12-19T16:07:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.479+0000 7fcb779c9640 1 Processor -- start 2023-12-19T16:07:14.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.479+0000 7fcb779c9640 1 -- start start 2023-12-19T16:07:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.479+0000 7fcb779c9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb7009a030 0x7fcb701e2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.479+0000 7fcb779c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb701e3460 0x7fcb7009e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.479+0000 7fcb779c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb7009ec10 0x7fcb7009b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.479+0000 7fcb779c9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7009cfc0 con 0x7fcb701e3460 2023-12-19T16:07:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.479+0000 7fcb779c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb701e04e0 con 0x7fcb7009ec10 2023-12-19T16:07:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.479+0000 7fcb779c9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb701df990 con 0x7fcb7009a030 2023-12-19T16:07:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.479+0000 7fcb74f64640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb701e3460 0x7fcb7009e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.479+0000 7fcb74f64640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb701e3460 0x7fcb7009e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47972/0 (socket says 172.21.15.37:47972) 2023-12-19T16:07:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.479+0000 7fcb74f64640 1 -- 172.21.15.37:0/1016978621 learned_addr learned my addr 172.21.15.37:0/1016978621 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.479+0000 7fcb75f66640 1 --2- 172.21.15.37:0/1016978621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb7009ec10 0x7fcb7009b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.479+0000 7fcb75765640 1 --2- 172.21.15.37:0/1016978621 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb7009a030 0x7fcb701e2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.480+0000 7fcb74f64640 1 -- 172.21.15.37:0/1016978621 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb7009a030 msgr2=0x7fcb701e2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.480+0000 7fcb74f64640 1 --2- 172.21.15.37:0/1016978621 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb7009a030 0x7fcb701e2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.480+0000 7fcb74f64640 1 -- 172.21.15.37:0/1016978621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb7009ec10 msgr2=0x7fcb7009b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.480+0000 7fcb74f64640 1 --2- 172.21.15.37:0/1016978621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb7009ec10 0x7fcb7009b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.480+0000 7fcb74f64640 1 -- 172.21.15.37:0/1016978621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb701e0900 con 0x7fcb701e3460 2023-12-19T16:07:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.480+0000 7fcb74f64640 1 --2- 172.21.15.37:0/1016978621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb701e3460 0x7fcb7009e6d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcb60011600 tx=0x7fcb60011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.480+0000 7fcb65ffb640 1 -- 172.21.15.37:0/1016978621 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60015870 con 0x7fcb701e3460 2023-12-19T16:07:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.480+0000 7fcb65ffb640 1 -- 172.21.15.37:0/1016978621 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb600159d0 con 0x7fcb701e3460 2023-12-19T16:07:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.480+0000 7fcb65ffb640 1 -- 172.21.15.37:0/1016978621 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60015d40 con 0x7fcb701e3460 2023-12-19T16:07:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.480+0000 7fcb779c9640 1 -- 172.21.15.37:0/1016978621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb700b73b0 con 0x7fcb701e3460 2023-12-19T16:07:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.480+0000 7fcb779c9640 1 -- 172.21.15.37:0/1016978621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb701dfe20 con 0x7fcb701e3460 2023-12-19T16:07:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.481+0000 7fcb779c9640 1 -- 172.21.15.37:0/1016978621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb700740a0 con 0x7fcb701e3460 2023-12-19T16:07:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.482+0000 7fcb65ffb640 1 -- 172.21.15.37:0/1016978621 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcb6000f460 con 0x7fcb701e3460 2023-12-19T16:07:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.482+0000 7fcb65ffb640 1 --2- 172.21.15.37:0/1016978621 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fcb5406a430 0x7fcb5406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.482+0000 7fcb65ffb640 1 -- 172.21.15.37:0/1016978621 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb60088c80 con 0x7fcb701e3460 2023-12-19T16:07:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.482+0000 7fcb75765640 1 --2- 172.21.15.37:0/1016978621 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fcb5406a430 0x7fcb5406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.483+0000 7fcb75765640 1 --2- 172.21.15.37:0/1016978621 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fcb5406a430 0x7fcb5406c8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c009c40 tx=0x7fcb6c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:14.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.486+0000 7fcb65ffb640 1 -- 172.21.15.37:0/1016978621 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcb60054270 con 0x7fcb701e3460 2023-12-19T16:07:14.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.663+0000 7fcb779c9640 1 -- 172.21.15.37:0/1016978621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcb700ba4a0 con 0x7fcb701e3460 2023-12-19T16:07:14.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.663+0000 7fcb65ffb640 1 -- 172.21.15.37:0/1016978621 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcb600220a0 con 0x7fcb701e3460 2023-12-19T16:07:14.665 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-19T16:07:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.665+0000 7fcb779c9640 1 -- 172.21.15.37:0/1016978621 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fcb5406a430 msgr2=0x7fcb5406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.665+0000 7fcb779c9640 1 --2- 172.21.15.37:0/1016978621 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fcb5406a430 0x7fcb5406c8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c009c40 tx=0x7fcb6c009190 comp rx=0 tx=0).stop 2023-12-19T16:07:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.665+0000 7fcb779c9640 1 -- 172.21.15.37:0/1016978621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb701e3460 msgr2=0x7fcb7009e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.665+0000 7fcb779c9640 1 --2- 172.21.15.37:0/1016978621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb701e3460 0x7fcb7009e6d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcb60011600 tx=0x7fcb60011a00 comp rx=0 tx=0).stop 2023-12-19T16:07:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.665+0000 7fcb779c9640 1 -- 172.21.15.37:0/1016978621 shutdown_connections 2023-12-19T16:07:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.665+0000 7fcb779c9640 1 --2- 172.21.15.37:0/1016978621 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fcb5406a430 0x7fcb5406c8f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.665+0000 7fcb779c9640 1 --2- 172.21.15.37:0/1016978621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb7009ec10 0x7fcb7009b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.665+0000 7fcb779c9640 1 --2- 172.21.15.37:0/1016978621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb701e3460 0x7fcb7009e6d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.665+0000 7fcb779c9640 1 --2- 172.21.15.37:0/1016978621 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb7009a030 0x7fcb701e2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.665+0000 7fcb779c9640 1 -- 172.21.15.37:0/1016978621 >> 172.21.15.37:0/1016978621 conn(0x7fcb700bcfd0 msgr2=0x7fcb700a56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.665+0000 7fcb779c9640 1 -- 172.21.15.37:0/1016978621 shutdown_connections 2023-12-19T16:07:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.665+0000 7fcb779c9640 1 -- 172.21.15.37:0/1016978621 wait complete. 2023-12-19T16:07:14.678 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:07:14.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.783+0000 7f454cb4e640 1 Processor -- start 2023-12-19T16:07:14.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.783+0000 7f454cb4e640 1 -- start start 2023-12-19T16:07:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.783+0000 7f454cb4e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45480b6690 0x7f4548144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.783+0000 7f454cb4e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45480bc6b0 con 0x7f4548144cd0 2023-12-19T16:07:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.783+0000 7f454cb4e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45480a59f0 con 0x7f45480bcdd0 2023-12-19T16:07:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.783+0000 7f454cb4e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45480bc0a0 con 0x7f45480b6690 2023-12-19T16:07:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f4546d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4548144cd0 0x7f4548155340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46512/0 (socket says 172.21.15.37:46512) 2023-12-19T16:07:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f4546d9d640 1 -- 172.21.15.37:0/2620070305 learned_addr learned my addr 172.21.15.37:0/2620070305 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f453dd9b640 1 --2- 172.21.15.37:0/2620070305 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45480b6690 0x7f4548144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f4545d9b640 1 -- 172.21.15.37:0/2620070305 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259167703 0 0) 0x7f45480bc6b0 con 0x7f4548144cd0 2023-12-19T16:07:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f4545d9b640 1 -- 172.21.15.37:0/2620070305 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4534003520 con 0x7f4548144cd0 2023-12-19T16:07:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f4545d9b640 1 -- 172.21.15.37:0/2620070305 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3767101917 0 0) 0x7f4534003520 con 0x7f4548144cd0 2023-12-19T16:07:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f4545d9b640 1 -- 172.21.15.37:0/2620070305 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45480b6690 msgr2=0x7f4548144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f4545d9b640 1 --2- 172.21.15.37:0/2620070305 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45480b6690 0x7f4548144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f4545d9b640 1 -- 172.21.15.37:0/2620070305 >> v1:172.21.15.78:6789/0 conn(0x7f45480bcdd0 legacy=0x7f45480b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f4545d9b640 1 -- 172.21.15.37:0/2620070305 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45480bc340 con 0x7f4548144cd0 2023-12-19T16:07:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f4545d9b640 1 -- 172.21.15.37:0/2620070305 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f45400019f0 con 0x7f4548144cd0 2023-12-19T16:07:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f4545d9b640 1 -- 172.21.15.37:0/2620070305 >> v1:172.21.15.37:6789/0 conn(0x7f4548144cd0 legacy=0x7f4548155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f4545d9b640 1 --2- 172.21.15.37:0/2620070305 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45480b6690 0x7f45340039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f4545d9b640 1 --2- 172.21.15.37:0/2620070305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4534003f20 0x7f45340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f4545d9b640 1 --2- 172.21.15.37:0/2620070305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4534004d00 0x7f4534005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f4545d9b640 1 -- 172.21.15.37:0/2620070305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45480bc0a0 con 0x7f4534004d00 2023-12-19T16:07:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f4545d9b640 1 -- 172.21.15.37:0/2620070305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453400baf0 con 0x7f4534003f20 2023-12-19T16:07:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f4545d9b640 1 -- 172.21.15.37:0/2620070305 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453400bcb0 con 0x7f45480b6690 2023-12-19T16:07:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f454659c640 1 --2- 172.21.15.37:0/2620070305 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45480b6690 0x7f45340039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f4546d9d640 1 --2- 172.21.15.37:0/2620070305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4534004d00 0x7f4534005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.784+0000 7f453dd9b640 1 --2- 172.21.15.37:0/2620070305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4534003f20 0x7f45340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.785+0000 7f454659c640 1 -- 172.21.15.37:0/2620070305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4534003f20 msgr2=0x7f45340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.785+0000 7f454659c640 1 --2- 172.21.15.37:0/2620070305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4534003f20 0x7f45340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.785+0000 7f454659c640 1 -- 172.21.15.37:0/2620070305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4534004d00 msgr2=0x7f4534005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.785+0000 7f454659c640 1 --2- 172.21.15.37:0/2620070305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4534004d00 0x7f4534005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.785+0000 7f454659c640 1 -- 172.21.15.37:0/2620070305 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4534003520 con 0x7f45480b6690 2023-12-19T16:07:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.785+0000 7f454659c640 1 --2- 172.21.15.37:0/2620070305 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45480b6690 0x7f45340039a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4538001750 tx=0x7f45340057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3349dfde20ea0814 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.786+0000 7f4545d9b640 1 -- 172.21.15.37:0/2620070305 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45380052d0 con 0x7f45480b6690 2023-12-19T16:07:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.786+0000 7f4545d9b640 1 -- 172.21.15.37:0/2620070305 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453802e050 con 0x7f45480b6690 2023-12-19T16:07:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.786+0000 7f4545d9b640 1 -- 172.21.15.37:0/2620070305 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538003830 con 0x7f45480b6690 2023-12-19T16:07:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.786+0000 7f454cb4e640 1 -- 172.21.15.37:0/2620070305 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45480b6690 msgr2=0x7f45340039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.786+0000 7f454cb4e640 1 --2- 172.21.15.37:0/2620070305 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45480b6690 0x7f45340039a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4538001750 tx=0x7f45340057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.786+0000 7f4546d9d640 1 -- 172.21.15.37:0/2620070305 reap_dead start 2023-12-19T16:07:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.786+0000 7f454cb4e640 1 -- 172.21.15.37:0/2620070305 shutdown_connections 2023-12-19T16:07:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.786+0000 7f454cb4e640 1 -- 172.21.15.37:0/2620070305 >> 172.21.15.37:0/2620070305 conn(0x7f4548071e60 msgr2=0x7f45480c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.786+0000 7f454cb4e640 1 -- 172.21.15.37:0/2620070305 shutdown_connections 2023-12-19T16:07:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.786+0000 7f454cb4e640 1 -- 172.21.15.37:0/2620070305 wait complete. 2023-12-19T16:07:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.787+0000 7f454cb4e640 1 Processor -- start 2023-12-19T16:07:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.787+0000 7f454cb4e640 1 -- start start 2023-12-19T16:07:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.788+0000 7f454cb4e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45480b6690 0x7f45480a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.788+0000 7f454cb4e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4548099450 0x7f454814a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.788+0000 7f454cb4e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454814a540 0x7f454813f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.788+0000 7f454cb4e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454814bca0 con 0x7f4548099450 2023-12-19T16:07:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.788+0000 7f454cb4e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45480998e0 con 0x7f454814a540 2023-12-19T16:07:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.788+0000 7f454cb4e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454814b000 con 0x7f45480b6690 2023-12-19T16:07:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.788+0000 7f453dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4548099450 0x7f454814a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.788+0000 7f453dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4548099450 0x7f454814a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47996/0 (socket says 172.21.15.37:47996) 2023-12-19T16:07:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.788+0000 7f453dd9b640 1 -- 172.21.15.37:0/3685829289 learned_addr learned my addr 172.21.15.37:0/3685829289 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.788+0000 7f4546d9d640 1 --2- 172.21.15.37:0/3685829289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454814a540 0x7f454813f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.788+0000 7f454659c640 1 --2- 172.21.15.37:0/3685829289 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45480b6690 0x7f45480a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.788+0000 7f453dd9b640 1 -- 172.21.15.37:0/3685829289 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45480b6690 msgr2=0x7f45480a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.788+0000 7f453dd9b640 1 --2- 172.21.15.37:0/3685829289 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45480b6690 0x7f45480a5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.788+0000 7f453dd9b640 1 -- 172.21.15.37:0/3685829289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454814a540 msgr2=0x7f454813f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.788+0000 7f453dd9b640 1 --2- 172.21.15.37:0/3685829289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454814a540 0x7f454813f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.789+0000 7f453dd9b640 1 -- 172.21.15.37:0/3685829289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454814b6e0 con 0x7f4548099450 2023-12-19T16:07:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.789+0000 7f4546d9d640 1 --2- 172.21.15.37:0/3685829289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454814a540 0x7f454813f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:14.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.789+0000 7f454659c640 1 --2- 172.21.15.37:0/3685829289 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45480b6690 0x7f45480a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:14.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.789+0000 7f453dd9b640 1 --2- 172.21.15.37:0/3685829289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4548099450 0x7f454814a000 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4530011960 tx=0x7f4530011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:14.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.789+0000 7f453f7fe640 1 -- 172.21.15.37:0/3685829289 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453000faf0 con 0x7f4548099450 2023-12-19T16:07:14.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.789+0000 7f453f7fe640 1 -- 172.21.15.37:0/3685829289 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453000fc50 con 0x7f4548099450 2023-12-19T16:07:14.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.789+0000 7f454cb4e640 1 -- 172.21.15.37:0/3685829289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454814b9c0 con 0x7f4548099450 2023-12-19T16:07:14.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.789+0000 7f453f7fe640 1 -- 172.21.15.37:0/3685829289 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4530014440 con 0x7f4548099450 2023-12-19T16:07:14.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.789+0000 7f454cb4e640 1 -- 172.21.15.37:0/3685829289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45481490c0 con 0x7f4548099450 2023-12-19T16:07:14.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.790+0000 7f454cb4e640 1 -- 172.21.15.37:0/3685829289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454804e840 con 0x7f4548099450 2023-12-19T16:07:14.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.790+0000 7f453f7fe640 1 -- 172.21.15.37:0/3685829289 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f45300145a0 con 0x7f4548099450 2023-12-19T16:07:14.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.791+0000 7f453f7fe640 1 --2- 172.21.15.37:0/3685829289 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f452806a430 0x7f452806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:14.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.791+0000 7f453f7fe640 1 -- 172.21.15.37:0/3685829289 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4530089100 con 0x7f4548099450 2023-12-19T16:07:14.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.791+0000 7f454659c640 1 --2- 172.21.15.37:0/3685829289 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f452806a430 0x7f452806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:14.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.791+0000 7f454659c640 1 --2- 172.21.15.37:0/3685829289 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f452806a430 0x7f452806c8f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4538033000 tx=0x7f4538009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:14.795+0000 7f453f7fe640 1 -- 172.21.15.37:0/3685829289 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4530054650 con 0x7f4548099450 2023-12-19T16:07:15.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.006+0000 7f454cb4e640 1 -- 172.21.15.37:0/3685829289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45480a4d20 con 0x7f4548099450 2023-12-19T16:07:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.007+0000 7f453f7fe640 1 -- 172.21.15.37:0/3685829289 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3947 (secure 0 0 0) 0x7f4530057c70 con 0x7f4548099450 2023-12-19T16:07:15.009 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:15.009 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4079311036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4079311036},{"type":"v1","addr":"172.21.15.37:6834","nonce":4079311036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1300485428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1300485428},{"type":"v1","addr":"172.21.15.37:6835","nonce":1300485428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:06:58.727746+0000","modified":"2023-12-19T16:07:01.300113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/3319636422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3319636422},{"type":"v1","addr":"172.21.15.78:6835","nonce":3319636422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:07:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-12-19T16:07:15.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.009+0000 7f454cb4e640 1 -- 172.21.15.37:0/3685829289 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f452806a430 msgr2=0x7f452806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.009+0000 7f454cb4e640 1 --2- 172.21.15.37:0/3685829289 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f452806a430 0x7f452806c8f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4538033000 tx=0x7f4538009030 comp rx=0 tx=0).stop 2023-12-19T16:07:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.009+0000 7f454cb4e640 1 -- 172.21.15.37:0/3685829289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4548099450 msgr2=0x7f454814a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.009+0000 7f454cb4e640 1 --2- 172.21.15.37:0/3685829289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4548099450 0x7f454814a000 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4530011960 tx=0x7f4530011e20 comp rx=0 tx=0).stop 2023-12-19T16:07:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.009+0000 7f454cb4e640 1 -- 172.21.15.37:0/3685829289 shutdown_connections 2023-12-19T16:07:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.009+0000 7f454cb4e640 1 --2- 172.21.15.37:0/3685829289 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f452806a430 0x7f452806c8f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.009+0000 7f454cb4e640 1 --2- 172.21.15.37:0/3685829289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454814a540 0x7f454813f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.009+0000 7f454cb4e640 1 --2- 172.21.15.37:0/3685829289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4548099450 0x7f454814a000 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.009+0000 7f454cb4e640 1 --2- 172.21.15.37:0/3685829289 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45480b6690 0x7f45480a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.009+0000 7f454cb4e640 1 -- 172.21.15.37:0/3685829289 >> 172.21.15.37:0/3685829289 conn(0x7f4548071e60 msgr2=0x7f4548142bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.009+0000 7f454cb4e640 1 -- 172.21.15.37:0/3685829289 shutdown_connections 2023-12-19T16:07:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.009+0000 7f454cb4e640 1 -- 172.21.15.37:0/3685829289 wait complete. 2023-12-19T16:07:15.022 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:07:15.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.125+0000 7f4e0751b640 1 Processor -- start 2023-12-19T16:07:15.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.125+0000 7f4e0751b640 1 -- start start 2023-12-19T16:07:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.126+0000 7f4e0751b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4e000711c0 0x7f4e0014aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.126+0000 7f4e0751b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4e00069f80 0x7f4e0006a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.126+0000 7f4e0751b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e00070d30 con 0x7f4e00069ba0 2023-12-19T16:07:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.126+0000 7f4e0751b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e000715c0 con 0x7f4e000711c0 2023-12-19T16:07:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.126+0000 7f4e0751b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e000b6f60 con 0x7f4e00069f80 2023-12-19T16:07:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.126+0000 7f4e04ab6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4e000711c0 0x7f4e0014aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.126+0000 7f4e04ab6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4e000711c0 0x7f4e0014aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48010/0 (socket says 172.21.15.37:48010) 2023-12-19T16:07:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.126+0000 7f4e04ab6640 1 -- 172.21.15.37:0/258375907 learned_addr learned my addr 172.21.15.37:0/258375907 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.126+0000 7f4e05ab8640 1 --2- 172.21.15.37:0/258375907 >> v2:172.21.15.78:3300/0 conn(0x7f4e00069f80 0x7f4e0006a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.127+0000 7f4e04ab6640 1 -- 172.21.15.37:0/258375907 >> v2:172.21.15.78:3300/0 conn(0x7f4e00069f80 msgr2=0x7f4e0006a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.127+0000 7f4e04ab6640 1 --2- 172.21.15.37:0/258375907 >> v2:172.21.15.78:3300/0 conn(0x7f4e00069f80 0x7f4e0006a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.127+0000 7f4e04ab6640 1 -- 172.21.15.37:0/258375907 >> v1:172.21.15.78:6789/0 conn(0x7f4e00069ba0 legacy=0x7f4e000b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.127+0000 7f4e04ab6640 1 -- 172.21.15.37:0/258375907 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e00071720 con 0x7f4e000711c0 2023-12-19T16:07:15.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.127+0000 7f4e04ab6640 1 --2- 172.21.15.37:0/258375907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e000711c0 0x7f4e0014aab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4e00071d90 tx=0x7f4df002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadf7aa6206018a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:15.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.127+0000 7f4df7fff640 1 -- 172.21.15.37:0/258375907 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df002f850 con 0x7f4e000711c0 2023-12-19T16:07:15.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.128+0000 7f4df7fff640 1 -- 172.21.15.37:0/258375907 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df002f9b0 con 0x7f4e000711c0 2023-12-19T16:07:15.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.128+0000 7f4df7fff640 1 -- 172.21.15.37:0/258375907 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df002fd40 con 0x7f4e000711c0 2023-12-19T16:07:15.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.128+0000 7f4e0751b640 1 -- 172.21.15.37:0/258375907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e000711c0 msgr2=0x7f4e0014aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:15.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.128+0000 7f4e0751b640 1 --2- 172.21.15.37:0/258375907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e000711c0 0x7f4e0014aab0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4e00071d90 tx=0x7f4df002ba30 comp rx=0 tx=0).stop 2023-12-19T16:07:15.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.128+0000 7f4e0751b640 1 -- 172.21.15.37:0/258375907 shutdown_connections 2023-12-19T16:07:15.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.128+0000 7f4e0751b640 1 --2- 172.21.15.37:0/258375907 >> v2:172.21.15.78:3300/0 conn(0x7f4e00069f80 0x7f4e0006a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.128+0000 7f4e0751b640 1 --2- 172.21.15.37:0/258375907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e000711c0 0x7f4e0014aab0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.128+0000 7f4e0751b640 1 -- 172.21.15.37:0/258375907 >> 172.21.15.37:0/258375907 conn(0x7f4e000b9c30 msgr2=0x7f4e000ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:15.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.128+0000 7f4e0751b640 1 -- 172.21.15.37:0/258375907 shutdown_connections 2023-12-19T16:07:15.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.128+0000 7f4e0751b640 1 -- 172.21.15.37:0/258375907 wait complete. 2023-12-19T16:07:15.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.129+0000 7f4e0751b640 1 Processor -- start 2023-12-19T16:07:15.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.129+0000 7f4e0751b640 1 -- start start 2023-12-19T16:07:15.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.130+0000 7f4e0751b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e00069ba0 0x7f4e000b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.130+0000 7f4e0751b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e00069f80 0x7f4e0014dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.130+0000 7f4e0751b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e000711c0 0x7f4e0014e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.130+0000 7f4e0751b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e000b5c40 con 0x7f4e00069f80 2023-12-19T16:07:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.130+0000 7f4e0751b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e000b50f0 con 0x7f4e00069ba0 2023-12-19T16:07:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.130+0000 7f4e0751b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e001df940 con 0x7f4e000711c0 2023-12-19T16:07:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.130+0000 7f4e04ab6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e00069f80 0x7f4e0014dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.130+0000 7f4e04ab6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e00069f80 0x7f4e0014dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48024/0 (socket says 172.21.15.37:48024) 2023-12-19T16:07:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.130+0000 7f4e04ab6640 1 -- 172.21.15.37:0/2406725909 learned_addr learned my addr 172.21.15.37:0/2406725909 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.130+0000 7f4e052b7640 1 --2- 172.21.15.37:0/2406725909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e00069ba0 0x7f4e000b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.130+0000 7f4e05ab8640 1 --2- 172.21.15.37:0/2406725909 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e000711c0 0x7f4e0014e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.130+0000 7f4e04ab6640 1 -- 172.21.15.37:0/2406725909 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e000711c0 msgr2=0x7f4e0014e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:15.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.130+0000 7f4e04ab6640 1 --2- 172.21.15.37:0/2406725909 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e000711c0 0x7f4e0014e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.130+0000 7f4e04ab6640 1 -- 172.21.15.37:0/2406725909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e00069ba0 msgr2=0x7f4e000b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:15.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.130+0000 7f4e04ab6640 1 --2- 172.21.15.37:0/2406725909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e00069ba0 0x7f4e000b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.130+0000 7f4e04ab6640 1 -- 172.21.15.37:0/2406725909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df00094d0 con 0x7f4e00069f80 2023-12-19T16:07:15.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.131+0000 7f4e04ab6640 1 --2- 172.21.15.37:0/2406725909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e00069f80 0x7f4e0014dd50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4df002ba70 tx=0x7f4df0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:15.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.131+0000 7f4df5ffb640 1 -- 172.21.15.37:0/2406725909 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df0037c40 con 0x7f4e00069f80 2023-12-19T16:07:15.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.131+0000 7f4df5ffb640 1 -- 172.21.15.37:0/2406725909 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df0037dc0 con 0x7f4e00069f80 2023-12-19T16:07:15.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.131+0000 7f4e0751b640 1 -- 172.21.15.37:0/2406725909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e001dfb90 con 0x7f4e00069f80 2023-12-19T16:07:15.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.131+0000 7f4df5ffb640 1 -- 172.21.15.37:0/2406725909 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df0041640 con 0x7f4e00069f80 2023-12-19T16:07:15.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.131+0000 7f4e0751b640 1 -- 172.21.15.37:0/2406725909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e001e0150 con 0x7f4e00069f80 2023-12-19T16:07:15.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.132+0000 7f4e0751b640 1 -- 172.21.15.37:0/2406725909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0004e840 con 0x7f4e00069f80 2023-12-19T16:07:15.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.132+0000 7f4df5ffb640 1 -- 172.21.15.37:0/2406725909 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4df00417a0 con 0x7f4e00069f80 2023-12-19T16:07:15.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.133+0000 7f4df5ffb640 1 --2- 172.21.15.37:0/2406725909 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4de406a430 0x7f4de406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:15.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.133+0000 7f4df5ffb640 1 -- 172.21.15.37:0/2406725909 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4df003c070 con 0x7f4e00069f80 2023-12-19T16:07:15.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.133+0000 7f4e052b7640 1 --2- 172.21.15.37:0/2406725909 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4de406a430 0x7f4de406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:15.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.133+0000 7f4e052b7640 1 --2- 172.21.15.37:0/2406725909 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4de406a430 0x7f4de406c8f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4df8000f60 tx=0x7f4df8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:15.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.137+0000 7f4df5ffb640 1 -- 172.21.15.37:0/2406725909 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4df0076bb0 con 0x7f4e00069f80 2023-12-19T16:07:15.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.316+0000 7f4e0751b640 1 -- 172.21.15.37:0/2406725909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e000b5fc0 con 0x7f4e00069f80 2023-12-19T16:07:15.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.317+0000 7f4df5ffb640 1 -- 172.21.15.37:0/2406725909 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f4df00a9e60 con 0x7f4e00069f80 2023-12-19T16:07:15.319 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:15.319 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:59.728935+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:06:56.758166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:06:57.635291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:07:15.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.319+0000 7f4e0751b640 1 -- 172.21.15.37:0/2406725909 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4de406a430 msgr2=0x7f4de406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:15.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.319+0000 7f4e0751b640 1 --2- 172.21.15.37:0/2406725909 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4de406a430 0x7f4de406c8f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4df8000f60 tx=0x7f4df8009040 comp rx=0 tx=0).stop 2023-12-19T16:07:15.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.319+0000 7f4e0751b640 1 -- 172.21.15.37:0/2406725909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e00069f80 msgr2=0x7f4e0014dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:15.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.319+0000 7f4e0751b640 1 --2- 172.21.15.37:0/2406725909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e00069f80 0x7f4e0014dd50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4df002ba70 tx=0x7f4df0004730 comp rx=0 tx=0).stop 2023-12-19T16:07:15.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.319+0000 7f4e0751b640 1 -- 172.21.15.37:0/2406725909 shutdown_connections 2023-12-19T16:07:15.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.319+0000 7f4e0751b640 1 --2- 172.21.15.37:0/2406725909 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4de406a430 0x7f4de406c8f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.319+0000 7f4e0751b640 1 --2- 172.21.15.37:0/2406725909 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e000711c0 0x7f4e0014e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.319+0000 7f4e0751b640 1 --2- 172.21.15.37:0/2406725909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e00069f80 0x7f4e0014dd50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.319+0000 7f4e0751b640 1 --2- 172.21.15.37:0/2406725909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e00069ba0 0x7f4e000b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.319+0000 7f4e0751b640 1 -- 172.21.15.37:0/2406725909 >> 172.21.15.37:0/2406725909 conn(0x7f4e000b9c30 msgr2=0x7f4e000ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:15.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.319+0000 7f4e0751b640 1 -- 172.21.15.37:0/2406725909 shutdown_connections 2023-12-19T16:07:15.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.319+0000 7f4e0751b640 1 -- 172.21.15.37:0/2406725909 wait complete. 2023-12-19T16:07:15.332 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:07:15.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.436+0000 7fd83b7d9640 1 Processor -- start 2023-12-19T16:07:15.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.436+0000 7fd83b7d9640 1 -- start start 2023-12-19T16:07:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.437+0000 7fd83b7d9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8340bcdd0 0x7fd8340b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.437+0000 7fd83b7d9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd834144ea0 0x7fd834155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.437+0000 7fd83b7d9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8340bc6b0 con 0x7fd8340b64c0 2023-12-19T16:07:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.437+0000 7fd83b7d9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8340b6900 con 0x7fd834144ea0 2023-12-19T16:07:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.437+0000 7fd83b7d9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340a59f0 con 0x7fd8340bcdd0 2023-12-19T16:07:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.437+0000 7fd839d76640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd834144ea0 0x7fd834155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.437+0000 7fd838d74640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd8340b64c0 0x7fd834144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46528/0 (socket says 172.21.15.37:46528) 2023-12-19T16:07:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.437+0000 7fd838d74640 1 -- 172.21.15.37:0/1424016058 learned_addr learned my addr 172.21.15.37:0/1424016058 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.437+0000 7fd839575640 1 --2- 172.21.15.37:0/1424016058 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8340bcdd0 0x7fd8340b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.437+0000 7fd839d76640 1 -- 172.21.15.37:0/1424016058 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8340bcdd0 msgr2=0x7fd8340b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.437+0000 7fd839d76640 1 --2- 172.21.15.37:0/1424016058 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8340bcdd0 0x7fd8340b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.437+0000 7fd839d76640 1 -- 172.21.15.37:0/1424016058 >> v1:172.21.15.37:6789/0 conn(0x7fd8340b64c0 legacy=0x7fd834144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.437+0000 7fd839d76640 1 -- 172.21.15.37:0/1424016058 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340bc0a0 con 0x7fd834144ea0 2023-12-19T16:07:15.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.438+0000 7fd839d76640 1 --2- 172.21.15.37:0/1424016058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd834144ea0 0x7fd834155340 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd82c009d90 tx=0x7fd82c02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c84578a5715b0d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:15.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.438+0000 7fd82bfff640 1 -- 172.21.15.37:0/1424016058 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c02cce0 con 0x7fd834144ea0 2023-12-19T16:07:15.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.438+0000 7fd82bfff640 1 -- 172.21.15.37:0/1424016058 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c02ce40 con 0x7fd834144ea0 2023-12-19T16:07:15.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.438+0000 7fd82bfff640 1 -- 172.21.15.37:0/1424016058 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c034660 con 0x7fd834144ea0 2023-12-19T16:07:15.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.438+0000 7fd83b7d9640 1 -- 172.21.15.37:0/1424016058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd834144ea0 msgr2=0x7fd834155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:15.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.438+0000 7fd83b7d9640 1 --2- 172.21.15.37:0/1424016058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd834144ea0 0x7fd834155340 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd82c009d90 tx=0x7fd82c02bf30 comp rx=0 tx=0).stop 2023-12-19T16:07:15.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.438+0000 7fd83b7d9640 1 -- 172.21.15.37:0/1424016058 shutdown_connections 2023-12-19T16:07:15.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.438+0000 7fd83b7d9640 1 --2- 172.21.15.37:0/1424016058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd834144ea0 0x7fd834155340 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.438+0000 7fd83b7d9640 1 --2- 172.21.15.37:0/1424016058 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8340bcdd0 0x7fd8340b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.438+0000 7fd83b7d9640 1 -- 172.21.15.37:0/1424016058 >> 172.21.15.37:0/1424016058 conn(0x7fd834071e60 msgr2=0x7fd8340c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:15.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.439+0000 7fd83b7d9640 1 -- 172.21.15.37:0/1424016058 shutdown_connections 2023-12-19T16:07:15.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.439+0000 7fd83b7d9640 1 -- 172.21.15.37:0/1424016058 wait complete. 2023-12-19T16:07:15.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.440+0000 7fd83b7d9640 1 Processor -- start 2023-12-19T16:07:15.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.440+0000 7fd83b7d9640 1 -- start start 2023-12-19T16:07:15.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.440+0000 7fd83b7d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8340b64c0 0x7fd834149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:15.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.440+0000 7fd83b7d9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8340bcdd0 0x7fd83414a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:15.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.440+0000 7fd83b7d9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd834144ea0 0x7fd834148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:15.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.440+0000 7fd83b7d9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd834149f50 con 0x7fd8340b64c0 2023-12-19T16:07:15.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.440+0000 7fd83b7d9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340a5400 con 0x7fd8340bcdd0 2023-12-19T16:07:15.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.440+0000 7fd83b7d9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83414aed0 con 0x7fd834144ea0 2023-12-19T16:07:15.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.440+0000 7fd839575640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8340b64c0 0x7fd834149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.440+0000 7fd839575640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8340b64c0 0x7fd834149a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48048/0 (socket says 172.21.15.37:48048) 2023-12-19T16:07:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.440+0000 7fd839575640 1 -- 172.21.15.37:0/4130802833 learned_addr learned my addr 172.21.15.37:0/4130802833 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.441+0000 7fd839d76640 1 --2- 172.21.15.37:0/4130802833 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd834144ea0 0x7fd834148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.441+0000 7fd838d74640 1 --2- 172.21.15.37:0/4130802833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8340bcdd0 0x7fd83414a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.441+0000 7fd839575640 1 -- 172.21.15.37:0/4130802833 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd834144ea0 msgr2=0x7fd834148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.441+0000 7fd839575640 1 --2- 172.21.15.37:0/4130802833 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd834144ea0 0x7fd834148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.441+0000 7fd839575640 1 -- 172.21.15.37:0/4130802833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8340bcdd0 msgr2=0x7fd83414a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.441+0000 7fd839575640 1 --2- 172.21.15.37:0/4130802833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8340bcdd0 0x7fd83414a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.441+0000 7fd839575640 1 -- 172.21.15.37:0/4130802833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c009a70 con 0x7fd8340b64c0 2023-12-19T16:07:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.441+0000 7fd839d76640 1 --2- 172.21.15.37:0/4130802833 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd834144ea0 0x7fd834148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.441+0000 7fd838d74640 1 --2- 172.21.15.37:0/4130802833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8340bcdd0 0x7fd83414a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.441+0000 7fd839575640 1 --2- 172.21.15.37:0/4130802833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8340b64c0 0x7fd834149a10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd83000d800 tx=0x7fd83000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.441+0000 7fd829ffb640 1 -- 172.21.15.37:0/4130802833 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83000b6c0 con 0x7fd8340b64c0 2023-12-19T16:07:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.441+0000 7fd829ffb640 1 -- 172.21.15.37:0/4130802833 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83000b820 con 0x7fd8340b64c0 2023-12-19T16:07:15.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.441+0000 7fd83b7d9640 1 -- 172.21.15.37:0/4130802833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8340a5610 con 0x7fd8340b64c0 2023-12-19T16:07:15.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.441+0000 7fd829ffb640 1 -- 172.21.15.37:0/4130802833 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83000bbb0 con 0x7fd8340b64c0 2023-12-19T16:07:15.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.441+0000 7fd83b7d9640 1 -- 172.21.15.37:0/4130802833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd834147d90 con 0x7fd8340b64c0 2023-12-19T16:07:15.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.442+0000 7fd83b7d9640 1 -- 172.21.15.37:0/4130802833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83404e840 con 0x7fd8340b64c0 2023-12-19T16:07:15.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.442+0000 7fd829ffb640 1 -- 172.21.15.37:0/4130802833 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd83000bd10 con 0x7fd8340b64c0 2023-12-19T16:07:15.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.443+0000 7fd829ffb640 1 --2- 172.21.15.37:0/4130802833 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd81806a460 0x7fd81806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:15.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.443+0000 7fd829ffb640 1 -- 172.21.15.37:0/4130802833 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd830088d90 con 0x7fd8340b64c0 2023-12-19T16:07:15.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.443+0000 7fd838d74640 1 --2- 172.21.15.37:0/4130802833 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd81806a460 0x7fd81806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:15.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.443+0000 7fd838d74640 1 --2- 172.21.15.37:0/4130802833 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd81806a460 0x7fd81806c920 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd8341dd1d0 tx=0x7fd824009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:15.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.447+0000 7fd829ffb640 1 -- 172.21.15.37:0/4130802833 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd830054410 con 0x7fd8340b64c0 2023-12-19T16:07:15.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.661+0000 7fd83b7d9640 1 -- 172.21.15.37:0/4130802833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd83414b0e0 con 0x7fd8340b64c0 2023-12-19T16:07:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.662+0000 7fd829ffb640 1 -- 172.21.15.37:0/4130802833 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3947 (secure 0 0 0) 0x7fd830057a30 con 0x7fd8340b64c0 2023-12-19T16:07:15.664 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:15.664 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4079311036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4079311036},{"type":"v1","addr":"172.21.15.37:6834","nonce":4079311036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1300485428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1300485428},{"type":"v1","addr":"172.21.15.37:6835","nonce":1300485428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:06:58.727746+0000","modified":"2023-12-19T16:07:01.300113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/3319636422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3319636422},{"type":"v1","addr":"172.21.15.78:6835","nonce":3319636422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:07:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-12-19T16:07:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.664+0000 7fd83b7d9640 1 -- 172.21.15.37:0/4130802833 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd81806a460 msgr2=0x7fd81806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.664+0000 7fd83b7d9640 1 --2- 172.21.15.37:0/4130802833 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd81806a460 0x7fd81806c920 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd8341dd1d0 tx=0x7fd824009040 comp rx=0 tx=0).stop 2023-12-19T16:07:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.664+0000 7fd83b7d9640 1 -- 172.21.15.37:0/4130802833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8340b64c0 msgr2=0x7fd834149a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.664+0000 7fd83b7d9640 1 --2- 172.21.15.37:0/4130802833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8340b64c0 0x7fd834149a10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd83000d800 tx=0x7fd83000dcc0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.664+0000 7fd83b7d9640 1 -- 172.21.15.37:0/4130802833 shutdown_connections 2023-12-19T16:07:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.664+0000 7fd83b7d9640 1 --2- 172.21.15.37:0/4130802833 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd81806a460 0x7fd81806c920 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.664+0000 7fd83b7d9640 1 --2- 172.21.15.37:0/4130802833 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd834144ea0 0x7fd834148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.664+0000 7fd83b7d9640 1 --2- 172.21.15.37:0/4130802833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8340bcdd0 0x7fd83414a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.664+0000 7fd83b7d9640 1 --2- 172.21.15.37:0/4130802833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8340b64c0 0x7fd834149a10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.664+0000 7fd83b7d9640 1 -- 172.21.15.37:0/4130802833 >> 172.21.15.37:0/4130802833 conn(0x7fd834071e60 msgr2=0x7fd8340b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.664+0000 7fd83b7d9640 1 -- 172.21.15.37:0/4130802833 shutdown_connections 2023-12-19T16:07:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:15.664+0000 7fd83b7d9640 1 -- 172.21.15.37:0/4130802833 wait complete. 2023-12-19T16:07:15.979 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T16:06:58.727746+0000', 'modified': '2023-12-19T16:07:01.300113+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6835/3319636422', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 3319636422}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 3319636422}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T16:07:15.979 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T16:07:15.979 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-19T16:07:16.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.085+0000 7f07f8870640 1 Processor -- start 2023-12-19T16:07:16.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.085+0000 7f07f8870640 1 -- start start 2023-12-19T16:07:16.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.086+0000 7f07f8870640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07f4142e00 0x7f07f40b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.086+0000 7f07f8870640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f40b4d60 0x7f07f40b7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.086+0000 7f07f8870640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f4071450 con 0x7f07f40b77a0 2023-12-19T16:07:16.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.086+0000 7f07f8870640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f40ba6a0 con 0x7f07f4142e00 2023-12-19T16:07:16.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.086+0000 7f07f8870640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f4070e00 con 0x7f07f40b4d60 2023-12-19T16:07:16.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.086+0000 7f07f259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07f4142e00 0x7f07f40b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.086+0000 7f07f259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07f4142e00 0x7f07f40b54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48062/0 (socket says 172.21.15.37:48062) 2023-12-19T16:07:16.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.086+0000 7f07f259c640 1 -- 172.21.15.37:0/452721627 learned_addr learned my addr 172.21.15.37:0/452721627 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:16.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.086+0000 7f07f259c640 1 -- 172.21.15.37:0/452721627 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f40b4d60 msgr2=0x7f07f40b7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:16.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.086+0000 7f07f1d9b640 1 --2- 172.21.15.37:0/452721627 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f40b4d60 0x7f07f40b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.087+0000 7f07f259c640 1 --2- 172.21.15.37:0/452721627 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f40b4d60 0x7f07f40b7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.087+0000 7f07f259c640 1 -- 172.21.15.37:0/452721627 >> v1:172.21.15.78:6789/0 conn(0x7f07f40b77a0 legacy=0x7f07f4148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:16.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.087+0000 7f07f259c640 1 -- 172.21.15.37:0/452721627 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f40710e0 con 0x7f07f4142e00 2023-12-19T16:07:16.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.087+0000 7f07f1d9b640 1 --2- 172.21.15.37:0/452721627 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f40b4d60 0x7f07f40b7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:16.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.087+0000 7f07f259c640 1 --2- 172.21.15.37:0/452721627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f4142e00 0x7f07f40b54a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f07e4009e50 tx=0x7f07e402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4ac514307a4a5a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:16.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.087+0000 7f07f159a640 1 -- 172.21.15.37:0/452721627 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e402ca70 con 0x7f07f4142e00 2023-12-19T16:07:16.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.087+0000 7f07f159a640 1 -- 172.21.15.37:0/452721627 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e402cbd0 con 0x7f07f4142e00 2023-12-19T16:07:16.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.087+0000 7f07f159a640 1 -- 172.21.15.37:0/452721627 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e40343f0 con 0x7f07f4142e00 2023-12-19T16:07:16.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.088+0000 7f07f8870640 1 -- 172.21.15.37:0/452721627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f4142e00 msgr2=0x7f07f40b54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:16.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.088+0000 7f07f8870640 1 --2- 172.21.15.37:0/452721627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f4142e00 0x7f07f40b54a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f07e4009e50 tx=0x7f07e402bed0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.088+0000 7f07f8870640 1 -- 172.21.15.37:0/452721627 shutdown_connections 2023-12-19T16:07:16.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.088+0000 7f07f8870640 1 --2- 172.21.15.37:0/452721627 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f40b4d60 0x7f07f40b7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.088+0000 7f07f8870640 1 --2- 172.21.15.37:0/452721627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f4142e00 0x7f07f40b54a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.088+0000 7f07f8870640 1 -- 172.21.15.37:0/452721627 >> 172.21.15.37:0/452721627 conn(0x7f07f40bab20 msgr2=0x7f07f40baf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:16.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.088+0000 7f07f8870640 1 -- 172.21.15.37:0/452721627 shutdown_connections 2023-12-19T16:07:16.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.088+0000 7f07f8870640 1 -- 172.21.15.37:0/452721627 wait complete. 2023-12-19T16:07:16.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.089+0000 7f07f8870640 1 Processor -- start 2023-12-19T16:07:16.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.089+0000 7f07f8870640 1 -- start start 2023-12-19T16:07:16.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.090+0000 7f07f8870640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f40b77a0 0x7f07f41d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.090+0000 7f07f8870640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f4142e00 0x7f07f41ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.090+0000 7f07f8870640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f41de010 0x7f07f41cf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.090+0000 7f07f8870640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f41cfe10 con 0x7f07f4142e00 2023-12-19T16:07:16.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.090+0000 7f07f8870640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f41cfac0 con 0x7f07f41de010 2023-12-19T16:07:16.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.090+0000 7f07f8870640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f41d07e0 con 0x7f07f40b77a0 2023-12-19T16:07:16.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.090+0000 7f07f1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f4142e00 0x7f07f41ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.090+0000 7f07f1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f4142e00 0x7f07f41ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48066/0 (socket says 172.21.15.37:48066) 2023-12-19T16:07:16.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.090+0000 7f07f1d9b640 1 -- 172.21.15.37:0/72041112 learned_addr learned my addr 172.21.15.37:0/72041112 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:16.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.090+0000 7f07f259c640 1 --2- 172.21.15.37:0/72041112 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f40b77a0 0x7f07f41d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.090+0000 7f07f2d9d640 1 --2- 172.21.15.37:0/72041112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f41de010 0x7f07f41cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.090+0000 7f07f1d9b640 1 -- 172.21.15.37:0/72041112 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f40b77a0 msgr2=0x7f07f41d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.090+0000 7f07f1d9b640 1 --2- 172.21.15.37:0/72041112 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f40b77a0 0x7f07f41d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.090+0000 7f07f1d9b640 1 -- 172.21.15.37:0/72041112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f41de010 msgr2=0x7f07f41cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.090+0000 7f07f1d9b640 1 --2- 172.21.15.37:0/72041112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f41de010 0x7f07f41cf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.090+0000 7f07f1d9b640 1 -- 172.21.15.37:0/72041112 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e4009b30 con 0x7f07f4142e00 2023-12-19T16:07:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.090+0000 7f07f2d9d640 1 --2- 172.21.15.37:0/72041112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f41de010 0x7f07f41cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.090+0000 7f07f259c640 1 --2- 172.21.15.37:0/72041112 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f40b77a0 0x7f07f41d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.090+0000 7f07f1d9b640 1 --2- 172.21.15.37:0/72041112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f4142e00 0x7f07f41ceb00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f07e800c7f0 tx=0x7f07e800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.091+0000 7f07e2ffd640 1 -- 172.21.15.37:0/72041112 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8007820 con 0x7f07f4142e00 2023-12-19T16:07:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.091+0000 7f07e2ffd640 1 -- 172.21.15.37:0/72041112 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e8007980 con 0x7f07f4142e00 2023-12-19T16:07:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.091+0000 7f07e2ffd640 1 -- 172.21.15.37:0/72041112 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8007cf0 con 0x7f07f4142e00 2023-12-19T16:07:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.091+0000 7f07f8870640 1 -- 172.21.15.37:0/72041112 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f413bcd0 con 0x7f07f4142e00 2023-12-19T16:07:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.091+0000 7f07f8870640 1 -- 172.21.15.37:0/72041112 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f41d14a0 con 0x7f07f4142e00 2023-12-19T16:07:16.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.092+0000 7f07e2ffd640 1 -- 172.21.15.37:0/72041112 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f07e80113f0 con 0x7f07f4142e00 2023-12-19T16:07:16.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.093+0000 7f07e2ffd640 1 --2- 172.21.15.37:0/72041112 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f07d406a430 0x7f07d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.093+0000 7f07e2ffd640 1 -- 172.21.15.37:0/72041112 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07e8088bb0 con 0x7f07f4142e00 2023-12-19T16:07:16.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.093+0000 7f07f259c640 1 --2- 172.21.15.37:0/72041112 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f07d406a430 0x7f07d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.094+0000 7f07f259c640 1 --2- 172.21.15.37:0/72041112 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f07d406a430 0x7f07d406c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f07e4035000 tx=0x7f07e4030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:16.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.094+0000 7f07fb3e4740 1 Processor -- start 2023-12-19T16:07:16.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.094+0000 7f07fb3e4740 1 -- start start 2023-12-19T16:07:16.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.094+0000 7f07fb3e4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff2a800 0x55a90feeebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.094+0000 7f07fb3e4740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90feef100 0x55a90ff1fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.094+0000 7f07fb3e4740 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff200e0 0x55a90ff20560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.094+0000 7f07fb3e4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90fe5e0b0 con 0x55a90ff2a800 2023-12-19T16:07:16.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.094+0000 7f07fb3e4740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90fe5b840 con 0x55a90feef100 2023-12-19T16:07:16.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.094+0000 7f07fb3e4740 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a90fe57130 con 0x55a90ff200e0 2023-12-19T16:07:16.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.094+0000 7f07f259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff2a800 0x55a90feeebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.094+0000 7f07f259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff2a800 0x55a90feeebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48072/0 (socket says 172.21.15.37:48072) 2023-12-19T16:07:16.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.094+0000 7f07f259c640 1 -- 172.21.15.37:0/2051224678 learned_addr learned my addr 172.21.15.37:0/2051224678 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:16.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.095+0000 7f07f1d9b640 1 --2- 172.21.15.37:0/2051224678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90feef100 0x55a90ff1fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.095+0000 7f07f2d9d640 1 --2- 172.21.15.37:0/2051224678 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff200e0 0x55a90ff20560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.095+0000 7f07f259c640 1 -- 172.21.15.37:0/2051224678 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff200e0 msgr2=0x55a90ff20560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:16.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.095+0000 7f07f259c640 1 --2- 172.21.15.37:0/2051224678 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff200e0 0x55a90ff20560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.095+0000 7f07f259c640 1 -- 172.21.15.37:0/2051224678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90feef100 msgr2=0x55a90ff1fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:16.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.095+0000 7f07f259c640 1 --2- 172.21.15.37:0/2051224678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90feef100 0x55a90ff1fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.095+0000 7f07f259c640 1 -- 172.21.15.37:0/2051224678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a90fe11c40 con 0x55a90ff2a800 2023-12-19T16:07:16.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.095+0000 7f07f259c640 1 --2- 172.21.15.37:0/2051224678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff2a800 0x55a90feeebc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f07e4036040 tx=0x7f07e402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa527abd70d37f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:16.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.095+0000 7f07d3fff640 1 -- 172.21.15.37:0/2051224678 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e403e430 con 0x55a90ff2a800 2023-12-19T16:07:16.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.095+0000 7f07d3fff640 1 -- 172.21.15.37:0/2051224678 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e4045040 con 0x55a90ff2a800 2023-12-19T16:07:16.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.095+0000 7f07d3fff640 1 -- 172.21.15.37:0/2051224678 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e403e790 con 0x55a90ff2a800 2023-12-19T16:07:16.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.096+0000 7f07fb3e4740 1 -- 172.21.15.37:0/2051224678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff2a800 msgr2=0x55a90feeebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:16.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.096+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/2051224678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff2a800 0x55a90feeebc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f07e4036040 tx=0x7f07e402e000 comp rx=0 tx=0).stop 2023-12-19T16:07:16.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.096+0000 7f07fb3e4740 1 -- 172.21.15.37:0/2051224678 shutdown_connections 2023-12-19T16:07:16.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.096+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/2051224678 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff200e0 0x55a90ff20560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.096+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/2051224678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90feef100 0x55a90ff1fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.096+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/2051224678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff2a800 0x55a90feeebc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.096+0000 7f07fb3e4740 1 -- 172.21.15.37:0/2051224678 >> 172.21.15.37:0/2051224678 conn(0x55a90fef05f0 msgr2=0x55a90ff29f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:16.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.096+0000 7f07fb3e4740 1 -- 172.21.15.37:0/2051224678 shutdown_connections 2023-12-19T16:07:16.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.096+0000 7f07fb3e4740 1 -- 172.21.15.37:0/2051224678 wait complete. 2023-12-19T16:07:16.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.096+0000 7f07fb3e4740 1 -- start start 2023-12-19T16:07:16.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.096+0000 7f07fb3e4740 1 Processor -- start 2023-12-19T16:07:16.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.097+0000 7f07fb3e4740 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff200e0 0x55a90ff1a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.097+0000 7f07fb3e4740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90ff2a800 0x55a90ff18bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.097+0000 7f07fb3e4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff16b30 0x55a90ff16f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.097+0000 7f07fb3e4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90fe15840 con 0x55a90ff16b30 2023-12-19T16:07:16.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.097+0000 7f07fb3e4740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90fe154e0 con 0x55a90ff2a800 2023-12-19T16:07:16.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.097+0000 7f07fb3e4740 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a90fddb230 con 0x55a90ff200e0 2023-12-19T16:07:16.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.097+0000 7f07fb3e4740 10 client.0 _ll_register_callbacks cb 0x55a90fe2c6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:07:16.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.097+0000 7f07f2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff16b30 0x55a90ff16f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.097+0000 7f07f2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff16b30 0x55a90ff16f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48088/0 (socket says 172.21.15.37:48088) 2023-12-19T16:07:16.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.097+0000 7f07f2d9d640 1 -- 172.21.15.37:0/340462202 learned_addr learned my addr 172.21.15.37:0/340462202 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:16.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07f1d9b640 1 --2- 172.21.15.37:0/340462202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90ff2a800 0x55a90ff18bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07f259c640 1 --2- 172.21.15.37:0/340462202 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff200e0 0x55a90ff1a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07f2d9d640 1 -- 172.21.15.37:0/340462202 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff200e0 msgr2=0x55a90ff1a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:16.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07f2d9d640 1 --2- 172.21.15.37:0/340462202 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff200e0 0x55a90ff1a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07f2d9d640 1 -- 172.21.15.37:0/340462202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90ff2a800 msgr2=0x55a90ff18bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:16.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07f2d9d640 1 --2- 172.21.15.37:0/340462202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90ff2a800 0x55a90ff18bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07f2d9d640 1 -- 172.21.15.37:0/340462202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f40710e0 con 0x55a90ff16b30 2023-12-19T16:07:16.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07f259c640 1 --2- 172.21.15.37:0/340462202 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff200e0 0x55a90ff1a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:16.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07f2d9d640 1 --2- 172.21.15.37:0/340462202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff16b30 0x55a90ff16f90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f07ec011380 tx=0x7f07ec011840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebd8cd721ddc073 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:16.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-12-19T16:07:16.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07d17fa640 1 -- 172.21.15.37:0/340462202 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec004b20 con 0x55a90ff16b30 2023-12-19T16:07:16.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07d17fa640 1 -- 172.21.15.37:0/340462202 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07ec003bd0 con 0x55a90ff16b30 2023-12-19T16:07:16.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07fb3e4740 1 -- 172.21.15.37:0/340462202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a90fe80970 con 0x55a90ff16b30 2023-12-19T16:07:16.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07d17fa640 1 -- 172.21.15.37:0/340462202 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07ec003d90 con 0x55a90ff16b30 2023-12-19T16:07:16.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07fb3e4740 10 client.4689 fetch_fsmap learned FSMap version 7 2023-12-19T16:07:16.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07fb3e4740 1 -- 172.21.15.37:0/340462202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55a90fe557b0 con 0x55a90ff16b30 2023-12-19T16:07:16.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07d17fa640 1 -- 172.21.15.37:0/340462202 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a90fe80970 con 0x55a90ff16b30 2023-12-19T16:07:16.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07d17fa640 1 -- 172.21.15.37:0/340462202 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 7) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f07ec004050 con 0x55a90ff16b30 2023-12-19T16:07:16.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07fb3e4740 10 client.4689 fetch_fsmap finished waiting for FSMap version 7 2023-12-19T16:07:16.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07fb3e4740 10 client.4689 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T16:07:16.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07fb3e4740 20 client.4689 populate_metadata read hostname 'smithi037' 2023-12-19T16:07:16.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/340462202 >> [v2:172.21.15.78:6834/3319636422,v1:172.21.15.78:6835/3319636422] conn(0x55a90ff3a470 0x55a90ff3a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.098+0000 7f07fb3e4740 4 client.4689 mds_command: new command op to 4282 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T16:07:16.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.099+0000 7f07fb3e4740 1 -- 172.21.15.37:0/340462202 --> [v2:172.21.15.78:6834/3319636422,v1:172.21.15.78:6835/3319636422] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a90fe48f00 con 0x55a90ff3a470 2023-12-19T16:07:16.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.099+0000 7f07f259c640 1 --2- 172.21.15.37:0/340462202 >> [v2:172.21.15.78:6834/3319636422,v1:172.21.15.78:6835/3319636422] conn(0x55a90ff3a470 0x55a90ff3a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.099+0000 7f07d17fa640 10 client.4689 ms_handle_connect on v2:172.21.15.78:6834/3319636422 2023-12-19T16:07:16.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.099+0000 7f07f259c640 1 --2- 172.21.15.37:0/340462202 >> [v2:172.21.15.78:6834/3319636422,v1:172.21.15.78:6835/3319636422] conn(0x55a90ff3a470 0x55a90ff3a850 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c69a07f83ab6b37 server_cookie=c878019b5b8625ec in_seq=0 out_seq=0 2023-12-19T16:07:16.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.100+0000 7f07d17fa640 1 -- 172.21.15.37:0/340462202 <== mds.0 v2:172.21.15.78:6834/3319636422 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55a90fe48f00 con 0x55a90ff3a470 2023-12-19T16:07:16.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.100+0000 7f07d17fa640 10 client.4689 handle_command_reply: tid=0 2023-12-19T16:07:16.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.100+0000 7f07fb3e4740 1 client.4689 shutdown 2023-12-19T16:07:16.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.100+0000 7f07fb3e4740 1 -- 172.21.15.37:0/340462202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff16b30 msgr2=0x55a90ff16f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:16.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.100+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/340462202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff16b30 0x55a90ff16f90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f07ec011380 tx=0x7f07ec011840 comp rx=0 tx=0).stop 2023-12-19T16:07:16.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.100+0000 7f07fb3e4740 1 -- 172.21.15.37:0/340462202 shutdown_connections 2023-12-19T16:07:16.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.100+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/340462202 >> [v2:172.21.15.78:6834/3319636422,v1:172.21.15.78:6835/3319636422] conn(0x55a90ff3a470 0x55a90ff3a850 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.100+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/340462202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff16b30 0x55a90ff16f90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.100+0000 7f07d17fa640 0 client.4689 ms_handle_reset on v2:172.21.15.78:6834/3319636422 2023-12-19T16:07:16.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.100+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/340462202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90ff2a800 0x55a90ff18bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.100+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/340462202 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff200e0 0x55a90ff1a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.100+0000 7f07fb3e4740 1 -- 172.21.15.37:0/340462202 >> 172.21.15.37:0/340462202 conn(0x55a90feef100 msgr2=0x55a90ff1b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:16.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.100+0000 7f07fb3e4740 1 -- 172.21.15.37:0/340462202 shutdown_connections 2023-12-19T16:07:16.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.100+0000 7f07fb3e4740 1 -- 172.21.15.37:0/340462202 wait complete. 2023-12-19T16:07:16.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.100+0000 7f07fb3e4740 20 client.4689 trim_cache size 0 max 16384 2023-12-19T16:07:16.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.115+0000 7f07fb3e4740 1 Processor -- start 2023-12-19T16:07:16.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.115+0000 7f07fb3e4740 1 -- start start 2023-12-19T16:07:16.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.115+0000 7f07fb3e4740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90ff16b30 0x55a90ff40880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.115+0000 7f07fb3e4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff200e0 0x55a90fef3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.115+0000 7f07fb3e4740 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff2a800 0x55a90fef3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.115+0000 7f07fb3e4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90feef950 con 0x55a90ff200e0 2023-12-19T16:07:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.115+0000 7f07fb3e4740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90fe8c3a0 con 0x55a90ff16b30 2023-12-19T16:07:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.115+0000 7f07fb3e4740 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a90fee9bb0 con 0x55a90ff2a800 2023-12-19T16:07:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.116+0000 7f07f1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff200e0 0x55a90fef3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.116+0000 7f07f1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff200e0 0x55a90fef3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48104/0 (socket says 172.21.15.37:48104) 2023-12-19T16:07:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.116+0000 7f07f1d9b640 1 -- 172.21.15.37:0/604274558 learned_addr learned my addr 172.21.15.37:0/604274558 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.116+0000 7f07f1d9b640 1 -- 172.21.15.37:0/604274558 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff2a800 msgr2=0x55a90fef3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.116+0000 7f07f1d9b640 1 --2- 172.21.15.37:0/604274558 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff2a800 0x55a90fef3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.116+0000 7f07f1d9b640 1 -- 172.21.15.37:0/604274558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90ff16b30 msgr2=0x55a90ff40880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.116+0000 7f07f259c640 1 --2- 172.21.15.37:0/604274558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90ff16b30 0x55a90ff40880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.116+0000 7f07f1d9b640 1 --2- 172.21.15.37:0/604274558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90ff16b30 0x55a90ff40880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.116+0000 7f07f1d9b640 1 -- 172.21.15.37:0/604274558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a90fdf7be0 con 0x55a90ff200e0 2023-12-19T16:07:16.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.116+0000 7f07f1d9b640 1 --2- 172.21.15.37:0/604274558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff200e0 0x55a90fef3a80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f07e80870e0 tx=0x7f07e80586b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd559929a821e59b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:16.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.116+0000 7f07e0ff9640 1 -- 172.21.15.37:0/604274558 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e805fed0 con 0x55a90ff200e0 2023-12-19T16:07:16.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.116+0000 7f07e0ff9640 1 -- 172.21.15.37:0/604274558 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e8056290 con 0x55a90ff200e0 2023-12-19T16:07:16.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.116+0000 7f07e0ff9640 1 -- 172.21.15.37:0/604274558 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e805fa40 con 0x55a90ff200e0 2023-12-19T16:07:16.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.117+0000 7f07fb3e4740 1 -- 172.21.15.37:0/604274558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff200e0 msgr2=0x55a90fef3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:16.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.117+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/604274558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff200e0 0x55a90fef3a80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f07e80870e0 tx=0x7f07e80586b0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.117+0000 7f07fb3e4740 1 -- 172.21.15.37:0/604274558 shutdown_connections 2023-12-19T16:07:16.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.117+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/604274558 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff2a800 0x55a90fef3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.117+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/604274558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff200e0 0x55a90fef3a80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.117+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/604274558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90ff16b30 0x55a90ff40880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.117+0000 7f07fb3e4740 1 -- 172.21.15.37:0/604274558 >> 172.21.15.37:0/604274558 conn(0x55a90feef100 msgr2=0x55a90ff195c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:16.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.117+0000 7f07fb3e4740 1 -- 172.21.15.37:0/604274558 shutdown_connections 2023-12-19T16:07:16.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.117+0000 7f07fb3e4740 1 -- 172.21.15.37:0/604274558 wait complete. 2023-12-19T16:07:16.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.117+0000 7f07fb3e4740 1 -- start start 2023-12-19T16:07:16.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.117+0000 7f07fb3e4740 1 Processor -- start 2023-12-19T16:07:16.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.118+0000 7f07fb3e4740 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff16b30 0x55a90ff45b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.118+0000 7f07fb3e4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff200e0 0x55a90ff231e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.118+0000 7f07fb3e4740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90ff2a800 0x55a90ff489b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.118+0000 7f07fb3e4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90ff277b0 con 0x55a90ff200e0 2023-12-19T16:07:16.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.118+0000 7f07fb3e4740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a90ff23a20 con 0x55a90ff2a800 2023-12-19T16:07:16.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.118+0000 7f07fb3e4740 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a90ff46060 con 0x55a90ff16b30 2023-12-19T16:07:16.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.118+0000 7f07fb3e4740 10 client.0 _ll_register_callbacks cb 0x7f07e4009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:07:16.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.118+0000 7f07f1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff200e0 0x55a90ff231e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.118+0000 7f07f1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff200e0 0x55a90ff231e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48114/0 (socket says 172.21.15.37:48114) 2023-12-19T16:07:16.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.118+0000 7f07f1d9b640 1 -- 172.21.15.37:0/1150617599 learned_addr learned my addr 172.21.15.37:0/1150617599 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:16.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.118+0000 7f07f2d9d640 1 --2- 172.21.15.37:0/1150617599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90ff2a800 0x55a90ff489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.118+0000 7f07f259c640 1 --2- 172.21.15.37:0/1150617599 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff16b30 0x55a90ff45b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.118+0000 7f07f1d9b640 1 -- 172.21.15.37:0/1150617599 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff16b30 msgr2=0x55a90ff45b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:16.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.118+0000 7f07f1d9b640 1 --2- 172.21.15.37:0/1150617599 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff16b30 0x55a90ff45b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.118+0000 7f07f1d9b640 1 -- 172.21.15.37:0/1150617599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90ff2a800 msgr2=0x55a90ff489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:16.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.118+0000 7f07f1d9b640 1 --2- 172.21.15.37:0/1150617599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90ff2a800 0x55a90ff489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.118+0000 7f07f1d9b640 1 -- 172.21.15.37:0/1150617599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f41d14a0 con 0x55a90ff200e0 2023-12-19T16:07:16.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.119+0000 7f07f1d9b640 1 --2- 172.21.15.37:0/1150617599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff200e0 0x55a90ff231e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f07e80870e0 tx=0x7f07e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695dfdcd0e0cf895 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:16.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.119+0000 7f07d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-12-19T16:07:16.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.119+0000 7f07d17fa640 1 -- 172.21.15.37:0/1150617599 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8076210 con 0x55a90ff200e0 2023-12-19T16:07:16.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.119+0000 7f07d17fa640 1 -- 172.21.15.37:0/1150617599 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07e8076370 con 0x55a90ff200e0 2023-12-19T16:07:16.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.119+0000 7f07fb3e4740 1 -- 172.21.15.37:0/1150617599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f07e4045040 con 0x55a90ff200e0 2023-12-19T16:07:16.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.119+0000 7f07d17fa640 1 -- 172.21.15.37:0/1150617599 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07e8076550 con 0x55a90ff200e0 2023-12-19T16:07:16.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.119+0000 7f07fb3e4740 10 client.4695 fetch_fsmap learned FSMap version 7 2023-12-19T16:07:16.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.119+0000 7f07fb3e4740 1 -- 172.21.15.37:0/1150617599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55a90fe1d2f0 con 0x55a90ff200e0 2023-12-19T16:07:16.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.119+0000 7f07d17fa640 1 -- 172.21.15.37:0/1150617599 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e4045040 con 0x55a90ff200e0 2023-12-19T16:07:16.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.119+0000 7f07d17fa640 1 -- 172.21.15.37:0/1150617599 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 7) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f07e8082070 con 0x55a90ff200e0 2023-12-19T16:07:16.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.119+0000 7f07fb3e4740 10 client.4695 fetch_fsmap finished waiting for FSMap version 7 2023-12-19T16:07:16.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.119+0000 7f07fb3e4740 10 client.4695 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T16:07:16.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.119+0000 7f07fb3e4740 20 client.4695 populate_metadata read hostname 'smithi037' 2023-12-19T16:07:16.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.119+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/1150617599 >> [v2:172.21.15.78:6834/3319636422,v1:172.21.15.78:6835/3319636422] conn(0x55a90ff467f0 0x55a90ff90730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.119+0000 7f07fb3e4740 4 client.4695 mds_command: new command op to 4282 tid=0[{"prefix": "status"}] 2023-12-19T16:07:16.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.119+0000 7f07fb3e4740 1 -- 172.21.15.37:0/1150617599 --> [v2:172.21.15.78:6834/3319636422,v1:172.21.15.78:6835/3319636422] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a90fe501b0 con 0x55a90ff467f0 2023-12-19T16:07:16.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.119+0000 7f07f259c640 1 --2- 172.21.15.37:0/1150617599 >> [v2:172.21.15.78:6834/3319636422,v1:172.21.15.78:6835/3319636422] conn(0x55a90ff467f0 0x55a90ff90730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.120+0000 7f07d17fa640 10 client.4695 ms_handle_connect on v2:172.21.15.78:6834/3319636422 2023-12-19T16:07:16.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.120+0000 7f07f259c640 1 --2- 172.21.15.37:0/1150617599 >> [v2:172.21.15.78:6834/3319636422,v1:172.21.15.78:6835/3319636422] conn(0x55a90ff467f0 0x55a90ff90730 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8502591ea67f02a server_cookie=8faa8c1bcd013301 in_seq=0 out_seq=0 2023-12-19T16:07:16.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.120+0000 7f07d17fa640 1 -- 172.21.15.37:0/1150617599 <== mds.0 v2:172.21.15.78:6834/3319636422 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55a90fe501b0 con 0x55a90ff467f0 2023-12-19T16:07:16.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.120+0000 7f07d17fa640 10 client.4695 handle_command_reply: tid=0 2023-12-19T16:07:16.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.120+0000 7f07fb3e4740 1 client.4695 shutdown 2023-12-19T16:07:16.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.120+0000 7f07fb3e4740 1 -- 172.21.15.37:0/1150617599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff200e0 msgr2=0x55a90ff231e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:16.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.120+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/1150617599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff200e0 0x55a90ff231e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f07e80870e0 tx=0x7f07e80046c0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.120+0000 7f07fb3e4740 1 -- 172.21.15.37:0/1150617599 shutdown_connections 2023-12-19T16:07:16.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.120+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/1150617599 >> [v2:172.21.15.78:6834/3319636422,v1:172.21.15.78:6835/3319636422] conn(0x55a90ff467f0 0x55a90ff90730 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.120+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/1150617599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a90ff2a800 0x55a90ff489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.120+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/1150617599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a90ff200e0 0x55a90ff231e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.120+0000 7f07fb3e4740 1 --2- 172.21.15.37:0/1150617599 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55a90ff16b30 0x55a90ff45b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.120+0000 7f07d17fa640 0 client.4695 ms_handle_reset on v2:172.21.15.78:6834/3319636422 2023-12-19T16:07:16.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.120+0000 7f07fb3e4740 1 -- 172.21.15.37:0/1150617599 >> 172.21.15.37:0/1150617599 conn(0x55a90feef100 msgr2=0x55a90ff40880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:16.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.120+0000 7f07fb3e4740 1 -- 172.21.15.37:0/1150617599 shutdown_connections 2023-12-19T16:07:16.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.120+0000 7f07fb3e4740 1 -- 172.21.15.37:0/1150617599 wait complete. 2023-12-19T16:07:16.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.120+0000 7f07fb3e4740 20 client.4695 trim_cache size 0 max 16384 2023-12-19T16:07:16.129 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-12-19T16:07:16.129 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2", 2023-12-19T16:07:16.129 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-12-19T16:07:16.129 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4282, 2023-12-19T16:07:16.129 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-12-19T16:07:16.129 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-12-19T16:07:16.130 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-12-19T16:07:16.130 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 17.391177066000001, 2023-12-19T16:07:16.130 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 7, 2023-12-19T16:07:16.130 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 20, 2023-12-19T16:07:16.130 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 20, 2023-12-19T16:07:16.130 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 23.857972412999999 2023-12-19T16:07:16.130 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-12-19T16:07:16.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.121+0000 7f07f8870640 1 -- 172.21.15.37:0/72041112 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f07d406a430 msgr2=0x7f07d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:16.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.121+0000 7f07f8870640 1 --2- 172.21.15.37:0/72041112 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f07d406a430 0x7f07d406c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f07e4035000 tx=0x7f07e4030000 comp rx=0 tx=0).stop 2023-12-19T16:07:16.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.121+0000 7f07f8870640 1 -- 172.21.15.37:0/72041112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f4142e00 msgr2=0x7f07f41ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:16.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.121+0000 7f07f8870640 1 --2- 172.21.15.37:0/72041112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f4142e00 0x7f07f41ceb00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f07e800c7f0 tx=0x7f07e800ccb0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.121+0000 7f07f8870640 1 -- 172.21.15.37:0/72041112 shutdown_connections 2023-12-19T16:07:16.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.121+0000 7f07f8870640 1 --2- 172.21.15.37:0/72041112 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f07d406a430 0x7f07d406c8f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.121+0000 7f07f8870640 1 --2- 172.21.15.37:0/72041112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f41de010 0x7f07f41cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.121+0000 7f07f8870640 1 --2- 172.21.15.37:0/72041112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f4142e00 0x7f07f41ceb00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.121+0000 7f07f8870640 1 --2- 172.21.15.37:0/72041112 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f40b77a0 0x7f07f41d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.121+0000 7f07f8870640 1 -- 172.21.15.37:0/72041112 >> 172.21.15.37:0/72041112 conn(0x7f07f40bab20 msgr2=0x7f07f40b91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.121+0000 7f07f8870640 1 -- 172.21.15.37:0/72041112 shutdown_connections 2023-12-19T16:07:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.121+0000 7f07f8870640 1 -- 172.21.15.37:0/72041112 wait complete. 2023-12-19T16:07:16.133 INFO:teuthology.run_tasks:Running task kclient... 2023-12-19T16:07:16.157 INFO:tasks.kclient:Mounting kernel clients... 2023-12-19T16:07:16.158 INFO:tasks.kclient:config is {'client.0': {}} 2023-12-19T16:07:16.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:16.158 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T16:07:16.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:16.219 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-12-19T16:07:16.323 INFO:teuthology.orchestra.run.smithi151.stderr:Cannot find device "ceph-brx" 2023-12-19T16:07:16.326 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:07:16.327 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-19T16:07:16.327 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T16:07:16.327 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T16:07:16.327 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T16:07:16.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.433+0000 7ff6cc6bd640 1 Processor -- start 2023-12-19T16:07:16.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.433+0000 7ff6cc6bd640 1 -- start start 2023-12-19T16:07:16.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.434+0000 7ff6cc6bd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff6c4144ea0 0x7ff6c4156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.434+0000 7ff6cc6bd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c40bc6b0 con 0x7ff6c40bcdd0 2023-12-19T16:07:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.434+0000 7ff6cc6bd640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c40a59f0 con 0x7ff6c40b6690 2023-12-19T16:07:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.434+0000 7ff6cc6bd640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c40bc0a0 con 0x7ff6c4144ea0 2023-12-19T16:07:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.434+0000 7ff6ca459640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff6c40bcdd0 0x7ff6c40b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46540/0 (socket says 172.21.15.37:46540) 2023-12-19T16:07:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.434+0000 7ff6ca459640 1 -- 172.21.15.37:0/2815622940 learned_addr learned my addr 172.21.15.37:0/2815622940 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.434+0000 7ff6cac5a640 1 --2- 172.21.15.37:0/2815622940 >> v2:172.21.15.78:3300/0 conn(0x7ff6c4144ea0 0x7ff6c4156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.434+0000 7ff6c9457640 1 -- 172.21.15.37:0/2815622940 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651761089 0 0) 0x7ff6c40bc6b0 con 0x7ff6c40bcdd0 2023-12-19T16:07:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.434+0000 7ff6c9457640 1 -- 172.21.15.37:0/2815622940 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6b0003520 con 0x7ff6c40bcdd0 2023-12-19T16:07:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.434+0000 7ff6c9457640 1 -- 172.21.15.37:0/2815622940 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1641374128 0 0) 0x7ff6b0003520 con 0x7ff6c40bcdd0 2023-12-19T16:07:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.434+0000 7ff6c9457640 1 -- 172.21.15.37:0/2815622940 >> v2:172.21.15.78:3300/0 conn(0x7ff6c4144ea0 msgr2=0x7ff6c4156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.434+0000 7ff6c9457640 1 --2- 172.21.15.37:0/2815622940 >> v2:172.21.15.78:3300/0 conn(0x7ff6c4144ea0 0x7ff6c4156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.434+0000 7ff6c9457640 1 -- 172.21.15.37:0/2815622940 >> v1:172.21.15.78:6789/0 conn(0x7ff6c40b6690 legacy=0x7ff6c4144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.434+0000 7ff6c9457640 1 -- 172.21.15.37:0/2815622940 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c40bc340 con 0x7ff6c40bcdd0 2023-12-19T16:07:16.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.434+0000 7ff6c9457640 1 -- 172.21.15.37:0/2815622940 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7ff6bc001670 con 0x7ff6c40bcdd0 2023-12-19T16:07:16.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.434+0000 7ff6c9457640 1 -- 172.21.15.37:0/2815622940 >> v1:172.21.15.37:6789/0 conn(0x7ff6c40bcdd0 legacy=0x7ff6c40b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:16.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.435+0000 7ff6c9457640 1 --2- 172.21.15.37:0/2815622940 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6b0003970 0x7ff6b0003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.435+0000 7ff6c9457640 1 --2- 172.21.15.37:0/2815622940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b00047c0 0x7ff6b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.435+0000 7ff6c9457640 1 --2- 172.21.15.37:0/2815622940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6b0005180 0x7ff6b000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.435+0000 7ff6c9457640 1 -- 172.21.15.37:0/2815622940 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c40bc0a0 con 0x7ff6b0005180 2023-12-19T16:07:16.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.435+0000 7ff6c9457640 1 -- 172.21.15.37:0/2815622940 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b000c030 con 0x7ff6b00047c0 2023-12-19T16:07:16.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.435+0000 7ff6c9457640 1 -- 172.21.15.37:0/2815622940 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b000c1f0 con 0x7ff6b0003970 2023-12-19T16:07:16.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.435+0000 7ff6cac5a640 1 --2- 172.21.15.37:0/2815622940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6b0005180 0x7ff6b000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.435+0000 7ff6ca459640 1 --2- 172.21.15.37:0/2815622940 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6b0003970 0x7ff6b0003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.435+0000 7ff6c9c58640 1 --2- 172.21.15.37:0/2815622940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b00047c0 0x7ff6b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.435+0000 7ff6cac5a640 1 -- 172.21.15.37:0/2815622940 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6b0003970 msgr2=0x7ff6b0003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:16.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.435+0000 7ff6cac5a640 1 --2- 172.21.15.37:0/2815622940 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6b0003970 0x7ff6b0003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.435+0000 7ff6cac5a640 1 -- 172.21.15.37:0/2815622940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b00047c0 msgr2=0x7ff6b0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.435+0000 7ff6cac5a640 1 --2- 172.21.15.37:0/2815622940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b00047c0 0x7ff6b0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.435+0000 7ff6cac5a640 1 -- 172.21.15.37:0/2815622940 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b0003520 con 0x7ff6b0005180 2023-12-19T16:07:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.436+0000 7ff6cac5a640 1 -- 172.21.15.37:0/2815622940 reap_dead start 2023-12-19T16:07:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.436+0000 7ff6cac5a640 1 --2- 172.21.15.37:0/2815622940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6b0005180 0x7ff6b000b980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0009fc0 tx=0x7ff6b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bc82276b1ba211 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.436+0000 7ff6c9457640 1 -- 172.21.15.37:0/2815622940 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c002cc60 con 0x7ff6b0005180 2023-12-19T16:07:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.436+0000 7ff6c9457640 1 -- 172.21.15.37:0/2815622940 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c000f040 con 0x7ff6b0005180 2023-12-19T16:07:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.436+0000 7ff6c9457640 1 -- 172.21.15.37:0/2815622940 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0003990 con 0x7ff6b0005180 2023-12-19T16:07:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.436+0000 7ff6cc6bd640 1 -- 172.21.15.37:0/2815622940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6b0005180 msgr2=0x7ff6b000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.436+0000 7ff6cc6bd640 1 --2- 172.21.15.37:0/2815622940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6b0005180 0x7ff6b000b980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0009fc0 tx=0x7ff6b00057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.436+0000 7ff6cc6bd640 1 -- 172.21.15.37:0/2815622940 shutdown_connections 2023-12-19T16:07:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.436+0000 7ff6cc6bd640 1 --2- 172.21.15.37:0/2815622940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6b0005180 0x7ff6b000b980 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.436+0000 7ff6cc6bd640 1 -- 172.21.15.37:0/2815622940 >> 172.21.15.37:0/2815622940 conn(0x7ff6c4071e60 msgr2=0x7ff6c40c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.436+0000 7ff6cc6bd640 1 -- 172.21.15.37:0/2815622940 shutdown_connections 2023-12-19T16:07:16.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.436+0000 7ff6cc6bd640 1 -- 172.21.15.37:0/2815622940 wait complete. 2023-12-19T16:07:16.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.438+0000 7ff6cc6bd640 1 Processor -- start 2023-12-19T16:07:16.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.438+0000 7ff6cc6bd640 1 -- start start 2023-12-19T16:07:16.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.438+0000 7ff6cc6bd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b0005180 0x7ff6c41d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.438+0000 7ff6cc6bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6c4145410 0x7ff6c41d30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.438+0000 7ff6cc6bd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c41d3600 0x7ff6c413e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.438+0000 7ff6cc6bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c41d2350 con 0x7ff6c4145410 2023-12-19T16:07:16.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.438+0000 7ff6cc6bd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c41d3ab0 con 0x7ff6b0005180 2023-12-19T16:07:16.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.438+0000 7ff6cc6bd640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c41d2a20 con 0x7ff6c41d3600 2023-12-19T16:07:16.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.438+0000 7ff6c9c58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6c4145410 0x7ff6c41d30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.438+0000 7ff6c9c58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6c4145410 0x7ff6c41d30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48122/0 (socket says 172.21.15.37:48122) 2023-12-19T16:07:16.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.438+0000 7ff6c9c58640 1 -- 172.21.15.37:0/1007576684 learned_addr learned my addr 172.21.15.37:0/1007576684 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:16.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.438+0000 7ff6ca459640 1 --2- 172.21.15.37:0/1007576684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b0005180 0x7ff6c41d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.438+0000 7ff6cac5a640 1 --2- 172.21.15.37:0/1007576684 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c41d3600 0x7ff6c413e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.439+0000 7ff6c9c58640 1 -- 172.21.15.37:0/1007576684 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c41d3600 msgr2=0x7ff6c413e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:16.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.439+0000 7ff6c9c58640 1 --2- 172.21.15.37:0/1007576684 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c41d3600 0x7ff6c413e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.439+0000 7ff6c9c58640 1 -- 172.21.15.37:0/1007576684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b0005180 msgr2=0x7ff6c41d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:16.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.439+0000 7ff6c9c58640 1 --2- 172.21.15.37:0/1007576684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b0005180 0x7ff6c41d1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.439+0000 7ff6c9c58640 1 -- 172.21.15.37:0/1007576684 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c41e31e0 con 0x7ff6c4145410 2023-12-19T16:07:16.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.439+0000 7ff6ca459640 1 --2- 172.21.15.37:0/1007576684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b0005180 0x7ff6c41d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:16.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.439+0000 7ff6c9c58640 1 --2- 172.21.15.37:0/1007576684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6c4145410 0x7ff6c41d30c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400f620 tx=0x7ff6b400fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:16.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.439+0000 7ff6baffd640 1 -- 172.21.15.37:0/1007576684 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40052e0 con 0x7ff6c4145410 2023-12-19T16:07:16.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.439+0000 7ff6baffd640 1 -- 172.21.15.37:0/1007576684 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b4005440 con 0x7ff6c4145410 2023-12-19T16:07:16.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.439+0000 7ff6cc6bd640 1 -- 172.21.15.37:0/1007576684 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c41e34c0 con 0x7ff6c4145410 2023-12-19T16:07:16.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.439+0000 7ff6baffd640 1 -- 172.21.15.37:0/1007576684 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4003810 con 0x7ff6c4145410 2023-12-19T16:07:16.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.439+0000 7ff6cc6bd640 1 -- 172.21.15.37:0/1007576684 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c41e3a80 con 0x7ff6c4145410 2023-12-19T16:07:16.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.440+0000 7ff6cc6bd640 1 -- 172.21.15.37:0/1007576684 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c41e3c40 con 0x7ff6c4145410 2023-12-19T16:07:16.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.440+0000 7ff6baffd640 1 -- 172.21.15.37:0/1007576684 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff6b4003970 con 0x7ff6c4145410 2023-12-19T16:07:16.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.441+0000 7ff6baffd640 1 --2- 172.21.15.37:0/1007576684 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff6a806a460 0x7ff6a806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:16.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.441+0000 7ff6baffd640 1 -- 172.21.15.37:0/1007576684 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6b40887d0 con 0x7ff6c4145410 2023-12-19T16:07:16.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.441+0000 7ff6ca459640 1 --2- 172.21.15.37:0/1007576684 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff6a806a460 0x7ff6a806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:16.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.441+0000 7ff6ca459640 1 --2- 172.21.15.37:0/1007576684 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff6a806a460 0x7ff6a806c920 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc001050 tx=0x7ff6bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:16.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.445+0000 7ff6baffd640 1 -- 172.21.15.37:0/1007576684 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff6b4053d60 con 0x7ff6c4145410 2023-12-19T16:07:16.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.661+0000 7ff6cc6bd640 1 -- 172.21.15.37:0/1007576684 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff6c404e840 con 0x7ff6c4145410 2023-12-19T16:07:16.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.662+0000 7ff6baffd640 1 -- 172.21.15.37:0/1007576684 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff6b4057380 con 0x7ff6c4145410 2023-12-19T16:07:16.664 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T16:07:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.663+0000 7ff6cc6bd640 1 -- 172.21.15.37:0/1007576684 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff6a806a460 msgr2=0x7ff6a806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.663+0000 7ff6cc6bd640 1 --2- 172.21.15.37:0/1007576684 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff6a806a460 0x7ff6a806c920 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc001050 tx=0x7ff6bc009040 comp rx=0 tx=0).stop 2023-12-19T16:07:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.663+0000 7ff6cc6bd640 1 -- 172.21.15.37:0/1007576684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6c4145410 msgr2=0x7ff6c41d30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.663+0000 7ff6cc6bd640 1 --2- 172.21.15.37:0/1007576684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6c4145410 0x7ff6c41d30c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400f620 tx=0x7ff6b400fae0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.664+0000 7ff6cc6bd640 1 -- 172.21.15.37:0/1007576684 shutdown_connections 2023-12-19T16:07:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.664+0000 7ff6cc6bd640 1 --2- 172.21.15.37:0/1007576684 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff6a806a460 0x7ff6a806c920 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.664+0000 7ff6cc6bd640 1 --2- 172.21.15.37:0/1007576684 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff6c41d3600 0x7ff6c413e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.664+0000 7ff6cc6bd640 1 --2- 172.21.15.37:0/1007576684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6c4145410 0x7ff6c41d30c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.664+0000 7ff6cc6bd640 1 --2- 172.21.15.37:0/1007576684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff6b0005180 0x7ff6c41d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:16.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.664+0000 7ff6cc6bd640 1 -- 172.21.15.37:0/1007576684 >> 172.21.15.37:0/1007576684 conn(0x7ff6c4071e60 msgr2=0x7ff6c41407c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:16.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.664+0000 7ff6cc6bd640 1 -- 172.21.15.37:0/1007576684 shutdown_connections 2023-12-19T16:07:16.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:16.664+0000 7ff6cc6bd640 1 -- 172.21.15.37:0/1007576684 wait complete. 2023-12-19T16:07:16.676 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T16:07:16.676 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T16:07:16.676 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-12-19T16:07:16.676 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T16:07:16.676 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T16:07:16.676 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T16:07:16.677 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T16:07:16.677 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T16:07:16.677 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:07:16.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:16.677 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-12-19T16:07:16.738 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:07:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:07:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:07:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:07:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-19T16:07:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:07:16.738 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T16:07:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-19T16:07:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-12-19T16:07:16.738 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T16:07:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-19T16:07:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-12-19T16:07:16.738 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T16:07:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:07:16.739 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T16:07:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:07:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T16:07:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42346sec preferred_lft 42346sec 2023-12-19T16:07:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-12-19T16:07:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:07:16.740 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-19T16:07:16.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:16.741 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T16:07:16.741 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T16:07:16.741 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add name ceph-brx type bridge 2023-12-19T16:07:16.741 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr flush dev ceph-brx 2023-12-19T16:07:16.741 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set ceph-brx up 2023-12-19T16:07:16.741 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-19T16:07:16.741 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T16:07:17.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:17.193 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T16:07:17.268 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-12-19T16:07:17.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:17.272 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-12-19T16:07:17.331 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-12-19T16:07:17.331 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T16:07:17.331 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T16:07:17.331 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T16:07:17.331 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T16:07:17.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:17.332 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T16:07:17.332 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T16:07:17.332 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T16:07:17.332 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T16:07:17.332 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T16:07:17.332 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T16:07:18.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:18.049 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T16:07:18.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:18.093 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2023-12-19T16:07:18.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:18.186 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T16:07:18.186 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T16:07:18.186 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T16:07:18.187 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-19T16:07:18.187 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T16:07:18.325 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-19T16:07:18.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:18.325 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T16:07:18.325 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T16:07:18.326 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-19T16:07:18.326 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-19T16:07:18.326 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-19T16:07:18.326 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-19T16:07:18.326 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-19T16:07:18.326 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T16:07:18.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:18.601 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T16:07:18.601 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T16:07:18.601 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-12-19T16:07:18.601 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.0 master ceph-brx 2023-12-19T16:07:18.602 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T16:07:18.750 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:07:18.750 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T16:07:18.794 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:07:18.794 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:07:18.795 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:07:18.889 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-19T16:07:18.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:18.889 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:07:19.044 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:07:19.044 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T16:07:19.044 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2023-12-19T16:07:19.497 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:07:19.497 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T16:07:19.498 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2023-12-19T16:07:19.498 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.78:3300,172.21.15.78:3301" 2023-12-19T16:07:19.498 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T16:07:19.533 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:07:19.533 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T16:07:19.533 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2023-12-19T16:07:19.533 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.78:3300,172.21.15.78:3301" 2023-12-19T16:07:19.533 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T16:07:19.533 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.78:6789,172.21.15.78:6790" 2023-12-19T16:07:19.533 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.78:6789,172.21.15.78:6790:/ 2023-12-19T16:07:19.533 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2" will pass to kernel 2023-12-19T16:07:19.539 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T16:07:19.540 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2023-12-19T16:07:19.540 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T16:07:19.540 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T16:07:19.540 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T16:07:19.545 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T16:07:19.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:19.545 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:07:19.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:19.633 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T16:07:19.698 INFO:teuthology.orchestra.run.smithi151.stdout:client4621 2023-12-19T16:07:19.698 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T16:07:19.698 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:07:19.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:19.751 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T16:07:19.815 INFO:teuthology.orchestra.run.smithi151.stdout:client4621 2023-12-19T16:07:19.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:19.816 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T16:07:19.884 INFO:teuthology.orchestra.run.smithi151.stdout:client4621 2023-12-19T16:07:19.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:19.885 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2.client4621/status') 2023-12-19T16:07:19.981 INFO:teuthology.orchestra.run.smithi151.stdout:instance: client.4621 (3)172.21.15.151:0/2488673831 2023-12-19T16:07:19.981 INFO:teuthology.orchestra.run.smithi151.stdout:blocklisted: false 2023-12-19T16:07:19.982 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records in 2023-12-19T16:07:19.982 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records out 2023-12-19T16:07:19.982 INFO:teuthology.orchestra.run.smithi151.stderr:71 bytes copied, 6.653e-05 s, 1.1 MB/s 2023-12-19T16:07:19.985 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-19T16:07:20.002 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:07:20.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.117+0000 7f6cf7320640 1 Processor -- start 2023-12-19T16:07:20.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.117+0000 7f6cf7320640 1 -- start start 2023-12-19T16:07:20.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.118+0000 7f6cf7320640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6cf00bcdd0 0x7f6cf00b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:20.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.118+0000 7f6cf7320640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf00bc6b0 con 0x7f6cf00b64c0 2023-12-19T16:07:20.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.118+0000 7f6cf7320640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf00b6900 con 0x7f6cf0144ea0 2023-12-19T16:07:20.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.118+0000 7f6cf7320640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf00a59f0 con 0x7f6cf00bcdd0 2023-12-19T16:07:20.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.118+0000 7f6cf48bb640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6cf00b64c0 0x7f6cf0144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34886/0 (socket says 172.21.15.37:34886) 2023-12-19T16:07:20.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.118+0000 7f6cf48bb640 1 -- 172.21.15.37:0/2799728412 learned_addr learned my addr 172.21.15.37:0/2799728412 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:20.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.118+0000 7f6cf50bc640 1 --2- 172.21.15.37:0/2799728412 >> v2:172.21.15.78:3300/0 conn(0x7f6cf00bcdd0 0x7f6cf00b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:20.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.119+0000 7f6ce7fff640 1 -- 172.21.15.37:0/2799728412 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104087113 0 0) 0x7f6cf00bc6b0 con 0x7f6cf00b64c0 2023-12-19T16:07:20.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.119+0000 7f6ce7fff640 1 -- 172.21.15.37:0/2799728412 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cdc003520 con 0x7f6cf00b64c0 2023-12-19T16:07:20.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.119+0000 7f6ce7fff640 1 -- 172.21.15.37:0/2799728412 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435851331 0 0) 0x7f6cf00b6900 con 0x7f6cf0144ea0 2023-12-19T16:07:20.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.119+0000 7f6ce7fff640 1 -- 172.21.15.37:0/2799728412 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cf00bc6b0 con 0x7f6cf0144ea0 2023-12-19T16:07:20.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.119+0000 7f6ce7fff640 1 -- 172.21.15.37:0/2799728412 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1786178778 0 0) 0x7f6cdc003520 con 0x7f6cf00b64c0 2023-12-19T16:07:20.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.119+0000 7f6cf50bc640 1 -- 172.21.15.37:0/2799728412 >> v1:172.21.15.78:6789/0 conn(0x7f6cf0144ea0 legacy=0x7f6cf0155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:20.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.119+0000 7f6cf50bc640 1 -- 172.21.15.37:0/2799728412 >> v1:172.21.15.37:6789/0 conn(0x7f6cf00b64c0 legacy=0x7f6cf0144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:20.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.119+0000 7f6cf50bc640 1 -- 172.21.15.37:0/2799728412 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf00bc0a0 con 0x7f6cf00bcdd0 2023-12-19T16:07:20.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.120+0000 7f6cf50bc640 1 --2- 172.21.15.37:0/2799728412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf00bcdd0 0x7f6cf00b5f80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0097a0 tx=0x7f6cec02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a3279d7e6f32a26 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:20.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.120+0000 7f6ce7fff640 1 -- 172.21.15.37:0/2799728412 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0001670 con 0x7f6cf00bcdd0 2023-12-19T16:07:20.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.120+0000 7f6ce7fff640 1 -- 172.21.15.37:0/2799728412 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cec031590 con 0x7f6cf00bcdd0 2023-12-19T16:07:20.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.120+0000 7f6ce7fff640 1 -- 172.21.15.37:0/2799728412 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec031920 con 0x7f6cf00bcdd0 2023-12-19T16:07:20.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.120+0000 7f6cf7320640 1 -- 172.21.15.37:0/2799728412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf00bcdd0 msgr2=0x7f6cf00b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:20.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.120+0000 7f6cf7320640 1 --2- 172.21.15.37:0/2799728412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf00bcdd0 0x7f6cf00b5f80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0097a0 tx=0x7f6cec02b8b0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.120+0000 7f6cf7320640 1 -- 172.21.15.37:0/2799728412 shutdown_connections 2023-12-19T16:07:20.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.121+0000 7f6cf7320640 1 --2- 172.21.15.37:0/2799728412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf00bcdd0 0x7f6cf00b5f80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.121+0000 7f6cf7320640 1 -- 172.21.15.37:0/2799728412 >> 172.21.15.37:0/2799728412 conn(0x7f6cf0071e60 msgr2=0x7f6cf00c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:20.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.121+0000 7f6cf7320640 1 -- 172.21.15.37:0/2799728412 shutdown_connections 2023-12-19T16:07:20.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.121+0000 7f6cf7320640 1 -- 172.21.15.37:0/2799728412 wait complete. 2023-12-19T16:07:20.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.122+0000 7f6cf7320640 1 Processor -- start 2023-12-19T16:07:20.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.122+0000 7f6cf7320640 1 -- start start 2023-12-19T16:07:20.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.122+0000 7f6cf7320640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cf00b64c0 0x7f6cf01d52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:20.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.122+0000 7f6cf7320640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf00bcdd0 0x7f6cf01e39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:20.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.122+0000 7f6cf7320640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cf0144ea0 0x7f6cf01488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:20.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.122+0000 7f6cf7320640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf01493f0 con 0x7f6cf0144ea0 2023-12-19T16:07:20.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.122+0000 7f6cf7320640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf01d57e0 con 0x7f6cf00bcdd0 2023-12-19T16:07:20.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.122+0000 7f6cf7320640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf01e0a70 con 0x7f6cf00b64c0 2023-12-19T16:07:20.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.122+0000 7f6cf58bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cf0144ea0 0x7f6cf01488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:20.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.123+0000 7f6cf58bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cf0144ea0 0x7f6cf01488f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58036/0 (socket says 172.21.15.37:58036) 2023-12-19T16:07:20.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.123+0000 7f6cf58bd640 1 -- 172.21.15.37:0/2400855105 learned_addr learned my addr 172.21.15.37:0/2400855105 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:20.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.123+0000 7f6cf48bb640 1 --2- 172.21.15.37:0/2400855105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf00bcdd0 0x7f6cf01e39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:20.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.123+0000 7f6cf50bc640 1 --2- 172.21.15.37:0/2400855105 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cf00b64c0 0x7f6cf01d52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:20.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.123+0000 7f6cf58bd640 1 -- 172.21.15.37:0/2400855105 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cf00b64c0 msgr2=0x7f6cf01d52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:20.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.123+0000 7f6cf58bd640 1 --2- 172.21.15.37:0/2400855105 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cf00b64c0 0x7f6cf01d52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.123+0000 7f6cf58bd640 1 -- 172.21.15.37:0/2400855105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf00bcdd0 msgr2=0x7f6cf01e39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:20.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.123+0000 7f6cf58bd640 1 --2- 172.21.15.37:0/2400855105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf00bcdd0 0x7f6cf01e39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.123+0000 7f6cf58bd640 1 -- 172.21.15.37:0/2400855105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec009400 con 0x7f6cf0144ea0 2023-12-19T16:07:20.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.123+0000 7f6cf50bc640 1 --2- 172.21.15.37:0/2400855105 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cf00b64c0 0x7f6cf01d52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:20.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.123+0000 7f6cf58bd640 1 --2- 172.21.15.37:0/2400855105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cf0144ea0 0x7f6cf01488f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6ce800c6e0 tx=0x7f6ce800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:20.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.123+0000 7f6ce5ffb640 1 -- 172.21.15.37:0/2400855105 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8003b70 con 0x7f6cf0144ea0 2023-12-19T16:07:20.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.123+0000 7f6ce5ffb640 1 -- 172.21.15.37:0/2400855105 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce8003cd0 con 0x7f6cf0144ea0 2023-12-19T16:07:20.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.123+0000 7f6ce5ffb640 1 -- 172.21.15.37:0/2400855105 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce80052d0 con 0x7f6cf0144ea0 2023-12-19T16:07:20.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.123+0000 7f6cf7320640 1 -- 172.21.15.37:0/2400855105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf014a210 con 0x7f6cf0144ea0 2023-12-19T16:07:20.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.124+0000 7f6cf7320640 1 -- 172.21.15.37:0/2400855105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf0149110 con 0x7f6cf0144ea0 2023-12-19T16:07:20.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.124+0000 7f6cf7320640 1 -- 172.21.15.37:0/2400855105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf004e840 con 0x7f6cf0144ea0 2023-12-19T16:07:20.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.125+0000 7f6ce5ffb640 1 -- 172.21.15.37:0/2400855105 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6ce8005430 con 0x7f6cf0144ea0 2023-12-19T16:07:20.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.125+0000 7f6ce5ffb640 1 --2- 172.21.15.37:0/2400855105 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6cd406a430 0x7f6cd406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:20.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.125+0000 7f6ce5ffb640 1 -- 172.21.15.37:0/2400855105 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ce8088750 con 0x7f6cf0144ea0 2023-12-19T16:07:20.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.125+0000 7f6cf50bc640 1 --2- 172.21.15.37:0/2400855105 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6cd406a430 0x7f6cd406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:20.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.126+0000 7f6cf50bc640 1 --2- 172.21.15.37:0/2400855105 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6cd406a430 0x7f6cd406c8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6cec036000 tx=0x7f6cec03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:20.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.130+0000 7f6ce5ffb640 1 -- 172.21.15.37:0/2400855105 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6ce8057740 con 0x7f6cf0144ea0 2023-12-19T16:07:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.306+0000 7f6cf7320640 1 -- 172.21.15.37:0/2400855105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cf0148e30 con 0x7f6cf0144ea0 2023-12-19T16:07:20.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.307+0000 7f6ce5ffb640 1 -- 172.21.15.37:0/2400855105 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f6ce80572d0 con 0x7f6cf0144ea0 2023-12-19T16:07:20.310 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:20.310 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:59.728935+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:06:56.758166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:06:57.635291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:07:20.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.309+0000 7f6cf7320640 1 -- 172.21.15.37:0/2400855105 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6cd406a430 msgr2=0x7f6cd406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:20.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.309+0000 7f6cf7320640 1 --2- 172.21.15.37:0/2400855105 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6cd406a430 0x7f6cd406c8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6cec036000 tx=0x7f6cec03d040 comp rx=0 tx=0).stop 2023-12-19T16:07:20.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.309+0000 7f6cf7320640 1 -- 172.21.15.37:0/2400855105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cf0144ea0 msgr2=0x7f6cf01488f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:20.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.309+0000 7f6cf7320640 1 --2- 172.21.15.37:0/2400855105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cf0144ea0 0x7f6cf01488f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6ce800c6e0 tx=0x7f6ce800cba0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.309+0000 7f6cf7320640 1 -- 172.21.15.37:0/2400855105 shutdown_connections 2023-12-19T16:07:20.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.309+0000 7f6cf7320640 1 --2- 172.21.15.37:0/2400855105 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6cd406a430 0x7f6cd406c8f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.309+0000 7f6cf7320640 1 --2- 172.21.15.37:0/2400855105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cf0144ea0 0x7f6cf01488f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.309+0000 7f6cf7320640 1 --2- 172.21.15.37:0/2400855105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf00bcdd0 0x7f6cf01e39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.309+0000 7f6cf7320640 1 --2- 172.21.15.37:0/2400855105 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6cf00b64c0 0x7f6cf01d52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.309+0000 7f6cf7320640 1 -- 172.21.15.37:0/2400855105 >> 172.21.15.37:0/2400855105 conn(0x7f6cf0071e60 msgr2=0x7f6cf0140730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:20.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.309+0000 7f6cf7320640 1 -- 172.21.15.37:0/2400855105 shutdown_connections 2023-12-19T16:07:20.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.309+0000 7f6cf7320640 1 -- 172.21.15.37:0/2400855105 wait complete. 2023-12-19T16:07:20.322 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:06:46.684027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:06:56.758166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:06:57.635291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:07:20.323 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:07:20.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.430+0000 7f3a13043640 1 Processor -- start 2023-12-19T16:07:20.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.430+0000 7f3a13043640 1 -- start start 2023-12-19T16:07:20.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.430+0000 7f3a13043640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3a0c144de0 0x7f3a0c0703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:20.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.430+0000 7f3a13043640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a0c0b8f70 0x7f3a0c14df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:20.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.430+0000 7f3a13043640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3a0c0b84d0 0x7f3a0c069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:20.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.430+0000 7f3a13043640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0c1451c0 con 0x7f3a0c144de0 2023-12-19T16:07:20.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.430+0000 7f3a13043640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0c06fc30 con 0x7f3a0c0b84d0 2023-12-19T16:07:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.430+0000 7f3a13043640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c0b3c80 con 0x7f3a0c0b8f70 2023-12-19T16:07:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.430+0000 7f3a10ddf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3a0c144de0 0x7f3a0c0703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.430+0000 7f3a10ddf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3a0c144de0 0x7f3a0c0703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58052/0 (socket says 172.21.15.37:58052) 2023-12-19T16:07:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.430+0000 7f3a10ddf640 1 -- 172.21.15.37:0/3314751331 learned_addr learned my addr 172.21.15.37:0/3314751331 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.431+0000 7f3a0bfff640 1 --2- 172.21.15.37:0/3314751331 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a0c0b8f70 0x7f3a0c14df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.431+0000 7f3a115e0640 1 --2- 172.21.15.37:0/3314751331 >> v2:172.21.15.78:3300/0 conn(0x7f3a0c0b84d0 0x7f3a0c069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.431+0000 7f3a10ddf640 1 -- 172.21.15.37:0/3314751331 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a0c0b8f70 msgr2=0x7f3a0c14df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.431+0000 7f3a10ddf640 1 --2- 172.21.15.37:0/3314751331 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a0c0b8f70 0x7f3a0c14df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.431+0000 7f3a10ddf640 1 -- 172.21.15.37:0/3314751331 >> v2:172.21.15.78:3300/0 conn(0x7f3a0c0b84d0 msgr2=0x7f3a0c069ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.431+0000 7f3a10ddf640 1 --2- 172.21.15.37:0/3314751331 >> v2:172.21.15.78:3300/0 conn(0x7f3a0c0b84d0 0x7f3a0c069ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.431+0000 7f3a10ddf640 1 -- 172.21.15.37:0/3314751331 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c0b3f20 con 0x7f3a0c144de0 2023-12-19T16:07:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.431+0000 7f3a115e0640 1 --2- 172.21.15.37:0/3314751331 >> v2:172.21.15.78:3300/0 conn(0x7f3a0c0b84d0 0x7f3a0c069ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.431+0000 7f3a0bfff640 1 --2- 172.21.15.37:0/3314751331 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a0c0b8f70 0x7f3a0c14df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.431+0000 7f3a10ddf640 1 --2- 172.21.15.37:0/3314751331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a0c144de0 0x7f3a0c0703a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0bae50 tx=0x7f3a0002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb1665ed2ae09cc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:20.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.432+0000 7f3a0b7fe640 1 -- 172.21.15.37:0/3314751331 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a000317e0 con 0x7f3a0c144de0 2023-12-19T16:07:20.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.432+0000 7f3a0b7fe640 1 -- 172.21.15.37:0/3314751331 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a00031940 con 0x7f3a0c144de0 2023-12-19T16:07:20.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.432+0000 7f3a0b7fe640 1 -- 172.21.15.37:0/3314751331 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a00031cd0 con 0x7f3a0c144de0 2023-12-19T16:07:20.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.432+0000 7f3a13043640 1 -- 172.21.15.37:0/3314751331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a0c144de0 msgr2=0x7f3a0c0703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:20.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.432+0000 7f3a13043640 1 --2- 172.21.15.37:0/3314751331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a0c144de0 0x7f3a0c0703a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0bae50 tx=0x7f3a0002b880 comp rx=0 tx=0).stop 2023-12-19T16:07:20.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.432+0000 7f3a13043640 1 -- 172.21.15.37:0/3314751331 shutdown_connections 2023-12-19T16:07:20.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.432+0000 7f3a13043640 1 --2- 172.21.15.37:0/3314751331 >> v2:172.21.15.78:3300/0 conn(0x7f3a0c0b84d0 0x7f3a0c069ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.432+0000 7f3a13043640 1 --2- 172.21.15.37:0/3314751331 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a0c0b8f70 0x7f3a0c14df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.432+0000 7f3a13043640 1 --2- 172.21.15.37:0/3314751331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a0c144de0 0x7f3a0c0703a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.432+0000 7f3a13043640 1 -- 172.21.15.37:0/3314751331 >> 172.21.15.37:0/3314751331 conn(0x7f3a0c0bcfe0 msgr2=0x7f3a0c0bd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:20.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.432+0000 7f3a13043640 1 -- 172.21.15.37:0/3314751331 shutdown_connections 2023-12-19T16:07:20.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.432+0000 7f3a13043640 1 -- 172.21.15.37:0/3314751331 wait complete. 2023-12-19T16:07:20.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.433+0000 7f3a13043640 1 Processor -- start 2023-12-19T16:07:20.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.433+0000 7f3a13043640 1 -- start start 2023-12-19T16:07:20.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.434+0000 7f3a13043640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a0c0b84d0 0x7f3a0c13d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:20.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.434+0000 7f3a13043640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a0c0b8f70 0x7f3a0c1e3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.434+0000 7f3a13043640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a0c144de0 0x7f3a0c1e3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.434+0000 7f3a13043640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c13df00 con 0x7f3a0c144de0 2023-12-19T16:07:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.434+0000 7f3a13043640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c0b5a60 con 0x7f3a0c0b84d0 2023-12-19T16:07:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.434+0000 7f3a13043640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0c0b5cb0 con 0x7f3a0c0b8f70 2023-12-19T16:07:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.434+0000 7f3a115e0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a0c144de0 0x7f3a0c1e3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.434+0000 7f3a115e0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a0c144de0 0x7f3a0c1e3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58068/0 (socket says 172.21.15.37:58068) 2023-12-19T16:07:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.434+0000 7f3a115e0640 1 -- 172.21.15.37:0/2142133300 learned_addr learned my addr 172.21.15.37:0/2142133300 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.434+0000 7f3a10ddf640 1 --2- 172.21.15.37:0/2142133300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a0c0b84d0 0x7f3a0c13d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.434+0000 7f3a0bfff640 1 --2- 172.21.15.37:0/2142133300 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a0c0b8f70 0x7f3a0c1e3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.435+0000 7f3a115e0640 1 -- 172.21.15.37:0/2142133300 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a0c0b8f70 msgr2=0x7f3a0c1e3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.435+0000 7f3a115e0640 1 --2- 172.21.15.37:0/2142133300 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a0c0b8f70 0x7f3a0c1e3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.435+0000 7f3a115e0640 1 -- 172.21.15.37:0/2142133300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a0c0b84d0 msgr2=0x7f3a0c13d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.435+0000 7f3a115e0640 1 --2- 172.21.15.37:0/2142133300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a0c0b84d0 0x7f3a0c13d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.435+0000 7f3a115e0640 1 -- 172.21.15.37:0/2142133300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a000094d0 con 0x7f3a0c144de0 2023-12-19T16:07:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.435+0000 7f3a10ddf640 1 --2- 172.21.15.37:0/2142133300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a0c0b84d0 0x7f3a0c13d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.435+0000 7f3a0bfff640 1 --2- 172.21.15.37:0/2142133300 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a0c0b8f70 0x7f3a0c1e3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.435+0000 7f3a115e0640 1 --2- 172.21.15.37:0/2142133300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a0c144de0 0x7f3a0c1e3b60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3a04007db0 tx=0x7f3a0400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.435+0000 7f3a097fa640 1 -- 172.21.15.37:0/2142133300 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04003990 con 0x7f3a0c144de0 2023-12-19T16:07:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.435+0000 7f3a097fa640 1 -- 172.21.15.37:0/2142133300 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0400f040 con 0x7f3a0c144de0 2023-12-19T16:07:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.435+0000 7f3a097fa640 1 -- 172.21.15.37:0/2142133300 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a04003d50 con 0x7f3a0c144de0 2023-12-19T16:07:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.435+0000 7f3a13043640 1 -- 172.21.15.37:0/2142133300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a0c0b5f90 con 0x7f3a0c144de0 2023-12-19T16:07:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.435+0000 7f3a13043640 1 -- 172.21.15.37:0/2142133300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a0c0b5660 con 0x7f3a0c144de0 2023-12-19T16:07:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.436+0000 7f3a13043640 1 -- 172.21.15.37:0/2142133300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a0c1e3340 con 0x7f3a0c144de0 2023-12-19T16:07:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.436+0000 7f3a097fa640 1 -- 172.21.15.37:0/2142133300 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3a04004030 con 0x7f3a0c144de0 2023-12-19T16:07:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.437+0000 7f3a097fa640 1 --2- 172.21.15.37:0/2142133300 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f39f006a430 0x7f39f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.437+0000 7f3a097fa640 1 -- 172.21.15.37:0/2142133300 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a04088b60 con 0x7f3a0c144de0 2023-12-19T16:07:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.437+0000 7f3a10ddf640 1 --2- 172.21.15.37:0/2142133300 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f39f006a430 0x7f39f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.438+0000 7f3a10ddf640 1 --2- 172.21.15.37:0/2142133300 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f39f006a430 0x7f39f006c8f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3a00036000 tx=0x7f3a0003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:20.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.441+0000 7f3a097fa640 1 -- 172.21.15.37:0/2142133300 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3a0c1e3340 con 0x7f3a0c144de0 2023-12-19T16:07:20.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.615+0000 7f3a13043640 1 -- 172.21.15.37:0/2142133300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a0c1e3340 con 0x7f3a0c144de0 2023-12-19T16:07:20.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.615+0000 7f3a097fa640 1 -- 172.21.15.37:0/2142133300 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a0c1e3340 con 0x7f3a0c144de0 2023-12-19T16:07:20.618 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-19T16:07:20.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.617+0000 7f3a13043640 1 -- 172.21.15.37:0/2142133300 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f39f006a430 msgr2=0x7f39f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:20.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.617+0000 7f3a13043640 1 --2- 172.21.15.37:0/2142133300 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f39f006a430 0x7f39f006c8f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3a00036000 tx=0x7f3a0003d040 comp rx=0 tx=0).stop 2023-12-19T16:07:20.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.617+0000 7f3a13043640 1 -- 172.21.15.37:0/2142133300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a0c144de0 msgr2=0x7f3a0c1e3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:20.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.617+0000 7f3a13043640 1 --2- 172.21.15.37:0/2142133300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a0c144de0 0x7f3a0c1e3b60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3a04007db0 tx=0x7f3a0400d4a0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.617+0000 7f3a13043640 1 -- 172.21.15.37:0/2142133300 shutdown_connections 2023-12-19T16:07:20.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.617+0000 7f3a13043640 1 --2- 172.21.15.37:0/2142133300 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f39f006a430 0x7f39f006c8f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.617+0000 7f3a13043640 1 --2- 172.21.15.37:0/2142133300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a0c144de0 0x7f3a0c1e3b60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.617+0000 7f3a13043640 1 --2- 172.21.15.37:0/2142133300 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3a0c0b8f70 0x7f3a0c1e3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.617+0000 7f3a13043640 1 --2- 172.21.15.37:0/2142133300 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a0c0b84d0 0x7f3a0c13d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.617+0000 7f3a13043640 1 -- 172.21.15.37:0/2142133300 >> 172.21.15.37:0/2142133300 conn(0x7f3a0c0bcfe0 msgr2=0x7f3a0c142500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:20.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.617+0000 7f3a13043640 1 -- 172.21.15.37:0/2142133300 shutdown_connections 2023-12-19T16:07:20.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.617+0000 7f3a13043640 1 -- 172.21.15.37:0/2142133300 wait complete. 2023-12-19T16:07:20.631 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:07:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.737+0000 7fc0a47c9640 1 Processor -- start 2023-12-19T16:07:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.737+0000 7fc0a47c9640 1 -- start start 2023-12-19T16:07:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.737+0000 7fc0a47c9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc09c0bb140 0x7fc09c0be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.737+0000 7fc0a47c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc09c0bf510 0x7fc09c0bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.737+0000 7fc0a47c9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09c0bfa50 con 0x7fc09c06a950 2023-12-19T16:07:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.737+0000 7fc0a47c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09c0bbda0 con 0x7fc09c0bf510 2023-12-19T16:07:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.737+0000 7fc0a47c9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c06b040 con 0x7fc09c0bb140 2023-12-19T16:07:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.738+0000 7fc0a2d66640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc09c0bf510 0x7fc09c0bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.738+0000 7fc0a2565640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc09c0bb140 0x7fc09c0be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.738+0000 7fc0a1d64640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc09c06a950 0x7fc09c0bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.37:39036/0 (socket says 172.21.15.37:39036) 2023-12-19T16:07:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.738+0000 7fc0a1d64640 1 -- 172.21.15.37:0/4142688398 learned_addr learned my addr 172.21.15.37:0/4142688398 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.738+0000 7fc0a2565640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc09c0bb140 0x7fc09c0be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:45676/0 (socket says 172.21.15.37:45676) 2023-12-19T16:07:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.738+0000 7fc0a1563640 1 -- 172.21.15.37:0/4142688398 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001980002 0 0) 0x7fc09c0bfa50 con 0x7fc09c06a950 2023-12-19T16:07:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.738+0000 7fc0a1563640 1 -- 172.21.15.37:0/4142688398 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc088003520 con 0x7fc09c06a950 2023-12-19T16:07:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.738+0000 7fc0a2565640 1 -- 172.21.15.37:0/4142688398 >> v2:172.21.15.78:3300/0 conn(0x7fc09c0bf510 msgr2=0x7fc09c0bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.738+0000 7fc0a2565640 1 --2- 172.21.15.37:0/4142688398 >> v2:172.21.15.78:3300/0 conn(0x7fc09c0bf510 0x7fc09c0bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.738+0000 7fc0a2565640 1 -- 172.21.15.37:0/4142688398 >> v1:172.21.15.78:6789/0 conn(0x7fc09c06a950 legacy=0x7fc09c0bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.738+0000 7fc0a2565640 1 -- 172.21.15.37:0/4142688398 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c0bb520 con 0x7fc09c0bb140 2023-12-19T16:07:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.738+0000 7fc0a2d66640 1 --2- 172.21.15.37:0/4142688398 >> v2:172.21.15.78:3300/0 conn(0x7fc09c0bf510 0x7fc09c0bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:07:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.739+0000 7fc0a2565640 1 --2- 172.21.15.37:0/4142688398 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc09c0bb140 0x7fc09c0be350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc0980097a0 tx=0x7fc09802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef3d7b851dfe8afb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.739+0000 7fc0a1563640 1 -- 172.21.15.37:0/4142688398 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098031780 con 0x7fc09c0bb140 2023-12-19T16:07:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.739+0000 7fc0a1563640 1 -- 172.21.15.37:0/4142688398 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0980318e0 con 0x7fc09c0bb140 2023-12-19T16:07:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.739+0000 7fc0a1563640 1 -- 172.21.15.37:0/4142688398 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098031c50 con 0x7fc09c0bb140 2023-12-19T16:07:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.740+0000 7fc0a47c9640 1 -- 172.21.15.37:0/4142688398 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc09c0bb140 msgr2=0x7fc09c0be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.740+0000 7fc0a47c9640 1 --2- 172.21.15.37:0/4142688398 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc09c0bb140 0x7fc09c0be350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc0980097a0 tx=0x7fc09802b820 comp rx=0 tx=0).stop 2023-12-19T16:07:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.740+0000 7fc0a47c9640 1 -- 172.21.15.37:0/4142688398 shutdown_connections 2023-12-19T16:07:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.740+0000 7fc0a47c9640 1 --2- 172.21.15.37:0/4142688398 >> v2:172.21.15.78:3300/0 conn(0x7fc09c0bf510 0x7fc09c0bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.740+0000 7fc0a47c9640 1 --2- 172.21.15.37:0/4142688398 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc09c0bb140 0x7fc09c0be350 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.740+0000 7fc0a47c9640 1 -- 172.21.15.37:0/4142688398 >> 172.21.15.37:0/4142688398 conn(0x7fc09c0bcfd0 msgr2=0x7fc09c0bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.740+0000 7fc0a47c9640 1 -- 172.21.15.37:0/4142688398 shutdown_connections 2023-12-19T16:07:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.740+0000 7fc0a47c9640 1 -- 172.21.15.37:0/4142688398 wait complete. 2023-12-19T16:07:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.741+0000 7fc0a47c9640 1 Processor -- start 2023-12-19T16:07:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.741+0000 7fc0a47c9640 1 -- start start 2023-12-19T16:07:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.741+0000 7fc0a47c9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc09c06a950 0x7fc09c1e3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.741+0000 7fc0a47c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc09c0bb140 0x7fc09c0a26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.741+0000 7fc0a47c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc09c0bf510 0x7fc09c0b6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.741+0000 7fc0a47c9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c1e4170 con 0x7fc09c0bf510 2023-12-19T16:07:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.741+0000 7fc0a47c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c1e3e90 con 0x7fc09c0bb140 2023-12-19T16:07:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.741+0000 7fc0a47c9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c0a1ef0 con 0x7fc09c06a950 2023-12-19T16:07:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.742+0000 7fc0a2d66640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc09c0bf510 0x7fc09c0b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.742+0000 7fc0a2d66640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc09c0bf510 0x7fc09c0b6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58076/0 (socket says 172.21.15.37:58076) 2023-12-19T16:07:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.742+0000 7fc0a1d64640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc09c0bb140 0x7fc09c0a26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.742+0000 7fc0a2d66640 1 -- 172.21.15.37:0/3033873642 learned_addr learned my addr 172.21.15.37:0/3033873642 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.742+0000 7fc0a2565640 1 --2- 172.21.15.37:0/3033873642 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc09c06a950 0x7fc09c1e3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.742+0000 7fc0a2d66640 1 -- 172.21.15.37:0/3033873642 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc09c06a950 msgr2=0x7fc09c1e3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.742+0000 7fc0a2d66640 1 --2- 172.21.15.37:0/3033873642 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc09c06a950 0x7fc09c1e3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.742+0000 7fc0a2d66640 1 -- 172.21.15.37:0/3033873642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc09c0bb140 msgr2=0x7fc09c0a26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.742+0000 7fc0a2d66640 1 --2- 172.21.15.37:0/3033873642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc09c0bb140 0x7fc09c0a26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.742+0000 7fc0a2d66640 1 -- 172.21.15.37:0/3033873642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc094009a70 con 0x7fc09c0bf510 2023-12-19T16:07:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.742+0000 7fc0a2565640 1 --2- 172.21.15.37:0/3033873642 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc09c06a950 0x7fc09c1e3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:07:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.742+0000 7fc0a1d64640 1 --2- 172.21.15.37:0/3033873642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc09c0bb140 0x7fc09c0a26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:07:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.742+0000 7fc0a2d66640 1 --2- 172.21.15.37:0/3033873642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc09c0bf510 0x7fc09c0b6730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc09400efb0 tx=0x7fc09400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.742+0000 7fc092ffd640 1 -- 172.21.15.37:0/3033873642 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094014480 con 0x7fc09c0bf510 2023-12-19T16:07:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.742+0000 7fc092ffd640 1 -- 172.21.15.37:0/3033873642 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09400f040 con 0x7fc09c0bf510 2023-12-19T16:07:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.742+0000 7fc0a47c9640 1 -- 172.21.15.37:0/3033873642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc098009400 con 0x7fc09c0bf510 2023-12-19T16:07:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.742+0000 7fc092ffd640 1 -- 172.21.15.37:0/3033873642 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094014800 con 0x7fc09c0bf510 2023-12-19T16:07:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.742+0000 7fc0a47c9640 1 -- 172.21.15.37:0/3033873642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09c1e3b80 con 0x7fc09c0bf510 2023-12-19T16:07:20.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.743+0000 7fc0a47c9640 1 -- 172.21.15.37:0/3033873642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09c0a1d50 con 0x7fc09c0bf510 2023-12-19T16:07:20.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.744+0000 7fc092ffd640 1 -- 172.21.15.37:0/3033873642 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc094014960 con 0x7fc09c0bf510 2023-12-19T16:07:20.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.744+0000 7fc092ffd640 1 --2- 172.21.15.37:0/3033873642 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc08006a430 0x7fc08006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:20.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.744+0000 7fc092ffd640 1 -- 172.21.15.37:0/3033873642 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc094089870 con 0x7fc09c0bf510 2023-12-19T16:07:20.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.745+0000 7fc0a2565640 1 --2- 172.21.15.37:0/3033873642 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc08006a430 0x7fc08006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:20.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.745+0000 7fc0a2565640 1 --2- 172.21.15.37:0/3033873642 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc08006a430 0x7fc08006c8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc098036000 tx=0x7fc09803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:20.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.748+0000 7fc092ffd640 1 -- 172.21.15.37:0/3033873642 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc09c0a1d50 con 0x7fc09c0bf510 2023-12-19T16:07:20.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.923+0000 7fc0a47c9640 1 -- 172.21.15.37:0/3033873642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc09c0a1d50 con 0x7fc09c0bf510 2023-12-19T16:07:20.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.923+0000 7fc092ffd640 1 -- 172.21.15.37:0/3033873642 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc09c0a1d50 con 0x7fc09c0bf510 2023-12-19T16:07:20.926 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-19T16:07:20.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.925+0000 7fc0a47c9640 1 -- 172.21.15.37:0/3033873642 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc08006a430 msgr2=0x7fc08006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:20.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.925+0000 7fc0a47c9640 1 --2- 172.21.15.37:0/3033873642 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc08006a430 0x7fc08006c8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc098036000 tx=0x7fc09803d040 comp rx=0 tx=0).stop 2023-12-19T16:07:20.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.925+0000 7fc0a47c9640 1 -- 172.21.15.37:0/3033873642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc09c0bf510 msgr2=0x7fc09c0b6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:20.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.925+0000 7fc0a47c9640 1 --2- 172.21.15.37:0/3033873642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc09c0bf510 0x7fc09c0b6730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc09400efb0 tx=0x7fc09400c490 comp rx=0 tx=0).stop 2023-12-19T16:07:20.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.925+0000 7fc0a47c9640 1 -- 172.21.15.37:0/3033873642 shutdown_connections 2023-12-19T16:07:20.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.925+0000 7fc0a47c9640 1 --2- 172.21.15.37:0/3033873642 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc08006a430 0x7fc08006c8f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.925+0000 7fc0a47c9640 1 --2- 172.21.15.37:0/3033873642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc09c0bf510 0x7fc09c0b6730 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.925+0000 7fc0a47c9640 1 --2- 172.21.15.37:0/3033873642 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc09c0bb140 0x7fc09c0a26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.925+0000 7fc0a47c9640 1 --2- 172.21.15.37:0/3033873642 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc09c06a950 0x7fc09c1e3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:20.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.925+0000 7fc0a47c9640 1 -- 172.21.15.37:0/3033873642 >> 172.21.15.37:0/3033873642 conn(0x7fc09c0bcfd0 msgr2=0x7fc09c0a37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:20.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.925+0000 7fc0a47c9640 1 -- 172.21.15.37:0/3033873642 shutdown_connections 2023-12-19T16:07:20.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:20.925+0000 7fc0a47c9640 1 -- 172.21.15.37:0/3033873642 wait complete. 2023-12-19T16:07:20.939 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:07:21.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.046+0000 7ffb8d5cb640 1 Processor -- start 2023-12-19T16:07:21.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.046+0000 7ffb8d5cb640 1 -- start start 2023-12-19T16:07:21.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.047+0000 7ffb8d5cb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffb8806a950 0x7ffb880be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.047+0000 7ffb8d5cb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb880bfa50 con 0x7ffb880bb140 2023-12-19T16:07:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.047+0000 7ffb8d5cb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8806b040 con 0x7ffb880bf510 2023-12-19T16:07:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.047+0000 7ffb8d5cb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb880bbda0 con 0x7ffb8806a950 2023-12-19T16:07:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.047+0000 7ffb86ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ffb880bb140 0x7ffb880bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34898/0 (socket says 172.21.15.37:34898) 2023-12-19T16:07:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.047+0000 7ffb86ffd640 1 -- 172.21.15.37:0/3388697252 learned_addr learned my addr 172.21.15.37:0/3388697252 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.047+0000 7ffb877fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffb8806a950 0x7ffb880be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.047+0000 7ffb877fe640 1 -- 172.21.15.37:0/3388697252 >> v1:172.21.15.78:6789/0 conn(0x7ffb880bf510 legacy=0x7ffb881534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.047+0000 7ffb877fe640 1 -- 172.21.15.37:0/3388697252 >> v1:172.21.15.37:6789/0 conn(0x7ffb880bb140 legacy=0x7ffb880bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.047+0000 7ffb877fe640 1 -- 172.21.15.37:0/3388697252 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb880bb520 con 0x7ffb8806a950 2023-12-19T16:07:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.047+0000 7ffb867fc640 1 -- 172.21.15.37:0/3388697252 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153642580 0 0) 0x7ffb880bfa50 con 0x7ffb880bb140 2023-12-19T16:07:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.048+0000 7ffb877fe640 1 --2- 172.21.15.37:0/3388697252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8806a950 0x7ffb880be350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009d90 tx=0x7ffb8002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8261430c756ed6bf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.048+0000 7ffb867fc640 1 -- 172.21.15.37:0/3388697252 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8002cc60 con 0x7ffb8806a950 2023-12-19T16:07:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.048+0000 7ffb867fc640 1 -- 172.21.15.37:0/3388697252 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8002cdc0 con 0x7ffb8806a950 2023-12-19T16:07:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.048+0000 7ffb867fc640 1 -- 172.21.15.37:0/3388697252 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb80034660 con 0x7ffb8806a950 2023-12-19T16:07:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.048+0000 7ffb8d5cb640 1 -- 172.21.15.37:0/3388697252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8806a950 msgr2=0x7ffb880be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.048+0000 7ffb8d5cb640 1 --2- 172.21.15.37:0/3388697252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8806a950 0x7ffb880be350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009d90 tx=0x7ffb8002beb0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.048+0000 7ffb8d5cb640 1 -- 172.21.15.37:0/3388697252 shutdown_connections 2023-12-19T16:07:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.049+0000 7ffb8d5cb640 1 --2- 172.21.15.37:0/3388697252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8806a950 0x7ffb880be350 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.049+0000 7ffb8d5cb640 1 -- 172.21.15.37:0/3388697252 >> 172.21.15.37:0/3388697252 conn(0x7ffb880bcfd0 msgr2=0x7ffb880bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.049+0000 7ffb8d5cb640 1 -- 172.21.15.37:0/3388697252 shutdown_connections 2023-12-19T16:07:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.049+0000 7ffb8d5cb640 1 -- 172.21.15.37:0/3388697252 wait complete. 2023-12-19T16:07:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.050+0000 7ffb8d5cb640 1 Processor -- start 2023-12-19T16:07:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.050+0000 7ffb8d5cb640 1 -- start start 2023-12-19T16:07:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.050+0000 7ffb8d5cb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffb8806a950 0x7ffb881e05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.050+0000 7ffb8d5cb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb880bb140 0x7ffb8814e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.050+0000 7ffb8d5cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb880bf510 0x7ffb880b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.050+0000 7ffb8d5cb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb881dff10 con 0x7ffb880bf510 2023-12-19T16:07:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.050+0000 7ffb8d5cb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb880a1d90 con 0x7ffb880bb140 2023-12-19T16:07:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.050+0000 7ffb8d5cb640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb881e0100 con 0x7ffb8806a950 2023-12-19T16:07:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.050+0000 7ffb877fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb880bf510 0x7ffb880b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.050+0000 7ffb877fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb880bf510 0x7ffb880b2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58086/0 (socket says 172.21.15.37:58086) 2023-12-19T16:07:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.050+0000 7ffb877fe640 1 -- 172.21.15.37:0/3547788464 learned_addr learned my addr 172.21.15.37:0/3547788464 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.051+0000 7ffb7ffff640 1 --2- 172.21.15.37:0/3547788464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb880bb140 0x7ffb8814e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.051+0000 7ffb86ffd640 1 --2- 172.21.15.37:0/3547788464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffb8806a950 0x7ffb881e05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.051+0000 7ffb877fe640 1 -- 172.21.15.37:0/3547788464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffb8806a950 msgr2=0x7ffb881e05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.051+0000 7ffb877fe640 1 --2- 172.21.15.37:0/3547788464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffb8806a950 0x7ffb881e05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.051+0000 7ffb877fe640 1 -- 172.21.15.37:0/3547788464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb880bb140 msgr2=0x7ffb8814e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.051+0000 7ffb877fe640 1 --2- 172.21.15.37:0/3547788464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb880bb140 0x7ffb8814e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.051+0000 7ffb877fe640 1 -- 172.21.15.37:0/3547788464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb80009a70 con 0x7ffb880bf510 2023-12-19T16:07:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.051+0000 7ffb877fe640 1 --2- 172.21.15.37:0/3547788464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb880bf510 0x7ffb880b2e30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009d90 tx=0x7ffb80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.051+0000 7ffb7f7fe640 1 -- 172.21.15.37:0/3547788464 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb80040450 con 0x7ffb880bf510 2023-12-19T16:07:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.051+0000 7ffb7f7fe640 1 -- 172.21.15.37:0/3547788464 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb800405d0 con 0x7ffb880bf510 2023-12-19T16:07:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.051+0000 7ffb8d5cb640 1 -- 172.21.15.37:0/3547788464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8814cf50 con 0x7ffb880bf510 2023-12-19T16:07:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.051+0000 7ffb7f7fe640 1 -- 172.21.15.37:0/3547788464 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb80040980 con 0x7ffb880bf510 2023-12-19T16:07:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.051+0000 7ffb8d5cb640 1 -- 172.21.15.37:0/3547788464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8814c990 con 0x7ffb880bf510 2023-12-19T16:07:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.052+0000 7ffb8d5cb640 1 -- 172.21.15.37:0/3547788464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb881e0300 con 0x7ffb880bf510 2023-12-19T16:07:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.052+0000 7ffb7f7fe640 1 -- 172.21.15.37:0/3547788464 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffb80040ae0 con 0x7ffb880bf510 2023-12-19T16:07:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.053+0000 7ffb7f7fe640 1 --2- 172.21.15.37:0/3547788464 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ffb6806a430 0x7ffb6806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.053+0000 7ffb7f7fe640 1 -- 172.21.15.37:0/3547788464 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb800ab480 con 0x7ffb880bf510 2023-12-19T16:07:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.053+0000 7ffb86ffd640 1 --2- 172.21.15.37:0/3547788464 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ffb6806a430 0x7ffb6806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.053+0000 7ffb86ffd640 1 --2- 172.21.15.37:0/3547788464 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ffb6806a430 0x7ffb6806c8f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffb78007fd0 tx=0x7ffb78009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.057+0000 7ffb7f7fe640 1 -- 172.21.15.37:0/3547788464 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ffb881e0300 con 0x7ffb880bf510 2023-12-19T16:07:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.233+0000 7ffb8d5cb640 1 -- 172.21.15.37:0/3547788464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffb880740a0 con 0x7ffb880bf510 2023-12-19T16:07:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.234+0000 7ffb7f7fe640 1 -- 172.21.15.37:0/3547788464 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffb80076b00 con 0x7ffb880bf510 2023-12-19T16:07:21.236 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-19T16:07:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.236+0000 7ffb8d5cb640 1 -- 172.21.15.37:0/3547788464 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ffb6806a430 msgr2=0x7ffb6806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.236+0000 7ffb8d5cb640 1 --2- 172.21.15.37:0/3547788464 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ffb6806a430 0x7ffb6806c8f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffb78007fd0 tx=0x7ffb78009040 comp rx=0 tx=0).stop 2023-12-19T16:07:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.236+0000 7ffb8d5cb640 1 -- 172.21.15.37:0/3547788464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb880bf510 msgr2=0x7ffb880b2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.236+0000 7ffb8d5cb640 1 --2- 172.21.15.37:0/3547788464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb880bf510 0x7ffb880b2e30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009d90 tx=0x7ffb80004a40 comp rx=0 tx=0).stop 2023-12-19T16:07:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.236+0000 7ffb8d5cb640 1 -- 172.21.15.37:0/3547788464 shutdown_connections 2023-12-19T16:07:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.236+0000 7ffb8d5cb640 1 --2- 172.21.15.37:0/3547788464 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ffb6806a430 0x7ffb6806c8f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.236+0000 7ffb8d5cb640 1 --2- 172.21.15.37:0/3547788464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb880bf510 0x7ffb880b2e30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.236+0000 7ffb8d5cb640 1 --2- 172.21.15.37:0/3547788464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb880bb140 0x7ffb8814e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.236+0000 7ffb8d5cb640 1 --2- 172.21.15.37:0/3547788464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffb8806a950 0x7ffb881e05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.236+0000 7ffb8d5cb640 1 -- 172.21.15.37:0/3547788464 >> 172.21.15.37:0/3547788464 conn(0x7ffb880bcfd0 msgr2=0x7ffb880a5850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.236+0000 7ffb8d5cb640 1 -- 172.21.15.37:0/3547788464 shutdown_connections 2023-12-19T16:07:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.236+0000 7ffb8d5cb640 1 -- 172.21.15.37:0/3547788464 wait complete. 2023-12-19T16:07:21.248 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:07:21.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.351+0000 7ff4775e0640 1 Processor -- start 2023-12-19T16:07:21.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.352+0000 7ff4775e0640 1 -- start start 2023-12-19T16:07:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.352+0000 7ff4775e0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4700bcdd0 0x7ff4700b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.352+0000 7ff4775e0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff4700b64c0 0x7ff470144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.352+0000 7ff4775e0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff470144cd0 0x7ff47014e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.352+0000 7ff4775e0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4700bc6b0 con 0x7ff4700bcdd0 2023-12-19T16:07:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.352+0000 7ff4775e0640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4700b6900 con 0x7ff4700b64c0 2023-12-19T16:07:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.352+0000 7ff4775e0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4700a59f0 con 0x7ff470144cd0 2023-12-19T16:07:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.352+0000 7ff47537c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4700bcdd0 0x7ff4700b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.352+0000 7ff47537c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4700bcdd0 0x7ff4700b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58092/0 (socket says 172.21.15.37:58092) 2023-12-19T16:07:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.352+0000 7ff47537c640 1 -- 172.21.15.37:0/3115446733 learned_addr learned my addr 172.21.15.37:0/3115446733 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.353+0000 7ff474b7b640 1 --2- 172.21.15.37:0/3115446733 >> v2:172.21.15.78:3300/0 conn(0x7ff4700b64c0 0x7ff470144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.353+0000 7ff475b7d640 1 --2- 172.21.15.37:0/3115446733 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff470144cd0 0x7ff47014e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.353+0000 7ff47537c640 1 -- 172.21.15.37:0/3115446733 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff470144cd0 msgr2=0x7ff47014e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.353+0000 7ff47537c640 1 --2- 172.21.15.37:0/3115446733 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff470144cd0 0x7ff47014e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.353+0000 7ff47537c640 1 -- 172.21.15.37:0/3115446733 >> v2:172.21.15.78:3300/0 conn(0x7ff4700b64c0 msgr2=0x7ff470144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.353+0000 7ff47537c640 1 --2- 172.21.15.37:0/3115446733 >> v2:172.21.15.78:3300/0 conn(0x7ff4700b64c0 0x7ff470144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.353+0000 7ff47537c640 1 -- 172.21.15.37:0/3115446733 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4700bc0a0 con 0x7ff4700bcdd0 2023-12-19T16:07:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.353+0000 7ff475b7d640 1 --2- 172.21.15.37:0/3115446733 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff470144cd0 0x7ff47014e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.353+0000 7ff474b7b640 1 --2- 172.21.15.37:0/3115446733 >> v2:172.21.15.78:3300/0 conn(0x7ff4700b64c0 0x7ff470144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.353+0000 7ff47537c640 1 --2- 172.21.15.37:0/3115446733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4700bcdd0 0x7ff4700b5f80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff4700b72e0 tx=0x7ff46c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf0e88cbaa67fcb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.354+0000 7ff467fff640 1 -- 172.21.15.37:0/3115446733 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c030860 con 0x7ff4700bcdd0 2023-12-19T16:07:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.354+0000 7ff467fff640 1 -- 172.21.15.37:0/3115446733 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c0309c0 con 0x7ff4700bcdd0 2023-12-19T16:07:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.354+0000 7ff467fff640 1 -- 172.21.15.37:0/3115446733 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c030d50 con 0x7ff4700bcdd0 2023-12-19T16:07:21.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.354+0000 7ff4775e0640 1 -- 172.21.15.37:0/3115446733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4700bcdd0 msgr2=0x7ff4700b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.354+0000 7ff4775e0640 1 --2- 172.21.15.37:0/3115446733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4700bcdd0 0x7ff4700b5f80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff4700b72e0 tx=0x7ff46c02b9a0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.354+0000 7ff4775e0640 1 -- 172.21.15.37:0/3115446733 shutdown_connections 2023-12-19T16:07:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.354+0000 7ff4775e0640 1 --2- 172.21.15.37:0/3115446733 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff470144cd0 0x7ff47014e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.354+0000 7ff4775e0640 1 --2- 172.21.15.37:0/3115446733 >> v2:172.21.15.78:3300/0 conn(0x7ff4700b64c0 0x7ff470144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.354+0000 7ff4775e0640 1 --2- 172.21.15.37:0/3115446733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4700bcdd0 0x7ff4700b5f80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.354+0000 7ff4775e0640 1 -- 172.21.15.37:0/3115446733 >> 172.21.15.37:0/3115446733 conn(0x7ff470071e60 msgr2=0x7ff4700c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.354+0000 7ff4775e0640 1 -- 172.21.15.37:0/3115446733 shutdown_connections 2023-12-19T16:07:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.354+0000 7ff4775e0640 1 -- 172.21.15.37:0/3115446733 wait complete. 2023-12-19T16:07:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.355+0000 7ff4775e0640 1 Processor -- start 2023-12-19T16:07:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.355+0000 7ff4775e0640 1 -- start start 2023-12-19T16:07:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.356+0000 7ff4775e0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4700b64c0 0x7ff4701d1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.356+0000 7ff4775e0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4700bcdd0 0x7ff4701d4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.356+0000 7ff4775e0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff470144cd0 0x7ff4701e2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.356+0000 7ff4775e0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4701d3bc0 con 0x7ff4700bcdd0 2023-12-19T16:07:21.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.356+0000 7ff4775e0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4701d1570 con 0x7ff470144cd0 2023-12-19T16:07:21.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.356+0000 7ff4775e0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4701d4db0 con 0x7ff4700b64c0 2023-12-19T16:07:21.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.356+0000 7ff474b7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4700bcdd0 0x7ff4701d4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.356+0000 7ff474b7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4700bcdd0 0x7ff4701d4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58106/0 (socket says 172.21.15.37:58106) 2023-12-19T16:07:21.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.356+0000 7ff474b7b640 1 -- 172.21.15.37:0/2010681916 learned_addr learned my addr 172.21.15.37:0/2010681916 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:21.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.356+0000 7ff47537c640 1 --2- 172.21.15.37:0/2010681916 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4700b64c0 0x7ff4701d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.356+0000 7ff475b7d640 1 --2- 172.21.15.37:0/2010681916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff470144cd0 0x7ff4701e2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.356+0000 7ff474b7b640 1 -- 172.21.15.37:0/2010681916 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4700b64c0 msgr2=0x7ff4701d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.356+0000 7ff474b7b640 1 --2- 172.21.15.37:0/2010681916 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4700b64c0 0x7ff4701d1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.356+0000 7ff474b7b640 1 -- 172.21.15.37:0/2010681916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff470144cd0 msgr2=0x7ff4701e2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.356+0000 7ff474b7b640 1 --2- 172.21.15.37:0/2010681916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff470144cd0 0x7ff4701e2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.356+0000 7ff474b7b640 1 -- 172.21.15.37:0/2010681916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c0094d0 con 0x7ff4700bcdd0 2023-12-19T16:07:21.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.357+0000 7ff474b7b640 1 --2- 172.21.15.37:0/2010681916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4700bcdd0 0x7ff4701d4870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff46000c7f0 tx=0x7ff46000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:21.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.357+0000 7ff465ffb640 1 -- 172.21.15.37:0/2010681916 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff460007a30 con 0x7ff4700bcdd0 2023-12-19T16:07:21.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.357+0000 7ff465ffb640 1 -- 172.21.15.37:0/2010681916 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff460007b90 con 0x7ff4700bcdd0 2023-12-19T16:07:21.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.357+0000 7ff4775e0640 1 -- 172.21.15.37:0/2010681916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4701d32b0 con 0x7ff4700bcdd0 2023-12-19T16:07:21.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.357+0000 7ff465ffb640 1 -- 172.21.15.37:0/2010681916 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46000ce40 con 0x7ff4700bcdd0 2023-12-19T16:07:21.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.357+0000 7ff4775e0640 1 -- 172.21.15.37:0/2010681916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4701d37e0 con 0x7ff4700bcdd0 2023-12-19T16:07:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.358+0000 7ff4775e0640 1 -- 172.21.15.37:0/2010681916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4701d3d00 con 0x7ff4700bcdd0 2023-12-19T16:07:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.358+0000 7ff465ffb640 1 -- 172.21.15.37:0/2010681916 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff4600113f0 con 0x7ff4700bcdd0 2023-12-19T16:07:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.359+0000 7ff465ffb640 1 --2- 172.21.15.37:0/2010681916 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff45406a430 0x7ff45406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.359+0000 7ff465ffb640 1 -- 172.21.15.37:0/2010681916 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff460088a50 con 0x7ff4700bcdd0 2023-12-19T16:07:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.359+0000 7ff47537c640 1 --2- 172.21.15.37:0/2010681916 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff45406a430 0x7ff45406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.359+0000 7ff47537c640 1 --2- 172.21.15.37:0/2010681916 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff45406a430 0x7ff45406c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff46c036000 tx=0x7ff46c03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.363+0000 7ff465ffb640 1 -- 172.21.15.37:0/2010681916 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff4701d3d00 con 0x7ff4700bcdd0 2023-12-19T16:07:21.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.542+0000 7ff4775e0640 1 -- 172.21.15.37:0/2010681916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4701d3d00 con 0x7ff4700bcdd0 2023-12-19T16:07:21.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.543+0000 7ff465ffb640 1 -- 172.21.15.37:0/2010681916 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7ff4701d3d00 con 0x7ff4700bcdd0 2023-12-19T16:07:21.545 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:21.545 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:59.728935+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:06:56.758166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:06:57.635291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:07:21.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.544+0000 7ff4775e0640 1 -- 172.21.15.37:0/2010681916 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff45406a430 msgr2=0x7ff45406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.544+0000 7ff4775e0640 1 --2- 172.21.15.37:0/2010681916 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff45406a430 0x7ff45406c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff46c036000 tx=0x7ff46c03b040 comp rx=0 tx=0).stop 2023-12-19T16:07:21.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.544+0000 7ff4775e0640 1 -- 172.21.15.37:0/2010681916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4700bcdd0 msgr2=0x7ff4701d4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.544+0000 7ff4775e0640 1 --2- 172.21.15.37:0/2010681916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4700bcdd0 0x7ff4701d4870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff46000c7f0 tx=0x7ff46000cbf0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.545+0000 7ff4775e0640 1 -- 172.21.15.37:0/2010681916 shutdown_connections 2023-12-19T16:07:21.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.545+0000 7ff4775e0640 1 --2- 172.21.15.37:0/2010681916 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff45406a430 0x7ff45406c8f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.545+0000 7ff4775e0640 1 --2- 172.21.15.37:0/2010681916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff470144cd0 0x7ff4701e2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.545+0000 7ff4775e0640 1 --2- 172.21.15.37:0/2010681916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4700bcdd0 0x7ff4701d4870 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.545+0000 7ff4775e0640 1 --2- 172.21.15.37:0/2010681916 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4700b64c0 0x7ff4701d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.545+0000 7ff4775e0640 1 -- 172.21.15.37:0/2010681916 >> 172.21.15.37:0/2010681916 conn(0x7ff470071e60 msgr2=0x7ff4701d50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:21.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.545+0000 7ff4775e0640 1 -- 172.21.15.37:0/2010681916 shutdown_connections 2023-12-19T16:07:21.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.545+0000 7ff4775e0640 1 -- 172.21.15.37:0/2010681916 wait complete. 2023-12-19T16:07:21.558 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:06:46.684027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:06:56.758166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:06:57.635291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:07:21.558 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:07:21.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.665+0000 7f405e2e9640 1 Processor -- start 2023-12-19T16:07:21.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.665+0000 7f405e2e9640 1 -- start start 2023-12-19T16:07:21.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.665+0000 7f405e2e9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f405806ae20 0x7f40580b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.665+0000 7f405e2e9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40580b5040 0x7f4058145c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.665+0000 7f405e2e9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40580b8f80 con 0x7f40580b3bc0 2023-12-19T16:07:21.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.665+0000 7f405e2e9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40580b8d70 con 0x7f405806ae20 2023-12-19T16:07:21.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.665+0000 7f405e2e9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40580b5990 con 0x7f40580b5040 2023-12-19T16:07:21.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.666+0000 7f4057fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f405806ae20 0x7f40580b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.666+0000 7f40577fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40580b5040 0x7f4058145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.666+0000 7f4057fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f405806ae20 0x7f40580b8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:51262/0 (socket says 172.21.15.37:51262) 2023-12-19T16:07:21.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.666+0000 7f40577fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40580b5040 0x7f4058145c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:45724/0 (socket says 172.21.15.37:45724) 2023-12-19T16:07:21.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.666+0000 7f4057fff640 1 -- 172.21.15.37:0/906320350 learned_addr learned my addr 172.21.15.37:0/906320350 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:21.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.666+0000 7f405c886640 1 --1- 172.21.15.37:0/906320350 >> v1:172.21.15.78:6789/0 conn(0x7f40580b3bc0 0x7f405814be30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.37:39054/0 (socket says 172.21.15.37:39054) 2023-12-19T16:07:21.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.666+0000 7f40577fe640 1 -- 172.21.15.37:0/906320350 >> v2:172.21.15.78:3300/0 conn(0x7f405806ae20 msgr2=0x7f40580b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:21.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.666+0000 7f40577fe640 1 --2- 172.21.15.37:0/906320350 >> v2:172.21.15.78:3300/0 conn(0x7f405806ae20 0x7f40580b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.666+0000 7f40577fe640 1 -- 172.21.15.37:0/906320350 >> v1:172.21.15.78:6789/0 conn(0x7f40580b3bc0 legacy=0x7f405814be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.666+0000 7f40577fe640 1 -- 172.21.15.37:0/906320350 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4058071870 con 0x7f40580b5040 2023-12-19T16:07:21.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.666+0000 7f4057fff640 1 --2- 172.21.15.37:0/906320350 >> v2:172.21.15.78:3300/0 conn(0x7f405806ae20 0x7f40580b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:07:21.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.667+0000 7f40577fe640 1 --2- 172.21.15.37:0/906320350 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40580b5040 0x7f4058145c90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f404c0097a0 tx=0x7f404c02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac579ef227ac85ec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:21.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.667+0000 7f4056ffd640 1 -- 172.21.15.37:0/906320350 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c030610 con 0x7f40580b5040 2023-12-19T16:07:21.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.667+0000 7f4056ffd640 1 -- 172.21.15.37:0/906320350 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c030770 con 0x7f40580b5040 2023-12-19T16:07:21.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.667+0000 7f4056ffd640 1 -- 172.21.15.37:0/906320350 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c030b00 con 0x7f40580b5040 2023-12-19T16:07:21.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.668+0000 7f405e2e9640 1 -- 172.21.15.37:0/906320350 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40580b5040 msgr2=0x7f4058145c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.668+0000 7f405e2e9640 1 --2- 172.21.15.37:0/906320350 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40580b5040 0x7f4058145c90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f404c0097a0 tx=0x7f404c02b960 comp rx=0 tx=0).stop 2023-12-19T16:07:21.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.668+0000 7f405e2e9640 1 -- 172.21.15.37:0/906320350 shutdown_connections 2023-12-19T16:07:21.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.668+0000 7f405e2e9640 1 --2- 172.21.15.37:0/906320350 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40580b5040 0x7f4058145c90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.668+0000 7f405e2e9640 1 --2- 172.21.15.37:0/906320350 >> v2:172.21.15.78:3300/0 conn(0x7f405806ae20 0x7f40580b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.668+0000 7f405e2e9640 1 -- 172.21.15.37:0/906320350 >> 172.21.15.37:0/906320350 conn(0x7f40580b91b0 msgr2=0x7f40580b95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:21.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.668+0000 7f405e2e9640 1 -- 172.21.15.37:0/906320350 shutdown_connections 2023-12-19T16:07:21.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.668+0000 7f405e2e9640 1 -- 172.21.15.37:0/906320350 wait complete. 2023-12-19T16:07:21.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.669+0000 7f405e2e9640 1 Processor -- start 2023-12-19T16:07:21.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.669+0000 7f405e2e9640 1 -- start start 2023-12-19T16:07:21.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.669+0000 7f405e2e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405806ae20 0x7f4058148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f405e2e9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40580b3bc0 0x7f405814c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f405e2e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40580b5040 0x7f405814c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f405e2e9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4058149400 con 0x7f405806ae20 2023-12-19T16:07:21.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f405e2e9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4058149ed0 con 0x7f40580b5040 2023-12-19T16:07:21.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f405e2e9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405814ade0 con 0x7f40580b3bc0 2023-12-19T16:07:21.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f4057fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405806ae20 0x7f4058148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f4057fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405806ae20 0x7f4058148ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58118/0 (socket says 172.21.15.37:58118) 2023-12-19T16:07:21.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f4057fff640 1 -- 172.21.15.37:0/683028578 learned_addr learned my addr 172.21.15.37:0/683028578 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:21.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f40577fe640 1 --2- 172.21.15.37:0/683028578 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40580b3bc0 0x7f405814c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f405c886640 1 --2- 172.21.15.37:0/683028578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40580b5040 0x7f405814c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f4057fff640 1 -- 172.21.15.37:0/683028578 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40580b3bc0 msgr2=0x7f405814c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f4057fff640 1 --2- 172.21.15.37:0/683028578 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40580b3bc0 0x7f405814c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f4057fff640 1 -- 172.21.15.37:0/683028578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40580b5040 msgr2=0x7f405814c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f4057fff640 1 --2- 172.21.15.37:0/683028578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40580b5040 0x7f405814c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f4057fff640 1 -- 172.21.15.37:0/683028578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40480094d0 con 0x7f405806ae20 2023-12-19T16:07:21.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f4057fff640 1 --2- 172.21.15.37:0/683028578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405806ae20 0x7f4058148ec0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f404800e9d0 tx=0x7f404800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:21.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f4054ff9640 1 -- 172.21.15.37:0/683028578 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404800ca60 con 0x7f405806ae20 2023-12-19T16:07:21.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f4054ff9640 1 -- 172.21.15.37:0/683028578 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404800cbc0 con 0x7f405806ae20 2023-12-19T16:07:21.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f405e2e9640 1 -- 172.21.15.37:0/683028578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404c009400 con 0x7f405806ae20 2023-12-19T16:07:21.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f4054ff9640 1 -- 172.21.15.37:0/683028578 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4048013470 con 0x7f405806ae20 2023-12-19T16:07:21.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.670+0000 7f405e2e9640 1 -- 172.21.15.37:0/683028578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405814a440 con 0x7f405806ae20 2023-12-19T16:07:21.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.672+0000 7f405e2e9640 1 -- 172.21.15.37:0/683028578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405814aba0 con 0x7f405806ae20 2023-12-19T16:07:21.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.672+0000 7f4054ff9640 1 -- 172.21.15.37:0/683028578 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f40480135d0 con 0x7f405806ae20 2023-12-19T16:07:21.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.672+0000 7f4054ff9640 1 --2- 172.21.15.37:0/683028578 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f404406a430 0x7f404406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.672+0000 7f4054ff9640 1 -- 172.21.15.37:0/683028578 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4048088c20 con 0x7f405806ae20 2023-12-19T16:07:21.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.673+0000 7f40577fe640 1 --2- 172.21.15.37:0/683028578 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f404406a430 0x7f404406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.673+0000 7f40577fe640 1 --2- 172.21.15.37:0/683028578 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f404406a430 0x7f404406c8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f404c036000 tx=0x7f404c03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:21.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.677+0000 7f4054ff9640 1 -- 172.21.15.37:0/683028578 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4048054240 con 0x7f405806ae20 2023-12-19T16:07:21.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.852+0000 7f405e2e9640 1 -- 172.21.15.37:0/683028578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40580740a0 con 0x7f405806ae20 2023-12-19T16:07:21.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.852+0000 7f4054ff9640 1 -- 172.21.15.37:0/683028578 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4048057860 con 0x7f405806ae20 2023-12-19T16:07:21.855 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-19T16:07:21.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.854+0000 7f405e2e9640 1 -- 172.21.15.37:0/683028578 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f404406a430 msgr2=0x7f404406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.854+0000 7f405e2e9640 1 --2- 172.21.15.37:0/683028578 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f404406a430 0x7f404406c8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f404c036000 tx=0x7f404c03b040 comp rx=0 tx=0).stop 2023-12-19T16:07:21.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.854+0000 7f405e2e9640 1 -- 172.21.15.37:0/683028578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405806ae20 msgr2=0x7f4058148ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.854+0000 7f405e2e9640 1 --2- 172.21.15.37:0/683028578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405806ae20 0x7f4058148ec0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f404800e9d0 tx=0x7f404800ee90 comp rx=0 tx=0).stop 2023-12-19T16:07:21.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.854+0000 7f405e2e9640 1 -- 172.21.15.37:0/683028578 shutdown_connections 2023-12-19T16:07:21.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.854+0000 7f405e2e9640 1 --2- 172.21.15.37:0/683028578 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f404406a430 0x7f404406c8f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.854+0000 7f405e2e9640 1 --2- 172.21.15.37:0/683028578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f40580b5040 0x7f405814c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.854+0000 7f405e2e9640 1 --2- 172.21.15.37:0/683028578 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f40580b3bc0 0x7f405814c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.854+0000 7f405e2e9640 1 --2- 172.21.15.37:0/683028578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f405806ae20 0x7f4058148ec0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.854+0000 7f405e2e9640 1 -- 172.21.15.37:0/683028578 >> 172.21.15.37:0/683028578 conn(0x7f40580b91b0 msgr2=0x7f4058144c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:21.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.854+0000 7f405e2e9640 1 -- 172.21.15.37:0/683028578 shutdown_connections 2023-12-19T16:07:21.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.854+0000 7f405e2e9640 1 -- 172.21.15.37:0/683028578 wait complete. 2023-12-19T16:07:21.867 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:07:21.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.974+0000 7f56d1dfb640 1 Processor -- start 2023-12-19T16:07:21.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.974+0000 7f56d1dfb640 1 -- start start 2023-12-19T16:07:21.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.975+0000 7f56d1dfb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f56cc0bf510 0x7f56cc0be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.975+0000 7f56d1dfb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f56cc06a950 0x7f56cc0bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.975+0000 7f56d1dfb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc0bfa50 con 0x7f56cc0bb140 2023-12-19T16:07:21.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.975+0000 7f56d1dfb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56cc0bbda0 con 0x7f56cc0bf510 2023-12-19T16:07:21.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.975+0000 7f56d1dfb640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc06b040 con 0x7f56cc06a950 2023-12-19T16:07:21.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.975+0000 7f56caffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f56cc0bf510 0x7f56cc0be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.975+0000 7f56cb7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f56cc0bb140 0x7f56cc0bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34904/0 (socket says 172.21.15.37:34904) 2023-12-19T16:07:21.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.975+0000 7f56cb7fe640 1 -- 172.21.15.37:0/1368464118 learned_addr learned my addr 172.21.15.37:0/1368464118 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:21.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.975+0000 7f56caffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f56cc0bf510 0x7f56cc0be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58132/0 (socket says 172.21.15.37:58132) 2023-12-19T16:07:21.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.975+0000 7f56caffd640 1 -- 172.21.15.37:0/1368464118 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f56cc06a950 msgr2=0x7f56cc0bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:21.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.975+0000 7f56cbfff640 1 --2- 172.21.15.37:0/1368464118 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f56cc06a950 0x7f56cc0bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.975+0000 7f56caffd640 1 --2- 172.21.15.37:0/1368464118 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f56cc06a950 0x7f56cc0bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.975+0000 7f56caffd640 1 -- 172.21.15.37:0/1368464118 >> v1:172.21.15.37:6789/0 conn(0x7f56cc0bb140 legacy=0x7f56cc0bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.975+0000 7f56caffd640 1 -- 172.21.15.37:0/1368464118 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc0bb520 con 0x7f56cc0bf510 2023-12-19T16:07:21.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.976+0000 7f56caffd640 1 --2- 172.21.15.37:0/1368464118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56cc0bf510 0x7f56cc0be350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f56c00097a0 tx=0x7f56c002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e61e1eefeea558e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:21.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.976+0000 7f56ca7fc640 1 -- 172.21.15.37:0/1368464118 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0031780 con 0x7f56cc0bf510 2023-12-19T16:07:21.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.976+0000 7f56ca7fc640 1 -- 172.21.15.37:0/1368464118 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c00318e0 con 0x7f56cc0bf510 2023-12-19T16:07:21.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.976+0000 7f56ca7fc640 1 -- 172.21.15.37:0/1368464118 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0031c70 con 0x7f56cc0bf510 2023-12-19T16:07:21.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.976+0000 7f56d1dfb640 1 -- 172.21.15.37:0/1368464118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56cc0bf510 msgr2=0x7f56cc0be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.976+0000 7f56d1dfb640 1 --2- 172.21.15.37:0/1368464118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56cc0bf510 0x7f56cc0be350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f56c00097a0 tx=0x7f56c002b820 comp rx=0 tx=0).stop 2023-12-19T16:07:21.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.976+0000 7f56d1dfb640 1 -- 172.21.15.37:0/1368464118 shutdown_connections 2023-12-19T16:07:21.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.976+0000 7f56d1dfb640 1 --2- 172.21.15.37:0/1368464118 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f56cc06a950 0x7f56cc0bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.976+0000 7f56d1dfb640 1 --2- 172.21.15.37:0/1368464118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56cc0bf510 0x7f56cc0be350 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.976+0000 7f56d1dfb640 1 -- 172.21.15.37:0/1368464118 >> 172.21.15.37:0/1368464118 conn(0x7f56cc0bcfd0 msgr2=0x7f56cc0bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:21.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.976+0000 7f56d1dfb640 1 -- 172.21.15.37:0/1368464118 shutdown_connections 2023-12-19T16:07:21.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.977+0000 7f56d1dfb640 1 -- 172.21.15.37:0/1368464118 wait complete. 2023-12-19T16:07:21.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.977+0000 7f56d1dfb640 1 Processor -- start 2023-12-19T16:07:21.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.978+0000 7f56d1dfb640 1 -- start start 2023-12-19T16:07:21.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.978+0000 7f56d1dfb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc06a950 0x7f56cc14bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.978+0000 7f56d1dfb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56cc0bb140 0x7f56cc14c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.978+0000 7f56d1dfb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f56cc0bf510 0x7f56cc14e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.978+0000 7f56d1dfb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc14ccf0 con 0x7f56cc0bb140 2023-12-19T16:07:21.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.978+0000 7f56d1dfb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0a1c80 con 0x7f56cc06a950 2023-12-19T16:07:21.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.978+0000 7f56d1dfb640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0a2f00 con 0x7f56cc0bf510 2023-12-19T16:07:21.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.978+0000 7f56caffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56cc0bb140 0x7f56cc14c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.978+0000 7f56caffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56cc0bb140 0x7f56cc14c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58144/0 (socket says 172.21.15.37:58144) 2023-12-19T16:07:21.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.978+0000 7f56caffd640 1 -- 172.21.15.37:0/33727014 learned_addr learned my addr 172.21.15.37:0/33727014 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:21.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.979+0000 7f56cbfff640 1 --2- 172.21.15.37:0/33727014 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f56cc0bf510 0x7f56cc14e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.979+0000 7f56cb7fe640 1 --2- 172.21.15.37:0/33727014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc06a950 0x7f56cc14bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.979+0000 7f56caffd640 1 -- 172.21.15.37:0/33727014 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f56cc0bf510 msgr2=0x7f56cc14e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.979+0000 7f56caffd640 1 --2- 172.21.15.37:0/33727014 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f56cc0bf510 0x7f56cc14e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.979+0000 7f56caffd640 1 -- 172.21.15.37:0/33727014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc06a950 msgr2=0x7f56cc14bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:21.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.979+0000 7f56caffd640 1 --2- 172.21.15.37:0/33727014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc06a950 0x7f56cc14bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:21.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.979+0000 7f56caffd640 1 -- 172.21.15.37:0/33727014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c0009400 con 0x7f56cc0bb140 2023-12-19T16:07:21.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.979+0000 7f56cbfff640 1 --2- 172.21.15.37:0/33727014 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f56cc0bf510 0x7f56cc14e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:21.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.979+0000 7f56caffd640 1 --2- 172.21.15.37:0/33727014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56cc0bb140 0x7f56cc14c7b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f56c0034040 tx=0x7f56c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:21.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.979+0000 7f56b3fff640 1 -- 172.21.15.37:0/33727014 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0032960 con 0x7f56cc0bb140 2023-12-19T16:07:21.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.979+0000 7f56b3fff640 1 -- 172.21.15.37:0/33727014 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c0032ac0 con 0x7f56cc0bb140 2023-12-19T16:07:21.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.979+0000 7f56d1dfb640 1 -- 172.21.15.37:0/33727014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56cc14c3a0 con 0x7f56cc0bb140 2023-12-19T16:07:21.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.979+0000 7f56b3fff640 1 -- 172.21.15.37:0/33727014 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0032e70 con 0x7f56cc0bb140 2023-12-19T16:07:21.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.979+0000 7f56d1dfb640 1 -- 172.21.15.37:0/33727014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc0a2120 con 0x7f56cc0bb140 2023-12-19T16:07:21.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.980+0000 7f56d1dfb640 1 -- 172.21.15.37:0/33727014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56cc0740a0 con 0x7f56cc0bb140 2023-12-19T16:07:21.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.980+0000 7f56b3fff640 1 -- 172.21.15.37:0/33727014 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f56c0045400 con 0x7f56cc0bb140 2023-12-19T16:07:21.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.981+0000 7f56b3fff640 1 --2- 172.21.15.37:0/33727014 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f56b806a430 0x7f56b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:21.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.981+0000 7f56b3fff640 1 -- 172.21.15.37:0/33727014 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56c00aabc0 con 0x7f56cc0bb140 2023-12-19T16:07:21.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.981+0000 7f56cb7fe640 1 --2- 172.21.15.37:0/33727014 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f56b806a430 0x7f56b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:21.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.981+0000 7f56cb7fe640 1 --2- 172.21.15.37:0/33727014 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f56b806a430 0x7f56b806c8f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f56bc005880 tx=0x7f56bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:21.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:21.985+0000 7f56b3fff640 1 -- 172.21.15.37:0/33727014 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f56c00761b0 con 0x7f56cc0bb140 2023-12-19T16:07:22.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.159+0000 7f56d1dfb640 1 -- 172.21.15.37:0/33727014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56cc14c3a0 con 0x7f56cc0bb140 2023-12-19T16:07:22.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.160+0000 7f56b3fff640 1 -- 172.21.15.37:0/33727014 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56cc14c3a0 con 0x7f56cc0bb140 2023-12-19T16:07:22.162 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-19T16:07:22.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.162+0000 7f56d1dfb640 1 -- 172.21.15.37:0/33727014 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f56b806a430 msgr2=0x7f56b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:22.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.162+0000 7f56d1dfb640 1 --2- 172.21.15.37:0/33727014 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f56b806a430 0x7f56b806c8f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f56bc005880 tx=0x7f56bc009040 comp rx=0 tx=0).stop 2023-12-19T16:07:22.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.162+0000 7f56d1dfb640 1 -- 172.21.15.37:0/33727014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56cc0bb140 msgr2=0x7f56cc14c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:22.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.162+0000 7f56d1dfb640 1 --2- 172.21.15.37:0/33727014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56cc0bb140 0x7f56cc14c7b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f56c0034040 tx=0x7f56c00046c0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.162+0000 7f56d1dfb640 1 -- 172.21.15.37:0/33727014 shutdown_connections 2023-12-19T16:07:22.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.162+0000 7f56d1dfb640 1 --2- 172.21.15.37:0/33727014 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f56b806a430 0x7f56b806c8f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.162+0000 7f56d1dfb640 1 --2- 172.21.15.37:0/33727014 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f56cc0bf510 0x7f56cc14e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.162+0000 7f56d1dfb640 1 --2- 172.21.15.37:0/33727014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56cc0bb140 0x7f56cc14c7b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.162+0000 7f56d1dfb640 1 --2- 172.21.15.37:0/33727014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc06a950 0x7f56cc14bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.162+0000 7f56d1dfb640 1 -- 172.21.15.37:0/33727014 >> 172.21.15.37:0/33727014 conn(0x7f56cc0bcfd0 msgr2=0x7f56cc14a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:22.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.162+0000 7f56d1dfb640 1 -- 172.21.15.37:0/33727014 shutdown_connections 2023-12-19T16:07:22.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.162+0000 7f56d1dfb640 1 -- 172.21.15.37:0/33727014 wait complete. 2023-12-19T16:07:22.175 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:07:22.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.282+0000 7f47b0799640 1 Processor -- start 2023-12-19T16:07:22.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.282+0000 7f47b0799640 1 -- start start 2023-12-19T16:07:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.282+0000 7f47b0799640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47a80bb140 0x7f47a80be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.282+0000 7f47b0799640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47a80bf510 0x7f47a80bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.282+0000 7f47b0799640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a80bfa50 con 0x7f47a806a950 2023-12-19T16:07:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.282+0000 7f47b0799640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a80bbda0 con 0x7f47a80bf510 2023-12-19T16:07:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.282+0000 7f47b0799640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a806b040 con 0x7f47a80bb140 2023-12-19T16:07:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.283+0000 7f47aed36640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47a80bf510 0x7f47a80bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.283+0000 7f47add34640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f47a806a950 0x7f47a80bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34920/0 (socket says 172.21.15.37:34920) 2023-12-19T16:07:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.283+0000 7f47aed36640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47a80bf510 0x7f47a80bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58156/0 (socket says 172.21.15.37:58156) 2023-12-19T16:07:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.283+0000 7f47add34640 1 -- 172.21.15.37:0/2192091240 learned_addr learned my addr 172.21.15.37:0/2192091240 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.283+0000 7f47ae535640 1 --2- 172.21.15.37:0/2192091240 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47a80bb140 0x7f47a80be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.283+0000 7f47aed36640 1 -- 172.21.15.37:0/2192091240 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47a80bb140 msgr2=0x7f47a80be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.283+0000 7f47aed36640 1 --2- 172.21.15.37:0/2192091240 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47a80bb140 0x7f47a80be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.283+0000 7f47aed36640 1 -- 172.21.15.37:0/2192091240 >> v1:172.21.15.37:6789/0 conn(0x7f47a806a950 legacy=0x7f47a80bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.283+0000 7f47ad533640 1 -- 172.21.15.37:0/2192091240 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357968173 0 0) 0x7f47a80bfa50 con 0x7f47a806a950 2023-12-19T16:07:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.283+0000 7f47aed36640 1 -- 172.21.15.37:0/2192091240 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a80bb520 con 0x7f47a80bf510 2023-12-19T16:07:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.284+0000 7f47aed36640 1 --2- 172.21.15.37:0/2192091240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47a80bf510 0x7f47a80bfee0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009d90 tx=0x7f47a002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d48d9a05e6cbba5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.284+0000 7f47ad533640 1 -- 172.21.15.37:0/2192091240 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a002cbc0 con 0x7f47a80bf510 2023-12-19T16:07:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.284+0000 7f47ad533640 1 -- 172.21.15.37:0/2192091240 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a002cd20 con 0x7f47a80bf510 2023-12-19T16:07:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.284+0000 7f47ad533640 1 -- 172.21.15.37:0/2192091240 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0034660 con 0x7f47a80bf510 2023-12-19T16:07:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.284+0000 7f47b0799640 1 -- 172.21.15.37:0/2192091240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47a80bf510 msgr2=0x7f47a80bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.284+0000 7f47b0799640 1 --2- 172.21.15.37:0/2192091240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47a80bf510 0x7f47a80bfee0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009d90 tx=0x7f47a002be10 comp rx=0 tx=0).stop 2023-12-19T16:07:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.284+0000 7f47b0799640 1 -- 172.21.15.37:0/2192091240 shutdown_connections 2023-12-19T16:07:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.284+0000 7f47b0799640 1 --2- 172.21.15.37:0/2192091240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47a80bf510 0x7f47a80bfee0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.284+0000 7f47b0799640 1 --2- 172.21.15.37:0/2192091240 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47a80bb140 0x7f47a80be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.284+0000 7f47b0799640 1 -- 172.21.15.37:0/2192091240 >> 172.21.15.37:0/2192091240 conn(0x7f47a80bcfd0 msgr2=0x7f47a80bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.284+0000 7f47b0799640 1 -- 172.21.15.37:0/2192091240 shutdown_connections 2023-12-19T16:07:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.284+0000 7f47b0799640 1 -- 172.21.15.37:0/2192091240 wait complete. 2023-12-19T16:07:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.285+0000 7f47b0799640 1 Processor -- start 2023-12-19T16:07:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.286+0000 7f47b0799640 1 -- start start 2023-12-19T16:07:22.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.286+0000 7f47b0799640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47a806a950 0x7f47a80a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.286+0000 7f47b0799640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47a80bb140 0x7f47a81e2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.286+0000 7f47b0799640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47a80bf510 0x7f47a81e34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.286+0000 7f47b0799640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80a2280 con 0x7f47a806a950 2023-12-19T16:07:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.286+0000 7f47b0799640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a814c3b0 con 0x7f47a80bb140 2023-12-19T16:07:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.286+0000 7f47b0799640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80a2da0 con 0x7f47a80bf510 2023-12-19T16:07:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.286+0000 7f47ae535640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47a806a950 0x7f47a80a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.286+0000 7f47ae535640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47a806a950 0x7f47a80a1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58168/0 (socket says 172.21.15.37:58168) 2023-12-19T16:07:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.286+0000 7f47ae535640 1 -- 172.21.15.37:0/2464190203 learned_addr learned my addr 172.21.15.37:0/2464190203 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.286+0000 7f47aed36640 1 --2- 172.21.15.37:0/2464190203 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47a80bf510 0x7f47a81e34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.286+0000 7f47add34640 1 --2- 172.21.15.37:0/2464190203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47a80bb140 0x7f47a81e2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.287+0000 7f47ae535640 1 -- 172.21.15.37:0/2464190203 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47a80bf510 msgr2=0x7f47a81e34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.287+0000 7f47ae535640 1 --2- 172.21.15.37:0/2464190203 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47a80bf510 0x7f47a81e34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.287+0000 7f47ae535640 1 -- 172.21.15.37:0/2464190203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47a80bb140 msgr2=0x7f47a81e2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.287+0000 7f47ae535640 1 --2- 172.21.15.37:0/2464190203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47a80bb140 0x7f47a81e2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.287+0000 7f47ae535640 1 -- 172.21.15.37:0/2464190203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a0009a70 con 0x7f47a806a950 2023-12-19T16:07:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.287+0000 7f47aed36640 1 --2- 172.21.15.37:0/2464190203 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47a80bf510 0x7f47a81e34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.287+0000 7f47add34640 1 --2- 172.21.15.37:0/2464190203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47a80bb140 0x7f47a81e2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.287+0000 7f47ae535640 1 --2- 172.21.15.37:0/2464190203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47a806a950 0x7f47a80a1d40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f47a400c7f0 tx=0x7f47a400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.287+0000 7f479effd640 1 -- 172.21.15.37:0/2464190203 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4004220 con 0x7f47a806a950 2023-12-19T16:07:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.287+0000 7f479effd640 1 -- 172.21.15.37:0/2464190203 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a4004380 con 0x7f47a806a950 2023-12-19T16:07:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.287+0000 7f47b0799640 1 -- 172.21.15.37:0/2464190203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a81e0280 con 0x7f47a806a950 2023-12-19T16:07:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.287+0000 7f479effd640 1 -- 172.21.15.37:0/2464190203 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4007840 con 0x7f47a806a950 2023-12-19T16:07:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.287+0000 7f47b0799640 1 -- 172.21.15.37:0/2464190203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a81dff90 con 0x7f47a806a950 2023-12-19T16:07:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.288+0000 7f47b0799640 1 -- 172.21.15.37:0/2464190203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a80740a0 con 0x7f47a806a950 2023-12-19T16:07:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.288+0000 7f479effd640 1 -- 172.21.15.37:0/2464190203 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f47a4007bb0 con 0x7f47a806a950 2023-12-19T16:07:22.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.289+0000 7f479effd640 1 --2- 172.21.15.37:0/2464190203 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f478c06a460 0x7f478c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.289+0000 7f479effd640 1 -- 172.21.15.37:0/2464190203 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47a40887c0 con 0x7f47a806a950 2023-12-19T16:07:22.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.289+0000 7f47add34640 1 --2- 172.21.15.37:0/2464190203 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f478c06a460 0x7f478c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.290+0000 7f47add34640 1 --2- 172.21.15.37:0/2464190203 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f478c06a460 0x7f478c06c920 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f47a8147090 tx=0x7f4798009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:22.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.293+0000 7f479effd640 1 -- 172.21.15.37:0/2464190203 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f47a4053db0 con 0x7f47a806a950 2023-12-19T16:07:22.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.469+0000 7f47b0799640 1 -- 172.21.15.37:0/2464190203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f47a80a2f10 con 0x7f47a806a950 2023-12-19T16:07:22.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.470+0000 7f479effd640 1 -- 172.21.15.37:0/2464190203 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f47a401e0a0 con 0x7f47a806a950 2023-12-19T16:07:22.472 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-19T16:07:22.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.472+0000 7f47b0799640 1 -- 172.21.15.37:0/2464190203 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f478c06a460 msgr2=0x7f478c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:22.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.472+0000 7f47b0799640 1 --2- 172.21.15.37:0/2464190203 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f478c06a460 0x7f478c06c920 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f47a8147090 tx=0x7f4798009040 comp rx=0 tx=0).stop 2023-12-19T16:07:22.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.472+0000 7f47b0799640 1 -- 172.21.15.37:0/2464190203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47a806a950 msgr2=0x7f47a80a1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:22.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.472+0000 7f47b0799640 1 --2- 172.21.15.37:0/2464190203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47a806a950 0x7f47a80a1d40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f47a400c7f0 tx=0x7f47a400ccb0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.472+0000 7f47b0799640 1 -- 172.21.15.37:0/2464190203 shutdown_connections 2023-12-19T16:07:22.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.472+0000 7f47b0799640 1 --2- 172.21.15.37:0/2464190203 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f478c06a460 0x7f478c06c920 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.472+0000 7f47b0799640 1 --2- 172.21.15.37:0/2464190203 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f47a80bf510 0x7f47a81e34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.472+0000 7f47b0799640 1 --2- 172.21.15.37:0/2464190203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47a80bb140 0x7f47a81e2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.472+0000 7f47b0799640 1 --2- 172.21.15.37:0/2464190203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47a806a950 0x7f47a80a1d40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.472+0000 7f47b0799640 1 -- 172.21.15.37:0/2464190203 >> 172.21.15.37:0/2464190203 conn(0x7f47a80bcfd0 msgr2=0x7f47a80a5750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.472+0000 7f47b0799640 1 -- 172.21.15.37:0/2464190203 shutdown_connections 2023-12-19T16:07:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.472+0000 7f47b0799640 1 -- 172.21.15.37:0/2464190203 wait complete. 2023-12-19T16:07:22.484 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:07:22.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.588+0000 7f3d55ffd640 1 Processor -- start 2023-12-19T16:07:22.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.588+0000 7f3d55ffd640 1 -- start start 2023-12-19T16:07:22.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.589+0000 7f3d55ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3d500b6860 0x7f3d50070340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.589+0000 7f3d55ffd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d5006b0c0 0x7f3d5006b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.589+0000 7f3d55ffd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5006ba70 con 0x7f3d500bc810 2023-12-19T16:07:22.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.589+0000 7f3d55ffd640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d50069f50 con 0x7f3d500b6860 2023-12-19T16:07:22.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.589+0000 7f3d55ffd640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d500710d0 con 0x7f3d5006b0c0 2023-12-19T16:07:22.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.589+0000 7f3d4effd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3d500bc810 0x7f3d501427f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34930/0 (socket says 172.21.15.37:34930) 2023-12-19T16:07:22.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.589+0000 7f3d4effd640 1 -- 172.21.15.37:0/2847356548 learned_addr learned my addr 172.21.15.37:0/2847356548 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:22.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.589+0000 7f3d4ffff640 1 --2- 172.21.15.37:0/2847356548 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d5006b0c0 0x7f3d5006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.589+0000 7f3d4f7fe640 1 --2- 172.21.15.37:0/2847356548 >> v2:172.21.15.78:3300/0 conn(0x7f3d500b6860 0x7f3d50070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.590+0000 7f3d4e7fc640 1 -- 172.21.15.37:0/2847356548 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426545817 0 0) 0x7f3d5006ba70 con 0x7f3d500bc810 2023-12-19T16:07:22.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.590+0000 7f3d4e7fc640 1 -- 172.21.15.37:0/2847356548 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d38003520 con 0x7f3d500bc810 2023-12-19T16:07:22.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.590+0000 7f3d4e7fc640 1 -- 172.21.15.37:0/2847356548 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1436379602 0 0) 0x7f3d38003520 con 0x7f3d500bc810 2023-12-19T16:07:22.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.590+0000 7f3d4ffff640 1 -- 172.21.15.37:0/2847356548 >> v2:172.21.15.78:3300/0 conn(0x7f3d500b6860 msgr2=0x7f3d50070340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:22.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.590+0000 7f3d4ffff640 1 --2- 172.21.15.37:0/2847356548 >> v2:172.21.15.78:3300/0 conn(0x7f3d500b6860 0x7f3d50070340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.590+0000 7f3d4ffff640 1 -- 172.21.15.37:0/2847356548 >> v1:172.21.15.37:6789/0 conn(0x7f3d500bc810 legacy=0x7f3d501427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:22.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.590+0000 7f3d4ffff640 1 -- 172.21.15.37:0/2847356548 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d500713b0 con 0x7f3d5006b0c0 2023-12-19T16:07:22.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.590+0000 7f3d4f7fe640 1 --2- 172.21.15.37:0/2847356548 >> v2:172.21.15.78:3300/0 conn(0x7f3d500b6860 0x7f3d50070340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:07:22.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.591+0000 7f3d4ffff640 1 --2- 172.21.15.37:0/2847356548 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d5006b0c0 0x7f3d5006b530 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009d90 tx=0x7f3d4802be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c40171ace5997ae7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:22.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.591+0000 7f3d4e7fc640 1 -- 172.21.15.37:0/2847356548 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d44001670 con 0x7f3d5006b0c0 2023-12-19T16:07:22.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.591+0000 7f3d4e7fc640 1 -- 172.21.15.37:0/2847356548 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4802c930 con 0x7f3d5006b0c0 2023-12-19T16:07:22.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.591+0000 7f3d4e7fc640 1 -- 172.21.15.37:0/2847356548 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4802cca0 con 0x7f3d5006b0c0 2023-12-19T16:07:22.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.591+0000 7f3d55ffd640 1 -- 172.21.15.37:0/2847356548 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d5006b0c0 msgr2=0x7f3d5006b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:22.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.591+0000 7f3d55ffd640 1 --2- 172.21.15.37:0/2847356548 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d5006b0c0 0x7f3d5006b530 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009d90 tx=0x7f3d4802be00 comp rx=0 tx=0).stop 2023-12-19T16:07:22.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.591+0000 7f3d55ffd640 1 -- 172.21.15.37:0/2847356548 shutdown_connections 2023-12-19T16:07:22.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.591+0000 7f3d55ffd640 1 --2- 172.21.15.37:0/2847356548 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d5006b0c0 0x7f3d5006b530 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.591+0000 7f3d55ffd640 1 --2- 172.21.15.37:0/2847356548 >> v2:172.21.15.78:3300/0 conn(0x7f3d500b6860 0x7f3d50070340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.591+0000 7f3d55ffd640 1 -- 172.21.15.37:0/2847356548 >> 172.21.15.37:0/2847356548 conn(0x7f3d500bcf60 msgr2=0x7f3d500bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:22.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.591+0000 7f3d55ffd640 1 -- 172.21.15.37:0/2847356548 shutdown_connections 2023-12-19T16:07:22.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.591+0000 7f3d55ffd640 1 -- 172.21.15.37:0/2847356548 wait complete. 2023-12-19T16:07:22.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.592+0000 7f3d55ffd640 1 Processor -- start 2023-12-19T16:07:22.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.593+0000 7f3d55ffd640 1 -- start start 2023-12-19T16:07:22.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.593+0000 7f3d55ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d5006b0c0 0x7f3d501cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.593+0000 7f3d55ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d500b6860 0x7f3d50138920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.593+0000 7f3d55ffd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d500bc810 0x7f3d500b4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.593+0000 7f3d55ffd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d501d0170 con 0x7f3d5006b0c0 2023-12-19T16:07:22.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.593+0000 7f3d55ffd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d501342e0 con 0x7f3d500b6860 2023-12-19T16:07:22.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.593+0000 7f3d55ffd640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d500b6440 con 0x7f3d500bc810 2023-12-19T16:07:22.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.593+0000 7f3d4f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d5006b0c0 0x7f3d501cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.593+0000 7f3d4f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d5006b0c0 0x7f3d501cfc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58182/0 (socket says 172.21.15.37:58182) 2023-12-19T16:07:22.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.593+0000 7f3d4f7fe640 1 -- 172.21.15.37:0/3412054362 learned_addr learned my addr 172.21.15.37:0/3412054362 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:22.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.594+0000 7f3d4ffff640 1 --2- 172.21.15.37:0/3412054362 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d500bc810 0x7f3d500b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.594+0000 7f3d4effd640 1 --2- 172.21.15.37:0/3412054362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d500b6860 0x7f3d50138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.594+0000 7f3d4f7fe640 1 -- 172.21.15.37:0/3412054362 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d500bc810 msgr2=0x7f3d500b4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:22.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.594+0000 7f3d4f7fe640 1 --2- 172.21.15.37:0/3412054362 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d500bc810 0x7f3d500b4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.594+0000 7f3d4f7fe640 1 -- 172.21.15.37:0/3412054362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d500b6860 msgr2=0x7f3d50138920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:22.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.594+0000 7f3d4f7fe640 1 --2- 172.21.15.37:0/3412054362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d500b6860 0x7f3d50138920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.594+0000 7f3d4f7fe640 1 -- 172.21.15.37:0/3412054362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d40009400 con 0x7f3d5006b0c0 2023-12-19T16:07:22.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.594+0000 7f3d4effd640 1 --2- 172.21.15.37:0/3412054362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d500b6860 0x7f3d50138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:22.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.594+0000 7f3d4ffff640 1 --2- 172.21.15.37:0/3412054362 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d500bc810 0x7f3d500b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:22.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.594+0000 7f3d4f7fe640 1 --2- 172.21.15.37:0/3412054362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d5006b0c0 0x7f3d501cfc30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000ebe0 tx=0x7f3d4000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:22.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.594+0000 7f3d37fff640 1 -- 172.21.15.37:0/3412054362 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40009760 con 0x7f3d5006b0c0 2023-12-19T16:07:22.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.594+0000 7f3d37fff640 1 -- 172.21.15.37:0/3412054362 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4000cbd0 con 0x7f3d5006b0c0 2023-12-19T16:07:22.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.594+0000 7f3d55ffd640 1 -- 172.21.15.37:0/3412054362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d48009a70 con 0x7f3d5006b0c0 2023-12-19T16:07:22.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.594+0000 7f3d37fff640 1 -- 172.21.15.37:0/3412054362 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4000eee0 con 0x7f3d5006b0c0 2023-12-19T16:07:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.594+0000 7f3d55ffd640 1 -- 172.21.15.37:0/3412054362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d501d04c0 con 0x7f3d5006b0c0 2023-12-19T16:07:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.595+0000 7f3d55ffd640 1 -- 172.21.15.37:0/3412054362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d500bcbf0 con 0x7f3d5006b0c0 2023-12-19T16:07:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.595+0000 7f3d37fff640 1 -- 172.21.15.37:0/3412054362 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3d40013470 con 0x7f3d5006b0c0 2023-12-19T16:07:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.596+0000 7f3d37fff640 1 --2- 172.21.15.37:0/3412054362 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3d3c06a460 0x7f3d3c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.596+0000 7f3d37fff640 1 -- 172.21.15.37:0/3412054362 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d40088ac0 con 0x7f3d5006b0c0 2023-12-19T16:07:22.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.596+0000 7f3d4effd640 1 --2- 172.21.15.37:0/3412054362 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3d3c06a460 0x7f3d3c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.597+0000 7f3d4effd640 1 --2- 172.21.15.37:0/3412054362 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3d3c06a460 0x7f3d3c06c920 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3d50146400 tx=0x7f3d44009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:22.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.600+0000 7f3d37fff640 1 -- 172.21.15.37:0/3412054362 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3d40054140 con 0x7f3d5006b0c0 2023-12-19T16:07:22.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.781+0000 7f3d55ffd640 1 -- 172.21.15.37:0/3412054362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d501392e0 con 0x7f3d5006b0c0 2023-12-19T16:07:22.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.782+0000 7f3d37fff640 1 -- 172.21.15.37:0/3412054362 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f3d40057760 con 0x7f3d5006b0c0 2023-12-19T16:07:22.784 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:22.784 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:59.728935+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:06:56.758166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:06:57.635291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:07:22.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.784+0000 7f3d55ffd640 1 -- 172.21.15.37:0/3412054362 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3d3c06a460 msgr2=0x7f3d3c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.784+0000 7f3d55ffd640 1 --2- 172.21.15.37:0/3412054362 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3d3c06a460 0x7f3d3c06c920 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3d50146400 tx=0x7f3d44009040 comp rx=0 tx=0).stop 2023-12-19T16:07:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.784+0000 7f3d55ffd640 1 -- 172.21.15.37:0/3412054362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d5006b0c0 msgr2=0x7f3d501cfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.784+0000 7f3d55ffd640 1 --2- 172.21.15.37:0/3412054362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d5006b0c0 0x7f3d501cfc30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000ebe0 tx=0x7f3d4000c520 comp rx=0 tx=0).stop 2023-12-19T16:07:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.784+0000 7f3d55ffd640 1 -- 172.21.15.37:0/3412054362 shutdown_connections 2023-12-19T16:07:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.784+0000 7f3d55ffd640 1 --2- 172.21.15.37:0/3412054362 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3d3c06a460 0x7f3d3c06c920 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.784+0000 7f3d55ffd640 1 --2- 172.21.15.37:0/3412054362 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3d500bc810 0x7f3d500b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.784+0000 7f3d55ffd640 1 --2- 172.21.15.37:0/3412054362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d500b6860 0x7f3d50138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.784+0000 7f3d55ffd640 1 --2- 172.21.15.37:0/3412054362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d5006b0c0 0x7f3d501cfc30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.784+0000 7f3d55ffd640 1 -- 172.21.15.37:0/3412054362 >> 172.21.15.37:0/3412054362 conn(0x7f3d500bcf60 msgr2=0x7f3d500bad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.784+0000 7f3d55ffd640 1 -- 172.21.15.37:0/3412054362 shutdown_connections 2023-12-19T16:07:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.784+0000 7f3d55ffd640 1 -- 172.21.15.37:0/3412054362 wait complete. 2023-12-19T16:07:22.797 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:06:46.684027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:06:56.758166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:06:57.635291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:07:22.798 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:07:22.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.904+0000 7fc2282c4640 1 Processor -- start 2023-12-19T16:07:22.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.904+0000 7fc2282c4640 1 -- start start 2023-12-19T16:07:22.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc2282c4640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2200bb140 0x7fc2200be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc2282c4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2200bfa50 con 0x7fc22006a950 2023-12-19T16:07:22.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc2282c4640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22006b040 con 0x7fc2200bf510 2023-12-19T16:07:22.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc2282c4640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2200bbda0 con 0x7fc2200bb140 2023-12-19T16:07:22.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc22585f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc22006a950 0x7fc2200bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34942/0 (socket says 172.21.15.37:34942) 2023-12-19T16:07:22.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc22585f640 1 -- 172.21.15.37:0/1620052167 learned_addr learned my addr 172.21.15.37:0/1620052167 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:22.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc22505e640 1 -- 172.21.15.37:0/1620052167 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178657101 0 0) 0x7fc2200bfa50 con 0x7fc22006a950 2023-12-19T16:07:22.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc22505e640 1 -- 172.21.15.37:0/1620052167 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc208003520 con 0x7fc22006a950 2023-12-19T16:07:22.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc226060640 1 --2- 172.21.15.37:0/1620052167 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2200bb140 0x7fc2200be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc22505e640 1 -- 172.21.15.37:0/1620052167 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4098132030 0 0) 0x7fc208003520 con 0x7fc22006a950 2023-12-19T16:07:22.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc22505e640 1 -- 172.21.15.37:0/1620052167 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2200bb140 msgr2=0x7fc2200be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:22.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc22505e640 1 --2- 172.21.15.37:0/1620052167 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2200bb140 0x7fc2200be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc22505e640 1 -- 172.21.15.37:0/1620052167 >> v1:172.21.15.78:6789/0 conn(0x7fc2200bf510 legacy=0x7fc220155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:22.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc22505e640 1 -- 172.21.15.37:0/1620052167 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2200bb520 con 0x7fc22006a950 2023-12-19T16:07:22.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc22505e640 1 -- 172.21.15.37:0/1620052167 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7fc214001670 con 0x7fc22006a950 2023-12-19T16:07:22.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc22505e640 1 -- 172.21.15.37:0/1620052167 >> v1:172.21.15.37:6789/0 conn(0x7fc22006a950 legacy=0x7fc2200bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:22.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc22505e640 1 --2- 172.21.15.37:0/1620052167 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2200bb140 0x7fc2080039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc22505e640 1 --2- 172.21.15.37:0/1620052167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc208004020 0x7fc2080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc22505e640 1 --2- 172.21.15.37:0/1620052167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc208004d00 0x7fc208005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc22505e640 1 -- 172.21.15.37:0/1620052167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20800bb90 con 0x7fc208004d00 2023-12-19T16:07:22.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc22505e640 1 -- 172.21.15.37:0/1620052167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20800bd00 con 0x7fc208004020 2023-12-19T16:07:22.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.905+0000 7fc22505e640 1 -- 172.21.15.37:0/1620052167 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20800bec0 con 0x7fc2200bb140 2023-12-19T16:07:22.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.906+0000 7fc226861640 1 --2- 172.21.15.37:0/1620052167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc208004d00 0x7fc208005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.906+0000 7fc226060640 1 --2- 172.21.15.37:0/1620052167 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2200bb140 0x7fc2080039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.906+0000 7fc22585f640 1 --2- 172.21.15.37:0/1620052167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc208004020 0x7fc2080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.906+0000 7fc226861640 1 -- 172.21.15.37:0/1620052167 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2200bb140 msgr2=0x7fc2080039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:22.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.906+0000 7fc226861640 1 --2- 172.21.15.37:0/1620052167 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc2200bb140 0x7fc2080039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.906+0000 7fc226861640 1 -- 172.21.15.37:0/1620052167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc208004020 msgr2=0x7fc2080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.906+0000 7fc226861640 1 --2- 172.21.15.37:0/1620052167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc208004020 0x7fc2080047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.906+0000 7fc226861640 1 -- 172.21.15.37:0/1620052167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc208003520 con 0x7fc208004d00 2023-12-19T16:07:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.907+0000 7fc226861640 1 --2- 172.21.15.37:0/1620052167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc208004d00 0x7fc208005180 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc218001e20 tx=0x7fc2080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfac15ee16fa864e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.907+0000 7fc22505e640 1 -- 172.21.15.37:0/1620052167 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218003b70 con 0x7fc208004d00 2023-12-19T16:07:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.907+0000 7fc22505e640 1 -- 172.21.15.37:0/1620052167 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc218003cd0 con 0x7fc208004d00 2023-12-19T16:07:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.907+0000 7fc22505e640 1 -- 172.21.15.37:0/1620052167 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218005310 con 0x7fc208004d00 2023-12-19T16:07:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.907+0000 7fc2282c4640 1 -- 172.21.15.37:0/1620052167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc208004d00 msgr2=0x7fc208005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.907+0000 7fc2282c4640 1 --2- 172.21.15.37:0/1620052167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc208004d00 0x7fc208005180 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc218001e20 tx=0x7fc2080057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.907+0000 7fc226861640 1 -- 172.21.15.37:0/1620052167 reap_dead start 2023-12-19T16:07:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.907+0000 7fc2282c4640 1 -- 172.21.15.37:0/1620052167 shutdown_connections 2023-12-19T16:07:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.907+0000 7fc2282c4640 1 -- 172.21.15.37:0/1620052167 >> 172.21.15.37:0/1620052167 conn(0x7fc2200bcfd0 msgr2=0x7fc2200bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.907+0000 7fc2282c4640 1 -- 172.21.15.37:0/1620052167 shutdown_connections 2023-12-19T16:07:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.907+0000 7fc2282c4640 1 -- 172.21.15.37:0/1620052167 wait complete. 2023-12-19T16:07:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.908+0000 7fc2282c4640 1 Processor -- start 2023-12-19T16:07:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.908+0000 7fc2282c4640 1 -- start start 2023-12-19T16:07:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.909+0000 7fc2282c4640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc208004d00 0x7fc22009bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.909+0000 7fc2282c4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc22009b6b0 0x7fc22009a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.909+0000 7fc2282c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22009aab0 0x7fc22009e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.909+0000 7fc2282c4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22009c2b0 con 0x7fc22009b6b0 2023-12-19T16:07:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.909+0000 7fc2282c4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22009a120 con 0x7fc22009aab0 2023-12-19T16:07:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.909+0000 7fc2282c4640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22009af10 con 0x7fc208004d00 2023-12-19T16:07:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.909+0000 7fc22585f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc22009b6b0 0x7fc22009a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.909+0000 7fc22585f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc22009b6b0 0x7fc22009a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58194/0 (socket says 172.21.15.37:58194) 2023-12-19T16:07:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.909+0000 7fc22585f640 1 -- 172.21.15.37:0/2807057988 learned_addr learned my addr 172.21.15.37:0/2807057988 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.909+0000 7fc226060640 1 --2- 172.21.15.37:0/2807057988 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc208004d00 0x7fc22009bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.909+0000 7fc226861640 1 --2- 172.21.15.37:0/2807057988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22009aab0 0x7fc22009e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.909+0000 7fc22585f640 1 -- 172.21.15.37:0/2807057988 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc208004d00 msgr2=0x7fc22009bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.909+0000 7fc22585f640 1 --2- 172.21.15.37:0/2807057988 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc208004d00 0x7fc22009bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.909+0000 7fc22585f640 1 -- 172.21.15.37:0/2807057988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22009aab0 msgr2=0x7fc22009e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.909+0000 7fc22585f640 1 --2- 172.21.15.37:0/2807057988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22009aab0 0x7fc22009e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.909+0000 7fc22585f640 1 -- 172.21.15.37:0/2807057988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2201e39a0 con 0x7fc22009b6b0 2023-12-19T16:07:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.910+0000 7fc22585f640 1 --2- 172.21.15.37:0/2807057988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc22009b6b0 0x7fc22009a570 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc2140072c0 tx=0x7fc2140076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.910+0000 7fc21effd640 1 -- 172.21.15.37:0/2807057988 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21400f940 con 0x7fc22009b6b0 2023-12-19T16:07:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.910+0000 7fc21effd640 1 -- 172.21.15.37:0/2807057988 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21400faa0 con 0x7fc22009b6b0 2023-12-19T16:07:22.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.910+0000 7fc2282c4640 1 -- 172.21.15.37:0/2807057988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2201e3c80 con 0x7fc22009b6b0 2023-12-19T16:07:22.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.910+0000 7fc21effd640 1 -- 172.21.15.37:0/2807057988 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21400fe50 con 0x7fc22009b6b0 2023-12-19T16:07:22.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.910+0000 7fc2282c4640 1 -- 172.21.15.37:0/2807057988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2201e3f60 con 0x7fc22009b6b0 2023-12-19T16:07:22.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.911+0000 7fc2282c4640 1 -- 172.21.15.37:0/2807057988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc22009a290 con 0x7fc22009b6b0 2023-12-19T16:07:22.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.911+0000 7fc21effd640 1 -- 172.21.15.37:0/2807057988 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc21401d460 con 0x7fc22009b6b0 2023-12-19T16:07:22.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.911+0000 7fc21effd640 1 --2- 172.21.15.37:0/2807057988 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc20c06a460 0x7fc20c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:22.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.912+0000 7fc21effd640 1 -- 172.21.15.37:0/2807057988 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc214088940 con 0x7fc22009b6b0 2023-12-19T16:07:22.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.912+0000 7fc226060640 1 --2- 172.21.15.37:0/2807057988 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc20c06a460 0x7fc20c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:22.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.912+0000 7fc226060640 1 --2- 172.21.15.37:0/2807057988 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc20c06a460 0x7fc20c06c920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc210006fd0 tx=0x7fc210008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:22.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:22.916+0000 7fc21effd640 1 -- 172.21.15.37:0/2807057988 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc22009a290 con 0x7fc22009b6b0 2023-12-19T16:07:23.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.094+0000 7fc2282c4640 1 -- 172.21.15.37:0/2807057988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc22009a290 con 0x7fc22009b6b0 2023-12-19T16:07:23.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.095+0000 7fc21effd640 1 -- 172.21.15.37:0/2807057988 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc22009a290 con 0x7fc22009b6b0 2023-12-19T16:07:23.098 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-19T16:07:23.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.097+0000 7fc2282c4640 1 -- 172.21.15.37:0/2807057988 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc20c06a460 msgr2=0x7fc20c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:23.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.097+0000 7fc2282c4640 1 --2- 172.21.15.37:0/2807057988 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc20c06a460 0x7fc20c06c920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc210006fd0 tx=0x7fc210008040 comp rx=0 tx=0).stop 2023-12-19T16:07:23.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.097+0000 7fc2282c4640 1 -- 172.21.15.37:0/2807057988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc22009b6b0 msgr2=0x7fc22009a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:23.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.097+0000 7fc2282c4640 1 --2- 172.21.15.37:0/2807057988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc22009b6b0 0x7fc22009a570 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc2140072c0 tx=0x7fc2140076c0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.097+0000 7fc2282c4640 1 -- 172.21.15.37:0/2807057988 shutdown_connections 2023-12-19T16:07:23.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.097+0000 7fc2282c4640 1 --2- 172.21.15.37:0/2807057988 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc20c06a460 0x7fc20c06c920 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.097+0000 7fc2282c4640 1 --2- 172.21.15.37:0/2807057988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc22009aab0 0x7fc22009e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.097+0000 7fc2282c4640 1 --2- 172.21.15.37:0/2807057988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc22009b6b0 0x7fc22009a570 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.097+0000 7fc2282c4640 1 --2- 172.21.15.37:0/2807057988 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc208004d00 0x7fc22009bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.097+0000 7fc2282c4640 1 -- 172.21.15.37:0/2807057988 >> 172.21.15.37:0/2807057988 conn(0x7fc2200bcfd0 msgr2=0x7fc2200a5500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.097+0000 7fc2282c4640 1 -- 172.21.15.37:0/2807057988 shutdown_connections 2023-12-19T16:07:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.097+0000 7fc2282c4640 1 -- 172.21.15.37:0/2807057988 wait complete. 2023-12-19T16:07:23.110 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:07:23.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.216+0000 7fd06b147640 1 Processor -- start 2023-12-19T16:07:23.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.216+0000 7fd06b147640 1 -- start start 2023-12-19T16:07:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.217+0000 7fd06b147640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd0640bf510 0x7fd0640be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.217+0000 7fd06b147640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd06406a950 0x7fd0640bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.217+0000 7fd06b147640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0640bfa50 con 0x7fd0640bb140 2023-12-19T16:07:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.217+0000 7fd06b147640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0640bbda0 con 0x7fd06406a950 2023-12-19T16:07:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.217+0000 7fd06b147640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06406b040 con 0x7fd0640bf510 2023-12-19T16:07:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.217+0000 7fd068ee3640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd0640bb140 0x7fd0640bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34952/0 (socket says 172.21.15.37:34952) 2023-12-19T16:07:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.217+0000 7fd068ee3640 1 -- 172.21.15.37:0/967517355 learned_addr learned my addr 172.21.15.37:0/967517355 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.217+0000 7fd0696e4640 1 --2- 172.21.15.37:0/967517355 >> v2:172.21.15.37:3300/0 conn(0x7fd06406a950 0x7fd0640bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.217+0000 7fd063fff640 1 --2- 172.21.15.37:0/967517355 >> v2:172.21.15.78:3300/0 conn(0x7fd0640bf510 0x7fd0640be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.217+0000 7fd0637fe640 1 -- 172.21.15.37:0/967517355 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818836917 0 0) 0x7fd0640bfa50 con 0x7fd0640bb140 2023-12-19T16:07:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.217+0000 7fd0637fe640 1 -- 172.21.15.37:0/967517355 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd04c003520 con 0x7fd0640bb140 2023-12-19T16:07:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.217+0000 7fd0696e4640 1 -- 172.21.15.37:0/967517355 >> v2:172.21.15.78:3300/0 conn(0x7fd0640bf510 msgr2=0x7fd0640be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.217+0000 7fd0696e4640 1 --2- 172.21.15.37:0/967517355 >> v2:172.21.15.78:3300/0 conn(0x7fd0640bf510 0x7fd0640be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.217+0000 7fd0696e4640 1 -- 172.21.15.37:0/967517355 >> v1:172.21.15.37:6789/0 conn(0x7fd0640bb140 legacy=0x7fd0640bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.217+0000 7fd0696e4640 1 -- 172.21.15.37:0/967517355 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0640bb520 con 0x7fd06406a950 2023-12-19T16:07:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.218+0000 7fd0696e4640 1 --2- 172.21.15.37:0/967517355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd06406a950 0x7fd0640bfee0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd06406b650 tx=0x7fd05402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6deccada72422ba9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.218+0000 7fd0637fe640 1 -- 172.21.15.37:0/967517355 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05402e070 con 0x7fd06406a950 2023-12-19T16:07:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.218+0000 7fd0637fe640 1 -- 172.21.15.37:0/967517355 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0540315a0 con 0x7fd06406a950 2023-12-19T16:07:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.218+0000 7fd0637fe640 1 -- 172.21.15.37:0/967517355 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd054031930 con 0x7fd06406a950 2023-12-19T16:07:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.219+0000 7fd06b147640 1 -- 172.21.15.37:0/967517355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd06406a950 msgr2=0x7fd0640bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.219+0000 7fd06b147640 1 --2- 172.21.15.37:0/967517355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd06406a950 0x7fd0640bfee0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd06406b650 tx=0x7fd05402b840 comp rx=0 tx=0).stop 2023-12-19T16:07:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.219+0000 7fd06b147640 1 -- 172.21.15.37:0/967517355 shutdown_connections 2023-12-19T16:07:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.219+0000 7fd06b147640 1 --2- 172.21.15.37:0/967517355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd06406a950 0x7fd0640bfee0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.219+0000 7fd06b147640 1 --2- 172.21.15.37:0/967517355 >> v2:172.21.15.78:3300/0 conn(0x7fd0640bf510 0x7fd0640be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.219+0000 7fd06b147640 1 -- 172.21.15.37:0/967517355 >> 172.21.15.37:0/967517355 conn(0x7fd0640bcfd0 msgr2=0x7fd0640bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.219+0000 7fd06b147640 1 -- 172.21.15.37:0/967517355 shutdown_connections 2023-12-19T16:07:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.219+0000 7fd06b147640 1 -- 172.21.15.37:0/967517355 wait complete. 2023-12-19T16:07:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.220+0000 7fd06b147640 1 Processor -- start 2023-12-19T16:07:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.220+0000 7fd06b147640 1 -- start start 2023-12-19T16:07:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd06b147640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd06406a950 0x7fd06414ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd06b147640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0640bb140 0x7fd0640a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd06b147640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0640bf510 0x7fd0640a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd06b147640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06414e310 con 0x7fd06406a950 2023-12-19T16:07:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd06b147640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0641e3b60 con 0x7fd0640bb140 2023-12-19T16:07:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd06b147640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0640b4900 con 0x7fd0640bf510 2023-12-19T16:07:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd068ee3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd06406a950 0x7fd06414ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd068ee3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd06406a950 0x7fd06414ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58206/0 (socket says 172.21.15.37:58206) 2023-12-19T16:07:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd068ee3640 1 -- 172.21.15.37:0/2524553498 learned_addr learned my addr 172.21.15.37:0/2524553498 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd063fff640 1 --2- 172.21.15.37:0/2524553498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0640bb140 0x7fd0640a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd0696e4640 1 --2- 172.21.15.37:0/2524553498 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0640bf510 0x7fd0640a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd068ee3640 1 -- 172.21.15.37:0/2524553498 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0640bf510 msgr2=0x7fd0640a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd068ee3640 1 --2- 172.21.15.37:0/2524553498 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0640bf510 0x7fd0640a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd068ee3640 1 -- 172.21.15.37:0/2524553498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0640bb140 msgr2=0x7fd0640a0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd068ee3640 1 --2- 172.21.15.37:0/2524553498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0640bb140 0x7fd0640a0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd068ee3640 1 -- 172.21.15.37:0/2524553498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd054009400 con 0x7fd06406a950 2023-12-19T16:07:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd063fff640 1 --2- 172.21.15.37:0/2524553498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0640bb140 0x7fd0640a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd068ee3640 1 --2- 172.21.15.37:0/2524553498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd06406a950 0x7fd06414ddd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00cbc0 tx=0x7fd05c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd0617fa640 1 -- 172.21.15.37:0/2524553498 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c00ad40 con 0x7fd06406a950 2023-12-19T16:07:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd0617fa640 1 -- 172.21.15.37:0/2524553498 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c012400 con 0x7fd06406a950 2023-12-19T16:07:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd06b147640 1 -- 172.21.15.37:0/2524553498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06414e790 con 0x7fd06406a950 2023-12-19T16:07:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd0617fa640 1 -- 172.21.15.37:0/2524553498 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c00aea0 con 0x7fd06406a950 2023-12-19T16:07:23.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.221+0000 7fd06b147640 1 -- 172.21.15.37:0/2524553498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0641e3510 con 0x7fd06406a950 2023-12-19T16:07:23.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.222+0000 7fd06b147640 1 -- 172.21.15.37:0/2524553498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd064066e90 con 0x7fd06406a950 2023-12-19T16:07:23.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.223+0000 7fd0617fa640 1 -- 172.21.15.37:0/2524553498 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd05c007070 con 0x7fd06406a950 2023-12-19T16:07:23.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.223+0000 7fd0617fa640 1 --2- 172.21.15.37:0/2524553498 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd05006a430 0x7fd05006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.223+0000 7fd0617fa640 1 -- 172.21.15.37:0/2524553498 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd05c088900 con 0x7fd06406a950 2023-12-19T16:07:23.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.223+0000 7fd063fff640 1 --2- 172.21.15.37:0/2524553498 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd05006a430 0x7fd05006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.224+0000 7fd063fff640 1 --2- 172.21.15.37:0/2524553498 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd05006a430 0x7fd05006c8f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd058006fd0 tx=0x7fd058008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:23.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.227+0000 7fd0617fa640 1 -- 172.21.15.37:0/2524553498 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd05c053f10 con 0x7fd06406a950 2023-12-19T16:07:23.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.402+0000 7fd06b147640 1 -- 172.21.15.37:0/2524553498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd0640a0c00 con 0x7fd06406a950 2023-12-19T16:07:23.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.403+0000 7fd0617fa640 1 -- 172.21.15.37:0/2524553498 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd05c017020 con 0x7fd06406a950 2023-12-19T16:07:23.405 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-19T16:07:23.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.404+0000 7fd06b147640 1 -- 172.21.15.37:0/2524553498 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd05006a430 msgr2=0x7fd05006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:23.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.404+0000 7fd06b147640 1 --2- 172.21.15.37:0/2524553498 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd05006a430 0x7fd05006c8f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd058006fd0 tx=0x7fd058008040 comp rx=0 tx=0).stop 2023-12-19T16:07:23.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.404+0000 7fd06b147640 1 -- 172.21.15.37:0/2524553498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd06406a950 msgr2=0x7fd06414ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:23.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.404+0000 7fd06b147640 1 --2- 172.21.15.37:0/2524553498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd06406a950 0x7fd06414ddd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00cbc0 tx=0x7fd05c00a430 comp rx=0 tx=0).stop 2023-12-19T16:07:23.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.405+0000 7fd06b147640 1 -- 172.21.15.37:0/2524553498 shutdown_connections 2023-12-19T16:07:23.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.405+0000 7fd06b147640 1 --2- 172.21.15.37:0/2524553498 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd05006a430 0x7fd05006c8f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.405+0000 7fd06b147640 1 --2- 172.21.15.37:0/2524553498 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0640bf510 0x7fd0640a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.405+0000 7fd06b147640 1 --2- 172.21.15.37:0/2524553498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0640bb140 0x7fd0640a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.405+0000 7fd06b147640 1 --2- 172.21.15.37:0/2524553498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd06406a950 0x7fd06414ddd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.405+0000 7fd06b147640 1 -- 172.21.15.37:0/2524553498 >> 172.21.15.37:0/2524553498 conn(0x7fd0640bcfd0 msgr2=0x7fd0640a4780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:23.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.405+0000 7fd06b147640 1 -- 172.21.15.37:0/2524553498 shutdown_connections 2023-12-19T16:07:23.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.405+0000 7fd06b147640 1 -- 172.21.15.37:0/2524553498 wait complete. 2023-12-19T16:07:23.418 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:07:23.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.524+0000 7f099aaaf640 1 Processor -- start 2023-12-19T16:07:23.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.524+0000 7f099aaaf640 1 -- start start 2023-12-19T16:07:23.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.525+0000 7f099aaaf640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f099406fc30 0x7f09940b9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.525+0000 7f099aaaf640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0994070ef0 con 0x7f09940b9b00 2023-12-19T16:07:23.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.525+0000 7f099aaaf640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0994141e00 con 0x7f099414ac60 2023-12-19T16:07:23.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.525+0000 7f099aaaf640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0994071190 con 0x7f099406fc30 2023-12-19T16:07:23.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.525+0000 7f099884b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f09940b9b00 0x7f09941416f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34958/0 (socket says 172.21.15.37:34958) 2023-12-19T16:07:23.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.525+0000 7f099884b640 1 -- 172.21.15.37:0/3063827324 learned_addr learned my addr 172.21.15.37:0/3063827324 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:23.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.525+0000 7f09937fe640 1 -- 172.21.15.37:0/3063827324 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312453472 0 0) 0x7f0994070ef0 con 0x7f09940b9b00 2023-12-19T16:07:23.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.525+0000 7f0993fff640 1 --2- 172.21.15.37:0/3063827324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f099406fc30 0x7f09940b9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.525+0000 7f09937fe640 1 -- 172.21.15.37:0/3063827324 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f097c003520 con 0x7f09940b9b00 2023-12-19T16:07:23.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f09937fe640 1 -- 172.21.15.37:0/3063827324 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1712718669 0 0) 0x7f097c003520 con 0x7f09940b9b00 2023-12-19T16:07:23.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f09937fe640 1 -- 172.21.15.37:0/3063827324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f099406fc30 msgr2=0x7f09940b9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:23.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f09937fe640 1 --2- 172.21.15.37:0/3063827324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f099406fc30 0x7f09940b9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f09937fe640 1 -- 172.21.15.37:0/3063827324 >> v1:172.21.15.78:6789/0 conn(0x7f099414ac60 legacy=0x7f0994151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:23.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f09937fe640 1 -- 172.21.15.37:0/3063827324 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0994071470 con 0x7f09940b9b00 2023-12-19T16:07:23.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f09937fe640 1 -- 172.21.15.37:0/3063827324 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f098c0019f0 con 0x7f09940b9b00 2023-12-19T16:07:23.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f09937fe640 1 -- 172.21.15.37:0/3063827324 >> v1:172.21.15.37:6789/0 conn(0x7f09940b9b00 legacy=0x7f09941416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:23.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f09937fe640 1 --2- 172.21.15.37:0/3063827324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f099406fc30 0x7f097c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f09937fe640 1 --2- 172.21.15.37:0/3063827324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f097c003f20 0x7f097c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f09937fe640 1 --2- 172.21.15.37:0/3063827324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f097c004d00 0x7f097c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f09937fe640 1 -- 172.21.15.37:0/3063827324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0994071190 con 0x7f097c003f20 2023-12-19T16:07:23.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f09937fe640 1 -- 172.21.15.37:0/3063827324 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c00ba60 con 0x7f097c004d00 2023-12-19T16:07:23.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f09937fe640 1 -- 172.21.15.37:0/3063827324 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c00de30 con 0x7f099406fc30 2023-12-19T16:07:23.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f0993fff640 1 --2- 172.21.15.37:0/3063827324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f097c003f20 0x7f097c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f099904c640 1 --2- 172.21.15.37:0/3063827324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f097c004d00 0x7f097c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f099884b640 1 --2- 172.21.15.37:0/3063827324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f099406fc30 0x7f097c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f0993fff640 1 -- 172.21.15.37:0/3063827324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f099406fc30 msgr2=0x7f097c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:23.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f0993fff640 1 --2- 172.21.15.37:0/3063827324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f099406fc30 0x7f097c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f0993fff640 1 -- 172.21.15.37:0/3063827324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f097c004d00 msgr2=0x7f097c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:23.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f0993fff640 1 --2- 172.21.15.37:0/3063827324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f097c004d00 0x7f097c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.526+0000 7f0993fff640 1 -- 172.21.15.37:0/3063827324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c003520 con 0x7f097c003f20 2023-12-19T16:07:23.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.527+0000 7f0993fff640 1 --2- 172.21.15.37:0/3063827324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f097c003f20 0x7f097c0047c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0988009a90 tx=0x7f097c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8fe290768ae40d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:23.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.527+0000 7f09937fe640 1 -- 172.21.15.37:0/3063827324 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098802c680 con 0x7f097c003f20 2023-12-19T16:07:23.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.527+0000 7f09937fe640 1 -- 172.21.15.37:0/3063827324 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098802c7e0 con 0x7f097c003f20 2023-12-19T16:07:23.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.527+0000 7f09937fe640 1 -- 172.21.15.37:0/3063827324 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098802cb90 con 0x7f097c003f20 2023-12-19T16:07:23.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.528+0000 7f099aaaf640 1 -- 172.21.15.37:0/3063827324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f097c003f20 msgr2=0x7f097c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:23.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.528+0000 7f099aaaf640 1 --2- 172.21.15.37:0/3063827324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f097c003f20 0x7f097c0047c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0988009a90 tx=0x7f097c0057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.528+0000 7f099904c640 1 -- 172.21.15.37:0/3063827324 reap_dead start 2023-12-19T16:07:23.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.528+0000 7f099aaaf640 1 -- 172.21.15.37:0/3063827324 shutdown_connections 2023-12-19T16:07:23.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.528+0000 7f099aaaf640 1 -- 172.21.15.37:0/3063827324 >> 172.21.15.37:0/3063827324 conn(0x7f09940bcfe0 msgr2=0x7f09940bd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:23.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.528+0000 7f099aaaf640 1 -- 172.21.15.37:0/3063827324 shutdown_connections 2023-12-19T16:07:23.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.528+0000 7f099aaaf640 1 -- 172.21.15.37:0/3063827324 wait complete. 2023-12-19T16:07:23.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.529+0000 7f099aaaf640 1 Processor -- start 2023-12-19T16:07:23.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.529+0000 7f099aaaf640 1 -- start start 2023-12-19T16:07:23.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.529+0000 7f099aaaf640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f097c003f20 0x7f0994148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.529+0000 7f099aaaf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0994140600 0x7f09940bb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.529+0000 7f099aaaf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09940bbf60 0x7f09940bc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.529+0000 7f099aaaf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09940bb570 con 0x7f0994140600 2023-12-19T16:07:23.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.529+0000 7f099aaaf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0994137e70 con 0x7f09940bbf60 2023-12-19T16:07:23.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.529+0000 7f099aaaf640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0994140a60 con 0x7f097c003f20 2023-12-19T16:07:23.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.530+0000 7f0993fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0994140600 0x7f09940bb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.530+0000 7f0993fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0994140600 0x7f09940bb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58232/0 (socket says 172.21.15.37:58232) 2023-12-19T16:07:23.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.530+0000 7f0993fff640 1 -- 172.21.15.37:0/1695987703 learned_addr learned my addr 172.21.15.37:0/1695987703 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:23.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.530+0000 7f099884b640 1 --2- 172.21.15.37:0/1695987703 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f097c003f20 0x7f0994148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.530+0000 7f099904c640 1 --2- 172.21.15.37:0/1695987703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09940bbf60 0x7f09940bc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.530+0000 7f0993fff640 1 -- 172.21.15.37:0/1695987703 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f097c003f20 msgr2=0x7f0994148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:23.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.530+0000 7f0993fff640 1 --2- 172.21.15.37:0/1695987703 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f097c003f20 0x7f0994148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.530+0000 7f0993fff640 1 -- 172.21.15.37:0/1695987703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09940bbf60 msgr2=0x7f09940bc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:23.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.530+0000 7f0993fff640 1 --2- 172.21.15.37:0/1695987703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09940bbf60 0x7f09940bc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.530+0000 7f0993fff640 1 -- 172.21.15.37:0/1695987703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09940bc920 con 0x7f0994140600 2023-12-19T16:07:23.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.530+0000 7f099904c640 1 --2- 172.21.15.37:0/1695987703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09940bbf60 0x7f09940bc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:23.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.530+0000 7f0993fff640 1 --2- 172.21.15.37:0/1695987703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0994140600 0x7f09940bb030 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f098802c2f0 tx=0x7f0988004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:23.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.530+0000 7f09917fa640 1 -- 172.21.15.37:0/1695987703 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988034a10 con 0x7f0994140600 2023-12-19T16:07:23.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.530+0000 7f09917fa640 1 -- 172.21.15.37:0/1695987703 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0988034b90 con 0x7f0994140600 2023-12-19T16:07:23.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.530+0000 7f099aaaf640 1 -- 172.21.15.37:0/1695987703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0994140db0 con 0x7f0994140600 2023-12-19T16:07:23.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.530+0000 7f09917fa640 1 -- 172.21.15.37:0/1695987703 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098803e400 con 0x7f0994140600 2023-12-19T16:07:23.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.530+0000 7f099aaaf640 1 -- 172.21.15.37:0/1695987703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09940bcba0 con 0x7f0994140600 2023-12-19T16:07:23.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.531+0000 7f099aaaf640 1 -- 172.21.15.37:0/1695987703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0994140c10 con 0x7f0994140600 2023-12-19T16:07:23.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.532+0000 7f09917fa640 1 -- 172.21.15.37:0/1695987703 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f098803e560 con 0x7f0994140600 2023-12-19T16:07:23.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.532+0000 7f09917fa640 1 --2- 172.21.15.37:0/1695987703 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f098006a430 0x7f098006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.532+0000 7f09917fa640 1 -- 172.21.15.37:0/1695987703 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09880aa780 con 0x7f0994140600 2023-12-19T16:07:23.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.532+0000 7f099884b640 1 --2- 172.21.15.37:0/1695987703 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f098006a430 0x7f098006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.533+0000 7f099884b640 1 --2- 172.21.15.37:0/1695987703 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f098006a430 0x7f098006c8f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f098c0013d0 tx=0x7f098c006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:23.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.536+0000 7f09917fa640 1 -- 172.21.15.37:0/1695987703 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0994140c10 con 0x7f0994140600 2023-12-19T16:07:23.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.712+0000 7f099aaaf640 1 -- 172.21.15.37:0/1695987703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0994140c10 con 0x7f0994140600 2023-12-19T16:07:23.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.712+0000 7f09917fa640 1 -- 172.21.15.37:0/1695987703 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0994140c10 con 0x7f0994140600 2023-12-19T16:07:23.715 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-19T16:07:23.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.714+0000 7f099aaaf640 1 -- 172.21.15.37:0/1695987703 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f098006a430 msgr2=0x7f098006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.714+0000 7f099aaaf640 1 --2- 172.21.15.37:0/1695987703 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f098006a430 0x7f098006c8f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f098c0013d0 tx=0x7f098c006040 comp rx=0 tx=0).stop 2023-12-19T16:07:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.714+0000 7f099aaaf640 1 -- 172.21.15.37:0/1695987703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0994140600 msgr2=0x7f09940bb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.714+0000 7f099aaaf640 1 --2- 172.21.15.37:0/1695987703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0994140600 0x7f09940bb030 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f098802c2f0 tx=0x7f0988004730 comp rx=0 tx=0).stop 2023-12-19T16:07:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.714+0000 7f099aaaf640 1 -- 172.21.15.37:0/1695987703 shutdown_connections 2023-12-19T16:07:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.714+0000 7f099aaaf640 1 --2- 172.21.15.37:0/1695987703 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f098006a430 0x7f098006c8f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.714+0000 7f099aaaf640 1 --2- 172.21.15.37:0/1695987703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09940bbf60 0x7f09940bc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.714+0000 7f099aaaf640 1 --2- 172.21.15.37:0/1695987703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0994140600 0x7f09940bb030 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.714+0000 7f099aaaf640 1 --2- 172.21.15.37:0/1695987703 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f097c003f20 0x7f0994148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.714+0000 7f099aaaf640 1 -- 172.21.15.37:0/1695987703 >> 172.21.15.37:0/1695987703 conn(0x7f09940bcfe0 msgr2=0x7f09940b7860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.714+0000 7f099aaaf640 1 -- 172.21.15.37:0/1695987703 shutdown_connections 2023-12-19T16:07:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.714+0000 7f099aaaf640 1 -- 172.21.15.37:0/1695987703 wait complete. 2023-12-19T16:07:23.727 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:07:23.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.830+0000 7ff47c869640 1 Processor -- start 2023-12-19T16:07:23.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.830+0000 7ff47c869640 1 -- start start 2023-12-19T16:07:23.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.831+0000 7ff47c869640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff4780b6690 0x7ff478144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.831+0000 7ff47c869640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff478144cd0 0x7ff478155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.831+0000 7ff47c869640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4780bc6b0 con 0x7ff4780bcdd0 2023-12-19T16:07:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.831+0000 7ff47c869640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4780a59f0 con 0x7ff4780b6690 2023-12-19T16:07:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.831+0000 7ff47c869640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4780bc0a0 con 0x7ff478144cd0 2023-12-19T16:07:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.832+0000 7ff46ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff4780b6690 0x7ff478144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.832+0000 7ff476d9d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff478144cd0 0x7ff478155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.832+0000 7ff46ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff4780b6690 0x7ff478144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:51360/0 (socket says 172.21.15.37:51360) 2023-12-19T16:07:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.832+0000 7ff46ffff640 1 -- 172.21.15.37:0/1250398185 learned_addr learned my addr 172.21.15.37:0/1250398185 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.832+0000 7ff46ffff640 1 -- 172.21.15.37:0/1250398185 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff478144cd0 msgr2=0x7ff478155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.832+0000 7ff46ffff640 1 --2- 172.21.15.37:0/1250398185 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff478144cd0 0x7ff478155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.832+0000 7ff46ffff640 1 -- 172.21.15.37:0/1250398185 >> v1:172.21.15.78:6789/0 conn(0x7ff4780bcdd0 legacy=0x7ff4780b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.832+0000 7ff475d9b640 1 -- 172.21.15.37:0/1250398185 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994104109 0 0) 0x7ff4780bc6b0 con 0x7ff4780bcdd0 2023-12-19T16:07:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.832+0000 7ff46ffff640 1 -- 172.21.15.37:0/1250398185 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4780bc340 con 0x7ff4780b6690 2023-12-19T16:07:23.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.833+0000 7ff46ffff640 1 --2- 172.21.15.37:0/1250398185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4780b6690 0x7ff478144790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff460009870 tx=0x7ff46002ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23838b63945adcfd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:23.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.833+0000 7ff475d9b640 1 -- 172.21.15.37:0/1250398185 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46002f840 con 0x7ff4780b6690 2023-12-19T16:07:23.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.833+0000 7ff475d9b640 1 -- 172.21.15.37:0/1250398185 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46002f9a0 con 0x7ff4780b6690 2023-12-19T16:07:23.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.833+0000 7ff475d9b640 1 -- 172.21.15.37:0/1250398185 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46002fd30 con 0x7ff4780b6690 2023-12-19T16:07:23.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.833+0000 7ff47c869640 1 -- 172.21.15.37:0/1250398185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4780b6690 msgr2=0x7ff478144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:23.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.833+0000 7ff47c869640 1 --2- 172.21.15.37:0/1250398185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4780b6690 0x7ff478144790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff460009870 tx=0x7ff46002ba20 comp rx=0 tx=0).stop 2023-12-19T16:07:23.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.833+0000 7ff47c869640 1 -- 172.21.15.37:0/1250398185 shutdown_connections 2023-12-19T16:07:23.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.833+0000 7ff47c869640 1 --2- 172.21.15.37:0/1250398185 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff478144cd0 0x7ff478155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.833+0000 7ff47c869640 1 --2- 172.21.15.37:0/1250398185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4780b6690 0x7ff478144790 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.833+0000 7ff47c869640 1 -- 172.21.15.37:0/1250398185 >> 172.21.15.37:0/1250398185 conn(0x7ff478071e60 msgr2=0x7ff4780c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:23.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.833+0000 7ff47c869640 1 -- 172.21.15.37:0/1250398185 shutdown_connections 2023-12-19T16:07:23.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.833+0000 7ff47c869640 1 -- 172.21.15.37:0/1250398185 wait complete. 2023-12-19T16:07:23.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.835+0000 7ff47c869640 1 Processor -- start 2023-12-19T16:07:23.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.835+0000 7ff47c869640 1 -- start start 2023-12-19T16:07:23.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.835+0000 7ff47c869640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4780b6690 0x7ff47814afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.835+0000 7ff47c869640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4780bcdd0 0x7ff478148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.835+0000 7ff47c869640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff478144cd0 0x7ff4781e3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.835+0000 7ff47c869640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47814ac70 con 0x7ff478144cd0 2023-12-19T16:07:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.835+0000 7ff47c869640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47814a0a0 con 0x7ff4780bcdd0 2023-12-19T16:07:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.835+0000 7ff47c869640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47814a340 con 0x7ff4780b6690 2023-12-19T16:07:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.835+0000 7ff476d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff478144cd0 0x7ff4781e3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.835+0000 7ff476d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff478144cd0 0x7ff4781e3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58234/0 (socket says 172.21.15.37:58234) 2023-12-19T16:07:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.835+0000 7ff476d9d640 1 -- 172.21.15.37:0/1059551132 learned_addr learned my addr 172.21.15.37:0/1059551132 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.835+0000 7ff46ffff640 1 --2- 172.21.15.37:0/1059551132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4780bcdd0 0x7ff478148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.835+0000 7ff47659c640 1 --2- 172.21.15.37:0/1059551132 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4780b6690 0x7ff47814afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.836+0000 7ff476d9d640 1 -- 172.21.15.37:0/1059551132 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4780b6690 msgr2=0x7ff47814afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.836+0000 7ff476d9d640 1 --2- 172.21.15.37:0/1059551132 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4780b6690 0x7ff47814afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.836+0000 7ff476d9d640 1 -- 172.21.15.37:0/1059551132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4780bcdd0 msgr2=0x7ff478148410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.836+0000 7ff476d9d640 1 --2- 172.21.15.37:0/1059551132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4780bcdd0 0x7ff478148410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.836+0000 7ff476d9d640 1 -- 172.21.15.37:0/1059551132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4600094d0 con 0x7ff478144cd0 2023-12-19T16:07:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.836+0000 7ff476d9d640 1 --2- 172.21.15.37:0/1059551132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff478144cd0 0x7ff4781e3400 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff47000efc0 tx=0x7ff47000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:23.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.836+0000 7ff46effd640 1 -- 172.21.15.37:0/1059551132 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff470009ba0 con 0x7ff478144cd0 2023-12-19T16:07:23.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.836+0000 7ff46effd640 1 -- 172.21.15.37:0/1059551132 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47000f040 con 0x7ff478144cd0 2023-12-19T16:07:23.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.836+0000 7ff46effd640 1 -- 172.21.15.37:0/1059551132 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4700146c0 con 0x7ff478144cd0 2023-12-19T16:07:23.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.836+0000 7ff47c869640 1 -- 172.21.15.37:0/1059551132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47814a620 con 0x7ff478144cd0 2023-12-19T16:07:23.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.836+0000 7ff47c869640 1 -- 172.21.15.37:0/1059551132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff478149c80 con 0x7ff478144cd0 2023-12-19T16:07:23.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.837+0000 7ff47c869640 1 -- 172.21.15.37:0/1059551132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47804e840 con 0x7ff478144cd0 2023-12-19T16:07:23.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.838+0000 7ff46effd640 1 -- 172.21.15.37:0/1059551132 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff470014820 con 0x7ff478144cd0 2023-12-19T16:07:23.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.838+0000 7ff46effd640 1 --2- 172.21.15.37:0/1059551132 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff45806a430 0x7ff45806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:23.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.838+0000 7ff46effd640 1 -- 172.21.15.37:0/1059551132 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff470089280 con 0x7ff478144cd0 2023-12-19T16:07:23.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.838+0000 7ff47659c640 1 --2- 172.21.15.37:0/1059551132 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff45806a430 0x7ff45806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:23.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.839+0000 7ff47659c640 1 --2- 172.21.15.37:0/1059551132 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff45806a430 0x7ff45806c8f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff468000f60 tx=0x7ff468009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:23.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:23.842+0000 7ff46effd640 1 -- 172.21.15.37:0/1059551132 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff470054920 con 0x7ff478144cd0 2023-12-19T16:07:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.018+0000 7ff47c869640 1 -- 172.21.15.37:0/1059551132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4781e3160 con 0x7ff478144cd0 2023-12-19T16:07:24.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.019+0000 7ff46effd640 1 -- 172.21.15.37:0/1059551132 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7ff470057f40 con 0x7ff478144cd0 2023-12-19T16:07:24.021 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:24.021 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:59.728935+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:06:56.758166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:06:57.635291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:07:24.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.021+0000 7ff47c869640 1 -- 172.21.15.37:0/1059551132 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff45806a430 msgr2=0x7ff45806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.021+0000 7ff47c869640 1 --2- 172.21.15.37:0/1059551132 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff45806a430 0x7ff45806c8f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff468000f60 tx=0x7ff468009040 comp rx=0 tx=0).stop 2023-12-19T16:07:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.021+0000 7ff47c869640 1 -- 172.21.15.37:0/1059551132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff478144cd0 msgr2=0x7ff4781e3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.021+0000 7ff47c869640 1 --2- 172.21.15.37:0/1059551132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff478144cd0 0x7ff4781e3400 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff47000efc0 tx=0x7ff47000c490 comp rx=0 tx=0).stop 2023-12-19T16:07:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.021+0000 7ff47c869640 1 -- 172.21.15.37:0/1059551132 shutdown_connections 2023-12-19T16:07:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.021+0000 7ff47c869640 1 --2- 172.21.15.37:0/1059551132 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff45806a430 0x7ff45806c8f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.021+0000 7ff47c869640 1 --2- 172.21.15.37:0/1059551132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff478144cd0 0x7ff4781e3400 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.021+0000 7ff47c869640 1 --2- 172.21.15.37:0/1059551132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4780bcdd0 0x7ff478148410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.021+0000 7ff47c869640 1 --2- 172.21.15.37:0/1059551132 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4780b6690 0x7ff47814afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.021+0000 7ff47c869640 1 -- 172.21.15.37:0/1059551132 >> 172.21.15.37:0/1059551132 conn(0x7ff478071e60 msgr2=0x7ff478143600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.021+0000 7ff47c869640 1 -- 172.21.15.37:0/1059551132 shutdown_connections 2023-12-19T16:07:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.021+0000 7ff47c869640 1 -- 172.21.15.37:0/1059551132 wait complete. 2023-12-19T16:07:24.035 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:06:46.684027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:06:56.758166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:06:57.635291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:07:24.035 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:07:24.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.141+0000 7fe808bc9640 1 Processor -- start 2023-12-19T16:07:24.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.141+0000 7fe808bc9640 1 -- start start 2023-12-19T16:07:24.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.142+0000 7fe808bc9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe804141c10 0x7fe80406fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.142+0000 7fe808bc9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe804147900 con 0x7fe80406f170 2023-12-19T16:07:24.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.142+0000 7fe808bc9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8040b2b40 con 0x7fe804147d90 2023-12-19T16:07:24.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.142+0000 7fe808bc9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80406fba0 con 0x7fe804141c10 2023-12-19T16:07:24.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.142+0000 7fe801d9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe80406f170 0x7fe8040b7a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34966/0 (socket says 172.21.15.37:34966) 2023-12-19T16:07:24.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.142+0000 7fe801d9b640 1 -- 172.21.15.37:0/3652664830 learned_addr learned my addr 172.21.15.37:0/3652664830 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:24.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.142+0000 7fe80259c640 1 --2- 172.21.15.37:0/3652664830 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe804141c10 0x7fe80406fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.142+0000 7fe80159a640 1 -- 172.21.15.37:0/3652664830 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715852140 0 0) 0x7fe804147900 con 0x7fe80406f170 2023-12-19T16:07:24.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.142+0000 7fe80159a640 1 -- 172.21.15.37:0/3652664830 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7f0003520 con 0x7fe80406f170 2023-12-19T16:07:24.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.142+0000 7fe80159a640 1 -- 172.21.15.37:0/3652664830 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1401966473 0 0) 0x7fe7f0003520 con 0x7fe80406f170 2023-12-19T16:07:24.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe80159a640 1 -- 172.21.15.37:0/3652664830 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe804141c10 msgr2=0x7fe80406fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:24.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe80159a640 1 --2- 172.21.15.37:0/3652664830 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe804141c10 0x7fe80406fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe80159a640 1 -- 172.21.15.37:0/3652664830 >> v1:172.21.15.78:6789/0 conn(0x7fe804147d90 legacy=0x7fe8041520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe80159a640 1 -- 172.21.15.37:0/3652664830 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8040b8160 con 0x7fe80406f170 2023-12-19T16:07:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe80159a640 1 -- 172.21.15.37:0/3652664830 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7fe7ec001670 con 0x7fe80406f170 2023-12-19T16:07:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe80159a640 1 -- 172.21.15.37:0/3652664830 >> v1:172.21.15.37:6789/0 conn(0x7fe80406f170 legacy=0x7fe8040b7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe80159a640 1 --2- 172.21.15.37:0/3652664830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7f00039a0 0x7fe7f0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe80159a640 1 --2- 172.21.15.37:0/3652664830 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe804141c10 0x7fe7f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe80159a640 1 --2- 172.21.15.37:0/3652664830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7f0004d00 0x7fe7f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe80159a640 1 -- 172.21.15.37:0/3652664830 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f000ba30 con 0x7fe7f00039a0 2023-12-19T16:07:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe80159a640 1 -- 172.21.15.37:0/3652664830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f000bb70 con 0x7fe7f0004d00 2023-12-19T16:07:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe80159a640 1 -- 172.21.15.37:0/3652664830 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f000df40 con 0x7fe804141c10 2023-12-19T16:07:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe80259c640 1 --2- 172.21.15.37:0/3652664830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7f00039a0 0x7fe7f0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe801d9b640 1 --2- 172.21.15.37:0/3652664830 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe804141c10 0x7fe7f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe802d9d640 1 --2- 172.21.15.37:0/3652664830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7f0004d00 0x7fe7f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe80259c640 1 -- 172.21.15.37:0/3652664830 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe804141c10 msgr2=0x7fe7f00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe80259c640 1 --2- 172.21.15.37:0/3652664830 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe804141c10 0x7fe7f00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe80259c640 1 -- 172.21.15.37:0/3652664830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7f0004d00 msgr2=0x7fe7f0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe80259c640 1 --2- 172.21.15.37:0/3652664830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7f0004d00 0x7fe7f0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.143+0000 7fe80259c640 1 -- 172.21.15.37:0/3652664830 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f0003520 con 0x7fe7f00039a0 2023-12-19T16:07:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.144+0000 7fe80259c640 1 --2- 172.21.15.37:0/3652664830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7f00039a0 0x7fe7f0003d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc009ac0 tx=0x7fe7f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d15fee7c9d81f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.144+0000 7fe80159a640 1 -- 172.21.15.37:0/3652664830 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc02c6b0 con 0x7fe7f00039a0 2023-12-19T16:07:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.144+0000 7fe80159a640 1 -- 172.21.15.37:0/3652664830 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc02c810 con 0x7fe7f00039a0 2023-12-19T16:07:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.144+0000 7fe80159a640 1 -- 172.21.15.37:0/3652664830 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc02cba0 con 0x7fe7f00039a0 2023-12-19T16:07:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.144+0000 7fe808bc9640 1 -- 172.21.15.37:0/3652664830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7f00039a0 msgr2=0x7fe7f0003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.144+0000 7fe808bc9640 1 --2- 172.21.15.37:0/3652664830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7f00039a0 0x7fe7f0003d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc009ac0 tx=0x7fe7f00057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.144+0000 7fe802d9d640 1 -- 172.21.15.37:0/3652664830 reap_dead start 2023-12-19T16:07:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.144+0000 7fe808bc9640 1 -- 172.21.15.37:0/3652664830 shutdown_connections 2023-12-19T16:07:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.144+0000 7fe808bc9640 1 -- 172.21.15.37:0/3652664830 >> 172.21.15.37:0/3652664830 conn(0x7fe8040b8a40 msgr2=0x7fe8040b8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.145+0000 7fe808bc9640 1 -- 172.21.15.37:0/3652664830 shutdown_connections 2023-12-19T16:07:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.145+0000 7fe808bc9640 1 -- 172.21.15.37:0/3652664830 wait complete. 2023-12-19T16:07:24.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.146+0000 7fe808bc9640 1 Processor -- start 2023-12-19T16:07:24.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.146+0000 7fe808bc9640 1 -- start start 2023-12-19T16:07:24.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.146+0000 7fe808bc9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7f00039a0 0x7fe80413c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.146+0000 7fe808bc9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe804147140 0x7fe8040b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.146+0000 7fe808bc9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe804142860 0x7fe8040b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.146+0000 7fe808bc9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe804140f90 con 0x7fe804147140 2023-12-19T16:07:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.146+0000 7fe808bc9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80413ccb0 con 0x7fe804142860 2023-12-19T16:07:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.146+0000 7fe808bc9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8041475d0 con 0x7fe7f00039a0 2023-12-19T16:07:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.146+0000 7fe801d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe804147140 0x7fe8040b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.146+0000 7fe801d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe804147140 0x7fe8040b52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58240/0 (socket says 172.21.15.37:58240) 2023-12-19T16:07:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.146+0000 7fe801d9b640 1 -- 172.21.15.37:0/973624020 learned_addr learned my addr 172.21.15.37:0/973624020 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.147+0000 7fe80259c640 1 --2- 172.21.15.37:0/973624020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7f00039a0 0x7fe80413c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.147+0000 7fe802d9d640 1 --2- 172.21.15.37:0/973624020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe804142860 0x7fe8040b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.147+0000 7fe801d9b640 1 -- 172.21.15.37:0/973624020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7f00039a0 msgr2=0x7fe80413c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.147+0000 7fe801d9b640 1 --2- 172.21.15.37:0/973624020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7f00039a0 0x7fe80413c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.147+0000 7fe801d9b640 1 -- 172.21.15.37:0/973624020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe804142860 msgr2=0x7fe8040b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.147+0000 7fe801d9b640 1 --2- 172.21.15.37:0/973624020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe804142860 0x7fe8040b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.147+0000 7fe801d9b640 1 -- 172.21.15.37:0/973624020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe804142db0 con 0x7fe804147140 2023-12-19T16:07:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.147+0000 7fe802d9d640 1 --2- 172.21.15.37:0/973624020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe804142860 0x7fe8040b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.147+0000 7fe80259c640 1 --2- 172.21.15.37:0/973624020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7f00039a0 0x7fe80413c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.147+0000 7fe801d9b640 1 --2- 172.21.15.37:0/973624020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe804147140 0x7fe8040b52b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0070b0 tx=0x7fe7ec007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.147+0000 7fe7faffd640 1 -- 172.21.15.37:0/973624020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec001430 con 0x7fe804147140 2023-12-19T16:07:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.147+0000 7fe7faffd640 1 -- 172.21.15.37:0/973624020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ec00f940 con 0x7fe804147140 2023-12-19T16:07:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.147+0000 7fe7faffd640 1 -- 172.21.15.37:0/973624020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec00fcd0 con 0x7fe804147140 2023-12-19T16:07:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.147+0000 7fe808bc9640 1 -- 172.21.15.37:0/973624020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8041408d0 con 0x7fe804147140 2023-12-19T16:07:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.147+0000 7fe808bc9640 1 -- 172.21.15.37:0/973624020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80413e160 con 0x7fe804147140 2023-12-19T16:07:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.148+0000 7fe808bc9640 1 -- 172.21.15.37:0/973624020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8041410d0 con 0x7fe804147140 2023-12-19T16:07:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.148+0000 7fe7faffd640 1 -- 172.21.15.37:0/973624020 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe7ec01d460 con 0x7fe804147140 2023-12-19T16:07:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.149+0000 7fe7faffd640 1 --2- 172.21.15.37:0/973624020 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe7e406a430 0x7fe7e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.149+0000 7fe7faffd640 1 -- 172.21.15.37:0/973624020 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7ec088a60 con 0x7fe804147140 2023-12-19T16:07:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.149+0000 7fe80259c640 1 --2- 172.21.15.37:0/973624020 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe7e406a430 0x7fe7e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.150+0000 7fe80259c640 1 --2- 172.21.15.37:0/973624020 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe7e406a430 0x7fe7e406c8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc036000 tx=0x7fe7fc030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:24.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.153+0000 7fe7faffd640 1 -- 172.21.15.37:0/973624020 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe8041410d0 con 0x7fe804147140 2023-12-19T16:07:24.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.329+0000 7fe808bc9640 1 -- 172.21.15.37:0/973624020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8041410d0 con 0x7fe804147140 2023-12-19T16:07:24.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.329+0000 7fe7faffd640 1 -- 172.21.15.37:0/973624020 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8041410d0 con 0x7fe804147140 2023-12-19T16:07:24.331 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-19T16:07:24.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.331+0000 7fe808bc9640 1 -- 172.21.15.37:0/973624020 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe7e406a430 msgr2=0x7fe7e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.331+0000 7fe808bc9640 1 --2- 172.21.15.37:0/973624020 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe7e406a430 0x7fe7e406c8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc036000 tx=0x7fe7fc030000 comp rx=0 tx=0).stop 2023-12-19T16:07:24.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.331+0000 7fe808bc9640 1 -- 172.21.15.37:0/973624020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe804147140 msgr2=0x7fe8040b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.331+0000 7fe808bc9640 1 --2- 172.21.15.37:0/973624020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe804147140 0x7fe8040b52b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0070b0 tx=0x7fe7ec007570 comp rx=0 tx=0).stop 2023-12-19T16:07:24.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.331+0000 7fe808bc9640 1 -- 172.21.15.37:0/973624020 shutdown_connections 2023-12-19T16:07:24.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.331+0000 7fe808bc9640 1 --2- 172.21.15.37:0/973624020 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe7e406a430 0x7fe7e406c8f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.331+0000 7fe808bc9640 1 --2- 172.21.15.37:0/973624020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe804142860 0x7fe8040b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.331+0000 7fe808bc9640 1 --2- 172.21.15.37:0/973624020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe804147140 0x7fe8040b52b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.331+0000 7fe808bc9640 1 --2- 172.21.15.37:0/973624020 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe7f00039a0 0x7fe80413c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.331+0000 7fe808bc9640 1 -- 172.21.15.37:0/973624020 >> 172.21.15.37:0/973624020 conn(0x7fe8040b8a40 msgr2=0x7fe8040b9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:24.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.331+0000 7fe808bc9640 1 -- 172.21.15.37:0/973624020 shutdown_connections 2023-12-19T16:07:24.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.331+0000 7fe808bc9640 1 -- 172.21.15.37:0/973624020 wait complete. 2023-12-19T16:07:24.344 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:07:24.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.452+0000 7f04c860b640 1 Processor -- start 2023-12-19T16:07:24.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.452+0000 7f04c860b640 1 -- start start 2023-12-19T16:07:24.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.453+0000 7f04c860b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04c00bb140 0x7f04c00be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.453+0000 7f04c860b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f04c00bf510 0x7f04c00bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.453+0000 7f04c860b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c00bfa50 con 0x7f04c006a950 2023-12-19T16:07:24.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.453+0000 7f04c860b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c00bbda0 con 0x7f04c00bb140 2023-12-19T16:07:24.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.453+0000 7f04c860b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c006b040 con 0x7f04c00bf510 2023-12-19T16:07:24.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.453+0000 7f04c63a7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04c00bb140 0x7f04c00be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.453+0000 7f04c63a7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04c00bb140 0x7f04c00be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58254/0 (socket says 172.21.15.37:58254) 2023-12-19T16:07:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.453+0000 7f04c5ba6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f04c006a950 0x7f04c00bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34972/0 (socket says 172.21.15.37:34972) 2023-12-19T16:07:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.453+0000 7f04c63a7640 1 -- 172.21.15.37:0/395942925 learned_addr learned my addr 172.21.15.37:0/395942925 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.453+0000 7f04c6ba8640 1 --2- 172.21.15.37:0/395942925 >> v2:172.21.15.78:3300/0 conn(0x7f04c00bf510 0x7f04c00bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.453+0000 7f04c63a7640 1 -- 172.21.15.37:0/395942925 >> v2:172.21.15.78:3300/0 conn(0x7f04c00bf510 msgr2=0x7f04c00bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.453+0000 7f04c63a7640 1 --2- 172.21.15.37:0/395942925 >> v2:172.21.15.78:3300/0 conn(0x7f04c00bf510 0x7f04c00bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.453+0000 7f04c63a7640 1 -- 172.21.15.37:0/395942925 >> v1:172.21.15.37:6789/0 conn(0x7f04c006a950 legacy=0x7f04c00bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.453+0000 7f04c63a7640 1 -- 172.21.15.37:0/395942925 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c00bb520 con 0x7f04c00bb140 2023-12-19T16:07:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.454+0000 7f04c63a7640 1 --2- 172.21.15.37:0/395942925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c00bb140 0x7f04c00be350 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f04c00b75b0 tx=0x7f04b802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3de1e97e7e193b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.454+0000 7f04c53a5640 1 -- 172.21.15.37:0/395942925 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b8031870 con 0x7f04c00bb140 2023-12-19T16:07:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.454+0000 7f04c53a5640 1 -- 172.21.15.37:0/395942925 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b80319d0 con 0x7f04c00bb140 2023-12-19T16:07:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.454+0000 7f04c53a5640 1 -- 172.21.15.37:0/395942925 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b8031d60 con 0x7f04c00bb140 2023-12-19T16:07:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.455+0000 7f04c860b640 1 -- 172.21.15.37:0/395942925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c00bb140 msgr2=0x7f04c00be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.455+0000 7f04c860b640 1 --2- 172.21.15.37:0/395942925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c00bb140 0x7f04c00be350 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f04c00b75b0 tx=0x7f04b802b910 comp rx=0 tx=0).stop 2023-12-19T16:07:24.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.455+0000 7f04c860b640 1 -- 172.21.15.37:0/395942925 shutdown_connections 2023-12-19T16:07:24.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.455+0000 7f04c860b640 1 --2- 172.21.15.37:0/395942925 >> v2:172.21.15.78:3300/0 conn(0x7f04c00bf510 0x7f04c00bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.455+0000 7f04c860b640 1 --2- 172.21.15.37:0/395942925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c00bb140 0x7f04c00be350 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.455+0000 7f04c860b640 1 -- 172.21.15.37:0/395942925 >> 172.21.15.37:0/395942925 conn(0x7f04c00bcfd0 msgr2=0x7f04c00bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:24.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.455+0000 7f04c860b640 1 -- 172.21.15.37:0/395942925 shutdown_connections 2023-12-19T16:07:24.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.455+0000 7f04c860b640 1 -- 172.21.15.37:0/395942925 wait complete. 2023-12-19T16:07:24.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.456+0000 7f04c860b640 1 Processor -- start 2023-12-19T16:07:24.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.456+0000 7f04c860b640 1 -- start start 2023-12-19T16:07:24.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c860b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c006a950 0x7f04c014c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c860b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f04c00bb140 0x7f04c014dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c860b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04c00bf510 0x7f04c00a22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c860b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c014efe0 con 0x7f04c006a950 2023-12-19T16:07:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c860b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c014d560 con 0x7f04c00bf510 2023-12-19T16:07:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c860b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c014e980 con 0x7f04c00bb140 2023-12-19T16:07:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c63a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c006a950 0x7f04c014c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c63a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c006a950 0x7f04c014c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58268/0 (socket says 172.21.15.37:58268) 2023-12-19T16:07:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c63a7640 1 -- 172.21.15.37:0/1845581079 learned_addr learned my addr 172.21.15.37:0/1845581079 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c6ba8640 1 --2- 172.21.15.37:0/1845581079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04c00bf510 0x7f04c00a22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c5ba6640 1 --2- 172.21.15.37:0/1845581079 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f04c00bb140 0x7f04c014dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c63a7640 1 -- 172.21.15.37:0/1845581079 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f04c00bb140 msgr2=0x7f04c014dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c63a7640 1 --2- 172.21.15.37:0/1845581079 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f04c00bb140 0x7f04c014dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c63a7640 1 -- 172.21.15.37:0/1845581079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04c00bf510 msgr2=0x7f04c00a22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c63a7640 1 --2- 172.21.15.37:0/1845581079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04c00bf510 0x7f04c00a22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c63a7640 1 -- 172.21.15.37:0/1845581079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b80094d0 con 0x7f04c006a950 2023-12-19T16:07:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c6ba8640 1 --2- 172.21.15.37:0/1845581079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04c00bf510 0x7f04c00a22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c63a7640 1 --2- 172.21.15.37:0/1845581079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c006a950 0x7f04c014c9b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f04b802b950 tx=0x7f04b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04b6ffd640 1 -- 172.21.15.37:0/1845581079 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b803ad30 con 0x7f04c006a950 2023-12-19T16:07:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04b6ffd640 1 -- 172.21.15.37:0/1845581079 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b80443f0 con 0x7f04c006a950 2023-12-19T16:07:24.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c860b640 1 -- 172.21.15.37:0/1845581079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c014d280 con 0x7f04c006a950 2023-12-19T16:07:24.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04b6ffd640 1 -- 172.21.15.37:0/1845581079 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b80447a0 con 0x7f04c006a950 2023-12-19T16:07:24.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.457+0000 7f04c860b640 1 -- 172.21.15.37:0/1845581079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c014cef0 con 0x7f04c006a950 2023-12-19T16:07:24.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.458+0000 7f04c860b640 1 -- 172.21.15.37:0/1845581079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c00740a0 con 0x7f04c006a950 2023-12-19T16:07:24.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.459+0000 7f04b6ffd640 1 -- 172.21.15.37:0/1845581079 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f04b804d450 con 0x7f04c006a950 2023-12-19T16:07:24.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.459+0000 7f04b6ffd640 1 --2- 172.21.15.37:0/1845581079 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f04a406a460 0x7f04a406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.460+0000 7f04b6ffd640 1 -- 172.21.15.37:0/1845581079 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04b802d040 con 0x7f04c006a950 2023-12-19T16:07:24.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.460+0000 7f04c5ba6640 1 --2- 172.21.15.37:0/1845581079 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f04a406a460 0x7f04a406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.460+0000 7f04c5ba6640 1 --2- 172.21.15.37:0/1845581079 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f04a406a460 0x7f04a406c920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f04c0144970 tx=0x7f04b0007c80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:24.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.464+0000 7f04b6ffd640 1 -- 172.21.15.37:0/1845581079 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f04b8076480 con 0x7f04c006a950 2023-12-19T16:07:24.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.641+0000 7f04c860b640 1 -- 172.21.15.37:0/1845581079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f04c00ba4a0 con 0x7f04c006a950 2023-12-19T16:07:24.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.641+0000 7f04b6ffd640 1 -- 172.21.15.37:0/1845581079 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f04b8035020 con 0x7f04c006a950 2023-12-19T16:07:24.643 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-19T16:07:24.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.643+0000 7f04c860b640 1 -- 172.21.15.37:0/1845581079 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f04a406a460 msgr2=0x7f04a406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.643+0000 7f04c860b640 1 --2- 172.21.15.37:0/1845581079 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f04a406a460 0x7f04a406c920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f04c0144970 tx=0x7f04b0007c80 comp rx=0 tx=0).stop 2023-12-19T16:07:24.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.643+0000 7f04c860b640 1 -- 172.21.15.37:0/1845581079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c006a950 msgr2=0x7f04c014c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.643+0000 7f04c860b640 1 --2- 172.21.15.37:0/1845581079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c006a950 0x7f04c014c9b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f04b802b950 tx=0x7f04b80046c0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.643+0000 7f04c860b640 1 -- 172.21.15.37:0/1845581079 shutdown_connections 2023-12-19T16:07:24.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.643+0000 7f04c860b640 1 --2- 172.21.15.37:0/1845581079 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f04a406a460 0x7f04a406c920 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.643+0000 7f04c860b640 1 --2- 172.21.15.37:0/1845581079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04c00bf510 0x7f04c00a22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.643+0000 7f04c860b640 1 --2- 172.21.15.37:0/1845581079 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f04c00bb140 0x7f04c014dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.643+0000 7f04c860b640 1 --2- 172.21.15.37:0/1845581079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c006a950 0x7f04c014c9b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.643+0000 7f04c860b640 1 -- 172.21.15.37:0/1845581079 >> 172.21.15.37:0/1845581079 conn(0x7f04c00bcfd0 msgr2=0x7f04c00a5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:24.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.643+0000 7f04c860b640 1 -- 172.21.15.37:0/1845581079 shutdown_connections 2023-12-19T16:07:24.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.643+0000 7f04c860b640 1 -- 172.21.15.37:0/1845581079 wait complete. 2023-12-19T16:07:24.655 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:07:24.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.761+0000 7f334b99c640 1 Processor -- start 2023-12-19T16:07:24.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.762+0000 7f334b99c640 1 -- start start 2023-12-19T16:07:24.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.762+0000 7f334b99c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3344142d90 0x7f33440baad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.762+0000 7f334b99c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33440b9740 0x7f3344153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.762+0000 7f334b99c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33440b4430 con 0x7f33440b1f60 2023-12-19T16:07:24.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.762+0000 7f334b99c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33440b3bd0 con 0x7f3344142d90 2023-12-19T16:07:24.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.762+0000 7f334b99c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33440bb010 con 0x7f33440b9740 2023-12-19T16:07:24.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.762+0000 7f3349738640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3344142d90 0x7f33440baad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.762+0000 7f3349738640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3344142d90 0x7f33440baad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58272/0 (socket says 172.21.15.37:58272) 2023-12-19T16:07:24.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.762+0000 7f3349738640 1 -- 172.21.15.37:0/2939616772 learned_addr learned my addr 172.21.15.37:0/2939616772 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:24.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.762+0000 7f3349f39640 1 --2- 172.21.15.37:0/2939616772 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33440b9740 0x7f3344153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.763+0000 7f3349738640 1 -- 172.21.15.37:0/2939616772 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33440b9740 msgr2=0x7f3344153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:24.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.763+0000 7f3349738640 1 --2- 172.21.15.37:0/2939616772 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33440b9740 0x7f3344153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.763+0000 7f3349738640 1 -- 172.21.15.37:0/2939616772 >> v1:172.21.15.78:6789/0 conn(0x7f33440b1f60 legacy=0x7f33440b9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.763+0000 7f3349738640 1 -- 172.21.15.37:0/2939616772 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3344143170 con 0x7f3344142d90 2023-12-19T16:07:24.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.763+0000 7f3349738640 1 --2- 172.21.15.37:0/2939616772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3344142d90 0x7f33440baad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3340009870 tx=0x7f334002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b42942bf311b655 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:24.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.763+0000 7f333bfff640 1 -- 172.21.15.37:0/2939616772 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334002f840 con 0x7f3344142d90 2023-12-19T16:07:24.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.764+0000 7f333bfff640 1 -- 172.21.15.37:0/2939616772 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334002f9a0 con 0x7f3344142d90 2023-12-19T16:07:24.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.764+0000 7f333bfff640 1 -- 172.21.15.37:0/2939616772 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334002fd30 con 0x7f3344142d90 2023-12-19T16:07:24.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.764+0000 7f334b99c640 1 -- 172.21.15.37:0/2939616772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3344142d90 msgr2=0x7f33440baad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.764+0000 7f334b99c640 1 --2- 172.21.15.37:0/2939616772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3344142d90 0x7f33440baad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3340009870 tx=0x7f334002ba20 comp rx=0 tx=0).stop 2023-12-19T16:07:24.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.764+0000 7f334b99c640 1 -- 172.21.15.37:0/2939616772 shutdown_connections 2023-12-19T16:07:24.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.764+0000 7f334b99c640 1 --2- 172.21.15.37:0/2939616772 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f33440b9740 0x7f3344153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.764+0000 7f334b99c640 1 --2- 172.21.15.37:0/2939616772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3344142d90 0x7f33440baad0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.764+0000 7f334b99c640 1 -- 172.21.15.37:0/2939616772 >> 172.21.15.37:0/2939616772 conn(0x7f33440be0c0 msgr2=0x7f33440be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:24.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.764+0000 7f334b99c640 1 -- 172.21.15.37:0/2939616772 shutdown_connections 2023-12-19T16:07:24.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.764+0000 7f334b99c640 1 -- 172.21.15.37:0/2939616772 wait complete. 2023-12-19T16:07:24.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.765+0000 7f334b99c640 1 Processor -- start 2023-12-19T16:07:24.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.765+0000 7f334b99c640 1 -- start start 2023-12-19T16:07:24.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.766+0000 7f334b99c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33440b1f60 0x7f33440b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.766+0000 7f334b99c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33440b9740 0x7f3344145770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.766+0000 7f334b99c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3344142d90 0x7f33441de740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.766+0000 7f334b99c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3344146830 con 0x7f33440b9740 2023-12-19T16:07:24.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.766+0000 7f334b99c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33441de2a0 con 0x7f33440b1f60 2023-12-19T16:07:24.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.766+0000 7f334b99c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3344146a80 con 0x7f3344142d90 2023-12-19T16:07:24.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.766+0000 7f3348f37640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33440b9740 0x7f3344145770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.766+0000 7f3348f37640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33440b9740 0x7f3344145770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58276/0 (socket says 172.21.15.37:58276) 2023-12-19T16:07:24.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.766+0000 7f3348f37640 1 -- 172.21.15.37:0/1343837044 learned_addr learned my addr 172.21.15.37:0/1343837044 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:24.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.766+0000 7f3349738640 1 --2- 172.21.15.37:0/1343837044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33440b1f60 0x7f33440b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.766+0000 7f3349f39640 1 --2- 172.21.15.37:0/1343837044 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3344142d90 0x7f33441de740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.766+0000 7f3348f37640 1 -- 172.21.15.37:0/1343837044 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3344142d90 msgr2=0x7f33441de740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.766+0000 7f3348f37640 1 --2- 172.21.15.37:0/1343837044 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3344142d90 0x7f33441de740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.766+0000 7f3348f37640 1 -- 172.21.15.37:0/1343837044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33440b1f60 msgr2=0x7f33440b7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.766+0000 7f3348f37640 1 --2- 172.21.15.37:0/1343837044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33440b1f60 0x7f33440b7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.766+0000 7f3348f37640 1 -- 172.21.15.37:0/1343837044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33400094d0 con 0x7f33440b9740 2023-12-19T16:07:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.766+0000 7f3348f37640 1 --2- 172.21.15.37:0/1343837044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33440b9740 0x7f3344145770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f333400c400 tx=0x7f333400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.766+0000 7f3339ffb640 1 -- 172.21.15.37:0/1343837044 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33340052d0 con 0x7f33440b9740 2023-12-19T16:07:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.767+0000 7f3339ffb640 1 -- 172.21.15.37:0/1343837044 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3334005450 con 0x7f33440b9740 2023-12-19T16:07:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.767+0000 7f334b99c640 1 -- 172.21.15.37:0/1343837044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3344146d60 con 0x7f33440b9740 2023-12-19T16:07:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.767+0000 7f3339ffb640 1 -- 172.21.15.37:0/1343837044 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3334007260 con 0x7f33440b9740 2023-12-19T16:07:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.767+0000 7f334b99c640 1 -- 172.21.15.37:0/1343837044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3344145e90 con 0x7f33440b9740 2023-12-19T16:07:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.768+0000 7f334b99c640 1 -- 172.21.15.37:0/1343837044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33440b2fc0 con 0x7f33440b9740 2023-12-19T16:07:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.768+0000 7f3339ffb640 1 -- 172.21.15.37:0/1343837044 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f33340073c0 con 0x7f33440b9740 2023-12-19T16:07:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.768+0000 7f3339ffb640 1 --2- 172.21.15.37:0/1343837044 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f332806a430 0x7f332806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.769+0000 7f3339ffb640 1 -- 172.21.15.37:0/1343837044 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3334087c20 con 0x7f33440b9740 2023-12-19T16:07:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.769+0000 7f3349738640 1 --2- 172.21.15.37:0/1343837044 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f332806a430 0x7f332806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:24.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.769+0000 7f3349738640 1 --2- 172.21.15.37:0/1343837044 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f332806a430 0x7f332806c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3340036000 tx=0x7f3340008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:24.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.773+0000 7f3339ffb640 1 -- 172.21.15.37:0/1343837044 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3334053350 con 0x7f33440b9740 2023-12-19T16:07:24.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.947+0000 7f334b99c640 1 -- 172.21.15.37:0/1343837044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f334413e140 con 0x7f33440b9740 2023-12-19T16:07:24.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.947+0000 7f3339ffb640 1 -- 172.21.15.37:0/1343837044 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3334056970 con 0x7f33440b9740 2023-12-19T16:07:24.950 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-19T16:07:24.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.949+0000 7f334b99c640 1 -- 172.21.15.37:0/1343837044 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f332806a430 msgr2=0x7f332806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.949+0000 7f334b99c640 1 --2- 172.21.15.37:0/1343837044 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f332806a430 0x7f332806c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3340036000 tx=0x7f3340008030 comp rx=0 tx=0).stop 2023-12-19T16:07:24.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.949+0000 7f334b99c640 1 -- 172.21.15.37:0/1343837044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33440b9740 msgr2=0x7f3344145770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:24.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.949+0000 7f334b99c640 1 --2- 172.21.15.37:0/1343837044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33440b9740 0x7f3344145770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f333400c400 tx=0x7f333400c8c0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.949+0000 7f334b99c640 1 -- 172.21.15.37:0/1343837044 shutdown_connections 2023-12-19T16:07:24.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.949+0000 7f334b99c640 1 --2- 172.21.15.37:0/1343837044 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f332806a430 0x7f332806c8f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.949+0000 7f334b99c640 1 --2- 172.21.15.37:0/1343837044 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3344142d90 0x7f33441de740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.949+0000 7f334b99c640 1 --2- 172.21.15.37:0/1343837044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33440b9740 0x7f3344145770 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.949+0000 7f334b99c640 1 --2- 172.21.15.37:0/1343837044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33440b1f60 0x7f33440b7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.949+0000 7f334b99c640 1 -- 172.21.15.37:0/1343837044 >> 172.21.15.37:0/1343837044 conn(0x7f33440be0c0 msgr2=0x7f334413da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.950+0000 7f334b99c640 1 -- 172.21.15.37:0/1343837044 shutdown_connections 2023-12-19T16:07:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:24.950+0000 7f334b99c640 1 -- 172.21.15.37:0/1343837044 wait complete. 2023-12-19T16:07:24.973 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-19T16:07:24.974 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2023-12-19T16:07:25.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.078+0000 7f5f38347640 1 Processor -- start 2023-12-19T16:07:25.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.078+0000 7f5f38347640 1 -- start start 2023-12-19T16:07:25.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.079+0000 7f5f38347640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f300b68d0 0x7f5f30071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:25.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.079+0000 7f5f38347640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f30070660 con 0x7f5f30142cc0 2023-12-19T16:07:25.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.079+0000 7f5f38347640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3006fc10 con 0x7f5f3006aca0 2023-12-19T16:07:25.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.079+0000 7f5f38347640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3006a8f0 con 0x7f5f300b68d0 2023-12-19T16:07:25.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.079+0000 7f5f368e4640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5f30142cc0 0x7f5f30153120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34984/0 (socket says 172.21.15.37:34984) 2023-12-19T16:07:25.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.079+0000 7f5f368e4640 1 -- 172.21.15.37:0/3933808915 learned_addr learned my addr 172.21.15.37:0/3933808915 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:25.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.079+0000 7f5f360e3640 1 --2- 172.21.15.37:0/3933808915 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f300b68d0 0x7f5f30071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:25.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.080+0000 7f5f350e1640 1 -- 172.21.15.37:0/3933808915 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243769801 0 0) 0x7f5f28001490 con 0x7f5f30142cc0 2023-12-19T16:07:25.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.080+0000 7f5f350e1640 1 -- 172.21.15.37:0/3933808915 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f1c003520 con 0x7f5f30142cc0 2023-12-19T16:07:25.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.080+0000 7f5f350e1640 1 -- 172.21.15.37:0/3933808915 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598694391 0 0) 0x7f5f3006fc10 con 0x7f5f3006aca0 2023-12-19T16:07:25.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.080+0000 7f5f350e1640 1 -- 172.21.15.37:0/3933808915 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f28001490 con 0x7f5f3006aca0 2023-12-19T16:07:25.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.080+0000 7f5f360e3640 1 -- 172.21.15.37:0/3933808915 >> v1:172.21.15.78:6789/0 conn(0x7f5f3006aca0 legacy=0x7f5f301425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:25.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.080+0000 7f5f360e3640 1 -- 172.21.15.37:0/3933808915 >> v1:172.21.15.37:6789/0 conn(0x7f5f30142cc0 legacy=0x7f5f30153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:25.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.080+0000 7f5f360e3640 1 -- 172.21.15.37:0/3933808915 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f30071640 con 0x7f5f300b68d0 2023-12-19T16:07:25.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.081+0000 7f5f360e3640 1 --2- 172.21.15.37:0/3933808915 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f300b68d0 0x7f5f30071100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5f240097d0 tx=0x7f5f2402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3492318b819d6e0c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:25.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.081+0000 7f5f350e1640 1 -- 172.21.15.37:0/3933808915 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24031890 con 0x7f5f300b68d0 2023-12-19T16:07:25.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.081+0000 7f5f350e1640 1 -- 172.21.15.37:0/3933808915 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f240319f0 con 0x7f5f300b68d0 2023-12-19T16:07:25.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.081+0000 7f5f350e1640 1 -- 172.21.15.37:0/3933808915 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24031d80 con 0x7f5f300b68d0 2023-12-19T16:07:25.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.081+0000 7f5f38347640 1 -- 172.21.15.37:0/3933808915 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f300b68d0 msgr2=0x7f5f30071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:25.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.081+0000 7f5f38347640 1 --2- 172.21.15.37:0/3933808915 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f300b68d0 0x7f5f30071100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5f240097d0 tx=0x7f5f2402b930 comp rx=0 tx=0).stop 2023-12-19T16:07:25.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.081+0000 7f5f38347640 1 -- 172.21.15.37:0/3933808915 shutdown_connections 2023-12-19T16:07:25.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.081+0000 7f5f38347640 1 --2- 172.21.15.37:0/3933808915 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f300b68d0 0x7f5f30071100 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:25.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.081+0000 7f5f38347640 1 -- 172.21.15.37:0/3933808915 >> 172.21.15.37:0/3933808915 conn(0x7f5f300b9c30 msgr2=0x7f5f300ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:25.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.081+0000 7f5f38347640 1 -- 172.21.15.37:0/3933808915 shutdown_connections 2023-12-19T16:07:25.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.081+0000 7f5f38347640 1 -- 172.21.15.37:0/3933808915 wait complete. 2023-12-19T16:07:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.082+0000 7f5f38347640 1 Processor -- start 2023-12-19T16:07:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.082+0000 7f5f38347640 1 -- start start 2023-12-19T16:07:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.083+0000 7f5f38347640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f3006aca0 0x7f5f300a8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.083+0000 7f5f38347640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f300b68d0 0x7f5f301dd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.083+0000 7f5f38347640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f30142cc0 0x7f5f300b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.083+0000 7f5f38347640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f30148cf0 con 0x7f5f3006aca0 2023-12-19T16:07:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.083+0000 7f5f38347640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f300a8b90 con 0x7f5f300b68d0 2023-12-19T16:07:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.083+0000 7f5f38347640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f301493f0 con 0x7f5f30142cc0 2023-12-19T16:07:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.083+0000 7f5f360e3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f3006aca0 0x7f5f300a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.083+0000 7f5f360e3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f3006aca0 0x7f5f300a8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58286/0 (socket says 172.21.15.37:58286) 2023-12-19T16:07:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.083+0000 7f5f360e3640 1 -- 172.21.15.37:0/726255883 learned_addr learned my addr 172.21.15.37:0/726255883 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.083+0000 7f5f368e4640 1 --2- 172.21.15.37:0/726255883 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f30142cc0 0x7f5f300b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.083+0000 7f5f358e2640 1 --2- 172.21.15.37:0/726255883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f300b68d0 0x7f5f301dd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.084+0000 7f5f360e3640 1 -- 172.21.15.37:0/726255883 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f30142cc0 msgr2=0x7f5f300b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.084+0000 7f5f360e3640 1 --2- 172.21.15.37:0/726255883 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f30142cc0 0x7f5f300b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.084+0000 7f5f360e3640 1 -- 172.21.15.37:0/726255883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f300b68d0 msgr2=0x7f5f301dd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.084+0000 7f5f360e3640 1 --2- 172.21.15.37:0/726255883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f300b68d0 0x7f5f301dd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.084+0000 7f5f360e3640 1 -- 172.21.15.37:0/726255883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f24009400 con 0x7f5f3006aca0 2023-12-19T16:07:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.084+0000 7f5f360e3640 1 --2- 172.21.15.37:0/726255883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f3006aca0 0x7f5f300a8650 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5f240098f0 tx=0x7f5f240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.084+0000 7f5f22ffd640 1 -- 172.21.15.37:0/726255883 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2403bbf0 con 0x7f5f3006aca0 2023-12-19T16:07:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.084+0000 7f5f22ffd640 1 -- 172.21.15.37:0/726255883 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2403bd90 con 0x7f5f3006aca0 2023-12-19T16:07:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.084+0000 7f5f38347640 1 -- 172.21.15.37:0/726255883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f30148150 con 0x7f5f3006aca0 2023-12-19T16:07:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.084+0000 7f5f22ffd640 1 -- 172.21.15.37:0/726255883 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f24045630 con 0x7f5f3006aca0 2023-12-19T16:07:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.084+0000 7f5f38347640 1 -- 172.21.15.37:0/726255883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f300b3290 con 0x7f5f3006aca0 2023-12-19T16:07:25.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.085+0000 7f5f38347640 1 -- 172.21.15.37:0/726255883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f300b3480 con 0x7f5f3006aca0 2023-12-19T16:07:25.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.085+0000 7f5f22ffd640 1 -- 172.21.15.37:0/726255883 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5f2404e450 con 0x7f5f3006aca0 2023-12-19T16:07:25.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.086+0000 7f5f22ffd640 1 --2- 172.21.15.37:0/726255883 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5f1406a430 0x7f5f1406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:25.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.086+0000 7f5f22ffd640 1 -- 172.21.15.37:0/726255883 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f240aacf0 con 0x7f5f3006aca0 2023-12-19T16:07:25.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.086+0000 7f5f358e2640 1 --2- 172.21.15.37:0/726255883 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5f1406a430 0x7f5f1406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:25.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.086+0000 7f5f358e2640 1 --2- 172.21.15.37:0/726255883 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5f1406a430 0x7f5f1406c8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5f30140070 tx=0x7f5f2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:25.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.090+0000 7f5f22ffd640 1 -- 172.21.15.37:0/726255883 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5f240af070 con 0x7f5f3006aca0 2023-12-19T16:07:25.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.334+0000 7f5f38347640 1 -- 172.21.15.37:0/726255883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f5f3004e840 con 0x7f5f3006aca0 2023-12-19T16:07:25.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.389+0000 7f5f22ffd640 1 -- 172.21.15.37:0/726255883 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v48) v1 ==== 166+0+0 (secure 0 0 0) 0x7f5f24079eb0 con 0x7f5f3006aca0 2023-12-19T16:07:25.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.391+0000 7f5f38347640 1 -- 172.21.15.37:0/726255883 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5f1406a430 msgr2=0x7f5f1406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:25.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.391+0000 7f5f38347640 1 --2- 172.21.15.37:0/726255883 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5f1406a430 0x7f5f1406c8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5f30140070 tx=0x7f5f2c009040 comp rx=0 tx=0).stop 2023-12-19T16:07:25.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.391+0000 7f5f38347640 1 -- 172.21.15.37:0/726255883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f3006aca0 msgr2=0x7f5f300a8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:25.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.391+0000 7f5f38347640 1 --2- 172.21.15.37:0/726255883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f3006aca0 0x7f5f300a8650 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5f240098f0 tx=0x7f5f240046c0 comp rx=0 tx=0).stop 2023-12-19T16:07:25.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.391+0000 7f5f38347640 1 -- 172.21.15.37:0/726255883 shutdown_connections 2023-12-19T16:07:25.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.391+0000 7f5f38347640 1 --2- 172.21.15.37:0/726255883 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5f1406a430 0x7f5f1406c8f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:25.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.391+0000 7f5f38347640 1 --2- 172.21.15.37:0/726255883 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f30142cc0 0x7f5f300b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:25.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.391+0000 7f5f38347640 1 --2- 172.21.15.37:0/726255883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f300b68d0 0x7f5f301dd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:25.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.391+0000 7f5f38347640 1 --2- 172.21.15.37:0/726255883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f3006aca0 0x7f5f300a8650 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:25.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.391+0000 7f5f38347640 1 -- 172.21.15.37:0/726255883 >> 172.21.15.37:0/726255883 conn(0x7f5f300b9c30 msgr2=0x7f5f300b7640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:25.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.391+0000 7f5f38347640 1 -- 172.21.15.37:0/726255883 shutdown_connections 2023-12-19T16:07:25.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.391+0000 7f5f38347640 1 -- 172.21.15.37:0/726255883 wait complete. 2023-12-19T16:07:25.404 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T16:07:25.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.511+0000 7f73053d0640 1 Processor -- start 2023-12-19T16:07:25.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.512+0000 7f73053d0640 1 -- start start 2023-12-19T16:07:25.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.512+0000 7f73053d0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f73000bad20 0x7f730014b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:25.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.512+0000 7f73053d0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7300140f70 0x7f73001413c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:25.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.512+0000 7f73053d0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730014aec0 con 0x7f73000b8370 2023-12-19T16:07:25.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.512+0000 7f73053d0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730014ab90 con 0x7f73000bad20 2023-12-19T16:07:25.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.512+0000 7f73053d0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7300141900 con 0x7f7300140f70 2023-12-19T16:07:25.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.512+0000 7f72f7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f73000bad20 0x7f730014b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:25.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.512+0000 7f72feffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f73000b8370 0x7f73000ba260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35000/0 (socket says 172.21.15.37:35000) 2023-12-19T16:07:25.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.512+0000 7f72feffd640 1 -- 172.21.15.37:0/1257873972 learned_addr learned my addr 172.21.15.37:0/1257873972 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:25.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.512+0000 7f72f7fff640 1 --2- 172.21.15.37:0/1257873972 >> v2:172.21.15.37:3300/0 conn(0x7f73000bad20 0x7f730014b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58300/0 (socket says 172.21.15.37:58300) 2023-12-19T16:07:25.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.513+0000 7f72f7fff640 1 -- 172.21.15.37:0/1257873972 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7300140f70 msgr2=0x7f73001413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:25.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.513+0000 7f72ff7fe640 1 --2- 172.21.15.37:0/1257873972 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7300140f70 0x7f73001413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:25.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.513+0000 7f72fe7fc640 1 -- 172.21.15.37:0/1257873972 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070633716 0 0) 0x7f730014aec0 con 0x7f73000b8370 2023-12-19T16:07:25.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.513+0000 7f72f7fff640 1 --2- 172.21.15.37:0/1257873972 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7300140f70 0x7f73001413c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:25.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.513+0000 7f72f7fff640 1 -- 172.21.15.37:0/1257873972 >> v1:172.21.15.37:6789/0 conn(0x7f73000b8370 legacy=0x7f73000ba260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:25.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.513+0000 7f72f7fff640 1 -- 172.21.15.37:0/1257873972 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73000b7bc0 con 0x7f73000bad20 2023-12-19T16:07:25.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.513+0000 7f72ff7fe640 1 --2- 172.21.15.37:0/1257873972 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7300140f70 0x7f73001413c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.513+0000 7f72f7fff640 1 --2- 172.21.15.37:0/1257873972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73000bad20 0x7f730014b350 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f72e80097a0 tx=0x7f72e802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c664c41b697e1e71 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.514+0000 7f72fe7fc640 1 -- 172.21.15.37:0/1257873972 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8031830 con 0x7f73000bad20 2023-12-19T16:07:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.514+0000 7f72fe7fc640 1 -- 172.21.15.37:0/1257873972 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e8031990 con 0x7f73000bad20 2023-12-19T16:07:25.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.514+0000 7f72fe7fc640 1 -- 172.21.15.37:0/1257873972 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8031d20 con 0x7f73000bad20 2023-12-19T16:07:25.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.514+0000 7f73053d0640 1 -- 172.21.15.37:0/1257873972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73000bad20 msgr2=0x7f730014b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:25.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.514+0000 7f73053d0640 1 --2- 172.21.15.37:0/1257873972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73000bad20 0x7f730014b350 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f72e80097a0 tx=0x7f72e802b8d0 comp rx=0 tx=0).stop 2023-12-19T16:07:25.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.514+0000 7f73053d0640 1 -- 172.21.15.37:0/1257873972 shutdown_connections 2023-12-19T16:07:25.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.514+0000 7f73053d0640 1 --2- 172.21.15.37:0/1257873972 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7300140f70 0x7f73001413c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:25.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.514+0000 7f73053d0640 1 --2- 172.21.15.37:0/1257873972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73000bad20 0x7f730014b350 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:25.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.514+0000 7f73053d0640 1 -- 172.21.15.37:0/1257873972 >> 172.21.15.37:0/1257873972 conn(0x7f73000c03a0 msgr2=0x7f73000c07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:25.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.514+0000 7f73053d0640 1 -- 172.21.15.37:0/1257873972 shutdown_connections 2023-12-19T16:07:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.514+0000 7f73053d0640 1 -- 172.21.15.37:0/1257873972 wait complete. 2023-12-19T16:07:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.515+0000 7f73053d0640 1 Processor -- start 2023-12-19T16:07:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.515+0000 7f73053d0640 1 -- start start 2023-12-19T16:07:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.516+0000 7f73053d0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73000b8370 0x7f7300147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.516+0000 7f73053d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73000bad20 0x7f730013beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.516+0000 7f73053d0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7300140f70 0x7f73001df5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.516+0000 7f73053d0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7300147860 con 0x7f73000bad20 2023-12-19T16:07:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.516+0000 7f73053d0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7300147a50 con 0x7f73000b8370 2023-12-19T16:07:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.516+0000 7f73053d0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73001464f0 con 0x7f7300140f70 2023-12-19T16:07:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.516+0000 7f72f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73000bad20 0x7f730013beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.516+0000 7f72f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73000bad20 0x7f730013beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58308/0 (socket says 172.21.15.37:58308) 2023-12-19T16:07:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.516+0000 7f72f7fff640 1 -- 172.21.15.37:0/2969101367 learned_addr learned my addr 172.21.15.37:0/2969101367 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.516+0000 7f72ff7fe640 1 --2- 172.21.15.37:0/2969101367 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7300140f70 0x7f73001df5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.516+0000 7f72feffd640 1 --2- 172.21.15.37:0/2969101367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73000b8370 0x7f7300147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.516+0000 7f72f7fff640 1 -- 172.21.15.37:0/2969101367 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7300140f70 msgr2=0x7f73001df5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:25.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.516+0000 7f72f7fff640 1 --2- 172.21.15.37:0/2969101367 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7300140f70 0x7f73001df5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:25.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.516+0000 7f72f7fff640 1 -- 172.21.15.37:0/2969101367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73000b8370 msgr2=0x7f7300147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:25.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.516+0000 7f72f7fff640 1 --2- 172.21.15.37:0/2969101367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73000b8370 0x7f7300147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:25.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.516+0000 7f72f7fff640 1 -- 172.21.15.37:0/2969101367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e8009400 con 0x7f73000bad20 2023-12-19T16:07:25.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.516+0000 7f72f7fff640 1 --2- 172.21.15.37:0/2969101367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73000bad20 0x7f730013beb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f72e8000c00 tx=0x7f72e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:25.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.517+0000 7f72f77fe640 1 -- 172.21.15.37:0/2969101367 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8004230 con 0x7f73000bad20 2023-12-19T16:07:25.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.517+0000 7f72f77fe640 1 -- 172.21.15.37:0/2969101367 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e8004390 con 0x7f73000bad20 2023-12-19T16:07:25.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.517+0000 7f72f77fe640 1 -- 172.21.15.37:0/2969101367 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e803a920 con 0x7f73000bad20 2023-12-19T16:07:25.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.517+0000 7f73053d0640 1 -- 172.21.15.37:0/2969101367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73001455d0 con 0x7f73000bad20 2023-12-19T16:07:25.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.517+0000 7f73053d0640 1 -- 172.21.15.37:0/2969101367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7300145ea0 con 0x7f73000bad20 2023-12-19T16:07:25.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.518+0000 7f73053d0640 1 -- 172.21.15.37:0/2969101367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73001466a0 con 0x7f73000bad20 2023-12-19T16:07:25.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.518+0000 7f72f77fe640 1 -- 172.21.15.37:0/2969101367 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f72e803aa80 con 0x7f73000bad20 2023-12-19T16:07:25.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.518+0000 7f72f77fe640 1 --2- 172.21.15.37:0/2969101367 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f72e006a430 0x7f72e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:25.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.519+0000 7f72f77fe640 1 -- 172.21.15.37:0/2969101367 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72e80aaf30 con 0x7f73000bad20 2023-12-19T16:07:25.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.519+0000 7f72feffd640 1 --2- 172.21.15.37:0/2969101367 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f72e006a430 0x7f72e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:25.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.519+0000 7f72feffd640 1 --2- 172.21.15.37:0/2969101367 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f72e006a430 0x7f72e006c8f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f72f0000f60 tx=0x7f72f0007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:25.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.523+0000 7f72f77fe640 1 -- 172.21.15.37:0/2969101367 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f73001466a0 con 0x7f73000bad20 2023-12-19T16:07:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.698+0000 7f73053d0640 1 -- 172.21.15.37:0/2969101367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f73001466a0 con 0x7f73000bad20 2023-12-19T16:07:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.703+0000 7f72f77fe640 1 -- 172.21.15.37:0/2969101367 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f73001466a0 con 0x7f73000bad20 2023-12-19T16:07:25.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.705+0000 7f73053d0640 1 -- 172.21.15.37:0/2969101367 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f72e006a430 msgr2=0x7f72e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.705+0000 7f73053d0640 1 --2- 172.21.15.37:0/2969101367 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f72e006a430 0x7f72e006c8f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f72f0000f60 tx=0x7f72f0007d50 comp rx=0 tx=0).stop 2023-12-19T16:07:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.705+0000 7f73053d0640 1 -- 172.21.15.37:0/2969101367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73000bad20 msgr2=0x7f730013beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.705+0000 7f73053d0640 1 --2- 172.21.15.37:0/2969101367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73000bad20 0x7f730013beb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f72e8000c00 tx=0x7f72e80046c0 comp rx=0 tx=0).stop 2023-12-19T16:07:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.705+0000 7f73053d0640 1 -- 172.21.15.37:0/2969101367 shutdown_connections 2023-12-19T16:07:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.705+0000 7f73053d0640 1 --2- 172.21.15.37:0/2969101367 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f72e006a430 0x7f72e006c8f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.705+0000 7f73053d0640 1 --2- 172.21.15.37:0/2969101367 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7300140f70 0x7f73001df5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.705+0000 7f73053d0640 1 --2- 172.21.15.37:0/2969101367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73000bad20 0x7f730013beb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.705+0000 7f73053d0640 1 --2- 172.21.15.37:0/2969101367 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73000b8370 0x7f7300147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.705+0000 7f73053d0640 1 -- 172.21.15.37:0/2969101367 >> 172.21.15.37:0/2969101367 conn(0x7f73000c03a0 msgr2=0x7f73001485e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.705+0000 7f73053d0640 1 -- 172.21.15.37:0/2969101367 shutdown_connections 2023-12-19T16:07:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:25.706+0000 7f73053d0640 1 -- 172.21.15.37:0/2969101367 wait complete. 2023-12-19T16:07:25.718 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T16:07:25.718 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T16:07:25.791 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T16:07:25.882 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T16:07:26.006 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T16:07:26.006 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T16:07:26.006 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:07:26.057 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T16:07:26.057 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:07:26.109 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T16:07:26.109 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:07:26.162 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:07:26.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.269+0000 7fa993d73640 1 Processor -- start 2023-12-19T16:07:26.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.270+0000 7fa993d73640 1 -- start start 2023-12-19T16:07:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.270+0000 7fa993d73640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa98c14a760 0x7fa98c144250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.270+0000 7fa993d73640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa98c144790 0x7fa98c070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.270+0000 7fa993d73640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98c06fb80 con 0x7fa98c070550 2023-12-19T16:07:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.270+0000 7fa993d73640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98c06ef70 con 0x7fa98c14a760 2023-12-19T16:07:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.270+0000 7fa993d73640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0b2900 con 0x7fa98c144790 2023-12-19T16:07:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.270+0000 7fa991b0f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa98c14a760 0x7fa98c144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.270+0000 7fa991b0f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa98c14a760 0x7fa98c144250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58318/0 (socket says 172.21.15.37:58318) 2023-12-19T16:07:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.270+0000 7fa991b0f640 1 -- 172.21.15.37:0/858435492 learned_addr learned my addr 172.21.15.37:0/858435492 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:26.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.271+0000 7fa99130e640 1 --2- 172.21.15.37:0/858435492 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa98c144790 0x7fa98c070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.271+0000 7fa991b0f640 1 -- 172.21.15.37:0/858435492 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa98c144790 msgr2=0x7fa98c070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:26.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.271+0000 7fa991b0f640 1 --2- 172.21.15.37:0/858435492 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa98c144790 0x7fa98c070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.271+0000 7fa991b0f640 1 -- 172.21.15.37:0/858435492 >> v1:172.21.15.78:6789/0 conn(0x7fa98c070550 legacy=0x7fa98c146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:26.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.271+0000 7fa991b0f640 1 -- 172.21.15.37:0/858435492 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c0709e0 con 0x7fa98c14a760 2023-12-19T16:07:26.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.271+0000 7fa991b0f640 1 --2- 172.21.15.37:0/858435492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa98c14a760 0x7fa98c144250 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa98800bb10 tx=0x7fa98802e1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96373b59af589ba5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:26.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.272+0000 7fa990b0d640 1 -- 172.21.15.37:0/858435492 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988036440 con 0x7fa98c14a760 2023-12-19T16:07:26.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.272+0000 7fa990b0d640 1 -- 172.21.15.37:0/858435492 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9880365a0 con 0x7fa98c14a760 2023-12-19T16:07:26.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.272+0000 7fa990b0d640 1 -- 172.21.15.37:0/858435492 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988036930 con 0x7fa98c14a760 2023-12-19T16:07:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.272+0000 7fa993d73640 1 -- 172.21.15.37:0/858435492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa98c14a760 msgr2=0x7fa98c144250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.272+0000 7fa993d73640 1 --2- 172.21.15.37:0/858435492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa98c14a760 0x7fa98c144250 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa98800bb10 tx=0x7fa98802e1f0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.272+0000 7fa993d73640 1 -- 172.21.15.37:0/858435492 shutdown_connections 2023-12-19T16:07:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.272+0000 7fa993d73640 1 --2- 172.21.15.37:0/858435492 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa98c144790 0x7fa98c070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.272+0000 7fa993d73640 1 --2- 172.21.15.37:0/858435492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa98c14a760 0x7fa98c144250 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.272+0000 7fa993d73640 1 -- 172.21.15.37:0/858435492 >> 172.21.15.37:0/858435492 conn(0x7fa98c0bc220 msgr2=0x7fa98c0bc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.272+0000 7fa993d73640 1 -- 172.21.15.37:0/858435492 shutdown_connections 2023-12-19T16:07:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.272+0000 7fa993d73640 1 -- 172.21.15.37:0/858435492 wait complete. 2023-12-19T16:07:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.273+0000 7fa993d73640 1 Processor -- start 2023-12-19T16:07:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.273+0000 7fa993d73640 1 -- start start 2023-12-19T16:07:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.274+0000 7fa993d73640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa98c070550 0x7fa98c1450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.274+0000 7fa993d73640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa98c144790 0x7fa98c0b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.274+0000 7fa993d73640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa98c14a760 0x7fa98c0b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.274+0000 7fa993d73640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c145610 con 0x7fa98c14a760 2023-12-19T16:07:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.274+0000 7fa993d73640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c1dc6c0 con 0x7fa98c144790 2023-12-19T16:07:26.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.274+0000 7fa993d73640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c146690 con 0x7fa98c070550 2023-12-19T16:07:26.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.274+0000 7fa992310640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa98c14a760 0x7fa98c0b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.274+0000 7fa992310640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa98c14a760 0x7fa98c0b4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58320/0 (socket says 172.21.15.37:58320) 2023-12-19T16:07:26.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.274+0000 7fa992310640 1 -- 172.21.15.37:0/4209623391 learned_addr learned my addr 172.21.15.37:0/4209623391 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:26.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.274+0000 7fa99130e640 1 --2- 172.21.15.37:0/4209623391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa98c144790 0x7fa98c0b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.274+0000 7fa991b0f640 1 --2- 172.21.15.37:0/4209623391 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa98c070550 0x7fa98c1450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.274+0000 7fa992310640 1 -- 172.21.15.37:0/4209623391 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa98c070550 msgr2=0x7fa98c1450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:26.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.274+0000 7fa992310640 1 --2- 172.21.15.37:0/4209623391 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa98c070550 0x7fa98c1450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.274+0000 7fa992310640 1 -- 172.21.15.37:0/4209623391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa98c144790 msgr2=0x7fa98c0b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:26.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.274+0000 7fa992310640 1 --2- 172.21.15.37:0/4209623391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa98c144790 0x7fa98c0b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.274+0000 7fa992310640 1 -- 172.21.15.37:0/4209623391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98800b770 con 0x7fa98c14a760 2023-12-19T16:07:26.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.275+0000 7fa992310640 1 --2- 172.21.15.37:0/4209623391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa98c14a760 0x7fa98c0b4bb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa98400c7a0 tx=0x7fa98400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:26.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.275+0000 7fa9827fc640 1 -- 172.21.15.37:0/4209623391 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984003b70 con 0x7fa98c14a760 2023-12-19T16:07:26.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.275+0000 7fa9827fc640 1 -- 172.21.15.37:0/4209623391 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa984003cf0 con 0x7fa98c14a760 2023-12-19T16:07:26.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.275+0000 7fa9827fc640 1 -- 172.21.15.37:0/4209623391 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984003ea0 con 0x7fa98c14a760 2023-12-19T16:07:26.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.275+0000 7fa993d73640 1 -- 172.21.15.37:0/4209623391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c1dc980 con 0x7fa98c14a760 2023-12-19T16:07:26.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.275+0000 7fa993d73640 1 -- 172.21.15.37:0/4209623391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c0b57a0 con 0x7fa98c14a760 2023-12-19T16:07:26.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.276+0000 7fa993d73640 1 -- 172.21.15.37:0/4209623391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98c0b4390 con 0x7fa98c14a760 2023-12-19T16:07:26.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.276+0000 7fa9827fc640 1 -- 172.21.15.37:0/4209623391 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa98400aa90 con 0x7fa98c14a760 2023-12-19T16:07:26.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.277+0000 7fa9827fc640 1 --2- 172.21.15.37:0/4209623391 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa97006a430 0x7fa97006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.277+0000 7fa9827fc640 1 -- 172.21.15.37:0/4209623391 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa984088610 con 0x7fa98c14a760 2023-12-19T16:07:26.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.277+0000 7fa991b0f640 1 --2- 172.21.15.37:0/4209623391 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa97006a430 0x7fa97006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.277+0000 7fa991b0f640 1 --2- 172.21.15.37:0/4209623391 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa97006a430 0x7fa97006c8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa988038000 tx=0x7fa988032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:26.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.281+0000 7fa9827fc640 1 -- 172.21.15.37:0/4209623391 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa98c0b4390 con 0x7fa98c14a760 2023-12-19T16:07:26.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.461+0000 7fa993d73640 1 -- 172.21.15.37:0/4209623391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa98c0b4390 con 0x7fa98c14a760 2023-12-19T16:07:26.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.462+0000 7fa9827fc640 1 -- 172.21.15.37:0/4209623391 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7fa98c0b4390 con 0x7fa98c14a760 2023-12-19T16:07:26.464 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:26.464 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:59.728935+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:06:56.758166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:06:57.635291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:07:26.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.464+0000 7fa993d73640 1 -- 172.21.15.37:0/4209623391 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa97006a430 msgr2=0x7fa97006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:26.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.464+0000 7fa993d73640 1 --2- 172.21.15.37:0/4209623391 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa97006a430 0x7fa97006c8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa988038000 tx=0x7fa988032000 comp rx=0 tx=0).stop 2023-12-19T16:07:26.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.464+0000 7fa993d73640 1 -- 172.21.15.37:0/4209623391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa98c14a760 msgr2=0x7fa98c0b4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:26.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.464+0000 7fa993d73640 1 --2- 172.21.15.37:0/4209623391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa98c14a760 0x7fa98c0b4bb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa98400c7a0 tx=0x7fa98400cc60 comp rx=0 tx=0).stop 2023-12-19T16:07:26.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.464+0000 7fa993d73640 1 -- 172.21.15.37:0/4209623391 shutdown_connections 2023-12-19T16:07:26.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.464+0000 7fa993d73640 1 --2- 172.21.15.37:0/4209623391 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa97006a430 0x7fa97006c8f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.464+0000 7fa993d73640 1 --2- 172.21.15.37:0/4209623391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa98c14a760 0x7fa98c0b4bb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.464+0000 7fa993d73640 1 --2- 172.21.15.37:0/4209623391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa98c144790 0x7fa98c0b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.464+0000 7fa993d73640 1 --2- 172.21.15.37:0/4209623391 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa98c070550 0x7fa98c1450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.464+0000 7fa993d73640 1 -- 172.21.15.37:0/4209623391 >> 172.21.15.37:0/4209623391 conn(0x7fa98c0bc220 msgr2=0x7fa98c069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:26.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.464+0000 7fa993d73640 1 -- 172.21.15.37:0/4209623391 shutdown_connections 2023-12-19T16:07:26.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.464+0000 7fa993d73640 1 -- 172.21.15.37:0/4209623391 wait complete. 2023-12-19T16:07:26.477 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:06:46.684027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:06:56.758166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:06:57.635291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:07:26.477 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:07:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.583+0000 7f59355c9640 1 Processor -- start 2023-12-19T16:07:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.584+0000 7f59355c9640 1 -- start start 2023-12-19T16:07:26.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.584+0000 7f59355c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f59300bb140 0x7f59300be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.584+0000 7f59355c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59300bf510 0x7f59300bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.584+0000 7f59355c9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59300bfa50 con 0x7f593006a950 2023-12-19T16:07:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.584+0000 7f59355c9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59300bbda0 con 0x7f59300bf510 2023-12-19T16:07:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.584+0000 7f59355c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593006b040 con 0x7f59300bb140 2023-12-19T16:07:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.584+0000 7f592f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59300bf510 0x7f59300bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.584+0000 7f592f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59300bf510 0x7f59300bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58330/0 (socket says 172.21.15.37:58330) 2023-12-19T16:07:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.584+0000 7f592f7fe640 1 -- 172.21.15.37:0/1457000099 learned_addr learned my addr 172.21.15.37:0/1457000099 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.585+0000 7f592effd640 1 --2- 172.21.15.37:0/1457000099 >> v2:172.21.15.78:3300/0 conn(0x7f59300bb140 0x7f59300be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.585+0000 7f592f7fe640 1 -- 172.21.15.37:0/1457000099 >> v2:172.21.15.78:3300/0 conn(0x7f59300bb140 msgr2=0x7f59300be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.585+0000 7f592f7fe640 1 --2- 172.21.15.37:0/1457000099 >> v2:172.21.15.78:3300/0 conn(0x7f59300bb140 0x7f59300be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.585+0000 7f592f7fe640 1 -- 172.21.15.37:0/1457000099 >> v1:172.21.15.78:6789/0 conn(0x7f593006a950 legacy=0x7f59300bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.585+0000 7f592f7fe640 1 -- 172.21.15.37:0/1457000099 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59300bb520 con 0x7f59300bf510 2023-12-19T16:07:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.585+0000 7f592f7fe640 1 --2- 172.21.15.37:0/1457000099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59300bf510 0x7f59300bfee0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5930067620 tx=0x7f592802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33440dc0a4b63307 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.586+0000 7f592dffb640 1 -- 172.21.15.37:0/1457000099 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592802c9f0 con 0x7f59300bf510 2023-12-19T16:07:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.586+0000 7f592dffb640 1 -- 172.21.15.37:0/1457000099 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592802cb50 con 0x7f59300bf510 2023-12-19T16:07:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.586+0000 7f592dffb640 1 -- 172.21.15.37:0/1457000099 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59280343f0 con 0x7f59300bf510 2023-12-19T16:07:26.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.586+0000 7f59355c9640 1 -- 172.21.15.37:0/1457000099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59300bf510 msgr2=0x7f59300bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:26.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.586+0000 7f59355c9640 1 --2- 172.21.15.37:0/1457000099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59300bf510 0x7f59300bfee0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5930067620 tx=0x7f592802be50 comp rx=0 tx=0).stop 2023-12-19T16:07:26.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.586+0000 7f59355c9640 1 -- 172.21.15.37:0/1457000099 shutdown_connections 2023-12-19T16:07:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.586+0000 7f59355c9640 1 --2- 172.21.15.37:0/1457000099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59300bf510 0x7f59300bfee0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.586+0000 7f59355c9640 1 --2- 172.21.15.37:0/1457000099 >> v2:172.21.15.78:3300/0 conn(0x7f59300bb140 0x7f59300be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.586+0000 7f59355c9640 1 -- 172.21.15.37:0/1457000099 >> 172.21.15.37:0/1457000099 conn(0x7f59300bcfd0 msgr2=0x7f59300bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.586+0000 7f59355c9640 1 -- 172.21.15.37:0/1457000099 shutdown_connections 2023-12-19T16:07:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.586+0000 7f59355c9640 1 -- 172.21.15.37:0/1457000099 wait complete. 2023-12-19T16:07:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.587+0000 7f59355c9640 1 Processor -- start 2023-12-19T16:07:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.587+0000 7f59355c9640 1 -- start start 2023-12-19T16:07:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.588+0000 7f59355c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f593006a950 0x7f593014c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.588+0000 7f59355c9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f59300bb140 0x7f593014c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.588+0000 7f59355c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59300bf510 0x7f59301e3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.588+0000 7f59355c9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593014e670 con 0x7f59300bf510 2023-12-19T16:07:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.588+0000 7f59355c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59300a2d50 con 0x7f593006a950 2023-12-19T16:07:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.588+0000 7f59355c9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593014cc20 con 0x7f59300bb140 2023-12-19T16:07:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.588+0000 7f592f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59300bf510 0x7f59301e3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.588+0000 7f592f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59300bf510 0x7f59301e3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58344/0 (socket says 172.21.15.37:58344) 2023-12-19T16:07:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.588+0000 7f592f7fe640 1 -- 172.21.15.37:0/1984524854 learned_addr learned my addr 172.21.15.37:0/1984524854 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.588+0000 7f592e7fc640 1 --2- 172.21.15.37:0/1984524854 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f59300bb140 0x7f593014c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.588+0000 7f592effd640 1 --2- 172.21.15.37:0/1984524854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f593006a950 0x7f593014c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.588+0000 7f592f7fe640 1 -- 172.21.15.37:0/1984524854 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f59300bb140 msgr2=0x7f593014c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.588+0000 7f592f7fe640 1 --2- 172.21.15.37:0/1984524854 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f59300bb140 0x7f593014c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.588+0000 7f592f7fe640 1 -- 172.21.15.37:0/1984524854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f593006a950 msgr2=0x7f593014c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.588+0000 7f592f7fe640 1 --2- 172.21.15.37:0/1984524854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f593006a950 0x7f593014c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.588+0000 7f592f7fe640 1 -- 172.21.15.37:0/1984524854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5928009b30 con 0x7f59300bf510 2023-12-19T16:07:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.588+0000 7f592e7fc640 1 --2- 172.21.15.37:0/1984524854 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f59300bb140 0x7f593014c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.588+0000 7f592effd640 1 --2- 172.21.15.37:0/1984524854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f593006a950 0x7f593014c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.589+0000 7f592f7fe640 1 --2- 172.21.15.37:0/1984524854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59300bf510 0x7f59301e3210 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5928036040 tx=0x7f5928004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:26.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.589+0000 7f59177fe640 1 -- 172.21.15.37:0/1984524854 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592803e450 con 0x7f59300bf510 2023-12-19T16:07:26.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.589+0000 7f59177fe640 1 -- 172.21.15.37:0/1984524854 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592803e5d0 con 0x7f59300bf510 2023-12-19T16:07:26.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.589+0000 7f59177fe640 1 -- 172.21.15.37:0/1984524854 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592803e980 con 0x7f59300bf510 2023-12-19T16:07:26.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.589+0000 7f59355c9640 1 -- 172.21.15.37:0/1984524854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593014eb30 con 0x7f59300bf510 2023-12-19T16:07:26.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.589+0000 7f59355c9640 1 -- 172.21.15.37:0/1984524854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59300b9860 con 0x7f59300bf510 2023-12-19T16:07:26.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.590+0000 7f59355c9640 1 -- 172.21.15.37:0/1984524854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59300740a0 con 0x7f59300bf510 2023-12-19T16:07:26.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.590+0000 7f59177fe640 1 -- 172.21.15.37:0/1984524854 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f592803eae0 con 0x7f59300bf510 2023-12-19T16:07:26.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.591+0000 7f59177fe640 1 --2- 172.21.15.37:0/1984524854 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f591c06a430 0x7f591c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.591+0000 7f59177fe640 1 -- 172.21.15.37:0/1984524854 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59280ab770 con 0x7f59300bf510 2023-12-19T16:07:26.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.591+0000 7f592effd640 1 --2- 172.21.15.37:0/1984524854 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f591c06a430 0x7f591c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.592+0000 7f592effd640 1 --2- 172.21.15.37:0/1984524854 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f591c06a430 0x7f591c06c8f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5920006fd0 tx=0x7f5920008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:26.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.595+0000 7f59177fe640 1 -- 172.21.15.37:0/1984524854 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5928076ea0 con 0x7f59300bf510 2023-12-19T16:07:26.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.773+0000 7f59355c9640 1 -- 172.21.15.37:0/1984524854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59300ba4a0 con 0x7f59300bf510 2023-12-19T16:07:26.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.773+0000 7f59177fe640 1 -- 172.21.15.37:0/1984524854 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f592807a4c0 con 0x7f59300bf510 2023-12-19T16:07:26.776 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-19T16:07:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.775+0000 7f59355c9640 1 -- 172.21.15.37:0/1984524854 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f591c06a430 msgr2=0x7f591c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.775+0000 7f59355c9640 1 --2- 172.21.15.37:0/1984524854 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f591c06a430 0x7f591c06c8f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5920006fd0 tx=0x7f5920008040 comp rx=0 tx=0).stop 2023-12-19T16:07:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.775+0000 7f59355c9640 1 -- 172.21.15.37:0/1984524854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59300bf510 msgr2=0x7f59301e3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.775+0000 7f59355c9640 1 --2- 172.21.15.37:0/1984524854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59300bf510 0x7f59301e3210 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5928036040 tx=0x7f5928004a40 comp rx=0 tx=0).stop 2023-12-19T16:07:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.776+0000 7f59355c9640 1 -- 172.21.15.37:0/1984524854 shutdown_connections 2023-12-19T16:07:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.776+0000 7f59355c9640 1 --2- 172.21.15.37:0/1984524854 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f591c06a430 0x7f591c06c8f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.776+0000 7f59355c9640 1 --2- 172.21.15.37:0/1984524854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59300bf510 0x7f59301e3210 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.776+0000 7f59355c9640 1 --2- 172.21.15.37:0/1984524854 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f59300bb140 0x7f593014c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.776+0000 7f59355c9640 1 --2- 172.21.15.37:0/1984524854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f593006a950 0x7f593014c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.776+0000 7f59355c9640 1 -- 172.21.15.37:0/1984524854 >> 172.21.15.37:0/1984524854 conn(0x7f59300bcfd0 msgr2=0x7f59300a41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:26.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.776+0000 7f59355c9640 1 -- 172.21.15.37:0/1984524854 shutdown_connections 2023-12-19T16:07:26.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.776+0000 7f59355c9640 1 -- 172.21.15.37:0/1984524854 wait complete. 2023-12-19T16:07:26.788 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:07:26.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.895+0000 7f7d120af640 1 Processor -- start 2023-12-19T16:07:26.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.895+0000 7f7d120af640 1 -- start start 2023-12-19T16:07:26.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d120af640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d0c0bf510 0x7f7d0c0be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d120af640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7d0c06a950 0x7f7d0c0bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d120af640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c0bfa50 con 0x7f7d0c0bb140 2023-12-19T16:07:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d120af640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c0bbda0 con 0x7f7d0c06a950 2023-12-19T16:07:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d120af640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c06b040 con 0x7f7d0c0bf510 2023-12-19T16:07:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d0b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7d0c0bb140 0x7f7d0c0bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35006/0 (socket says 172.21.15.37:35006) 2023-12-19T16:07:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d0b7fe640 1 -- 172.21.15.37:0/2358240750 learned_addr learned my addr 172.21.15.37:0/2358240750 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d0a7fc640 1 -- 172.21.15.37:0/2358240750 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 648399623 0 0) 0x7f7d0c0bfa50 con 0x7f7d0c0bb140 2023-12-19T16:07:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d0a7fc640 1 -- 172.21.15.37:0/2358240750 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cf4003520 con 0x7f7d0c0bb140 2023-12-19T16:07:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d0affd640 1 --2- 172.21.15.37:0/2358240750 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d0c0bf510 0x7f7d0c0be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d0bfff640 1 --2- 172.21.15.37:0/2358240750 >> v2:172.21.15.78:3300/0 conn(0x7f7d0c06a950 0x7f7d0c0bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d0a7fc640 1 -- 172.21.15.37:0/2358240750 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2335234447 0 0) 0x7f7cf4003520 con 0x7f7d0c0bb140 2023-12-19T16:07:26.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d0a7fc640 1 -- 172.21.15.37:0/2358240750 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d0c0bf510 msgr2=0x7f7d0c0be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d0a7fc640 1 --2- 172.21.15.37:0/2358240750 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d0c0bf510 0x7f7d0c0be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d0a7fc640 1 -- 172.21.15.37:0/2358240750 >> v2:172.21.15.78:3300/0 conn(0x7f7d0c06a950 msgr2=0x7f7d0c0bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d0a7fc640 1 --2- 172.21.15.37:0/2358240750 >> v2:172.21.15.78:3300/0 conn(0x7f7d0c06a950 0x7f7d0c0bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d0a7fc640 1 -- 172.21.15.37:0/2358240750 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c0bb520 con 0x7f7d0c0bb140 2023-12-19T16:07:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d0a7fc640 1 -- 172.21.15.37:0/2358240750 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f7cfc001670 con 0x7f7d0c0bb140 2023-12-19T16:07:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d0a7fc640 1 -- 172.21.15.37:0/2358240750 >> v1:172.21.15.37:6789/0 conn(0x7f7d0c0bb140 legacy=0x7f7d0c0bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d0a7fc640 1 --2- 172.21.15.37:0/2358240750 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d0c0bf510 0x7f7cf4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d0a7fc640 1 --2- 172.21.15.37:0/2358240750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf4003ef0 0x7f7cf40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d0a7fc640 1 --2- 172.21.15.37:0/2358240750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cf4004d00 0x7f7cf4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d0a7fc640 1 -- 172.21.15.37:0/2358240750 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c06b040 con 0x7f7cf4004d00 2023-12-19T16:07:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.896+0000 7f7d0a7fc640 1 -- 172.21.15.37:0/2358240750 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf400b980 con 0x7f7cf4003ef0 2023-12-19T16:07:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.897+0000 7f7d0a7fc640 1 -- 172.21.15.37:0/2358240750 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf400bb10 con 0x7f7d0c0bf510 2023-12-19T16:07:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.897+0000 7f7d0bfff640 1 --2- 172.21.15.37:0/2358240750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cf4004d00 0x7f7cf4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.897+0000 7f7d0b7fe640 1 --2- 172.21.15.37:0/2358240750 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d0c0bf510 0x7f7cf4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.897+0000 7f7d0affd640 1 --2- 172.21.15.37:0/2358240750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf4003ef0 0x7f7cf40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.897+0000 7f7d0bfff640 1 -- 172.21.15.37:0/2358240750 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d0c0bf510 msgr2=0x7f7cf4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.897+0000 7f7d0bfff640 1 --2- 172.21.15.37:0/2358240750 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d0c0bf510 0x7f7cf4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.897+0000 7f7d0bfff640 1 -- 172.21.15.37:0/2358240750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf4003ef0 msgr2=0x7f7cf40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.897+0000 7f7d0bfff640 1 --2- 172.21.15.37:0/2358240750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cf4003ef0 0x7f7cf40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.897+0000 7f7d0bfff640 1 -- 172.21.15.37:0/2358240750 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf4003520 con 0x7f7cf4004d00 2023-12-19T16:07:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.898+0000 7f7d0bfff640 1 --2- 172.21.15.37:0/2358240750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cf4004d00 0x7f7cf4005180 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400e170 tx=0x7f7cf40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f5f3d240de9f7b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.898+0000 7f7d0a7fc640 1 -- 172.21.15.37:0/2358240750 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0402cc20 con 0x7f7cf4004d00 2023-12-19T16:07:26.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.898+0000 7f7d0a7fc640 1 -- 172.21.15.37:0/2358240750 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0400f040 con 0x7f7cf4004d00 2023-12-19T16:07:26.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.898+0000 7f7d0a7fc640 1 -- 172.21.15.37:0/2358240750 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d04034440 con 0x7f7cf4004d00 2023-12-19T16:07:26.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.898+0000 7f7d120af640 1 -- 172.21.15.37:0/2358240750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cf4004d00 msgr2=0x7f7cf4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:26.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.898+0000 7f7d120af640 1 --2- 172.21.15.37:0/2358240750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cf4004d00 0x7f7cf4005180 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400e170 tx=0x7f7cf40057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.898+0000 7f7d0bfff640 1 -- 172.21.15.37:0/2358240750 reap_dead start 2023-12-19T16:07:26.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.898+0000 7f7d120af640 1 -- 172.21.15.37:0/2358240750 shutdown_connections 2023-12-19T16:07:26.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.898+0000 7f7d120af640 1 -- 172.21.15.37:0/2358240750 >> 172.21.15.37:0/2358240750 conn(0x7f7d0c0bcfd0 msgr2=0x7f7d0c0bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:26.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.898+0000 7f7d120af640 1 -- 172.21.15.37:0/2358240750 shutdown_connections 2023-12-19T16:07:26.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.898+0000 7f7d120af640 1 -- 172.21.15.37:0/2358240750 wait complete. 2023-12-19T16:07:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.899+0000 7f7d120af640 1 Processor -- start 2023-12-19T16:07:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.899+0000 7f7d120af640 1 -- start start 2023-12-19T16:07:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.900+0000 7f7d120af640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7cf4004d00 0x7f7d0c09bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.900+0000 7f7d120af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c09ac40 0x7f7d0c09a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.900+0000 7f7d120af640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d0c09b0c0 0x7f7d0c09e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.900+0000 7f7d120af640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c09d4d0 con 0x7f7d0c09ac40 2023-12-19T16:07:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.900+0000 7f7d120af640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c149350 con 0x7f7d0c09b0c0 2023-12-19T16:07:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.900+0000 7f7d120af640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c1e3240 con 0x7f7cf4004d00 2023-12-19T16:07:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.900+0000 7f7d0affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c09ac40 0x7f7d0c09a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.900+0000 7f7d0affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c09ac40 0x7f7d0c09a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58362/0 (socket says 172.21.15.37:58362) 2023-12-19T16:07:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.900+0000 7f7d0affd640 1 -- 172.21.15.37:0/3114690609 learned_addr learned my addr 172.21.15.37:0/3114690609 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.900+0000 7f7d0b7fe640 1 --2- 172.21.15.37:0/3114690609 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7cf4004d00 0x7f7d0c09bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.900+0000 7f7d0bfff640 1 --2- 172.21.15.37:0/3114690609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d0c09b0c0 0x7f7d0c09e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.900+0000 7f7d0affd640 1 -- 172.21.15.37:0/3114690609 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7cf4004d00 msgr2=0x7f7d0c09bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.900+0000 7f7d0affd640 1 --2- 172.21.15.37:0/3114690609 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7cf4004d00 0x7f7d0c09bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.900+0000 7f7d0affd640 1 -- 172.21.15.37:0/3114690609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d0c09b0c0 msgr2=0x7f7d0c09e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.900+0000 7f7d0affd640 1 --2- 172.21.15.37:0/3114690609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d0c09b0c0 0x7f7d0c09e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.901+0000 7f7d0affd640 1 -- 172.21.15.37:0/3114690609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c1e3520 con 0x7f7d0c09ac40 2023-12-19T16:07:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.901+0000 7f7d0affd640 1 --2- 172.21.15.37:0/3114690609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c09ac40 0x7f7d0c09a010 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7d000118e0 tx=0x7f7d00011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.901+0000 7f7cf3fff640 1 -- 172.21.15.37:0/3114690609 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0000faf0 con 0x7f7d0c09ac40 2023-12-19T16:07:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.901+0000 7f7cf3fff640 1 -- 172.21.15.37:0/3114690609 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0000fc50 con 0x7f7d0c09ac40 2023-12-19T16:07:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.901+0000 7f7d120af640 1 -- 172.21.15.37:0/3114690609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0c1e3800 con 0x7f7d0c09ac40 2023-12-19T16:07:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.901+0000 7f7cf3fff640 1 -- 172.21.15.37:0/3114690609 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00014440 con 0x7f7d0c09ac40 2023-12-19T16:07:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.901+0000 7f7d120af640 1 -- 172.21.15.37:0/3114690609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c1e4000 con 0x7f7d0c09ac40 2023-12-19T16:07:26.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.902+0000 7f7d120af640 1 -- 172.21.15.37:0/3114690609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0c0740a0 con 0x7f7d0c09ac40 2023-12-19T16:07:26.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.902+0000 7f7cf3fff640 1 -- 172.21.15.37:0/3114690609 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7d000145a0 con 0x7f7d0c09ac40 2023-12-19T16:07:26.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.903+0000 7f7cf3fff640 1 --2- 172.21.15.37:0/3114690609 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7cf806a430 0x7f7cf806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:26.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.903+0000 7f7cf3fff640 1 -- 172.21.15.37:0/3114690609 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d000890d0 con 0x7f7d0c09ac40 2023-12-19T16:07:26.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.903+0000 7f7d0b7fe640 1 --2- 172.21.15.37:0/3114690609 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7cf806a430 0x7f7cf806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:26.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.903+0000 7f7d0b7fe640 1 --2- 172.21.15.37:0/3114690609 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7cf806a430 0x7f7cf806c8f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc000fb0 tx=0x7f7cfc0078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:26.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:26.907+0000 7f7cf3fff640 1 -- 172.21.15.37:0/3114690609 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7d00054770 con 0x7f7d0c09ac40 2023-12-19T16:07:27.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.080+0000 7f7d120af640 1 -- 172.21.15.37:0/3114690609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7d0c09f750 con 0x7f7d0c09ac40 2023-12-19T16:07:27.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.081+0000 7f7cf3fff640 1 -- 172.21.15.37:0/3114690609 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7d00057d90 con 0x7f7d0c09ac40 2023-12-19T16:07:27.083 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-19T16:07:27.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.083+0000 7f7d120af640 1 -- 172.21.15.37:0/3114690609 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7cf806a430 msgr2=0x7f7cf806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:27.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.083+0000 7f7d120af640 1 --2- 172.21.15.37:0/3114690609 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7cf806a430 0x7f7cf806c8f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc000fb0 tx=0x7f7cfc0078f0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.083+0000 7f7d120af640 1 -- 172.21.15.37:0/3114690609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c09ac40 msgr2=0x7f7d0c09a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.083+0000 7f7d120af640 1 --2- 172.21.15.37:0/3114690609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c09ac40 0x7f7d0c09a010 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7d000118e0 tx=0x7f7d00011da0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.083+0000 7f7d120af640 1 -- 172.21.15.37:0/3114690609 shutdown_connections 2023-12-19T16:07:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.083+0000 7f7d120af640 1 --2- 172.21.15.37:0/3114690609 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7cf806a430 0x7f7cf806c8f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.083+0000 7f7d120af640 1 --2- 172.21.15.37:0/3114690609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d0c09b0c0 0x7f7d0c09e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.083+0000 7f7d120af640 1 --2- 172.21.15.37:0/3114690609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c09ac40 0x7f7d0c09a010 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.083+0000 7f7d120af640 1 --2- 172.21.15.37:0/3114690609 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7cf4004d00 0x7f7d0c09bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.083+0000 7f7d120af640 1 -- 172.21.15.37:0/3114690609 >> 172.21.15.37:0/3114690609 conn(0x7f7d0c0bcfd0 msgr2=0x7f7d0c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.083+0000 7f7d120af640 1 -- 172.21.15.37:0/3114690609 shutdown_connections 2023-12-19T16:07:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.083+0000 7f7d120af640 1 -- 172.21.15.37:0/3114690609 wait complete. 2023-12-19T16:07:27.096 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:07:27.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.202+0000 7f8073c77640 1 Processor -- start 2023-12-19T16:07:27.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.202+0000 7f8073c77640 1 -- start start 2023-12-19T16:07:27.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.203+0000 7f8073c77640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f806c144f30 0x7f806c14e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.203+0000 7f8073c77640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f806c070e40 0x7f806c06acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.203+0000 7f8073c77640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f806c06b1f0 0x7f806c14abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.203+0000 7f8073c77640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f806c06c400 con 0x7f806c06b1f0 2023-12-19T16:07:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.203+0000 7f8073c77640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f806c14e540 con 0x7f806c070e40 2023-12-19T16:07:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.203+0000 7f8073c77640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806c145310 con 0x7f806c144f30 2023-12-19T16:07:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.203+0000 7f8072214640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f806c06b1f0 0x7f806c14abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.203+0000 7f8072214640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f806c06b1f0 0x7f806c14abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58378/0 (socket says 172.21.15.37:58378) 2023-12-19T16:07:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.203+0000 7f8072214640 1 -- 172.21.15.37:0/745954691 learned_addr learned my addr 172.21.15.37:0/745954691 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.203+0000 7f8071a13640 1 --2- 172.21.15.37:0/745954691 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f806c144f30 0x7f806c14e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.203+0000 7f8071212640 1 --2- 172.21.15.37:0/745954691 >> v2:172.21.15.78:3300/0 conn(0x7f806c070e40 0x7f806c06acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.203+0000 7f8072214640 1 -- 172.21.15.37:0/745954691 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f806c144f30 msgr2=0x7f806c14e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.203+0000 7f8072214640 1 --2- 172.21.15.37:0/745954691 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f806c144f30 0x7f806c14e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.203+0000 7f8072214640 1 -- 172.21.15.37:0/745954691 >> v2:172.21.15.78:3300/0 conn(0x7f806c070e40 msgr2=0x7f806c06acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:27.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.203+0000 7f8072214640 1 --2- 172.21.15.37:0/745954691 >> v2:172.21.15.78:3300/0 conn(0x7f806c070e40 0x7f806c06acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.203+0000 7f8072214640 1 -- 172.21.15.37:0/745954691 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806c06b680 con 0x7f806c06b1f0 2023-12-19T16:07:27.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.204+0000 7f8072214640 1 --2- 172.21.15.37:0/745954691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c06b1f0 0x7f806c14abc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f806c06ab20 tx=0x7f806402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f75421578e8af6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:27.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.204+0000 7f8070a11640 1 -- 172.21.15.37:0/745954691 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806402c9e0 con 0x7f806c06b1f0 2023-12-19T16:07:27.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.204+0000 7f8070a11640 1 -- 172.21.15.37:0/745954691 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806402cb40 con 0x7f806c06b1f0 2023-12-19T16:07:27.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.204+0000 7f8070a11640 1 -- 172.21.15.37:0/745954691 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80640343f0 con 0x7f806c06b1f0 2023-12-19T16:07:27.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.205+0000 7f8073c77640 1 -- 172.21.15.37:0/745954691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c06b1f0 msgr2=0x7f806c14abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:27.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.205+0000 7f8073c77640 1 --2- 172.21.15.37:0/745954691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c06b1f0 0x7f806c14abc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f806c06ab20 tx=0x7f806402be40 comp rx=0 tx=0).stop 2023-12-19T16:07:27.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.205+0000 7f8073c77640 1 -- 172.21.15.37:0/745954691 shutdown_connections 2023-12-19T16:07:27.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.205+0000 7f8073c77640 1 --2- 172.21.15.37:0/745954691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c06b1f0 0x7f806c14abc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.205+0000 7f8073c77640 1 --2- 172.21.15.37:0/745954691 >> v2:172.21.15.78:3300/0 conn(0x7f806c070e40 0x7f806c06acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.205+0000 7f8073c77640 1 --2- 172.21.15.37:0/745954691 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f806c144f30 0x7f806c14e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.205+0000 7f8073c77640 1 -- 172.21.15.37:0/745954691 >> 172.21.15.37:0/745954691 conn(0x7f806c0be100 msgr2=0x7f806c0be4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:27.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.205+0000 7f8073c77640 1 -- 172.21.15.37:0/745954691 shutdown_connections 2023-12-19T16:07:27.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.205+0000 7f8073c77640 1 -- 172.21.15.37:0/745954691 wait complete. 2023-12-19T16:07:27.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.206+0000 7f8073c77640 1 Processor -- start 2023-12-19T16:07:27.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.206+0000 7f8073c77640 1 -- start start 2023-12-19T16:07:27.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.206+0000 7f8073c77640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c070e40 0x7f806c14b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:27.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.206+0000 7f8073c77640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f806c144f30 0x7f806c14a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:27.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f8073c77640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f806c143c50 0x7f806c1440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:27.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f8073c77640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806c149ea0 con 0x7f806c070e40 2023-12-19T16:07:27.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f8073c77640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806c14bc00 con 0x7f806c143c50 2023-12-19T16:07:27.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f8073c77640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806c14ad20 con 0x7f806c144f30 2023-12-19T16:07:27.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f8071a13640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c070e40 0x7f806c14b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:27.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f8071a13640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c070e40 0x7f806c14b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58382/0 (socket says 172.21.15.37:58382) 2023-12-19T16:07:27.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f8071a13640 1 -- 172.21.15.37:0/3893564521 learned_addr learned my addr 172.21.15.37:0/3893564521 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:27.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f8072214640 1 --2- 172.21.15.37:0/3893564521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f806c143c50 0x7f806c1440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:27.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f8071212640 1 --2- 172.21.15.37:0/3893564521 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f806c144f30 0x7f806c14a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:27.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f8071a13640 1 -- 172.21.15.37:0/3893564521 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f806c144f30 msgr2=0x7f806c14a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:27.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f8071a13640 1 --2- 172.21.15.37:0/3893564521 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f806c144f30 0x7f806c14a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f8071a13640 1 -- 172.21.15.37:0/3893564521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f806c143c50 msgr2=0x7f806c1440e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:27.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f8071a13640 1 --2- 172.21.15.37:0/3893564521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f806c143c50 0x7f806c1440e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f8071a13640 1 -- 172.21.15.37:0/3893564521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8064009b30 con 0x7f806c070e40 2023-12-19T16:07:27.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f8072214640 1 --2- 172.21.15.37:0/3893564521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f806c143c50 0x7f806c1440e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:27.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f8071a13640 1 --2- 172.21.15.37:0/3893564521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c070e40 0x7f806c14b6c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f806800d800 tx=0x7f806800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:27.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f80627fc640 1 -- 172.21.15.37:0/3893564521 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806800b660 con 0x7f806c070e40 2023-12-19T16:07:27.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f80627fc640 1 -- 172.21.15.37:0/3893564521 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806800b7c0 con 0x7f806c070e40 2023-12-19T16:07:27.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f8073c77640 1 -- 172.21.15.37:0/3893564521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f806c1493b0 con 0x7f806c070e40 2023-12-19T16:07:27.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f80627fc640 1 -- 172.21.15.37:0/3893564521 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806800bb70 con 0x7f806c070e40 2023-12-19T16:07:27.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.207+0000 7f8073c77640 1 -- 172.21.15.37:0/3893564521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f806c1498e0 con 0x7f806c070e40 2023-12-19T16:07:27.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.208+0000 7f8073c77640 1 -- 172.21.15.37:0/3893564521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f806c0bb9e0 con 0x7f806c070e40 2023-12-19T16:07:27.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.209+0000 7f80627fc640 1 -- 172.21.15.37:0/3893564521 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f806800bcd0 con 0x7f806c070e40 2023-12-19T16:07:27.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.209+0000 7f80627fc640 1 --2- 172.21.15.37:0/3893564521 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f805006a460 0x7f805006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:27.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.209+0000 7f80627fc640 1 -- 172.21.15.37:0/3893564521 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8068088d60 con 0x7f806c070e40 2023-12-19T16:07:27.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.209+0000 7f8071212640 1 --2- 172.21.15.37:0/3893564521 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f805006a460 0x7f805006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:27.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.210+0000 7f8071212640 1 --2- 172.21.15.37:0/3893564521 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f805006a460 0x7f805006c920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f806c1ddc00 tx=0x7f805c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:27.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.213+0000 7f80627fc640 1 -- 172.21.15.37:0/3893564521 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8068054350 con 0x7f806c070e40 2023-12-19T16:07:27.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.389+0000 7f8073c77640 1 -- 172.21.15.37:0/3893564521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f806c0b82b0 con 0x7f806c070e40 2023-12-19T16:07:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.391+0000 7f80627fc640 1 -- 172.21.15.37:0/3893564521 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8068057970 con 0x7f806c070e40 2023-12-19T16:07:27.393 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-19T16:07:27.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.393+0000 7f8073c77640 1 -- 172.21.15.37:0/3893564521 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f805006a460 msgr2=0x7f805006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:27.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.393+0000 7f8073c77640 1 --2- 172.21.15.37:0/3893564521 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f805006a460 0x7f805006c920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f806c1ddc00 tx=0x7f805c008040 comp rx=0 tx=0).stop 2023-12-19T16:07:27.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.393+0000 7f8073c77640 1 -- 172.21.15.37:0/3893564521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c070e40 msgr2=0x7f806c14b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:27.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.393+0000 7f8073c77640 1 --2- 172.21.15.37:0/3893564521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c070e40 0x7f806c14b6c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f806800d800 tx=0x7f806800dcc0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.393+0000 7f8073c77640 1 -- 172.21.15.37:0/3893564521 shutdown_connections 2023-12-19T16:07:27.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.393+0000 7f8073c77640 1 --2- 172.21.15.37:0/3893564521 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f805006a460 0x7f805006c920 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.393+0000 7f8073c77640 1 --2- 172.21.15.37:0/3893564521 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f806c143c50 0x7f806c1440e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.393+0000 7f8073c77640 1 --2- 172.21.15.37:0/3893564521 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f806c144f30 0x7f806c14a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.393+0000 7f8073c77640 1 --2- 172.21.15.37:0/3893564521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f806c070e40 0x7f806c14b6c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.393+0000 7f8073c77640 1 -- 172.21.15.37:0/3893564521 >> 172.21.15.37:0/3893564521 conn(0x7f806c0be100 msgr2=0x7f806c0bb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:27.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.393+0000 7f8073c77640 1 -- 172.21.15.37:0/3893564521 shutdown_connections 2023-12-19T16:07:27.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.393+0000 7f8073c77640 1 -- 172.21.15.37:0/3893564521 wait complete. 2023-12-19T16:07:27.406 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:07:27.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.510+0000 7f945f68f640 1 Processor -- start 2023-12-19T16:07:27.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.511+0000 7f945f68f640 1 -- start start 2023-12-19T16:07:27.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.511+0000 7f945f68f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f94580b8b40 0x7f9458156330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:27.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.511+0000 7f945f68f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94580b6da0 con 0x7f94580bab80 2023-12-19T16:07:27.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.511+0000 7f945f68f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94580b8090 con 0x7f9458144e30 2023-12-19T16:07:27.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.511+0000 7f945f68f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f945814afe0 con 0x7f94580b8b40 2023-12-19T16:07:27.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.511+0000 7f945dc2c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f94580b8b40 0x7f9458156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:27.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.511+0000 7f945cc2a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f94580bab80 0x7f945814b470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35008/0 (socket says 172.21.15.37:35008) 2023-12-19T16:07:27.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.511+0000 7f945cc2a640 1 -- 172.21.15.37:0/2381926074 learned_addr learned my addr 172.21.15.37:0/2381926074 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:27.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.512+0000 7f944ffff640 1 -- 172.21.15.37:0/2381926074 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993042052 0 0) 0x7f9448001290 con 0x7f94580bab80 2023-12-19T16:07:27.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.512+0000 7f944ffff640 1 -- 172.21.15.37:0/2381926074 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9444003520 con 0x7f94580bab80 2023-12-19T16:07:27.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.512+0000 7f945dc2c640 1 -- 172.21.15.37:0/2381926074 >> v1:172.21.15.78:6789/0 conn(0x7f9458144e30 legacy=0x7f94580b7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:27.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.512+0000 7f945dc2c640 1 -- 172.21.15.37:0/2381926074 >> v1:172.21.15.37:6789/0 conn(0x7f94580bab80 legacy=0x7f945814b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:27.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.512+0000 7f945dc2c640 1 -- 172.21.15.37:0/2381926074 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9458145210 con 0x7f94580b8b40 2023-12-19T16:07:27.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.512+0000 7f945dc2c640 1 --2- 172.21.15.37:0/2381926074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94580b8b40 0x7f9458156330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f94581453a0 tx=0x7f945402bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ae3a55a438edc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:27.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.512+0000 7f944ffff640 1 -- 172.21.15.37:0/2381926074 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945402ccd0 con 0x7f94580b8b40 2023-12-19T16:07:27.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.513+0000 7f944ffff640 1 -- 172.21.15.37:0/2381926074 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945402ce30 con 0x7f94580b8b40 2023-12-19T16:07:27.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.513+0000 7f944ffff640 1 -- 172.21.15.37:0/2381926074 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9454034640 con 0x7f94580b8b40 2023-12-19T16:07:27.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.513+0000 7f945f68f640 1 -- 172.21.15.37:0/2381926074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94580b8b40 msgr2=0x7f9458156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:27.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.513+0000 7f945f68f640 1 --2- 172.21.15.37:0/2381926074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94580b8b40 0x7f9458156330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f94581453a0 tx=0x7f945402bf20 comp rx=0 tx=0).stop 2023-12-19T16:07:27.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.513+0000 7f945f68f640 1 -- 172.21.15.37:0/2381926074 shutdown_connections 2023-12-19T16:07:27.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.513+0000 7f945f68f640 1 --2- 172.21.15.37:0/2381926074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94580b8b40 0x7f9458156330 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.513+0000 7f945f68f640 1 -- 172.21.15.37:0/2381926074 >> 172.21.15.37:0/2381926074 conn(0x7f94580c0200 msgr2=0x7f94580c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:27.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.513+0000 7f945f68f640 1 -- 172.21.15.37:0/2381926074 shutdown_connections 2023-12-19T16:07:27.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.513+0000 7f945f68f640 1 -- 172.21.15.37:0/2381926074 wait complete. 2023-12-19T16:07:27.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.514+0000 7f945f68f640 1 Processor -- start 2023-12-19T16:07:27.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.514+0000 7f945f68f640 1 -- start start 2023-12-19T16:07:27.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.515+0000 7f945f68f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94580b8b40 0x7f9458147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:27.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.515+0000 7f945f68f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94580bab80 0x7f94580af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:27.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.515+0000 7f945f68f640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9458144e30 0x7f94580afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.515+0000 7f945f68f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94581d1e30 con 0x7f94580b8b40 2023-12-19T16:07:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.515+0000 7f945f68f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94581d0dc0 con 0x7f94580bab80 2023-12-19T16:07:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.515+0000 7f945f68f640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9458147f70 con 0x7f9458144e30 2023-12-19T16:07:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.515+0000 7f945d42b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94580b8b40 0x7f9458147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.515+0000 7f945d42b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94580b8b40 0x7f9458147a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58396/0 (socket says 172.21.15.37:58396) 2023-12-19T16:07:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.515+0000 7f945d42b640 1 -- 172.21.15.37:0/693002844 learned_addr learned my addr 172.21.15.37:0/693002844 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.515+0000 7f945d42b640 1 -- 172.21.15.37:0/693002844 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9458144e30 msgr2=0x7f94580afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.515+0000 7f945dc2c640 1 --2- 172.21.15.37:0/693002844 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9458144e30 0x7f94580afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.515+0000 7f945cc2a640 1 --2- 172.21.15.37:0/693002844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94580bab80 0x7f94580af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.515+0000 7f945d42b640 1 --2- 172.21.15.37:0/693002844 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9458144e30 0x7f94580afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.515+0000 7f945d42b640 1 -- 172.21.15.37:0/693002844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94580bab80 msgr2=0x7f94580af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.515+0000 7f945d42b640 1 --2- 172.21.15.37:0/693002844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94580bab80 0x7f94580af520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.515+0000 7f945d42b640 1 -- 172.21.15.37:0/693002844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9454009a70 con 0x7f94580b8b40 2023-12-19T16:07:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.515+0000 7f945dc2c640 1 --2- 172.21.15.37:0/693002844 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9458144e30 0x7f94580afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.515+0000 7f945cc2a640 1 --2- 172.21.15.37:0/693002844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94580bab80 0x7f94580af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.516+0000 7f945d42b640 1 --2- 172.21.15.37:0/693002844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94580b8b40 0x7f9458147a30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f945000b420 tx=0x7f945000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.516+0000 7f944dffb640 1 -- 172.21.15.37:0/693002844 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9450011830 con 0x7f94580b8b40 2023-12-19T16:07:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.516+0000 7f944dffb640 1 -- 172.21.15.37:0/693002844 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9450011990 con 0x7f94580b8b40 2023-12-19T16:07:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.516+0000 7f945f68f640 1 -- 172.21.15.37:0/693002844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94581d1a50 con 0x7f94580b8b40 2023-12-19T16:07:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.516+0000 7f944dffb640 1 -- 172.21.15.37:0/693002844 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9450011d40 con 0x7f94580b8b40 2023-12-19T16:07:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.516+0000 7f945f68f640 1 -- 172.21.15.37:0/693002844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94581d21c0 con 0x7f94580b8b40 2023-12-19T16:07:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.517+0000 7f944dffb640 1 -- 172.21.15.37:0/693002844 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f945001b460 con 0x7f94580b8b40 2023-12-19T16:07:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.517+0000 7f945f68f640 1 -- 172.21.15.37:0/693002844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94581d1f70 con 0x7f94580b8b40 2023-12-19T16:07:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.517+0000 7f944dffb640 1 --2- 172.21.15.37:0/693002844 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f943c06a430 0x7f943c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:27.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.518+0000 7f944dffb640 1 -- 172.21.15.37:0/693002844 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9450088460 con 0x7f94580b8b40 2023-12-19T16:07:27.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.518+0000 7f945cc2a640 1 --2- 172.21.15.37:0/693002844 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f943c06a430 0x7f943c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:27.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.518+0000 7f945cc2a640 1 --2- 172.21.15.37:0/693002844 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f943c06a430 0x7f943c06c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f94480013f0 tx=0x7f9448009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:27.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.522+0000 7f944dffb640 1 -- 172.21.15.37:0/693002844 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f94581d1f70 con 0x7f94580b8b40 2023-12-19T16:07:27.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.712+0000 7f945f68f640 1 -- 172.21.15.37:0/693002844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f94581d1f70 con 0x7f94580b8b40 2023-12-19T16:07:27.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.713+0000 7f944dffb640 1 -- 172.21.15.37:0/693002844 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f94581d1f70 con 0x7f94580b8b40 2023-12-19T16:07:27.715 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-12-19T16:07:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.714+0000 7f945f68f640 1 -- 172.21.15.37:0/693002844 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f943c06a430 msgr2=0x7f943c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.714+0000 7f945f68f640 1 --2- 172.21.15.37:0/693002844 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f943c06a430 0x7f943c06c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f94480013f0 tx=0x7f9448009040 comp rx=0 tx=0).stop 2023-12-19T16:07:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.714+0000 7f945f68f640 1 -- 172.21.15.37:0/693002844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94580b8b40 msgr2=0x7f9458147a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.714+0000 7f945f68f640 1 --2- 172.21.15.37:0/693002844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94580b8b40 0x7f9458147a30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f945000b420 tx=0x7f945000b8e0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.714+0000 7f945f68f640 1 -- 172.21.15.37:0/693002844 shutdown_connections 2023-12-19T16:07:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.714+0000 7f945f68f640 1 --2- 172.21.15.37:0/693002844 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f943c06a430 0x7f943c06c8f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.714+0000 7f945f68f640 1 --2- 172.21.15.37:0/693002844 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9458144e30 0x7f94580afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.714+0000 7f945f68f640 1 --2- 172.21.15.37:0/693002844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94580bab80 0x7f94580af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.714+0000 7f945f68f640 1 --2- 172.21.15.37:0/693002844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94580b8b40 0x7f9458147a30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.714+0000 7f945f68f640 1 -- 172.21.15.37:0/693002844 >> 172.21.15.37:0/693002844 conn(0x7f94580c0200 msgr2=0x7f94580b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.715+0000 7f945f68f640 1 -- 172.21.15.37:0/693002844 shutdown_connections 2023-12-19T16:07:27.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:27.715+0000 7f945f68f640 1 -- 172.21.15.37:0/693002844 wait complete. 2023-12-19T16:07:27.727 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T16:07:27.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:27.727 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-19T16:07:27.838 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T16:07:27.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:27.838 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T16:07:27.899 INFO:tasks.cephfs.cephfs_test_case:[] 2023-12-19T16:07:27.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:07:28.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.004+0000 7f8944017640 1 Processor -- start 2023-12-19T16:07:28.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.004+0000 7f8944017640 1 -- start start 2023-12-19T16:07:28.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.005+0000 7f8944017640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f893c0bcdd0 0x7f893c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.005+0000 7f8944017640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f893c0b64c0 0x7f893c144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.005+0000 7f8944017640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893c0bc6b0 con 0x7f893c144cd0 2023-12-19T16:07:28.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.005+0000 7f8944017640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893c0b6900 con 0x7f893c0b64c0 2023-12-19T16:07:28.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.005+0000 7f8944017640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893c0a59f0 con 0x7f893c0bcdd0 2023-12-19T16:07:28.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.005+0000 7f89415b2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f893c0b64c0 0x7f893c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.005+0000 7f89415b2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f893c0b64c0 0x7f893c144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58404/0 (socket says 172.21.15.37:58404) 2023-12-19T16:07:28.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.005+0000 7f89415b2640 1 -- 172.21.15.37:0/2481881852 learned_addr learned my addr 172.21.15.37:0/2481881852 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:28.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.005+0000 7f8941db3640 1 --2- 172.21.15.37:0/2481881852 >> v2:172.21.15.78:3300/0 conn(0x7f893c0bcdd0 0x7f893c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.005+0000 7f89415b2640 1 -- 172.21.15.37:0/2481881852 >> v2:172.21.15.78:3300/0 conn(0x7f893c0bcdd0 msgr2=0x7f893c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:28.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.005+0000 7f89415b2640 1 --2- 172.21.15.37:0/2481881852 >> v2:172.21.15.78:3300/0 conn(0x7f893c0bcdd0 0x7f893c0b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.005+0000 7f89415b2640 1 -- 172.21.15.37:0/2481881852 >> v1:172.21.15.78:6789/0 conn(0x7f893c144cd0 legacy=0x7f893c14e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:28.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.005+0000 7f89415b2640 1 -- 172.21.15.37:0/2481881852 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c0bc0a0 con 0x7f893c0b64c0 2023-12-19T16:07:28.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.006+0000 7f89415b2640 1 --2- 172.21.15.37:0/2481881852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893c0b64c0 0x7f893c144790 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f893c0c10f0 tx=0x7f892c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208f91ad610c47b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.006+0000 7f8940db1640 1 -- 172.21.15.37:0/2481881852 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c030860 con 0x7f893c0b64c0 2023-12-19T16:07:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.006+0000 7f8940db1640 1 -- 172.21.15.37:0/2481881852 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c0309c0 con 0x7f893c0b64c0 2023-12-19T16:07:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.006+0000 7f8940db1640 1 -- 172.21.15.37:0/2481881852 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c030d50 con 0x7f893c0b64c0 2023-12-19T16:07:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.006+0000 7f8944017640 1 -- 172.21.15.37:0/2481881852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893c0b64c0 msgr2=0x7f893c144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.006+0000 7f8944017640 1 --2- 172.21.15.37:0/2481881852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893c0b64c0 0x7f893c144790 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f893c0c10f0 tx=0x7f892c02b9a0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.006+0000 7f8944017640 1 -- 172.21.15.37:0/2481881852 shutdown_connections 2023-12-19T16:07:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.007+0000 7f8944017640 1 --2- 172.21.15.37:0/2481881852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893c0b64c0 0x7f893c144790 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.007+0000 7f8944017640 1 --2- 172.21.15.37:0/2481881852 >> v2:172.21.15.78:3300/0 conn(0x7f893c0bcdd0 0x7f893c0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.007+0000 7f8944017640 1 -- 172.21.15.37:0/2481881852 >> 172.21.15.37:0/2481881852 conn(0x7f893c071e60 msgr2=0x7f893c0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.007+0000 7f8944017640 1 -- 172.21.15.37:0/2481881852 shutdown_connections 2023-12-19T16:07:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.007+0000 7f8944017640 1 -- 172.21.15.37:0/2481881852 wait complete. 2023-12-19T16:07:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.008+0000 7f8944017640 1 Processor -- start 2023-12-19T16:07:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.008+0000 7f8944017640 1 -- start start 2023-12-19T16:07:28.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.008+0000 7f8944017640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f893c0b64c0 0x7f893c1d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.008+0000 7f8944017640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f893c0bcdd0 0x7f893c1d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.008+0000 7f8944017640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893c144cd0 0x7f893c14a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.008+0000 7f8944017640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c1d1420 con 0x7f893c144cd0 2023-12-19T16:07:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.008+0000 7f8944017640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c148e00 con 0x7f893c0bcdd0 2023-12-19T16:07:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.008+0000 7f8944017640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893c149ee0 con 0x7f893c0b64c0 2023-12-19T16:07:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.008+0000 7f89425b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893c144cd0 0x7f893c14a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.008+0000 7f89425b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893c144cd0 0x7f893c14a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58408/0 (socket says 172.21.15.37:58408) 2023-12-19T16:07:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.008+0000 7f89425b4640 1 -- 172.21.15.37:0/1829637302 learned_addr learned my addr 172.21.15.37:0/1829637302 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.009+0000 7f8941db3640 1 --2- 172.21.15.37:0/1829637302 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f893c0b64c0 0x7f893c1d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.009+0000 7f89415b2640 1 --2- 172.21.15.37:0/1829637302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f893c0bcdd0 0x7f893c1d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.009+0000 7f89425b4640 1 -- 172.21.15.37:0/1829637302 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f893c0b64c0 msgr2=0x7f893c1d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.009+0000 7f89425b4640 1 --2- 172.21.15.37:0/1829637302 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f893c0b64c0 0x7f893c1d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.009+0000 7f89425b4640 1 -- 172.21.15.37:0/1829637302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f893c0bcdd0 msgr2=0x7f893c1d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.009+0000 7f89425b4640 1 --2- 172.21.15.37:0/1829637302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f893c0bcdd0 0x7f893c1d1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.009+0000 7f89425b4640 1 -- 172.21.15.37:0/1829637302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892c0094d0 con 0x7f893c144cd0 2023-12-19T16:07:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.009+0000 7f89415b2640 1 --2- 172.21.15.37:0/1829637302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f893c0bcdd0 0x7f893c1d1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.009+0000 7f89425b4640 1 --2- 172.21.15.37:0/1829637302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893c144cd0 0x7f893c14a370 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f893400b9a0 tx=0x7f893400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.009+0000 7f89327fc640 1 -- 172.21.15.37:0/1829637302 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893400cba0 con 0x7f893c144cd0 2023-12-19T16:07:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.009+0000 7f89327fc640 1 -- 172.21.15.37:0/1829637302 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893400cd00 con 0x7f893c144cd0 2023-12-19T16:07:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.009+0000 7f8944017640 1 -- 172.21.15.37:0/1829637302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893c1d2570 con 0x7f893c144cd0 2023-12-19T16:07:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.009+0000 7f89327fc640 1 -- 172.21.15.37:0/1829637302 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934014680 con 0x7f893c144cd0 2023-12-19T16:07:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.009+0000 7f8944017640 1 -- 172.21.15.37:0/1829637302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893c149b70 con 0x7f893c144cd0 2023-12-19T16:07:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.010+0000 7f8944017640 1 -- 172.21.15.37:0/1829637302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893c04e840 con 0x7f893c144cd0 2023-12-19T16:07:28.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.011+0000 7f89327fc640 1 -- 172.21.15.37:0/1829637302 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f893401d3b0 con 0x7f893c144cd0 2023-12-19T16:07:28.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.011+0000 7f89327fc640 1 --2- 172.21.15.37:0/1829637302 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f892006a430 0x7f892006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.011+0000 7f89327fc640 1 -- 172.21.15.37:0/1829637302 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89340886e0 con 0x7f893c144cd0 2023-12-19T16:07:28.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.011+0000 7f8941db3640 1 --2- 172.21.15.37:0/1829637302 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f892006a430 0x7f892006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.012+0000 7f8941db3640 1 --2- 172.21.15.37:0/1829637302 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f892006a430 0x7f892006c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8938006fd0 tx=0x7f8938008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:28.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.016+0000 7f89327fc640 1 -- 172.21.15.37:0/1829637302 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8934053d60 con 0x7f893c144cd0 2023-12-19T16:07:28.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.225+0000 7f8944017640 1 -- 172.21.15.37:0/1829637302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f893c14a020 con 0x7f893c144cd0 2023-12-19T16:07:28.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.226+0000 7f89327fc640 1 -- 172.21.15.37:0/1829637302 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3947 (secure 0 0 0) 0x7f8934057380 con 0x7f893c144cd0 2023-12-19T16:07:28.229 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:28.229 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4079311036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4079311036},{"type":"v1","addr":"172.21.15.37:6834","nonce":4079311036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1300485428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1300485428},{"type":"v1","addr":"172.21.15.37:6835","nonce":1300485428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:06:58.727746+0000","modified":"2023-12-19T16:07:01.300113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/3319636422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3319636422},{"type":"v1","addr":"172.21.15.78:6835","nonce":3319636422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:07:28.231 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-12-19T16:07:28.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.228+0000 7f8944017640 1 -- 172.21.15.37:0/1829637302 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f892006a430 msgr2=0x7f892006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.228+0000 7f8944017640 1 --2- 172.21.15.37:0/1829637302 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f892006a430 0x7f892006c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8938006fd0 tx=0x7f8938008040 comp rx=0 tx=0).stop 2023-12-19T16:07:28.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.228+0000 7f8944017640 1 -- 172.21.15.37:0/1829637302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893c144cd0 msgr2=0x7f893c14a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.228+0000 7f8944017640 1 --2- 172.21.15.37:0/1829637302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893c144cd0 0x7f893c14a370 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f893400b9a0 tx=0x7f893400be60 comp rx=0 tx=0).stop 2023-12-19T16:07:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.228+0000 7f8944017640 1 -- 172.21.15.37:0/1829637302 shutdown_connections 2023-12-19T16:07:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.228+0000 7f8944017640 1 --2- 172.21.15.37:0/1829637302 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f892006a430 0x7f892006c8f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.228+0000 7f8944017640 1 --2- 172.21.15.37:0/1829637302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893c144cd0 0x7f893c14a370 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.228+0000 7f8944017640 1 --2- 172.21.15.37:0/1829637302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f893c0bcdd0 0x7f893c1d1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.228+0000 7f8944017640 1 --2- 172.21.15.37:0/1829637302 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f893c0b64c0 0x7f893c1d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.228+0000 7f8944017640 1 -- 172.21.15.37:0/1829637302 >> 172.21.15.37:0/1829637302 conn(0x7f893c071e60 msgr2=0x7f893c141d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.228+0000 7f8944017640 1 -- 172.21.15.37:0/1829637302 shutdown_connections 2023-12-19T16:07:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.228+0000 7f8944017640 1 -- 172.21.15.37:0/1829637302 wait complete. 2023-12-19T16:07:28.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:07:28.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.344+0000 7f063a8cf640 1 Processor -- start 2023-12-19T16:07:28.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.345+0000 7f063a8cf640 1 -- start start 2023-12-19T16:07:28.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.345+0000 7f063a8cf640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06340b6690 0x7f0634144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.345+0000 7f063a8cf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0634144cd0 0x7f0634155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.345+0000 7f063a8cf640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06340bc6b0 con 0x7f06340bcdd0 2023-12-19T16:07:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.345+0000 7f063a8cf640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06340a59f0 con 0x7f0634144cd0 2023-12-19T16:07:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.345+0000 7f063a8cf640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06340bc0a0 con 0x7f06340b6690 2023-12-19T16:07:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.345+0000 7f0638e6c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0634144cd0 0x7f0634155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.345+0000 7f0638e6c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0634144cd0 0x7f0634155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58414/0 (socket says 172.21.15.37:58414) 2023-12-19T16:07:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.345+0000 7f0638e6c640 1 -- 172.21.15.37:0/2311213037 learned_addr learned my addr 172.21.15.37:0/2311213037 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.345+0000 7f06337fe640 1 --2- 172.21.15.37:0/2311213037 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06340b6690 0x7f0634144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.346+0000 7f0638e6c640 1 -- 172.21.15.37:0/2311213037 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06340b6690 msgr2=0x7f0634144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.346+0000 7f0638e6c640 1 --2- 172.21.15.37:0/2311213037 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06340b6690 0x7f0634144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.346+0000 7f0638e6c640 1 -- 172.21.15.37:0/2311213037 >> v1:172.21.15.78:6789/0 conn(0x7f06340bcdd0 legacy=0x7f06340b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.346+0000 7f0638e6c640 1 -- 172.21.15.37:0/2311213037 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06340bc340 con 0x7f0634144cd0 2023-12-19T16:07:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.346+0000 7f0638e6c640 1 --2- 172.21.15.37:0/2311213037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0634144cd0 0x7f0634155340 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f062c009e50 tx=0x7f062c02bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ebb74d54f0b193 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:28.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.347+0000 7f0632ffd640 1 -- 172.21.15.37:0/2311213037 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c02cb90 con 0x7f0634144cd0 2023-12-19T16:07:28.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.347+0000 7f0632ffd640 1 -- 172.21.15.37:0/2311213037 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c02ccf0 con 0x7f0634144cd0 2023-12-19T16:07:28.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.347+0000 7f0632ffd640 1 -- 172.21.15.37:0/2311213037 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c034610 con 0x7f0634144cd0 2023-12-19T16:07:28.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.347+0000 7f063a8cf640 1 -- 172.21.15.37:0/2311213037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0634144cd0 msgr2=0x7f0634155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.347+0000 7f063a8cf640 1 --2- 172.21.15.37:0/2311213037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0634144cd0 0x7f0634155340 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f062c009e50 tx=0x7f062c02bff0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.347+0000 7f063a8cf640 1 -- 172.21.15.37:0/2311213037 shutdown_connections 2023-12-19T16:07:28.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.347+0000 7f063a8cf640 1 --2- 172.21.15.37:0/2311213037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0634144cd0 0x7f0634155340 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.347+0000 7f063a8cf640 1 --2- 172.21.15.37:0/2311213037 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06340b6690 0x7f0634144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.347+0000 7f063a8cf640 1 -- 172.21.15.37:0/2311213037 >> 172.21.15.37:0/2311213037 conn(0x7f0634071e60 msgr2=0x7f06340c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:28.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.347+0000 7f063a8cf640 1 -- 172.21.15.37:0/2311213037 shutdown_connections 2023-12-19T16:07:28.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.347+0000 7f063a8cf640 1 -- 172.21.15.37:0/2311213037 wait complete. 2023-12-19T16:07:28.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.348+0000 7f063a8cf640 1 Processor -- start 2023-12-19T16:07:28.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.348+0000 7f063a8cf640 1 -- start start 2023-12-19T16:07:28.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.349+0000 7f063a8cf640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06340b6690 0x7f063414a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.349+0000 7f063a8cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06340bcdd0 0x7f06341453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.349+0000 7f063a8cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0634144cd0 0x7f0634147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.349+0000 7f063a8cf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063414b9c0 con 0x7f06340bcdd0 2023-12-19T16:07:28.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.349+0000 7f063a8cf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0634148310 con 0x7f0634144cd0 2023-12-19T16:07:28.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.349+0000 7f063a8cf640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063414b6e0 con 0x7f06340b6690 2023-12-19T16:07:28.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.349+0000 7f06337fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06340bcdd0 0x7f06341453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.349+0000 7f06337fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06340bcdd0 0x7f06341453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58418/0 (socket says 172.21.15.37:58418) 2023-12-19T16:07:28.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.349+0000 7f06337fe640 1 -- 172.21.15.37:0/2088504322 learned_addr learned my addr 172.21.15.37:0/2088504322 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:28.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.349+0000 7f0633fff640 1 --2- 172.21.15.37:0/2088504322 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06340b6690 0x7f063414a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.349+0000 7f0638e6c640 1 --2- 172.21.15.37:0/2088504322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0634144cd0 0x7f0634147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.349+0000 7f06337fe640 1 -- 172.21.15.37:0/2088504322 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06340b6690 msgr2=0x7f063414a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.349+0000 7f06337fe640 1 --2- 172.21.15.37:0/2088504322 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06340b6690 0x7f063414a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.349+0000 7f06337fe640 1 -- 172.21.15.37:0/2088504322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0634144cd0 msgr2=0x7f0634147c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.349+0000 7f06337fe640 1 --2- 172.21.15.37:0/2088504322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0634144cd0 0x7f0634147c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.349+0000 7f06337fe640 1 -- 172.21.15.37:0/2088504322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c009b30 con 0x7f06340bcdd0 2023-12-19T16:07:28.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.349+0000 7f0638e6c640 1 --2- 172.21.15.37:0/2088504322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0634144cd0 0x7f0634147c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:28.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.350+0000 7f06337fe640 1 --2- 172.21.15.37:0/2088504322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06340bcdd0 0x7f06341453f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f062800e870 tx=0x7f062800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:28.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.350+0000 7f0630ff9640 1 -- 172.21.15.37:0/2088504322 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06280094f0 con 0x7f06340bcdd0 2023-12-19T16:07:28.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.350+0000 7f0630ff9640 1 -- 172.21.15.37:0/2088504322 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062800c940 con 0x7f06340bcdd0 2023-12-19T16:07:28.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.350+0000 7f063a8cf640 1 -- 172.21.15.37:0/2088504322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06341e3c40 con 0x7f06340bcdd0 2023-12-19T16:07:28.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.350+0000 7f0630ff9640 1 -- 172.21.15.37:0/2088504322 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062800ccf0 con 0x7f06340bcdd0 2023-12-19T16:07:28.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.350+0000 7f063a8cf640 1 -- 172.21.15.37:0/2088504322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063414aa10 con 0x7f06340bcdd0 2023-12-19T16:07:28.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.351+0000 7f063a8cf640 1 -- 172.21.15.37:0/2088504322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0634149db0 con 0x7f06340bcdd0 2023-12-19T16:07:28.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.351+0000 7f0630ff9640 1 -- 172.21.15.37:0/2088504322 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0628013470 con 0x7f06340bcdd0 2023-12-19T16:07:28.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.352+0000 7f0630ff9640 1 --2- 172.21.15.37:0/2088504322 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f062006a430 0x7f062006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.352+0000 7f0630ff9640 1 -- 172.21.15.37:0/2088504322 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0628088990 con 0x7f06340bcdd0 2023-12-19T16:07:28.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.352+0000 7f0633fff640 1 --2- 172.21.15.37:0/2088504322 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f062006a430 0x7f062006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.353+0000 7f0633fff640 1 --2- 172.21.15.37:0/2088504322 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f062006a430 0x7f062006c8f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0624000f60 tx=0x7f0624009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:28.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.356+0000 7f0630ff9640 1 -- 172.21.15.37:0/2088504322 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0634149db0 con 0x7f06340bcdd0 2023-12-19T16:07:28.432 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:07:28.434 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:07:28.437 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:07:28.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.537+0000 7f063a8cf640 1 -- 172.21.15.37:0/2088504322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0634149db0 con 0x7f06340bcdd0 2023-12-19T16:07:28.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.538+0000 7f0630ff9640 1 -- 172.21.15.37:0/2088504322 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f0634149db0 con 0x7f06340bcdd0 2023-12-19T16:07:28.540 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:28.540 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:59.728935+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:06:56.758166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:06:57.635291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:07:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.539+0000 7f063a8cf640 1 -- 172.21.15.37:0/2088504322 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f062006a430 msgr2=0x7f062006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.539+0000 7f063a8cf640 1 --2- 172.21.15.37:0/2088504322 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f062006a430 0x7f062006c8f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0624000f60 tx=0x7f0624009040 comp rx=0 tx=0).stop 2023-12-19T16:07:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.539+0000 7f063a8cf640 1 -- 172.21.15.37:0/2088504322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06340bcdd0 msgr2=0x7f06341453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.539+0000 7f063a8cf640 1 --2- 172.21.15.37:0/2088504322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06340bcdd0 0x7f06341453f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f062800e870 tx=0x7f062800ed30 comp rx=0 tx=0).stop 2023-12-19T16:07:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.539+0000 7f063a8cf640 1 -- 172.21.15.37:0/2088504322 shutdown_connections 2023-12-19T16:07:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.539+0000 7f063a8cf640 1 --2- 172.21.15.37:0/2088504322 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f062006a430 0x7f062006c8f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.540+0000 7f063a8cf640 1 --2- 172.21.15.37:0/2088504322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0634144cd0 0x7f0634147c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.540+0000 7f063a8cf640 1 --2- 172.21.15.37:0/2088504322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06340bcdd0 0x7f06341453f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.540+0000 7f063a8cf640 1 --2- 172.21.15.37:0/2088504322 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f06340b6690 0x7f063414a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.540+0000 7f063a8cf640 1 -- 172.21.15.37:0/2088504322 >> 172.21.15.37:0/2088504322 conn(0x7f0634071e60 msgr2=0x7f06340b88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:28.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.540+0000 7f063a8cf640 1 -- 172.21.15.37:0/2088504322 shutdown_connections 2023-12-19T16:07:28.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.540+0000 7f063a8cf640 1 -- 172.21.15.37:0/2088504322 wait complete. 2023-12-19T16:07:28.552 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:06:46.684027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:06:56.758166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:06:57.635291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:07:28.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:07:28.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.660+0000 7f418493c640 1 Processor -- start 2023-12-19T16:07:28.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.660+0000 7f418493c640 1 -- start start 2023-12-19T16:07:28.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.660+0000 7f418493c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41800bb140 0x7f41800be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.660+0000 7f418493c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41800bf510 0x7f41800bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.660+0000 7f418493c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41800bfa50 con 0x7f418006a950 2023-12-19T16:07:28.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.660+0000 7f418493c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41800bbda0 con 0x7f41800bb140 2023-12-19T16:07:28.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.660+0000 7f418493c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418006b040 con 0x7f41800bf510 2023-12-19T16:07:28.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.660+0000 7f417e59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41800bb140 0x7f41800be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.660+0000 7f417dd9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f418006a950 0x7f41800bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35024/0 (socket says 172.21.15.37:35024) 2023-12-19T16:07:28.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.660+0000 7f417dd9b640 1 -- 172.21.15.37:0/3511437011 learned_addr learned my addr 172.21.15.37:0/3511437011 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:28.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.661+0000 7f417ed9d640 1 --2- 172.21.15.37:0/3511437011 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41800bf510 0x7f41800bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.661+0000 7f417e59c640 1 -- 172.21.15.37:0/3511437011 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41800bf510 msgr2=0x7f41800bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:28.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.661+0000 7f417e59c640 1 --2- 172.21.15.37:0/3511437011 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41800bf510 0x7f41800bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.661+0000 7f417e59c640 1 -- 172.21.15.37:0/3511437011 >> v1:172.21.15.37:6789/0 conn(0x7f418006a950 legacy=0x7f41800bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.661+0000 7f417e59c640 1 -- 172.21.15.37:0/3511437011 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41800bb520 con 0x7f41800bb140 2023-12-19T16:07:28.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.661+0000 7f417d59a640 1 -- 172.21.15.37:0/3511437011 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281895283 0 0) 0x7f41800bfa50 con 0x7f418006a950 2023-12-19T16:07:28.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.662+0000 7f417e59c640 1 --2- 172.21.15.37:0/3511437011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41800bb140 0x7f41800be350 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f41780097a0 tx=0x7f417802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc61d65604f8c548 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:28.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.662+0000 7f417d59a640 1 -- 172.21.15.37:0/3511437011 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417802e070 con 0x7f41800bb140 2023-12-19T16:07:28.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.662+0000 7f417d59a640 1 -- 172.21.15.37:0/3511437011 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41780315a0 con 0x7f41800bb140 2023-12-19T16:07:28.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.662+0000 7f417d59a640 1 -- 172.21.15.37:0/3511437011 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4178031930 con 0x7f41800bb140 2023-12-19T16:07:28.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.662+0000 7f418493c640 1 -- 172.21.15.37:0/3511437011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41800bb140 msgr2=0x7f41800be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.662+0000 7f418493c640 1 --2- 172.21.15.37:0/3511437011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41800bb140 0x7f41800be350 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f41780097a0 tx=0x7f417802b840 comp rx=0 tx=0).stop 2023-12-19T16:07:28.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.662+0000 7f418493c640 1 -- 172.21.15.37:0/3511437011 shutdown_connections 2023-12-19T16:07:28.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.662+0000 7f418493c640 1 --2- 172.21.15.37:0/3511437011 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41800bf510 0x7f41800bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.662+0000 7f418493c640 1 --2- 172.21.15.37:0/3511437011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41800bb140 0x7f41800be350 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.662+0000 7f418493c640 1 -- 172.21.15.37:0/3511437011 >> 172.21.15.37:0/3511437011 conn(0x7f41800bcfd0 msgr2=0x7f41800bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:28.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.662+0000 7f418493c640 1 -- 172.21.15.37:0/3511437011 shutdown_connections 2023-12-19T16:07:28.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.662+0000 7f418493c640 1 -- 172.21.15.37:0/3511437011 wait complete. 2023-12-19T16:07:28.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.664+0000 7f418493c640 1 Processor -- start 2023-12-19T16:07:28.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.664+0000 7f418493c640 1 -- start start 2023-12-19T16:07:28.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.664+0000 7f418493c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418006a950 0x7f418014eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.664+0000 7f418493c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41800bb140 0x7f41801dfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.664+0000 7f418493c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41800bf510 0x7f41800a2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.664+0000 7f418493c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418014d740 con 0x7f418006a950 2023-12-19T16:07:28.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.664+0000 7f418493c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418014f040 con 0x7f41800bb140 2023-12-19T16:07:28.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.664+0000 7f418493c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418014cc10 con 0x7f41800bf510 2023-12-19T16:07:28.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.664+0000 7f417e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418006a950 0x7f418014eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.664+0000 7f417e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418006a950 0x7f418014eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58438/0 (socket says 172.21.15.37:58438) 2023-12-19T16:07:28.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.664+0000 7f417e59c640 1 -- 172.21.15.37:0/3811745214 learned_addr learned my addr 172.21.15.37:0/3811745214 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:28.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.665+0000 7f417dd9b640 1 --2- 172.21.15.37:0/3811745214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41800bb140 0x7f41801dfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.665+0000 7f417ed9d640 1 --2- 172.21.15.37:0/3811745214 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41800bf510 0x7f41800a2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.665+0000 7f417e59c640 1 -- 172.21.15.37:0/3811745214 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41800bf510 msgr2=0x7f41800a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.665+0000 7f417e59c640 1 --2- 172.21.15.37:0/3811745214 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41800bf510 0x7f41800a2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.665+0000 7f417e59c640 1 -- 172.21.15.37:0/3811745214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41800bb140 msgr2=0x7f41801dfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.665+0000 7f417e59c640 1 --2- 172.21.15.37:0/3811745214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41800bb140 0x7f41801dfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.665+0000 7f417e59c640 1 -- 172.21.15.37:0/3811745214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4178009400 con 0x7f418006a950 2023-12-19T16:07:28.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.665+0000 7f417dd9b640 1 --2- 172.21.15.37:0/3811745214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41800bb140 0x7f41801dfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:28.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.665+0000 7f417e59c640 1 --2- 172.21.15.37:0/3811745214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418006a950 0x7f418014eb00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4178034040 tx=0x7f41780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:28.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.665+0000 7f416effd640 1 -- 172.21.15.37:0/3811745214 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4178032840 con 0x7f418006a950 2023-12-19T16:07:28.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.665+0000 7f416effd640 1 -- 172.21.15.37:0/3811745214 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41780329a0 con 0x7f418006a950 2023-12-19T16:07:28.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.665+0000 7f416effd640 1 -- 172.21.15.37:0/3811745214 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4178032d50 con 0x7f418006a950 2023-12-19T16:07:28.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.665+0000 7f418493c640 1 -- 172.21.15.37:0/3811745214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41801e02e0 con 0x7f418006a950 2023-12-19T16:07:28.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.665+0000 7f418493c640 1 -- 172.21.15.37:0/3811745214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4180149480 con 0x7f418006a950 2023-12-19T16:07:28.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.666+0000 7f418493c640 1 -- 172.21.15.37:0/3811745214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41800740a0 con 0x7f418006a950 2023-12-19T16:07:28.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.666+0000 7f416effd640 1 -- 172.21.15.37:0/3811745214 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f417804e430 con 0x7f418006a950 2023-12-19T16:07:28.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.667+0000 7f416effd640 1 --2- 172.21.15.37:0/3811745214 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f416006a430 0x7f416006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.667+0000 7f416effd640 1 -- 172.21.15.37:0/3811745214 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41780aa8f0 con 0x7f418006a950 2023-12-19T16:07:28.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.667+0000 7f417dd9b640 1 --2- 172.21.15.37:0/3811745214 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f416006a430 0x7f416006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.667+0000 7f417dd9b640 1 --2- 172.21.15.37:0/3811745214 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f416006a430 0x7f416006c8f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f41801e0e60 tx=0x7f4174009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:28.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.671+0000 7f416effd640 1 -- 172.21.15.37:0/3811745214 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4178075f50 con 0x7f418006a950 2023-12-19T16:07:28.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.846+0000 7f418493c640 1 -- 172.21.15.37:0/3811745214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f41800a4c90 con 0x7f418006a950 2023-12-19T16:07:28.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.847+0000 7f416effd640 1 -- 172.21.15.37:0/3811745214 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4178079570 con 0x7f418006a950 2023-12-19T16:07:28.849 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-19T16:07:28.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.849+0000 7f418493c640 1 -- 172.21.15.37:0/3811745214 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f416006a430 msgr2=0x7f416006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.849+0000 7f418493c640 1 --2- 172.21.15.37:0/3811745214 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f416006a430 0x7f416006c8f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f41801e0e60 tx=0x7f4174009040 comp rx=0 tx=0).stop 2023-12-19T16:07:28.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.849+0000 7f418493c640 1 -- 172.21.15.37:0/3811745214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418006a950 msgr2=0x7f418014eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.849+0000 7f418493c640 1 --2- 172.21.15.37:0/3811745214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418006a950 0x7f418014eb00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4178034040 tx=0x7f41780046c0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.849+0000 7f418493c640 1 -- 172.21.15.37:0/3811745214 shutdown_connections 2023-12-19T16:07:28.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.849+0000 7f418493c640 1 --2- 172.21.15.37:0/3811745214 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f416006a430 0x7f416006c8f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.849+0000 7f418493c640 1 --2- 172.21.15.37:0/3811745214 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41800bf510 0x7f41800a2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.849+0000 7f418493c640 1 --2- 172.21.15.37:0/3811745214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41800bb140 0x7f41801dfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.849+0000 7f418493c640 1 --2- 172.21.15.37:0/3811745214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418006a950 0x7f418014eb00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.849+0000 7f418493c640 1 -- 172.21.15.37:0/3811745214 >> 172.21.15.37:0/3811745214 conn(0x7f41800bcfd0 msgr2=0x7f41800a5770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:28.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.849+0000 7f418493c640 1 -- 172.21.15.37:0/3811745214 shutdown_connections 2023-12-19T16:07:28.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.849+0000 7f418493c640 1 -- 172.21.15.37:0/3811745214 wait complete. 2023-12-19T16:07:28.862 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:07:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.968+0000 7fde0dc38640 1 Processor -- start 2023-12-19T16:07:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.968+0000 7fde0dc38640 1 -- start start 2023-12-19T16:07:28.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.969+0000 7fde0dc38640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde0806c920 0x7fde081564a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.969+0000 7fde0dc38640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde080b9d90 con 0x7fde08145160 2023-12-19T16:07:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.969+0000 7fde0dc38640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0806b3c0 con 0x7fde080ba650 2023-12-19T16:07:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.969+0000 7fde0dc38640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde080b9260 con 0x7fde0806c920 2023-12-19T16:07:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.969+0000 7fde077fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fde08145160 0x7fde080b9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35036/0 (socket says 172.21.15.37:35036) 2023-12-19T16:07:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.969+0000 7fde07fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde0806c920 0x7fde081564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.969+0000 7fde077fe640 1 -- 172.21.15.37:0/2954505043 learned_addr learned my addr 172.21.15.37:0/2954505043 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.969+0000 7fde07fff640 1 -- 172.21.15.37:0/2954505043 >> v1:172.21.15.78:6789/0 conn(0x7fde080ba650 legacy=0x7fde0806acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.970+0000 7fde07fff640 1 -- 172.21.15.37:0/2954505043 >> v1:172.21.15.37:6789/0 conn(0x7fde08145160 legacy=0x7fde080b9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.970+0000 7fde07fff640 1 -- 172.21.15.37:0/2954505043 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde080bb230 con 0x7fde0806c920 2023-12-19T16:07:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.970+0000 7fde067fc640 1 -- 172.21.15.37:0/2954505043 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1355029951 0 0) 0x7fde080b9d90 con 0x7fde08145160 2023-12-19T16:07:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.970+0000 7fde07fff640 1 --2- 172.21.15.37:0/2954505043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde0806c920 0x7fde081564a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fde00009d90 tx=0x7fde0002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d51d3d0d90d9a54 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.970+0000 7fde067fc640 1 -- 172.21.15.37:0/2954505043 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0002cd00 con 0x7fde0806c920 2023-12-19T16:07:28.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.970+0000 7fde067fc640 1 -- 172.21.15.37:0/2954505043 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0002ce60 con 0x7fde0806c920 2023-12-19T16:07:28.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.970+0000 7fde067fc640 1 -- 172.21.15.37:0/2954505043 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00034660 con 0x7fde0806c920 2023-12-19T16:07:28.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.971+0000 7fde0dc38640 1 -- 172.21.15.37:0/2954505043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde0806c920 msgr2=0x7fde081564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.971+0000 7fde0dc38640 1 --2- 172.21.15.37:0/2954505043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde0806c920 0x7fde081564a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fde00009d90 tx=0x7fde0002bf50 comp rx=0 tx=0).stop 2023-12-19T16:07:28.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.971+0000 7fde0dc38640 1 -- 172.21.15.37:0/2954505043 shutdown_connections 2023-12-19T16:07:28.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.971+0000 7fde0dc38640 1 --2- 172.21.15.37:0/2954505043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde0806c920 0x7fde081564a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.971+0000 7fde0dc38640 1 -- 172.21.15.37:0/2954505043 >> 172.21.15.37:0/2954505043 conn(0x7fde080be0c0 msgr2=0x7fde080be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:28.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.971+0000 7fde0dc38640 1 -- 172.21.15.37:0/2954505043 shutdown_connections 2023-12-19T16:07:28.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.971+0000 7fde0dc38640 1 -- 172.21.15.37:0/2954505043 wait complete. 2023-12-19T16:07:28.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.972+0000 7fde0dc38640 1 Processor -- start 2023-12-19T16:07:28.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.972+0000 7fde0dc38640 1 -- start start 2023-12-19T16:07:28.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.973+0000 7fde0dc38640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde0806c920 0x7fde080b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.973+0000 7fde0dc38640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde080ba650 0x7fde0814a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.973+0000 7fde0dc38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde08145160 0x7fde0814ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.973+0000 7fde0dc38640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde080b3640 con 0x7fde08145160 2023-12-19T16:07:28.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.973+0000 7fde0dc38640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde081d4c80 con 0x7fde080ba650 2023-12-19T16:07:28.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.973+0000 7fde0dc38640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde080b40c0 con 0x7fde0806c920 2023-12-19T16:07:28.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.973+0000 7fde07fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde08145160 0x7fde0814ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.973+0000 7fde07fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde08145160 0x7fde0814ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58464/0 (socket says 172.21.15.37:58464) 2023-12-19T16:07:28.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.973+0000 7fde07fff640 1 -- 172.21.15.37:0/926971743 learned_addr learned my addr 172.21.15.37:0/926971743 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:28.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.973+0000 7fde077fe640 1 --2- 172.21.15.37:0/926971743 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde0806c920 0x7fde080b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.973+0000 7fde06ffd640 1 --2- 172.21.15.37:0/926971743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde080ba650 0x7fde0814a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.973+0000 7fde07fff640 1 -- 172.21.15.37:0/926971743 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde0806c920 msgr2=0x7fde080b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.973+0000 7fde07fff640 1 --2- 172.21.15.37:0/926971743 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde0806c920 0x7fde080b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.973+0000 7fde07fff640 1 -- 172.21.15.37:0/926971743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde080ba650 msgr2=0x7fde0814a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:28.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.973+0000 7fde07fff640 1 --2- 172.21.15.37:0/926971743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde080ba650 0x7fde0814a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:28.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.973+0000 7fde07fff640 1 -- 172.21.15.37:0/926971743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde00009a70 con 0x7fde08145160 2023-12-19T16:07:28.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.973+0000 7fde077fe640 1 --2- 172.21.15.37:0/926971743 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde0806c920 0x7fde080b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:28.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.973+0000 7fde06ffd640 1 --2- 172.21.15.37:0/926971743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde080ba650 0x7fde0814a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:28.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.974+0000 7fde07fff640 1 --2- 172.21.15.37:0/926971743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde08145160 0x7fde0814ad20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fde00009d90 tx=0x7fde00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:28.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.974+0000 7fddeffff640 1 -- 172.21.15.37:0/926971743 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0003d600 con 0x7fde08145160 2023-12-19T16:07:28.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.974+0000 7fddeffff640 1 -- 172.21.15.37:0/926971743 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0003d780 con 0x7fde08145160 2023-12-19T16:07:28.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.974+0000 7fde0dc38640 1 -- 172.21.15.37:0/926971743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde081d5970 con 0x7fde08145160 2023-12-19T16:07:28.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.974+0000 7fddeffff640 1 -- 172.21.15.37:0/926971743 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0003db30 con 0x7fde08145160 2023-12-19T16:07:28.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.974+0000 7fde0dc38640 1 -- 172.21.15.37:0/926971743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde081d5660 con 0x7fde08145160 2023-12-19T16:07:28.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.975+0000 7fde0dc38640 1 -- 172.21.15.37:0/926971743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde081d5e90 con 0x7fde08145160 2023-12-19T16:07:28.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.975+0000 7fddeffff640 1 -- 172.21.15.37:0/926971743 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fde0003b040 con 0x7fde08145160 2023-12-19T16:07:28.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.976+0000 7fddeffff640 1 --2- 172.21.15.37:0/926971743 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fddf406a430 0x7fddf406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:28.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.976+0000 7fddeffff640 1 -- 172.21.15.37:0/926971743 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde000aa8a0 con 0x7fde08145160 2023-12-19T16:07:28.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.976+0000 7fde077fe640 1 --2- 172.21.15.37:0/926971743 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fddf406a430 0x7fddf406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:28.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.976+0000 7fde077fe640 1 --2- 172.21.15.37:0/926971743 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fddf406a430 0x7fddf406c8f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fddf8000f60 tx=0x7fddf8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:28.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:28.980+0000 7fddeffff640 1 -- 172.21.15.37:0/926971743 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fde081d5e90 con 0x7fde08145160 2023-12-19T16:07:29.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.156+0000 7fde0dc38640 1 -- 172.21.15.37:0/926971743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fde081d5e90 con 0x7fde08145160 2023-12-19T16:07:29.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.157+0000 7fddeffff640 1 -- 172.21.15.37:0/926971743 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fde00039020 con 0x7fde08145160 2023-12-19T16:07:29.159 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-19T16:07:29.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.159+0000 7fde0dc38640 1 -- 172.21.15.37:0/926971743 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fddf406a430 msgr2=0x7fddf406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:29.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.159+0000 7fde0dc38640 1 --2- 172.21.15.37:0/926971743 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fddf406a430 0x7fddf406c8f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fddf8000f60 tx=0x7fddf8009040 comp rx=0 tx=0).stop 2023-12-19T16:07:29.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.159+0000 7fde0dc38640 1 -- 172.21.15.37:0/926971743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde08145160 msgr2=0x7fde0814ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:29.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.159+0000 7fde0dc38640 1 --2- 172.21.15.37:0/926971743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde08145160 0x7fde0814ad20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fde00009d90 tx=0x7fde00004a40 comp rx=0 tx=0).stop 2023-12-19T16:07:29.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.159+0000 7fde0dc38640 1 -- 172.21.15.37:0/926971743 shutdown_connections 2023-12-19T16:07:29.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.159+0000 7fde0dc38640 1 --2- 172.21.15.37:0/926971743 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fddf406a430 0x7fddf406c8f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.159+0000 7fde0dc38640 1 --2- 172.21.15.37:0/926971743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde08145160 0x7fde0814ad20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.159+0000 7fde0dc38640 1 --2- 172.21.15.37:0/926971743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde080ba650 0x7fde0814a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.159+0000 7fde0dc38640 1 --2- 172.21.15.37:0/926971743 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde0806c920 0x7fde080b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.159+0000 7fde0dc38640 1 -- 172.21.15.37:0/926971743 >> 172.21.15.37:0/926971743 conn(0x7fde080be0c0 msgr2=0x7fde080bc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:29.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.159+0000 7fde0dc38640 1 -- 172.21.15.37:0/926971743 shutdown_connections 2023-12-19T16:07:29.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.159+0000 7fde0dc38640 1 -- 172.21.15.37:0/926971743 wait complete. 2023-12-19T16:07:29.172 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:07:29.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.279+0000 7fe4470f3640 1 Processor -- start 2023-12-19T16:07:29.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.280+0000 7fe4470f3640 1 -- start start 2023-12-19T16:07:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.280+0000 7fe4470f3640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe4400bb140 0x7fe4400be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.280+0000 7fe4470f3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe44006a950 0x7fe4400bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.280+0000 7fe4470f3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe4400bee00 0x7fe4400bf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.280+0000 7fe4470f3640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4400bbda0 con 0x7fe44006a950 2023-12-19T16:07:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.280+0000 7fe4470f3640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4400bf790 con 0x7fe4400bee00 2023-12-19T16:07:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.280+0000 7fe4470f3640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4400bfa50 con 0x7fe4400bb140 2023-12-19T16:07:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.280+0000 7fe43ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe44006a950 0x7fe4400bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.280+0000 7fe43ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe44006a950 0x7fe4400bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58472/0 (socket says 172.21.15.37:58472) 2023-12-19T16:07:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.280+0000 7fe43ffff640 1 -- 172.21.15.37:0/2185442543 learned_addr learned my addr 172.21.15.37:0/2185442543 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.281+0000 7fe445690640 1 --2- 172.21.15.37:0/2185442543 >> v2:172.21.15.78:3300/0 conn(0x7fe4400bee00 0x7fe4400bf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.281+0000 7fe444e8f640 1 --2- 172.21.15.37:0/2185442543 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe4400bb140 0x7fe4400be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.281+0000 7fe43ffff640 1 -- 172.21.15.37:0/2185442543 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe4400bb140 msgr2=0x7fe4400be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.281+0000 7fe43ffff640 1 --2- 172.21.15.37:0/2185442543 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe4400bb140 0x7fe4400be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.281+0000 7fe43ffff640 1 -- 172.21.15.37:0/2185442543 >> v2:172.21.15.78:3300/0 conn(0x7fe4400bee00 msgr2=0x7fe4400bf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.281+0000 7fe43ffff640 1 --2- 172.21.15.37:0/2185442543 >> v2:172.21.15.78:3300/0 conn(0x7fe4400bee00 0x7fe4400bf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.281+0000 7fe43ffff640 1 -- 172.21.15.37:0/2185442543 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44006b040 con 0x7fe44006a950 2023-12-19T16:07:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.281+0000 7fe43ffff640 1 --2- 172.21.15.37:0/2185442543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe44006a950 0x7fe4400bfee0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe44008ac40 tx=0x7fe42c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a04af2a8b28603 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.281+0000 7fe43f7fe640 1 -- 172.21.15.37:0/2185442543 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0317e0 con 0x7fe44006a950 2023-12-19T16:07:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.282+0000 7fe43f7fe640 1 -- 172.21.15.37:0/2185442543 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c031940 con 0x7fe44006a950 2023-12-19T16:07:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.282+0000 7fe43f7fe640 1 -- 172.21.15.37:0/2185442543 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c031cd0 con 0x7fe44006a950 2023-12-19T16:07:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.282+0000 7fe4470f3640 1 -- 172.21.15.37:0/2185442543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe44006a950 msgr2=0x7fe4400bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.282+0000 7fe4470f3640 1 --2- 172.21.15.37:0/2185442543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe44006a950 0x7fe4400bfee0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe44008ac40 tx=0x7fe42c02b880 comp rx=0 tx=0).stop 2023-12-19T16:07:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.282+0000 7fe4470f3640 1 -- 172.21.15.37:0/2185442543 shutdown_connections 2023-12-19T16:07:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.282+0000 7fe4470f3640 1 --2- 172.21.15.37:0/2185442543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe44006a950 0x7fe4400bfee0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.282+0000 7fe4470f3640 1 --2- 172.21.15.37:0/2185442543 >> v2:172.21.15.78:3300/0 conn(0x7fe4400bee00 0x7fe4400bf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.282+0000 7fe4470f3640 1 --2- 172.21.15.37:0/2185442543 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe4400bb140 0x7fe4400be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.282+0000 7fe4470f3640 1 -- 172.21.15.37:0/2185442543 >> 172.21.15.37:0/2185442543 conn(0x7fe4400bcfd0 msgr2=0x7fe4400bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:29.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.282+0000 7fe4470f3640 1 -- 172.21.15.37:0/2185442543 shutdown_connections 2023-12-19T16:07:29.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.282+0000 7fe4470f3640 1 -- 172.21.15.37:0/2185442543 wait complete. 2023-12-19T16:07:29.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.283+0000 7fe4470f3640 1 Processor -- start 2023-12-19T16:07:29.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.283+0000 7fe4470f3640 1 -- start start 2023-12-19T16:07:29.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.284+0000 7fe4470f3640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe44006a950 0x7fe4401e3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.284+0000 7fe4470f3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4400bb140 0x7fe4400b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.284+0000 7fe4470f3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4400bee00 0x7fe44009b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.284+0000 7fe4470f3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44009a970 con 0x7fe4400bee00 2023-12-19T16:07:29.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.284+0000 7fe4470f3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44009a690 con 0x7fe4400bb140 2023-12-19T16:07:29.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.284+0000 7fe4470f3640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4400b6570 con 0x7fe44006a950 2023-12-19T16:07:29.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.284+0000 7fe445690640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4400bee00 0x7fe44009b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.284+0000 7fe445690640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4400bee00 0x7fe44009b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58478/0 (socket says 172.21.15.37:58478) 2023-12-19T16:07:29.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.284+0000 7fe445690640 1 -- 172.21.15.37:0/2503165527 learned_addr learned my addr 172.21.15.37:0/2503165527 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:29.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.284+0000 7fe445690640 1 -- 172.21.15.37:0/2503165527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe44006a950 msgr2=0x7fe4401e3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:29.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.284+0000 7fe444e8f640 1 --2- 172.21.15.37:0/2503165527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe44006a950 0x7fe4401e3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.284+0000 7fe43ffff640 1 --2- 172.21.15.37:0/2503165527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4400bb140 0x7fe4400b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.284+0000 7fe445690640 1 --2- 172.21.15.37:0/2503165527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe44006a950 0x7fe4401e3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.284+0000 7fe445690640 1 -- 172.21.15.37:0/2503165527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4400bb140 msgr2=0x7fe4400b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:29.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.284+0000 7fe445690640 1 --2- 172.21.15.37:0/2503165527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4400bb140 0x7fe4400b6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.284+0000 7fe445690640 1 -- 172.21.15.37:0/2503165527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c0094d0 con 0x7fe4400bee00 2023-12-19T16:07:29.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.285+0000 7fe445690640 1 --2- 172.21.15.37:0/2503165527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4400bee00 0x7fe44009b2d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe43800cc30 tx=0x7fe43800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:29.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.285+0000 7fe43d7fa640 1 -- 172.21.15.37:0/2503165527 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43800ce40 con 0x7fe4400bee00 2023-12-19T16:07:29.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.285+0000 7fe43d7fa640 1 -- 172.21.15.37:0/2503165527 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe438003990 con 0x7fe4400bee00 2023-12-19T16:07:29.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.285+0000 7fe4470f3640 1 -- 172.21.15.37:0/2503165527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe440099830 con 0x7fe4400bee00 2023-12-19T16:07:29.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.285+0000 7fe43d7fa640 1 -- 172.21.15.37:0/2503165527 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe438003d20 con 0x7fe4400bee00 2023-12-19T16:07:29.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.285+0000 7fe4470f3640 1 -- 172.21.15.37:0/2503165527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4400a5970 con 0x7fe4400bee00 2023-12-19T16:07:29.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.286+0000 7fe4470f3640 1 -- 172.21.15.37:0/2503165527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4400740a0 con 0x7fe4400bee00 2023-12-19T16:07:29.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.286+0000 7fe43d7fa640 1 -- 172.21.15.37:0/2503165527 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe438003e80 con 0x7fe4400bee00 2023-12-19T16:07:29.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.287+0000 7fe43d7fa640 1 --2- 172.21.15.37:0/2503165527 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe42406a430 0x7fe42406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.287+0000 7fe43d7fa640 1 -- 172.21.15.37:0/2503165527 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe438088c20 con 0x7fe4400bee00 2023-12-19T16:07:29.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.287+0000 7fe444e8f640 1 --2- 172.21.15.37:0/2503165527 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe42406a430 0x7fe42406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.287+0000 7fe444e8f640 1 --2- 172.21.15.37:0/2503165527 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe42406a430 0x7fe42406c8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe43400b740 tx=0x7fe434008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:29.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.291+0000 7fe43d7fa640 1 -- 172.21.15.37:0/2503165527 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe4380542a0 con 0x7fe4400bee00 2023-12-19T16:07:29.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.467+0000 7fe4470f3640 1 -- 172.21.15.37:0/2503165527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe4400ba4a0 con 0x7fe4400bee00 2023-12-19T16:07:29.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.467+0000 7fe43d7fa640 1 -- 172.21.15.37:0/2503165527 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe43801d070 con 0x7fe4400bee00 2023-12-19T16:07:29.470 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-19T16:07:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.469+0000 7fe4470f3640 1 -- 172.21.15.37:0/2503165527 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe42406a430 msgr2=0x7fe42406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.469+0000 7fe4470f3640 1 --2- 172.21.15.37:0/2503165527 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe42406a430 0x7fe42406c8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe43400b740 tx=0x7fe434008040 comp rx=0 tx=0).stop 2023-12-19T16:07:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.469+0000 7fe4470f3640 1 -- 172.21.15.37:0/2503165527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4400bee00 msgr2=0x7fe44009b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.469+0000 7fe4470f3640 1 --2- 172.21.15.37:0/2503165527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4400bee00 0x7fe44009b2d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe43800cc30 tx=0x7fe43800a5c0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.469+0000 7fe4470f3640 1 -- 172.21.15.37:0/2503165527 shutdown_connections 2023-12-19T16:07:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.469+0000 7fe4470f3640 1 --2- 172.21.15.37:0/2503165527 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe42406a430 0x7fe42406c8f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.469+0000 7fe4470f3640 1 --2- 172.21.15.37:0/2503165527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4400bee00 0x7fe44009b2d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.469+0000 7fe4470f3640 1 --2- 172.21.15.37:0/2503165527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4400bb140 0x7fe4400b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.469+0000 7fe4470f3640 1 --2- 172.21.15.37:0/2503165527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe44006a950 0x7fe4401e3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.469+0000 7fe4470f3640 1 -- 172.21.15.37:0/2503165527 >> 172.21.15.37:0/2503165527 conn(0x7fe4400bcfd0 msgr2=0x7fe4400b90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:29.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.469+0000 7fe4470f3640 1 -- 172.21.15.37:0/2503165527 shutdown_connections 2023-12-19T16:07:29.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.469+0000 7fe4470f3640 1 -- 172.21.15.37:0/2503165527 wait complete. 2023-12-19T16:07:29.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:07:29.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.587+0000 7f2a8ee51640 1 Processor -- start 2023-12-19T16:07:29.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.587+0000 7f2a8ee51640 1 -- start start 2023-12-19T16:07:29.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.587+0000 7f2a8ee51640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2a88070ff0 0x7f2a88142850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.587+0000 7f2a8ee51640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a880b4f90 0x7f2a880b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.587+0000 7f2a8ee51640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a880b56e0 con 0x7f2a88142d90 2023-12-19T16:07:29.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.587+0000 7f2a8ee51640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a880b6d70 con 0x7f2a88070ff0 2023-12-19T16:07:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.587+0000 7f2a8ee51640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a880b59c0 con 0x7f2a880b4f90 2023-12-19T16:07:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.587+0000 7f2a8d3ee640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2a88142d90 0x7f2a8814be10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48262/0 (socket says 172.21.15.37:48262) 2023-12-19T16:07:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.587+0000 7f2a8d3ee640 1 -- 172.21.15.37:0/1924893231 learned_addr learned my addr 172.21.15.37:0/1924893231 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a87fff640 1 --2- 172.21.15.37:0/1924893231 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a880b4f90 0x7f2a880b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a8cbed640 1 --2- 172.21.15.37:0/1924893231 >> v2:172.21.15.78:3300/0 conn(0x7f2a88070ff0 0x7f2a88142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a877fe640 1 -- 172.21.15.37:0/1924893231 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131498514 0 0) 0x7f2a880b56e0 con 0x7f2a88142d90 2023-12-19T16:07:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a877fe640 1 -- 172.21.15.37:0/1924893231 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a70003520 con 0x7f2a88142d90 2023-12-19T16:07:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a877fe640 1 -- 172.21.15.37:0/1924893231 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4156302660 0 0) 0x7f2a70003520 con 0x7f2a88142d90 2023-12-19T16:07:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a877fe640 1 -- 172.21.15.37:0/1924893231 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a880b4f90 msgr2=0x7f2a880b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a877fe640 1 --2- 172.21.15.37:0/1924893231 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a880b4f90 0x7f2a880b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a877fe640 1 -- 172.21.15.37:0/1924893231 >> v2:172.21.15.78:3300/0 conn(0x7f2a88070ff0 msgr2=0x7f2a88142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a877fe640 1 --2- 172.21.15.37:0/1924893231 >> v2:172.21.15.78:3300/0 conn(0x7f2a88070ff0 0x7f2a88142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a877fe640 1 -- 172.21.15.37:0/1924893231 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a880b5ca0 con 0x7f2a88142d90 2023-12-19T16:07:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a8cbed640 1 --2- 172.21.15.37:0/1924893231 >> v2:172.21.15.78:3300/0 conn(0x7f2a88070ff0 0x7f2a88142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:07:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a877fe640 1 -- 172.21.15.37:0/1924893231 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f2a78001670 con 0x7f2a88142d90 2023-12-19T16:07:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a877fe640 1 -- 172.21.15.37:0/1924893231 >> v1:172.21.15.37:6789/0 conn(0x7f2a88142d90 legacy=0x7f2a8814be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a877fe640 1 --2- 172.21.15.37:0/1924893231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a70003970 0x7f2a70003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a877fe640 1 --2- 172.21.15.37:0/1924893231 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a880b4f90 0x7f2a700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a877fe640 1 --2- 172.21.15.37:0/1924893231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a70004d00 0x7f2a70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a877fe640 1 -- 172.21.15.37:0/1924893231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a880b59c0 con 0x7f2a70003970 2023-12-19T16:07:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a877fe640 1 -- 172.21.15.37:0/1924893231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7000b980 con 0x7f2a70004d00 2023-12-19T16:07:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a877fe640 1 -- 172.21.15.37:0/1924893231 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7000bac0 con 0x7f2a880b4f90 2023-12-19T16:07:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a8cbed640 1 --2- 172.21.15.37:0/1924893231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a70003970 0x7f2a70003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a87fff640 1 --2- 172.21.15.37:0/1924893231 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a880b4f90 0x7f2a700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a8d3ee640 1 --2- 172.21.15.37:0/1924893231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a70004d00 0x7f2a70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a8cbed640 1 -- 172.21.15.37:0/1924893231 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a880b4f90 msgr2=0x7f2a700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a8cbed640 1 --2- 172.21.15.37:0/1924893231 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a880b4f90 0x7f2a700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a8cbed640 1 -- 172.21.15.37:0/1924893231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a70004d00 msgr2=0x7f2a70005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a8cbed640 1 --2- 172.21.15.37:0/1924893231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a70004d00 0x7f2a70005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a8cbed640 1 -- 172.21.15.37:0/1924893231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a70003520 con 0x7f2a70003970 2023-12-19T16:07:29.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.588+0000 7f2a8d3ee640 1 --2- 172.21.15.37:0/1924893231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a70004d00 0x7f2a70005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:29.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.589+0000 7f2a8cbed640 1 --2- 172.21.15.37:0/1924893231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a70003970 0x7f2a70003d90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000e350 tx=0x7f2a700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815f33711cdbcd8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:29.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.589+0000 7f2a877fe640 1 -- 172.21.15.37:0/1924893231 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8002ce00 con 0x7f2a70003970 2023-12-19T16:07:29.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.589+0000 7f2a877fe640 1 -- 172.21.15.37:0/1924893231 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8000f040 con 0x7f2a70003970 2023-12-19T16:07:29.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.589+0000 7f2a877fe640 1 -- 172.21.15.37:0/1924893231 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a80034640 con 0x7f2a70003970 2023-12-19T16:07:29.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.590+0000 7f2a8ee51640 1 -- 172.21.15.37:0/1924893231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a70003970 msgr2=0x7f2a70003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:29.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.590+0000 7f2a8ee51640 1 --2- 172.21.15.37:0/1924893231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a70003970 0x7f2a70003d90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000e350 tx=0x7f2a700057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.590+0000 7f2a8d3ee640 1 -- 172.21.15.37:0/1924893231 reap_dead start 2023-12-19T16:07:29.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.590+0000 7f2a8ee51640 1 -- 172.21.15.37:0/1924893231 shutdown_connections 2023-12-19T16:07:29.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.590+0000 7f2a8ee51640 1 -- 172.21.15.37:0/1924893231 >> 172.21.15.37:0/1924893231 conn(0x7f2a880be120 msgr2=0x7f2a880be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:29.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.590+0000 7f2a8ee51640 1 -- 172.21.15.37:0/1924893231 shutdown_connections 2023-12-19T16:07:29.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.590+0000 7f2a8ee51640 1 -- 172.21.15.37:0/1924893231 wait complete. 2023-12-19T16:07:29.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.591+0000 7f2a8ee51640 1 Processor -- start 2023-12-19T16:07:29.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.591+0000 7f2a8ee51640 1 -- start start 2023-12-19T16:07:29.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.592+0000 7f2a8ee51640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a70003970 0x7f2a88146b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.592+0000 7f2a8ee51640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a88148fa0 0x7f2a8806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.592+0000 7f2a8ee51640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a88148160 0x7f2a88141840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.592+0000 7f2a8ee51640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8806b1f0 con 0x7f2a88148fa0 2023-12-19T16:07:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.592+0000 7f2a8ee51640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a88141d80 con 0x7f2a88148160 2023-12-19T16:07:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.592+0000 7f2a8ee51640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a881473a0 con 0x7f2a70003970 2023-12-19T16:07:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.592+0000 7f2a87fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a88148fa0 0x7f2a8806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.592+0000 7f2a87fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a88148fa0 0x7f2a8806acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58244/0 (socket says 172.21.15.37:58244) 2023-12-19T16:07:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.592+0000 7f2a87fff640 1 -- 172.21.15.37:0/1429326715 learned_addr learned my addr 172.21.15.37:0/1429326715 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.592+0000 7f2a8cbed640 1 --2- 172.21.15.37:0/1429326715 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a70003970 0x7f2a88146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.592+0000 7f2a8d3ee640 1 --2- 172.21.15.37:0/1429326715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a88148160 0x7f2a88141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.592+0000 7f2a87fff640 1 -- 172.21.15.37:0/1429326715 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a70003970 msgr2=0x7f2a88146b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.592+0000 7f2a87fff640 1 --2- 172.21.15.37:0/1429326715 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a70003970 0x7f2a88146b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.592+0000 7f2a87fff640 1 -- 172.21.15.37:0/1429326715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a88148160 msgr2=0x7f2a88141840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.592+0000 7f2a87fff640 1 --2- 172.21.15.37:0/1429326715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a88148160 0x7f2a88141840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.592+0000 7f2a87fff640 1 -- 172.21.15.37:0/1429326715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a88147680 con 0x7f2a88148fa0 2023-12-19T16:07:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.592+0000 7f2a8d3ee640 1 --2- 172.21.15.37:0/1429326715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a88148160 0x7f2a88141840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.592+0000 7f2a87fff640 1 --2- 172.21.15.37:0/1429326715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a88148fa0 0x7f2a8806acb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0119d0 tx=0x7f2a7c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.592+0000 7f2a857fa640 1 -- 172.21.15.37:0/1429326715 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c00fb50 con 0x7f2a88148fa0 2023-12-19T16:07:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.593+0000 7f2a857fa640 1 -- 172.21.15.37:0/1429326715 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c00fcb0 con 0x7f2a88148fa0 2023-12-19T16:07:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.593+0000 7f2a8ee51640 1 -- 172.21.15.37:0/1429326715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a88147960 con 0x7f2a88148fa0 2023-12-19T16:07:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.593+0000 7f2a857fa640 1 -- 172.21.15.37:0/1429326715 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c014440 con 0x7f2a88148fa0 2023-12-19T16:07:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.593+0000 7f2a8ee51640 1 -- 172.21.15.37:0/1429326715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8814cbe0 con 0x7f2a88148fa0 2023-12-19T16:07:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.593+0000 7f2a8ee51640 1 -- 172.21.15.37:0/1429326715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a8804e840 con 0x7f2a88148fa0 2023-12-19T16:07:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.594+0000 7f2a857fa640 1 -- 172.21.15.37:0/1429326715 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2a7c0145a0 con 0x7f2a88148fa0 2023-12-19T16:07:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.594+0000 7f2a857fa640 1 --2- 172.21.15.37:0/1429326715 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2a7406a430 0x7f2a7406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.595+0000 7f2a857fa640 1 -- 172.21.15.37:0/1429326715 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a7c089100 con 0x7f2a88148fa0 2023-12-19T16:07:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.595+0000 7f2a8cbed640 1 --2- 172.21.15.37:0/1429326715 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2a7406a430 0x7f2a7406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.595+0000 7f2a8cbed640 1 --2- 172.21.15.37:0/1429326715 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2a7406a430 0x7f2a7406c8f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2a80036000 tx=0x7f2a8002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:29.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.599+0000 7f2a857fa640 1 -- 172.21.15.37:0/1429326715 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2a7c054830 con 0x7f2a88148fa0 2023-12-19T16:07:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.810+0000 7f2a8ee51640 1 -- 172.21.15.37:0/1429326715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a880716d0 con 0x7f2a88148fa0 2023-12-19T16:07:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.810+0000 7f2a857fa640 1 -- 172.21.15.37:0/1429326715 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3947 (secure 0 0 0) 0x7f2a7c057e50 con 0x7f2a88148fa0 2023-12-19T16:07:29.813 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:29.813 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4079311036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4079311036},{"type":"v1","addr":"172.21.15.37:6834","nonce":4079311036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1300485428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1300485428},{"type":"v1","addr":"172.21.15.37:6835","nonce":1300485428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:06:58.727746+0000","modified":"2023-12-19T16:07:01.300113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/3319636422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3319636422},{"type":"v1","addr":"172.21.15.78:6835","nonce":3319636422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:07:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-12-19T16:07:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.812+0000 7f2a8ee51640 1 -- 172.21.15.37:0/1429326715 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2a7406a430 msgr2=0x7f2a7406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.812+0000 7f2a8ee51640 1 --2- 172.21.15.37:0/1429326715 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2a7406a430 0x7f2a7406c8f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2a80036000 tx=0x7f2a8002e000 comp rx=0 tx=0).stop 2023-12-19T16:07:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.812+0000 7f2a8ee51640 1 -- 172.21.15.37:0/1429326715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a88148fa0 msgr2=0x7f2a8806acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.812+0000 7f2a8ee51640 1 --2- 172.21.15.37:0/1429326715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a88148fa0 0x7f2a8806acb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0119d0 tx=0x7f2a7c011e90 comp rx=0 tx=0).stop 2023-12-19T16:07:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.812+0000 7f2a8ee51640 1 -- 172.21.15.37:0/1429326715 shutdown_connections 2023-12-19T16:07:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.812+0000 7f2a8ee51640 1 --2- 172.21.15.37:0/1429326715 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2a7406a430 0x7f2a7406c8f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.812+0000 7f2a8ee51640 1 --2- 172.21.15.37:0/1429326715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a88148160 0x7f2a88141840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.812+0000 7f2a8ee51640 1 --2- 172.21.15.37:0/1429326715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a88148fa0 0x7f2a8806acb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.812+0000 7f2a8ee51640 1 --2- 172.21.15.37:0/1429326715 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a70003970 0x7f2a88146b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.813+0000 7f2a8ee51640 1 -- 172.21.15.37:0/1429326715 >> 172.21.15.37:0/1429326715 conn(0x7f2a880be120 msgr2=0x7f2a880bc020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.813+0000 7f2a8ee51640 1 -- 172.21.15.37:0/1429326715 shutdown_connections 2023-12-19T16:07:29.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.813+0000 7f2a8ee51640 1 -- 172.21.15.37:0/1429326715 wait complete. 2023-12-19T16:07:29.825 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:07:29.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.929+0000 7fb3edd66640 1 Processor -- start 2023-12-19T16:07:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.929+0000 7fb3edd66640 1 -- start start 2023-12-19T16:07:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.930+0000 7fb3edd66640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb3e80bcdd0 0x7fb3e80b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.930+0000 7fb3edd66640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb3e80b64c0 0x7fb3e8144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.930+0000 7fb3edd66640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3e8144cd0 0x7fb3e814e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.930+0000 7fb3edd66640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e80bc6b0 con 0x7fb3e80bcdd0 2023-12-19T16:07:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.930+0000 7fb3edd66640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e80b6900 con 0x7fb3e80b64c0 2023-12-19T16:07:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.930+0000 7fb3edd66640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80a59f0 con 0x7fb3e8144cd0 2023-12-19T16:07:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.930+0000 7fb3e77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb3e80bcdd0 0x7fb3e80b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.930+0000 7fb3e77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb3e80bcdd0 0x7fb3e80b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58248/0 (socket says 172.21.15.37:58248) 2023-12-19T16:07:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.930+0000 7fb3e77fe640 1 -- 172.21.15.37:0/1987491979 learned_addr learned my addr 172.21.15.37:0/1987491979 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.930+0000 7fb3e6ffd640 1 --2- 172.21.15.37:0/1987491979 >> v2:172.21.15.78:3300/0 conn(0x7fb3e80b64c0 0x7fb3e8144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.930+0000 7fb3e7fff640 1 --2- 172.21.15.37:0/1987491979 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3e8144cd0 0x7fb3e814e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.930+0000 7fb3e77fe640 1 -- 172.21.15.37:0/1987491979 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3e8144cd0 msgr2=0x7fb3e814e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.930+0000 7fb3e77fe640 1 --2- 172.21.15.37:0/1987491979 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3e8144cd0 0x7fb3e814e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.930+0000 7fb3e77fe640 1 -- 172.21.15.37:0/1987491979 >> v2:172.21.15.78:3300/0 conn(0x7fb3e80b64c0 msgr2=0x7fb3e8144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.930+0000 7fb3e77fe640 1 --2- 172.21.15.37:0/1987491979 >> v2:172.21.15.78:3300/0 conn(0x7fb3e80b64c0 0x7fb3e8144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.930+0000 7fb3e77fe640 1 -- 172.21.15.37:0/1987491979 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e80bc0a0 con 0x7fb3e80bcdd0 2023-12-19T16:07:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.930+0000 7fb3e7fff640 1 --2- 172.21.15.37:0/1987491979 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3e8144cd0 0x7fb3e814e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.931+0000 7fb3e77fe640 1 --2- 172.21.15.37:0/1987491979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3e80bcdd0 0x7fb3e80b5f80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80b72e0 tx=0x7fb3d802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8603f272c238084 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:29.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.931+0000 7fb3e67fc640 1 -- 172.21.15.37:0/1987491979 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8030860 con 0x7fb3e80bcdd0 2023-12-19T16:07:29.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.931+0000 7fb3e67fc640 1 -- 172.21.15.37:0/1987491979 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d80309c0 con 0x7fb3e80bcdd0 2023-12-19T16:07:29.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.931+0000 7fb3e67fc640 1 -- 172.21.15.37:0/1987491979 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8030d50 con 0x7fb3e80bcdd0 2023-12-19T16:07:29.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.932+0000 7fb3edd66640 1 -- 172.21.15.37:0/1987491979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3e80bcdd0 msgr2=0x7fb3e80b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:29.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.932+0000 7fb3edd66640 1 --2- 172.21.15.37:0/1987491979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3e80bcdd0 0x7fb3e80b5f80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80b72e0 tx=0x7fb3d802b9a0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.932+0000 7fb3edd66640 1 -- 172.21.15.37:0/1987491979 shutdown_connections 2023-12-19T16:07:29.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.932+0000 7fb3edd66640 1 --2- 172.21.15.37:0/1987491979 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3e8144cd0 0x7fb3e814e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.932+0000 7fb3edd66640 1 --2- 172.21.15.37:0/1987491979 >> v2:172.21.15.78:3300/0 conn(0x7fb3e80b64c0 0x7fb3e8144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.932+0000 7fb3edd66640 1 --2- 172.21.15.37:0/1987491979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3e80bcdd0 0x7fb3e80b5f80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.932+0000 7fb3edd66640 1 -- 172.21.15.37:0/1987491979 >> 172.21.15.37:0/1987491979 conn(0x7fb3e8071e60 msgr2=0x7fb3e80c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:29.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.932+0000 7fb3edd66640 1 -- 172.21.15.37:0/1987491979 shutdown_connections 2023-12-19T16:07:29.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.932+0000 7fb3edd66640 1 -- 172.21.15.37:0/1987491979 wait complete. 2023-12-19T16:07:29.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.933+0000 7fb3edd66640 1 Processor -- start 2023-12-19T16:07:29.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.933+0000 7fb3edd66640 1 -- start start 2023-12-19T16:07:29.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3edd66640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3e80b64c0 0x7fb3e814b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3edd66640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e80bcdd0 0x7fb3e81492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3edd66640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3e8144cd0 0x7fb3e813c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3edd66640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e8147c70 con 0x7fb3e8144cd0 2023-12-19T16:07:29.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3edd66640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e8147290 con 0x7fb3e80bcdd0 2023-12-19T16:07:29.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3edd66640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e8147570 con 0x7fb3e80b64c0 2023-12-19T16:07:29.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3e8144cd0 0x7fb3e813c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3e8144cd0 0x7fb3e813c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58258/0 (socket says 172.21.15.37:58258) 2023-12-19T16:07:29.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3e7fff640 1 -- 172.21.15.37:0/1509686738 learned_addr learned my addr 172.21.15.37:0/1509686738 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:29.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3e77fe640 1 --2- 172.21.15.37:0/1509686738 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3e80b64c0 0x7fb3e814b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3e6ffd640 1 --2- 172.21.15.37:0/1509686738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e80bcdd0 0x7fb3e81492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3e7fff640 1 -- 172.21.15.37:0/1509686738 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3e80b64c0 msgr2=0x7fb3e814b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:29.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3e7fff640 1 --2- 172.21.15.37:0/1509686738 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3e80b64c0 0x7fb3e814b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3e7fff640 1 -- 172.21.15.37:0/1509686738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e80bcdd0 msgr2=0x7fb3e81492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:29.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3e7fff640 1 --2- 172.21.15.37:0/1509686738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e80bcdd0 0x7fb3e81492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:29.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3e7fff640 1 -- 172.21.15.37:0/1509686738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d80094d0 con 0x7fb3e8144cd0 2023-12-19T16:07:29.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3e7fff640 1 --2- 172.21.15.37:0/1509686738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3e8144cd0 0x7fb3e813c4e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000cd50 tx=0x7fb3e000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:29.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3cffff640 1 -- 172.21.15.37:0/1509686738 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e000f680 con 0x7fb3e8144cd0 2023-12-19T16:07:29.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3cffff640 1 -- 172.21.15.37:0/1509686738 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e000f800 con 0x7fb3e8144cd0 2023-12-19T16:07:29.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3edd66640 1 -- 172.21.15.37:0/1509686738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e814bba0 con 0x7fb3e8144cd0 2023-12-19T16:07:29.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.934+0000 7fb3cffff640 1 -- 172.21.15.37:0/1509686738 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e000fbb0 con 0x7fb3e8144cd0 2023-12-19T16:07:29.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.935+0000 7fb3edd66640 1 -- 172.21.15.37:0/1509686738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e814b8c0 con 0x7fb3e8144cd0 2023-12-19T16:07:29.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.935+0000 7fb3edd66640 1 -- 172.21.15.37:0/1509686738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e814b080 con 0x7fb3e8144cd0 2023-12-19T16:07:29.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.936+0000 7fb3cffff640 1 -- 172.21.15.37:0/1509686738 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb3e000b040 con 0x7fb3e8144cd0 2023-12-19T16:07:29.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.936+0000 7fb3cffff640 1 --2- 172.21.15.37:0/1509686738 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fb3d406a430 0x7fb3d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:29.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.937+0000 7fb3cffff640 1 -- 172.21.15.37:0/1509686738 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3e0089100 con 0x7fb3e8144cd0 2023-12-19T16:07:29.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.937+0000 7fb3e77fe640 1 --2- 172.21.15.37:0/1509686738 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fb3d406a430 0x7fb3d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:29.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.937+0000 7fb3e77fe640 1 --2- 172.21.15.37:0/1509686738 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fb3d406a430 0x7fb3d406c8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8036000 tx=0x7fb3d8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:29.941+0000 7fb3cffff640 1 -- 172.21.15.37:0/1509686738 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb3e0054830 con 0x7fb3e8144cd0 2023-12-19T16:07:30.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.117+0000 7fb3edd66640 1 -- 172.21.15.37:0/1509686738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3e804e840 con 0x7fb3e8144cd0 2023-12-19T16:07:30.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.118+0000 7fb3cffff640 1 -- 172.21.15.37:0/1509686738 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7fb3e0057e50 con 0x7fb3e8144cd0 2023-12-19T16:07:30.120 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:30.120 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:59.728935+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:06:56.758166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:06:57.635291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:07:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.120+0000 7fb3edd66640 1 -- 172.21.15.37:0/1509686738 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fb3d406a430 msgr2=0x7fb3d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.120+0000 7fb3edd66640 1 --2- 172.21.15.37:0/1509686738 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fb3d406a430 0x7fb3d406c8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8036000 tx=0x7fb3d8008030 comp rx=0 tx=0).stop 2023-12-19T16:07:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.120+0000 7fb3edd66640 1 -- 172.21.15.37:0/1509686738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3e8144cd0 msgr2=0x7fb3e813c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.120+0000 7fb3edd66640 1 --2- 172.21.15.37:0/1509686738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3e8144cd0 0x7fb3e813c4e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000cd50 tx=0x7fb3e000a650 comp rx=0 tx=0).stop 2023-12-19T16:07:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.120+0000 7fb3edd66640 1 -- 172.21.15.37:0/1509686738 shutdown_connections 2023-12-19T16:07:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.120+0000 7fb3edd66640 1 --2- 172.21.15.37:0/1509686738 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fb3d406a430 0x7fb3d406c8f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.120+0000 7fb3edd66640 1 --2- 172.21.15.37:0/1509686738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3e8144cd0 0x7fb3e813c4e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.120+0000 7fb3edd66640 1 --2- 172.21.15.37:0/1509686738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3e80bcdd0 0x7fb3e81492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.120+0000 7fb3edd66640 1 --2- 172.21.15.37:0/1509686738 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb3e80b64c0 0x7fb3e814b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.120+0000 7fb3edd66640 1 -- 172.21.15.37:0/1509686738 >> 172.21.15.37:0/1509686738 conn(0x7fb3e8071e60 msgr2=0x7fb3e80b8590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.120+0000 7fb3edd66640 1 -- 172.21.15.37:0/1509686738 shutdown_connections 2023-12-19T16:07:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.120+0000 7fb3edd66640 1 -- 172.21.15.37:0/1509686738 wait complete. 2023-12-19T16:07:30.133 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T16:07:30.133 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:07:30.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.237+0000 7f10baeee640 1 Processor -- start 2023-12-19T16:07:30.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.237+0000 7f10baeee640 1 -- start start 2023-12-19T16:07:30.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.238+0000 7f10baeee640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10b4069ba0 0x7f10b40711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:30.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.238+0000 7f10baeee640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10b414aab0 0x7f10b40b6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.238+0000 7f10baeee640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b4070d30 con 0x7f10b4069f80 2023-12-19T16:07:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.238+0000 7f10baeee640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b4071720 con 0x7f10b4069ba0 2023-12-19T16:07:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.238+0000 7f10baeee640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40706e0 con 0x7f10b414aab0 2023-12-19T16:07:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.238+0000 7f10b8c8a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10b4069ba0 0x7f10b40711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.238+0000 7f10b8c8a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10b4069ba0 0x7f10b40711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58274/0 (socket says 172.21.15.37:58274) 2023-12-19T16:07:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.238+0000 7f10b948b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f10b4069f80 0x7f10b414dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48270/0 (socket says 172.21.15.37:48270) 2023-12-19T16:07:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.238+0000 7f10b8c8a640 1 -- 172.21.15.37:0/2125772817 learned_addr learned my addr 172.21.15.37:0/2125772817 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.238+0000 7f10b3fff640 1 --2- 172.21.15.37:0/2125772817 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10b414aab0 0x7f10b40b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.238+0000 7f10b8c8a640 1 -- 172.21.15.37:0/2125772817 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10b414aab0 msgr2=0x7f10b40b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.238+0000 7f10b8c8a640 1 --2- 172.21.15.37:0/2125772817 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10b414aab0 0x7f10b40b6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.238+0000 7f10b8c8a640 1 -- 172.21.15.37:0/2125772817 >> v1:172.21.15.37:6789/0 conn(0x7f10b4069f80 legacy=0x7f10b414dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.239+0000 7f10b8c8a640 1 -- 172.21.15.37:0/2125772817 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b40709c0 con 0x7f10b4069ba0 2023-12-19T16:07:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.238+0000 7f10b37fe640 1 -- 172.21.15.37:0/2125772817 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416525367 0 0) 0x7f10b4070d30 con 0x7f10b4069f80 2023-12-19T16:07:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.239+0000 7f10b3fff640 1 --2- 172.21.15.37:0/2125772817 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10b414aab0 0x7f10b40b6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.239+0000 7f10b8c8a640 1 --2- 172.21.15.37:0/2125772817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b4069ba0 0x7f10b40711c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009e50 tx=0x7f10ac02bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1d8177e5cba761 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.239+0000 7f10b37fe640 1 -- 172.21.15.37:0/2125772817 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac02cb90 con 0x7f10b4069ba0 2023-12-19T16:07:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.239+0000 7f10b37fe640 1 -- 172.21.15.37:0/2125772817 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ac02ccf0 con 0x7f10b4069ba0 2023-12-19T16:07:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.239+0000 7f10b37fe640 1 -- 172.21.15.37:0/2125772817 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac034610 con 0x7f10b4069ba0 2023-12-19T16:07:30.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.240+0000 7f10baeee640 1 -- 172.21.15.37:0/2125772817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b4069ba0 msgr2=0x7f10b40711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:30.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.240+0000 7f10baeee640 1 --2- 172.21.15.37:0/2125772817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b4069ba0 0x7f10b40711c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009e50 tx=0x7f10ac02bff0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.240+0000 7f10baeee640 1 -- 172.21.15.37:0/2125772817 shutdown_connections 2023-12-19T16:07:30.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.240+0000 7f10baeee640 1 --2- 172.21.15.37:0/2125772817 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10b414aab0 0x7f10b40b6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.240+0000 7f10baeee640 1 --2- 172.21.15.37:0/2125772817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b4069ba0 0x7f10b40711c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.240+0000 7f10baeee640 1 -- 172.21.15.37:0/2125772817 >> 172.21.15.37:0/2125772817 conn(0x7f10b40b9c30 msgr2=0x7f10b40ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.240+0000 7f10baeee640 1 -- 172.21.15.37:0/2125772817 shutdown_connections 2023-12-19T16:07:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.240+0000 7f10baeee640 1 -- 172.21.15.37:0/2125772817 wait complete. 2023-12-19T16:07:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.241+0000 7f10baeee640 1 Processor -- start 2023-12-19T16:07:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.241+0000 7f10baeee640 1 -- start start 2023-12-19T16:07:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.242+0000 7f10baeee640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10b4069ba0 0x7f10b41e27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.242+0000 7f10baeee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b4069f80 0x7f10b414ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.242+0000 7f10baeee640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10b414aab0 0x7f10b40bb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.242+0000 7f10baeee640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b414dc40 con 0x7f10b4069f80 2023-12-19T16:07:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.242+0000 7f10baeee640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40bb610 con 0x7f10b414aab0 2023-12-19T16:07:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.242+0000 7f10baeee640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b4147580 con 0x7f10b4069ba0 2023-12-19T16:07:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.242+0000 7f10b3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b4069f80 0x7f10b414ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.242+0000 7f10b3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b4069f80 0x7f10b414ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58280/0 (socket says 172.21.15.37:58280) 2023-12-19T16:07:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.242+0000 7f10b3fff640 1 -- 172.21.15.37:0/3702807057 learned_addr learned my addr 172.21.15.37:0/3702807057 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.242+0000 7f10b8c8a640 1 --2- 172.21.15.37:0/3702807057 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10b4069ba0 0x7f10b41e27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.242+0000 7f10b948b640 1 --2- 172.21.15.37:0/3702807057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10b414aab0 0x7f10b40bb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.242+0000 7f10b3fff640 1 -- 172.21.15.37:0/3702807057 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10b4069ba0 msgr2=0x7f10b41e27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.242+0000 7f10b3fff640 1 --2- 172.21.15.37:0/3702807057 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10b4069ba0 0x7f10b41e27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.242+0000 7f10b3fff640 1 -- 172.21.15.37:0/3702807057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10b414aab0 msgr2=0x7f10b40bb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.242+0000 7f10b3fff640 1 --2- 172.21.15.37:0/3702807057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10b414aab0 0x7f10b40bb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.242+0000 7f10b3fff640 1 -- 172.21.15.37:0/3702807057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac009b30 con 0x7f10b4069f80 2023-12-19T16:07:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.243+0000 7f10b3fff640 1 --2- 172.21.15.37:0/3702807057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b4069f80 0x7f10b414ea10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f10a800e7e0 tx=0x7f10a800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.243+0000 7f10b17fa640 1 -- 172.21.15.37:0/3702807057 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a8004030 con 0x7f10b4069f80 2023-12-19T16:07:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.243+0000 7f10b17fa640 1 -- 172.21.15.37:0/3702807057 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a8004190 con 0x7f10b4069f80 2023-12-19T16:07:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.243+0000 7f10baeee640 1 -- 172.21.15.37:0/3702807057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b414d960 con 0x7f10b4069f80 2023-12-19T16:07:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.243+0000 7f10b17fa640 1 -- 172.21.15.37:0/3702807057 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a8004520 con 0x7f10b4069f80 2023-12-19T16:07:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.243+0000 7f10baeee640 1 -- 172.21.15.37:0/3702807057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b4148130 con 0x7f10b4069f80 2023-12-19T16:07:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.244+0000 7f10baeee640 1 -- 172.21.15.37:0/3702807057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b404e840 con 0x7f10b4069f80 2023-12-19T16:07:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.244+0000 7f10b17fa640 1 -- 172.21.15.37:0/3702807057 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f10a800c6d0 con 0x7f10b4069f80 2023-12-19T16:07:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.245+0000 7f10b17fa640 1 --2- 172.21.15.37:0/3702807057 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f10a006a400 0x7f10a006c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.245+0000 7f10b17fa640 1 -- 172.21.15.37:0/3702807057 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10a80884e0 con 0x7f10b4069f80 2023-12-19T16:07:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.245+0000 7f10b8c8a640 1 --2- 172.21.15.37:0/3702807057 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f10a006a400 0x7f10a006c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.245+0000 7f10b8c8a640 1 --2- 172.21.15.37:0/3702807057 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f10a006a400 0x7f10a006c8c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f10ac035000 tx=0x7f10ac030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:30.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.249+0000 7f10b17fa640 1 -- 172.21.15.37:0/3702807057 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f10a8053c10 con 0x7f10b4069f80 2023-12-19T16:07:30.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.462+0000 7f10baeee640 1 -- 172.21.15.37:0/3702807057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10b406bf90 con 0x7f10b4069f80 2023-12-19T16:07:30.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.462+0000 7f10b17fa640 1 -- 172.21.15.37:0/3702807057 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3947 (secure 0 0 0) 0x7f10a8057230 con 0x7f10b4069f80 2023-12-19T16:07:30.464 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:30.465 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4079311036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4079311036},{"type":"v1","addr":"172.21.15.37:6834","nonce":4079311036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1300485428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1300485428},{"type":"v1","addr":"172.21.15.37:6835","nonce":1300485428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:06:58.727746+0000","modified":"2023-12-19T16:07:01.300113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/3319636422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3319636422},{"type":"v1","addr":"172.21.15.78:6835","nonce":3319636422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:07:30.465 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-12-19T16:07:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.464+0000 7f10baeee640 1 -- 172.21.15.37:0/3702807057 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f10a006a400 msgr2=0x7f10a006c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.464+0000 7f10baeee640 1 --2- 172.21.15.37:0/3702807057 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f10a006a400 0x7f10a006c8c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f10ac035000 tx=0x7f10ac030000 comp rx=0 tx=0).stop 2023-12-19T16:07:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.464+0000 7f10baeee640 1 -- 172.21.15.37:0/3702807057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b4069f80 msgr2=0x7f10b414ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.464+0000 7f10baeee640 1 --2- 172.21.15.37:0/3702807057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b4069f80 0x7f10b414ea10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f10a800e7e0 tx=0x7f10a800eca0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.464+0000 7f10baeee640 1 -- 172.21.15.37:0/3702807057 shutdown_connections 2023-12-19T16:07:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.464+0000 7f10baeee640 1 --2- 172.21.15.37:0/3702807057 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f10a006a400 0x7f10a006c8c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.464+0000 7f10baeee640 1 --2- 172.21.15.37:0/3702807057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10b414aab0 0x7f10b40bb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.464+0000 7f10baeee640 1 --2- 172.21.15.37:0/3702807057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10b4069f80 0x7f10b414ea10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.464+0000 7f10baeee640 1 --2- 172.21.15.37:0/3702807057 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f10b4069ba0 0x7f10b41e27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.464+0000 7f10baeee640 1 -- 172.21.15.37:0/3702807057 >> 172.21.15.37:0/3702807057 conn(0x7f10b40b9c30 msgr2=0x7f10b40b8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.464+0000 7f10baeee640 1 -- 172.21.15.37:0/3702807057 shutdown_connections 2023-12-19T16:07:30.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.464+0000 7f10baeee640 1 -- 172.21.15.37:0/3702807057 wait complete. 2023-12-19T16:07:30.477 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:07:30.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.581+0000 7ffa7344a640 1 Processor -- start 2023-12-19T16:07:30.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.581+0000 7ffa7344a640 1 -- start start 2023-12-19T16:07:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.582+0000 7ffa7344a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa6c0711c0 0x7ffa6c14aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.582+0000 7ffa7344a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffa6c069f80 0x7ffa6c155380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.582+0000 7ffa7344a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6c070d30 con 0x7ffa6c069ba0 2023-12-19T16:07:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.582+0000 7ffa7344a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6c0715c0 con 0x7ffa6c069f80 2023-12-19T16:07:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.582+0000 7ffa7344a640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0b6f60 con 0x7ffa6c0711c0 2023-12-19T16:07:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.582+0000 7ffa719e7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffa6c069f80 0x7ffa6c155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.582+0000 7ffa719e7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffa6c069f80 0x7ffa6c155380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58294/0 (socket says 172.21.15.37:58294) 2023-12-19T16:07:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.582+0000 7ffa719e7640 1 -- 172.21.15.37:0/4001025784 learned_addr learned my addr 172.21.15.37:0/4001025784 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.582+0000 7ffa709e5640 1 --2- 172.21.15.37:0/4001025784 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa6c0711c0 0x7ffa6c14aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.582+0000 7ffa719e7640 1 -- 172.21.15.37:0/4001025784 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa6c0711c0 msgr2=0x7ffa6c14aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.582+0000 7ffa719e7640 1 --2- 172.21.15.37:0/4001025784 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa6c0711c0 0x7ffa6c14aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.582+0000 7ffa719e7640 1 -- 172.21.15.37:0/4001025784 >> v1:172.21.15.78:6789/0 conn(0x7ffa6c069ba0 legacy=0x7ffa6c0b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:30.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.583+0000 7ffa719e7640 1 -- 172.21.15.37:0/4001025784 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c071720 con 0x7ffa6c069f80 2023-12-19T16:07:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.583+0000 7ffa719e7640 1 --2- 172.21.15.37:0/4001025784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa6c069f80 0x7ffa6c155380 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009e50 tx=0x7ffa5c02bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847f0cb8d03e6a48 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.583+0000 7ffa6bfff640 1 -- 172.21.15.37:0/4001025784 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c02cb90 con 0x7ffa6c069f80 2023-12-19T16:07:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.583+0000 7ffa6bfff640 1 -- 172.21.15.37:0/4001025784 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c02ccf0 con 0x7ffa6c069f80 2023-12-19T16:07:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.583+0000 7ffa6bfff640 1 -- 172.21.15.37:0/4001025784 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c034610 con 0x7ffa6c069f80 2023-12-19T16:07:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.584+0000 7ffa7344a640 1 -- 172.21.15.37:0/4001025784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa6c069f80 msgr2=0x7ffa6c155380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.584+0000 7ffa7344a640 1 --2- 172.21.15.37:0/4001025784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa6c069f80 0x7ffa6c155380 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009e50 tx=0x7ffa5c02bff0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.584+0000 7ffa7344a640 1 -- 172.21.15.37:0/4001025784 shutdown_connections 2023-12-19T16:07:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.584+0000 7ffa7344a640 1 --2- 172.21.15.37:0/4001025784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa6c069f80 0x7ffa6c155380 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.584+0000 7ffa7344a640 1 --2- 172.21.15.37:0/4001025784 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa6c0711c0 0x7ffa6c14aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.584+0000 7ffa7344a640 1 -- 172.21.15.37:0/4001025784 >> 172.21.15.37:0/4001025784 conn(0x7ffa6c0b9c30 msgr2=0x7ffa6c0ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.584+0000 7ffa7344a640 1 -- 172.21.15.37:0/4001025784 shutdown_connections 2023-12-19T16:07:30.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.584+0000 7ffa7344a640 1 -- 172.21.15.37:0/4001025784 wait complete. 2023-12-19T16:07:30.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.585+0000 7ffa7344a640 1 Processor -- start 2023-12-19T16:07:30.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.585+0000 7ffa7344a640 1 -- start start 2023-12-19T16:07:30.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa7344a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa6c069ba0 0x7ffa6c140500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:30.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa7344a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa6c069f80 0x7ffa6c1495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:30.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa7344a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa6c0711c0 0x7ffa6c1dff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:30.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa7344a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c1df820 con 0x7ffa6c069f80 2023-12-19T16:07:30.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa7344a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c1dfb00 con 0x7ffa6c0711c0 2023-12-19T16:07:30.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa7344a640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c146730 con 0x7ffa6c069ba0 2023-12-19T16:07:30.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa709e5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa6c069f80 0x7ffa6c1495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:30.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa709e5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa6c069f80 0x7ffa6c1495c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58302/0 (socket says 172.21.15.37:58302) 2023-12-19T16:07:30.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa709e5640 1 -- 172.21.15.37:0/779836037 learned_addr learned my addr 172.21.15.37:0/779836037 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:30.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa719e7640 1 --2- 172.21.15.37:0/779836037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa6c0711c0 0x7ffa6c1dff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:30.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa711e6640 1 --2- 172.21.15.37:0/779836037 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa6c069ba0 0x7ffa6c140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:30.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa709e5640 1 -- 172.21.15.37:0/779836037 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa6c069ba0 msgr2=0x7ffa6c140500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:30.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa709e5640 1 --2- 172.21.15.37:0/779836037 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa6c069ba0 0x7ffa6c140500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa709e5640 1 -- 172.21.15.37:0/779836037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa6c0711c0 msgr2=0x7ffa6c1dff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:30.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa709e5640 1 --2- 172.21.15.37:0/779836037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa6c0711c0 0x7ffa6c1dff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa709e5640 1 -- 172.21.15.37:0/779836037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c009b30 con 0x7ffa6c069f80 2023-12-19T16:07:30.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa711e6640 1 --2- 172.21.15.37:0/779836037 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa6c069ba0 0x7ffa6c140500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:30.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa709e5640 1 --2- 172.21.15.37:0/779836037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa6c069f80 0x7ffa6c1495c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000d830 tx=0x7ffa6000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:30.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa69ffb640 1 -- 172.21.15.37:0/779836037 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6000b6c0 con 0x7ffa6c069f80 2023-12-19T16:07:30.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.586+0000 7ffa69ffb640 1 -- 172.21.15.37:0/779836037 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6000b820 con 0x7ffa6c069f80 2023-12-19T16:07:30.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.587+0000 7ffa7344a640 1 -- 172.21.15.37:0/779836037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6c146070 con 0x7ffa6c069f80 2023-12-19T16:07:30.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.587+0000 7ffa69ffb640 1 -- 172.21.15.37:0/779836037 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6000bbb0 con 0x7ffa6c069f80 2023-12-19T16:07:30.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.587+0000 7ffa7344a640 1 -- 172.21.15.37:0/779836037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c0b3af0 con 0x7ffa6c069f80 2023-12-19T16:07:30.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.588+0000 7ffa7344a640 1 -- 172.21.15.37:0/779836037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c0b3cb0 con 0x7ffa6c069f80 2023-12-19T16:07:30.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.588+0000 7ffa69ffb640 1 -- 172.21.15.37:0/779836037 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffa6001e460 con 0x7ffa6c069f80 2023-12-19T16:07:30.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.588+0000 7ffa69ffb640 1 --2- 172.21.15.37:0/779836037 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ffa5806a430 0x7ffa5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:30.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.588+0000 7ffa69ffb640 1 -- 172.21.15.37:0/779836037 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa60088fe0 con 0x7ffa6c069f80 2023-12-19T16:07:30.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.589+0000 7ffa711e6640 1 --2- 172.21.15.37:0/779836037 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ffa5806a430 0x7ffa5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:30.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.589+0000 7ffa711e6640 1 --2- 172.21.15.37:0/779836037 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ffa5806a430 0x7ffa5806c8f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffa64007fd0 tx=0x7ffa64009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:30.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.593+0000 7ffa69ffb640 1 -- 172.21.15.37:0/779836037 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ffa6c0b3cb0 con 0x7ffa6c069f80 2023-12-19T16:07:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.810+0000 7ffa7344a640 1 -- 172.21.15.37:0/779836037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa6c0b3cb0 con 0x7ffa6c069f80 2023-12-19T16:07:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.810+0000 7ffa69ffb640 1 -- 172.21.15.37:0/779836037 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3947 (secure 0 0 0) 0x7ffa6c0b3cb0 con 0x7ffa6c069f80 2023-12-19T16:07:30.813 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:30.813 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4079311036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4079311036},{"type":"v1","addr":"172.21.15.37:6834","nonce":4079311036}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1300485428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1300485428},{"type":"v1","addr":"172.21.15.37:6835","nonce":1300485428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:06:58.727746+0000","modified":"2023-12-19T16:07:01.300113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/3319636422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3319636422},{"type":"v1","addr":"172.21.15.78:6835","nonce":3319636422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:07:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2023-12-19T16:07:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.812+0000 7ffa7344a640 1 -- 172.21.15.37:0/779836037 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ffa5806a430 msgr2=0x7ffa5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.812+0000 7ffa7344a640 1 --2- 172.21.15.37:0/779836037 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ffa5806a430 0x7ffa5806c8f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffa64007fd0 tx=0x7ffa64009040 comp rx=0 tx=0).stop 2023-12-19T16:07:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.812+0000 7ffa7344a640 1 -- 172.21.15.37:0/779836037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa6c069f80 msgr2=0x7ffa6c1495c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.812+0000 7ffa7344a640 1 --2- 172.21.15.37:0/779836037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa6c069f80 0x7ffa6c1495c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000d830 tx=0x7ffa6000dcf0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.812+0000 7ffa7344a640 1 -- 172.21.15.37:0/779836037 shutdown_connections 2023-12-19T16:07:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.812+0000 7ffa7344a640 1 --2- 172.21.15.37:0/779836037 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ffa5806a430 0x7ffa5806c8f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.812+0000 7ffa7344a640 1 --2- 172.21.15.37:0/779836037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa6c0711c0 0x7ffa6c1dff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.812+0000 7ffa7344a640 1 --2- 172.21.15.37:0/779836037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa6c069f80 0x7ffa6c1495c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.812+0000 7ffa7344a640 1 --2- 172.21.15.37:0/779836037 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa6c069ba0 0x7ffa6c140500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.812+0000 7ffa7344a640 1 -- 172.21.15.37:0/779836037 >> 172.21.15.37:0/779836037 conn(0x7ffa6c0b9c30 msgr2=0x7ffa6c0bae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.812+0000 7ffa7344a640 1 -- 172.21.15.37:0/779836037 shutdown_connections 2023-12-19T16:07:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.812+0000 7ffa7344a640 1 -- 172.21.15.37:0/779836037 wait complete. 2023-12-19T16:07:30.825 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:07:30.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.929+0000 7efebd41e640 1 Processor -- start 2023-12-19T16:07:30.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.929+0000 7efebd41e640 1 -- start start 2023-12-19T16:07:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.929+0000 7efebd41e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efeb80bcdd0 0x7efeb80b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.929+0000 7efebd41e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efeb8144ea0 0x7efeb8155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.929+0000 7efebd41e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb80bc6b0 con 0x7efeb80b64c0 2023-12-19T16:07:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.929+0000 7efebd41e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb80b6900 con 0x7efeb8144ea0 2023-12-19T16:07:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.929+0000 7efebd41e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb80a59f0 con 0x7efeb80bcdd0 2023-12-19T16:07:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.930+0000 7efeb77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efeb8144ea0 0x7efeb8155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.930+0000 7efeb77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efeb8144ea0 0x7efeb8155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58316/0 (socket says 172.21.15.37:58316) 2023-12-19T16:07:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.930+0000 7efeb77fe640 1 -- 172.21.15.37:0/852591897 learned_addr learned my addr 172.21.15.37:0/852591897 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.930+0000 7efeb6ffd640 1 --2- 172.21.15.37:0/852591897 >> v2:172.21.15.78:3300/0 conn(0x7efeb80bcdd0 0x7efeb80b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.930+0000 7efeb77fe640 1 -- 172.21.15.37:0/852591897 >> v2:172.21.15.78:3300/0 conn(0x7efeb80bcdd0 msgr2=0x7efeb80b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.930+0000 7efeb77fe640 1 --2- 172.21.15.37:0/852591897 >> v2:172.21.15.78:3300/0 conn(0x7efeb80bcdd0 0x7efeb80b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.930+0000 7efeb77fe640 1 -- 172.21.15.37:0/852591897 >> v1:172.21.15.78:6789/0 conn(0x7efeb80b64c0 legacy=0x7efeb8144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.930+0000 7efeb77fe640 1 -- 172.21.15.37:0/852591897 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb80bc0a0 con 0x7efeb8144ea0 2023-12-19T16:07:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.931+0000 7efeb77fe640 1 --2- 172.21.15.37:0/852591897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeb8144ea0 0x7efeb8155340 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efeb80c10f0 tx=0x7efeb002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a474b6f5c35f3958 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.931+0000 7efeb67fc640 1 -- 172.21.15.37:0/852591897 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb002cbb0 con 0x7efeb8144ea0 2023-12-19T16:07:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.931+0000 7efeb67fc640 1 -- 172.21.15.37:0/852591897 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb002cd10 con 0x7efeb8144ea0 2023-12-19T16:07:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.931+0000 7efeb67fc640 1 -- 172.21.15.37:0/852591897 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb0034610 con 0x7efeb8144ea0 2023-12-19T16:07:30.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.931+0000 7efebd41e640 1 -- 172.21.15.37:0/852591897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeb8144ea0 msgr2=0x7efeb8155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.931+0000 7efebd41e640 1 --2- 172.21.15.37:0/852591897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeb8144ea0 0x7efeb8155340 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efeb80c10f0 tx=0x7efeb002c010 comp rx=0 tx=0).stop 2023-12-19T16:07:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.931+0000 7efebd41e640 1 -- 172.21.15.37:0/852591897 shutdown_connections 2023-12-19T16:07:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.931+0000 7efebd41e640 1 --2- 172.21.15.37:0/852591897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeb8144ea0 0x7efeb8155340 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.931+0000 7efebd41e640 1 --2- 172.21.15.37:0/852591897 >> v2:172.21.15.78:3300/0 conn(0x7efeb80bcdd0 0x7efeb80b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.931+0000 7efebd41e640 1 -- 172.21.15.37:0/852591897 >> 172.21.15.37:0/852591897 conn(0x7efeb8071e60 msgr2=0x7efeb80c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.931+0000 7efebd41e640 1 -- 172.21.15.37:0/852591897 shutdown_connections 2023-12-19T16:07:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.931+0000 7efebd41e640 1 -- 172.21.15.37:0/852591897 wait complete. 2023-12-19T16:07:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.932+0000 7efebd41e640 1 Processor -- start 2023-12-19T16:07:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.933+0000 7efebd41e640 1 -- start start 2023-12-19T16:07:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.933+0000 7efebd41e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efeb80b64c0 0x7efeb814ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.933+0000 7efebd41e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeb80bcdd0 0x7efeb8149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.933+0000 7efebd41e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efeb8144ea0 0x7efeb81495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.933+0000 7efebd41e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb81e06b0 con 0x7efeb80bcdd0 2023-12-19T16:07:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.933+0000 7efebd41e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb8099dd0 con 0x7efeb80b64c0 2023-12-19T16:07:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.933+0000 7efebd41e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb814a980 con 0x7efeb8144ea0 2023-12-19T16:07:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.933+0000 7efeae7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeb80bcdd0 0x7efeb8149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.933+0000 7efeae7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeb80bcdd0 0x7efeb8149070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58324/0 (socket says 172.21.15.37:58324) 2023-12-19T16:07:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.933+0000 7efeae7fc640 1 -- 172.21.15.37:0/3221070115 learned_addr learned my addr 172.21.15.37:0/3221070115 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.934+0000 7efeb77fe640 1 --2- 172.21.15.37:0/3221070115 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efeb8144ea0 0x7efeb81495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.934+0000 7efeb6ffd640 1 --2- 172.21.15.37:0/3221070115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efeb80b64c0 0x7efeb814ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.934+0000 7efeae7fc640 1 -- 172.21.15.37:0/3221070115 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efeb8144ea0 msgr2=0x7efeb81495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.934+0000 7efeae7fc640 1 --2- 172.21.15.37:0/3221070115 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efeb8144ea0 0x7efeb81495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.934+0000 7efeae7fc640 1 -- 172.21.15.37:0/3221070115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efeb80b64c0 msgr2=0x7efeb814ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.934+0000 7efeae7fc640 1 --2- 172.21.15.37:0/3221070115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efeb80b64c0 0x7efeb814ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.934+0000 7efeae7fc640 1 -- 172.21.15.37:0/3221070115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb0009b30 con 0x7efeb80bcdd0 2023-12-19T16:07:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.934+0000 7efeb77fe640 1 --2- 172.21.15.37:0/3221070115 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efeb8144ea0 0x7efeb81495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.934+0000 7efeb6ffd640 1 --2- 172.21.15.37:0/3221070115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efeb80b64c0 0x7efeb814ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.934+0000 7efeae7fc640 1 --2- 172.21.15.37:0/3221070115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeb80bcdd0 0x7efeb8149070 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efea000c480 tx=0x7efea000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.934+0000 7efeaffff640 1 -- 172.21.15.37:0/3221070115 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea00052d0 con 0x7efeb80bcdd0 2023-12-19T16:07:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.934+0000 7efeaffff640 1 -- 172.21.15.37:0/3221070115 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea0005430 con 0x7efeb80bcdd0 2023-12-19T16:07:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.934+0000 7efebd41e640 1 -- 172.21.15.37:0/3221070115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb81e03d0 con 0x7efeb80bcdd0 2023-12-19T16:07:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.934+0000 7efeaffff640 1 -- 172.21.15.37:0/3221070115 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0012870 con 0x7efeb80bcdd0 2023-12-19T16:07:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.934+0000 7efebd41e640 1 -- 172.21.15.37:0/3221070115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb81e0060 con 0x7efeb80bcdd0 2023-12-19T16:07:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.935+0000 7efebd41e640 1 -- 172.21.15.37:0/3221070115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb8144c70 con 0x7efeb80bcdd0 2023-12-19T16:07:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.935+0000 7efeaffff640 1 -- 172.21.15.37:0/3221070115 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efea00129d0 con 0x7efeb80bcdd0 2023-12-19T16:07:30.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.936+0000 7efeaffff640 1 --2- 172.21.15.37:0/3221070115 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7efe9806a430 0x7efe9806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:30.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.936+0000 7efeaffff640 1 -- 172.21.15.37:0/3221070115 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efea0088550 con 0x7efeb80bcdd0 2023-12-19T16:07:30.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.936+0000 7efeb6ffd640 1 --2- 172.21.15.37:0/3221070115 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7efe9806a430 0x7efe9806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:30.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.937+0000 7efeb6ffd640 1 --2- 172.21.15.37:0/3221070115 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7efe9806a430 0x7efe9806c8f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efea8006fd0 tx=0x7efea8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:30.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:30.940+0000 7efeaffff640 1 -- 172.21.15.37:0/3221070115 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7efea0053b40 con 0x7efeb80bcdd0 2023-12-19T16:07:31.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.119+0000 7efebd41e640 1 -- 172.21.15.37:0/3221070115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efeb804e840 con 0x7efeb80bcdd0 2023-12-19T16:07:31.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.120+0000 7efeaffff640 1 -- 172.21.15.37:0/3221070115 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7efea0057160 con 0x7efeb80bcdd0 2023-12-19T16:07:31.122 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:31.122 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:06:59.728935+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:06:56.758166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:06:57.635291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:07:31.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.122+0000 7efebd41e640 1 -- 172.21.15.37:0/3221070115 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7efe9806a430 msgr2=0x7efe9806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:31.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.122+0000 7efebd41e640 1 --2- 172.21.15.37:0/3221070115 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7efe9806a430 0x7efe9806c8f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efea8006fd0 tx=0x7efea8008040 comp rx=0 tx=0).stop 2023-12-19T16:07:31.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.122+0000 7efebd41e640 1 -- 172.21.15.37:0/3221070115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeb80bcdd0 msgr2=0x7efeb8149070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:31.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.122+0000 7efebd41e640 1 --2- 172.21.15.37:0/3221070115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeb80bcdd0 0x7efeb8149070 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efea000c480 tx=0x7efea000c940 comp rx=0 tx=0).stop 2023-12-19T16:07:31.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.122+0000 7efebd41e640 1 -- 172.21.15.37:0/3221070115 shutdown_connections 2023-12-19T16:07:31.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.122+0000 7efebd41e640 1 --2- 172.21.15.37:0/3221070115 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7efe9806a430 0x7efe9806c8f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:31.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.122+0000 7efebd41e640 1 --2- 172.21.15.37:0/3221070115 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efeb8144ea0 0x7efeb81495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:31.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.122+0000 7efebd41e640 1 --2- 172.21.15.37:0/3221070115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeb80bcdd0 0x7efeb8149070 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:31.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.122+0000 7efebd41e640 1 --2- 172.21.15.37:0/3221070115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efeb80b64c0 0x7efeb814ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:31.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.122+0000 7efebd41e640 1 -- 172.21.15.37:0/3221070115 >> 172.21.15.37:0/3221070115 conn(0x7efeb8071e60 msgr2=0x7efeb8144560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:31.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.122+0000 7efebd41e640 1 -- 172.21.15.37:0/3221070115 shutdown_connections 2023-12-19T16:07:31.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.122+0000 7efebd41e640 1 -- 172.21.15.37:0/3221070115 wait complete. 2023-12-19T16:07:31.135 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T16:07:31.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.239+0000 7fde65f73640 1 Processor -- start 2023-12-19T16:07:31.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.240+0000 7fde65f73640 1 -- start start 2023-12-19T16:07:31.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.240+0000 7fde65f73640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde600b2ce0 0x7fde60140c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:31.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.240+0000 7fde65f73640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fde60147280 0x7fde60141170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:31.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.240+0000 7fde65f73640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde600b7310 con 0x7fde600707d0 2023-12-19T16:07:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.240+0000 7fde65f73640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde600b7030 con 0x7fde600b2ce0 2023-12-19T16:07:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.240+0000 7fde65f73640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde6006fe70 con 0x7fde60147280 2023-12-19T16:07:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.240+0000 7fde5effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde600b2ce0 0x7fde60140c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.240+0000 7fde5effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde600b2ce0 0x7fde60140c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58332/0 (socket says 172.21.15.37:58332) 2023-12-19T16:07:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.240+0000 7fde5effd640 1 -- 172.21.15.37:0/299678222 learned_addr learned my addr 172.21.15.37:0/299678222 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.241+0000 7fde5ffff640 1 --2- 172.21.15.37:0/299678222 >> v2:172.21.15.78:3300/0 conn(0x7fde60147280 0x7fde60141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.241+0000 7fde5effd640 1 -- 172.21.15.37:0/299678222 >> v2:172.21.15.78:3300/0 conn(0x7fde60147280 msgr2=0x7fde60141170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.241+0000 7fde5effd640 1 --2- 172.21.15.37:0/299678222 >> v2:172.21.15.78:3300/0 conn(0x7fde60147280 0x7fde60141170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.241+0000 7fde5effd640 1 -- 172.21.15.37:0/299678222 >> v1:172.21.15.78:6789/0 conn(0x7fde600707d0 legacy=0x7fde600b77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.241+0000 7fde5effd640 1 -- 172.21.15.37:0/299678222 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde60070150 con 0x7fde600b2ce0 2023-12-19T16:07:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.241+0000 7fde5effd640 1 --2- 172.21.15.37:0/299678222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde600b2ce0 0x7fde60140c30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fde600b9cd0 tx=0x7fde5402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b717f2622dfe2d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.242+0000 7fde5e7fc640 1 -- 172.21.15.37:0/299678222 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54030860 con 0x7fde600b2ce0 2023-12-19T16:07:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.242+0000 7fde5e7fc640 1 -- 172.21.15.37:0/299678222 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde540309c0 con 0x7fde600b2ce0 2023-12-19T16:07:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.242+0000 7fde5e7fc640 1 -- 172.21.15.37:0/299678222 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54030d50 con 0x7fde600b2ce0 2023-12-19T16:07:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.242+0000 7fde65f73640 1 -- 172.21.15.37:0/299678222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde600b2ce0 msgr2=0x7fde60140c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.242+0000 7fde65f73640 1 --2- 172.21.15.37:0/299678222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde600b2ce0 0x7fde60140c30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fde600b9cd0 tx=0x7fde5402b9a0 comp rx=0 tx=0).stop 2023-12-19T16:07:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.242+0000 7fde65f73640 1 -- 172.21.15.37:0/299678222 shutdown_connections 2023-12-19T16:07:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.242+0000 7fde65f73640 1 --2- 172.21.15.37:0/299678222 >> v2:172.21.15.78:3300/0 conn(0x7fde60147280 0x7fde60141170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.242+0000 7fde65f73640 1 --2- 172.21.15.37:0/299678222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde600b2ce0 0x7fde60140c30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.242+0000 7fde65f73640 1 -- 172.21.15.37:0/299678222 >> 172.21.15.37:0/299678222 conn(0x7fde60069ba0 msgr2=0x7fde60069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.242+0000 7fde65f73640 1 -- 172.21.15.37:0/299678222 shutdown_connections 2023-12-19T16:07:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.242+0000 7fde65f73640 1 -- 172.21.15.37:0/299678222 wait complete. 2023-12-19T16:07:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.243+0000 7fde65f73640 1 Processor -- start 2023-12-19T16:07:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.243+0000 7fde65f73640 1 -- start start 2023-12-19T16:07:31.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.244+0000 7fde65f73640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde600707d0 0x7fde601d1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:31.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.244+0000 7fde65f73640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde600b2ce0 0x7fde600b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:31.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.244+0000 7fde65f73640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde60147280 0x7fde601dffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:31.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.244+0000 7fde65f73640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde600a97d0 con 0x7fde600707d0 2023-12-19T16:07:31.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.244+0000 7fde65f73640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde601d1ea0 con 0x7fde60147280 2023-12-19T16:07:31.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.244+0000 7fde65f73640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde600b2450 con 0x7fde600b2ce0 2023-12-19T16:07:31.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.244+0000 7fde5f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde600707d0 0x7fde601d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.244+0000 7fde5f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde600707d0 0x7fde601d1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58340/0 (socket says 172.21.15.37:58340) 2023-12-19T16:07:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.244+0000 7fde5f7fe640 1 -- 172.21.15.37:0/4247581036 learned_addr learned my addr 172.21.15.37:0/4247581036 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.244+0000 7fde5ffff640 1 --2- 172.21.15.37:0/4247581036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde60147280 0x7fde601dffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.244+0000 7fde5effd640 1 --2- 172.21.15.37:0/4247581036 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde600b2ce0 0x7fde600b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.244+0000 7fde5f7fe640 1 -- 172.21.15.37:0/4247581036 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde600b2ce0 msgr2=0x7fde600b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.244+0000 7fde5f7fe640 1 --2- 172.21.15.37:0/4247581036 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde600b2ce0 0x7fde600b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.244+0000 7fde5f7fe640 1 -- 172.21.15.37:0/4247581036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde60147280 msgr2=0x7fde601dffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.244+0000 7fde5f7fe640 1 --2- 172.21.15.37:0/4247581036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde60147280 0x7fde601dffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.244+0000 7fde5f7fe640 1 -- 172.21.15.37:0/4247581036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde540094d0 con 0x7fde600707d0 2023-12-19T16:07:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.245+0000 7fde5ffff640 1 --2- 172.21.15.37:0/4247581036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde60147280 0x7fde601dffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.245+0000 7fde5effd640 1 --2- 172.21.15.37:0/4247581036 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde600b2ce0 0x7fde600b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.245+0000 7fde5f7fe640 1 --2- 172.21.15.37:0/4247581036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde600707d0 0x7fde601d1960 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fde5000c450 tx=0x7fde5000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.245+0000 7fde47fff640 1 -- 172.21.15.37:0/4247581036 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500052d0 con 0x7fde600707d0 2023-12-19T16:07:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.245+0000 7fde47fff640 1 -- 172.21.15.37:0/4247581036 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde50005430 con 0x7fde600707d0 2023-12-19T16:07:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.245+0000 7fde47fff640 1 -- 172.21.15.37:0/4247581036 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde50012870 con 0x7fde600707d0 2023-12-19T16:07:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.245+0000 7fde65f73640 1 -- 172.21.15.37:0/4247581036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde600a8ea0 con 0x7fde600707d0 2023-12-19T16:07:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.245+0000 7fde65f73640 1 -- 172.21.15.37:0/4247581036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde600a9460 con 0x7fde600707d0 2023-12-19T16:07:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.246+0000 7fde65f73640 1 -- 172.21.15.37:0/4247581036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde600a95f0 con 0x7fde600707d0 2023-12-19T16:07:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.246+0000 7fde47fff640 1 -- 172.21.15.37:0/4247581036 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fde500129d0 con 0x7fde600707d0 2023-12-19T16:07:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.247+0000 7fde47fff640 1 --2- 172.21.15.37:0/4247581036 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fde4c06a460 0x7fde4c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.247+0000 7fde47fff640 1 -- 172.21.15.37:0/4247581036 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde50088350 con 0x7fde600707d0 2023-12-19T16:07:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.247+0000 7fde5effd640 1 --2- 172.21.15.37:0/4247581036 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fde4c06a460 0x7fde4c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.248+0000 7fde5effd640 1 --2- 172.21.15.37:0/4247581036 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fde4c06a460 0x7fde4c06c920 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fde54036000 tx=0x7fde5403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:31.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.251+0000 7fde47fff640 1 -- 172.21.15.37:0/4247581036 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fde500539d0 con 0x7fde600707d0 2023-12-19T16:07:31.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.463+0000 7fde65f73640 1 -- 172.21.15.37:0/4247581036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fde6004e840 con 0x7fde600707d0 2023-12-19T16:07:31.466 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-12-19T16:07:31.464+0000 7f92889bd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T16:07:31.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.472+0000 7fde47fff640 1 -- 172.21.15.37:0/4247581036 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7fde50056ff0 con 0x7fde600707d0 2023-12-19T16:07:31.474 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T16:07:31.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.474+0000 7fde65f73640 1 -- 172.21.15.37:0/4247581036 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fde4c06a460 msgr2=0x7fde4c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:31.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.474+0000 7fde65f73640 1 --2- 172.21.15.37:0/4247581036 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fde4c06a460 0x7fde4c06c920 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fde54036000 tx=0x7fde5403b040 comp rx=0 tx=0).stop 2023-12-19T16:07:31.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.474+0000 7fde65f73640 1 -- 172.21.15.37:0/4247581036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde600707d0 msgr2=0x7fde601d1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:31.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.474+0000 7fde65f73640 1 --2- 172.21.15.37:0/4247581036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde600707d0 0x7fde601d1960 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fde5000c450 tx=0x7fde5000c910 comp rx=0 tx=0).stop 2023-12-19T16:07:31.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.474+0000 7fde65f73640 1 -- 172.21.15.37:0/4247581036 shutdown_connections 2023-12-19T16:07:31.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.474+0000 7fde65f73640 1 --2- 172.21.15.37:0/4247581036 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fde4c06a460 0x7fde4c06c920 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:31.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.474+0000 7fde65f73640 1 --2- 172.21.15.37:0/4247581036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde60147280 0x7fde601dffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:31.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.474+0000 7fde65f73640 1 --2- 172.21.15.37:0/4247581036 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde600b2ce0 0x7fde600b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:31.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.474+0000 7fde65f73640 1 --2- 172.21.15.37:0/4247581036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde600707d0 0x7fde601d1960 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:31.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.474+0000 7fde65f73640 1 -- 172.21.15.37:0/4247581036 >> 172.21.15.37:0/4247581036 conn(0x7fde60069ba0 msgr2=0x7fde600bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:31.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.474+0000 7fde65f73640 1 -- 172.21.15.37:0/4247581036 shutdown_connections 2023-12-19T16:07:31.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.474+0000 7fde65f73640 1 -- 172.21.15.37:0/4247581036 wait complete. 2023-12-19T16:07:31.478 INFO:tasks.ceph.mds.b.smithi078.stderr: -4847> 2023-12-19T16:06:59.286+0000 7f9319e50640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T16:07:31.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T16:07:31.509 INFO:tasks.ceph.mds.b.smithi078.stdout:starting mds.b at 2023-12-19T16:07:31.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.592+0000 7f419b6fb640 1 Processor -- start 2023-12-19T16:07:31.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.592+0000 7f419b6fb640 1 -- start start 2023-12-19T16:07:31.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.593+0000 7f419b6fb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41940b9f00 0x7f41940be220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.593+0000 7f419b6fb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41940ba7f0 con 0x7f41940c0f40 2023-12-19T16:07:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.593+0000 7f419b6fb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419406aa20 con 0x7f41940b3ab0 2023-12-19T16:07:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.593+0000 7f419b6fb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419406b090 con 0x7f41940b9f00 2023-12-19T16:07:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.593+0000 7f4199497640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41940b9f00 0x7f41940be220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.593+0000 7f4199497640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41940b9f00 0x7f41940be220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58348/0 (socket says 172.21.15.37:58348) 2023-12-19T16:07:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.593+0000 7f4198c96640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f41940c0f40 0x7f419406a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48274/0 (socket says 172.21.15.37:48274) 2023-12-19T16:07:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.593+0000 7f4199497640 1 -- 172.21.15.37:0/4064360776 learned_addr learned my addr 172.21.15.37:0/4064360776 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.593+0000 7f4199497640 1 -- 172.21.15.37:0/4064360776 >> v1:172.21.15.78:6789/0 conn(0x7f41940b3ab0 legacy=0x7f4194155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.593+0000 7f4193fff640 1 -- 172.21.15.37:0/4064360776 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415146325 0 0) 0x7f41940ba7f0 con 0x7f41940c0f40 2023-12-19T16:07:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.593+0000 7f4199497640 1 -- 172.21.15.37:0/4064360776 >> v1:172.21.15.37:6789/0 conn(0x7f41940c0f40 legacy=0x7f419406a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.593+0000 7f4199497640 1 -- 172.21.15.37:0/4064360776 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41940baed0 con 0x7f41940b9f00 2023-12-19T16:07:31.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.594+0000 7f4199497640 1 --2- 172.21.15.37:0/4064360776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41940b9f00 0x7f41940be220 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f418c009870 tx=0x7f418c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbae62e71d2c140 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:31.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.594+0000 7f4193fff640 1 -- 172.21.15.37:0/4064360776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c030860 con 0x7f41940b9f00 2023-12-19T16:07:31.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.594+0000 7f4193fff640 1 -- 172.21.15.37:0/4064360776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c0309c0 con 0x7f41940b9f00 2023-12-19T16:07:31.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.594+0000 7f4193fff640 1 -- 172.21.15.37:0/4064360776 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c030d50 con 0x7f41940b9f00 2023-12-19T16:07:31.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.595+0000 7f419b6fb640 1 -- 172.21.15.37:0/4064360776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41940b9f00 msgr2=0x7f41940be220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:31.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.595+0000 7f419b6fb640 1 --2- 172.21.15.37:0/4064360776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41940b9f00 0x7f41940be220 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f418c009870 tx=0x7f418c02b9a0 comp rx=0 tx=0).stop 2023-12-19T16:07:31.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.595+0000 7f419b6fb640 1 -- 172.21.15.37:0/4064360776 shutdown_connections 2023-12-19T16:07:31.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.595+0000 7f419b6fb640 1 --2- 172.21.15.37:0/4064360776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41940b9f00 0x7f41940be220 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:31.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.595+0000 7f419b6fb640 1 -- 172.21.15.37:0/4064360776 >> 172.21.15.37:0/4064360776 conn(0x7f41940c0420 msgr2=0x7f41940c0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:31.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.595+0000 7f419b6fb640 1 -- 172.21.15.37:0/4064360776 shutdown_connections 2023-12-19T16:07:31.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.595+0000 7f419b6fb640 1 -- 172.21.15.37:0/4064360776 wait complete. 2023-12-19T16:07:31.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.596+0000 7f419b6fb640 1 Processor -- start 2023-12-19T16:07:31.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.596+0000 7f419b6fb640 1 -- start start 2023-12-19T16:07:31.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f419b6fb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41940b3ab0 0x7f41940a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:31.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f419b6fb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41940b9f00 0x7f41941e3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:31.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f419b6fb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41940c0f40 0x7f41941e3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:31.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f419b6fb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41940a5cf0 con 0x7f41940b9f00 2023-12-19T16:07:31.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f419b6fb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41940b6f70 con 0x7f41940b3ab0 2023-12-19T16:07:31.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f419b6fb640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41940b71c0 con 0x7f41940c0f40 2023-12-19T16:07:31.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f4198c96640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41940b9f00 0x7f41941e3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:31.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f4198c96640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41940b9f00 0x7f41941e3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58356/0 (socket says 172.21.15.37:58356) 2023-12-19T16:07:31.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f4198c96640 1 -- 172.21.15.37:0/713513125 learned_addr learned my addr 172.21.15.37:0/713513125 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:31.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f4199497640 1 --2- 172.21.15.37:0/713513125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41940b3ab0 0x7f41940a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:31.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f4199c98640 1 --2- 172.21.15.37:0/713513125 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41940c0f40 0x7f41941e3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:31.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f4198c96640 1 -- 172.21.15.37:0/713513125 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41940c0f40 msgr2=0x7f41941e3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:31.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f4198c96640 1 --2- 172.21.15.37:0/713513125 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41940c0f40 0x7f41941e3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:31.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f4198c96640 1 -- 172.21.15.37:0/713513125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41940b3ab0 msgr2=0x7f41940a57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:31.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f4198c96640 1 --2- 172.21.15.37:0/713513125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41940b3ab0 0x7f41940a57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:31.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f4198c96640 1 -- 172.21.15.37:0/713513125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c0094d0 con 0x7f41940b9f00 2023-12-19T16:07:31.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f4198c96640 1 --2- 172.21.15.37:0/713513125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41940b9f00 0x7f41941e3520 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f418800c3f0 tx=0x7f418800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:31.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f4191ffb640 1 -- 172.21.15.37:0/713513125 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41880074e0 con 0x7f41940b9f00 2023-12-19T16:07:31.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f4191ffb640 1 -- 172.21.15.37:0/713513125 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4188007660 con 0x7f41940b9f00 2023-12-19T16:07:31.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f419b6fb640 1 -- 172.21.15.37:0/713513125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4194099d70 con 0x7f41940b9f00 2023-12-19T16:07:31.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.597+0000 7f4191ffb640 1 -- 172.21.15.37:0/713513125 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4188004a20 con 0x7f41940b9f00 2023-12-19T16:07:31.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.598+0000 7f419b6fb640 1 -- 172.21.15.37:0/713513125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4194099a00 con 0x7f41940b9f00 2023-12-19T16:07:31.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.598+0000 7f419b6fb640 1 -- 172.21.15.37:0/713513125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41941e3240 con 0x7f41940b9f00 2023-12-19T16:07:31.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.599+0000 7f4191ffb640 1 -- 172.21.15.37:0/713513125 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4188004b80 con 0x7f41940b9f00 2023-12-19T16:07:31.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.599+0000 7f4191ffb640 1 --2- 172.21.15.37:0/713513125 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f418006a460 0x7f418006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:31.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.599+0000 7f4191ffb640 1 -- 172.21.15.37:0/713513125 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f41880885e0 con 0x7f41940b9f00 2023-12-19T16:07:31.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.599+0000 7f4199497640 1 --2- 172.21.15.37:0/713513125 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f418006a460 0x7f418006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:31.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.600+0000 7f4199497640 1 --2- 172.21.15.37:0/713513125 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f418006a460 0x7f418006c920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f418c036000 tx=0x7f418c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:31.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.604+0000 7f4191ffb640 1 -- 172.21.15.37:0/713513125 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f41941e3240 con 0x7f41940b9f00 2023-12-19T16:07:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:31.821+0000 7f419b6fb640 1 -- 172.21.15.37:0/713513125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f41941e3240 con 0x7f41940b9f00 2023-12-19T16:07:32.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.473+0000 7f4191ffb640 1 -- 172.21.15.37:0/713513125 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f41941e3240 con 0x7f41940b9f00 2023-12-19T16:07:32.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.476+0000 7f419b6fb640 1 -- 172.21.15.37:0/713513125 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f418006a460 msgr2=0x7f418006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:32.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.476+0000 7f419b6fb640 1 --2- 172.21.15.37:0/713513125 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f418006a460 0x7f418006c920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f418c036000 tx=0x7f418c008030 comp rx=0 tx=0).stop 2023-12-19T16:07:32.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.476+0000 7f419b6fb640 1 -- 172.21.15.37:0/713513125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41940b9f00 msgr2=0x7f41941e3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:32.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.476+0000 7f419b6fb640 1 --2- 172.21.15.37:0/713513125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41940b9f00 0x7f41941e3520 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f418800c3f0 tx=0x7f418800c8b0 comp rx=0 tx=0).stop 2023-12-19T16:07:32.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.477+0000 7f419b6fb640 1 -- 172.21.15.37:0/713513125 shutdown_connections 2023-12-19T16:07:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.477+0000 7f419b6fb640 1 --2- 172.21.15.37:0/713513125 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f418006a460 0x7f418006c920 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.477+0000 7f419b6fb640 1 --2- 172.21.15.37:0/713513125 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41940c0f40 0x7f41941e3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.477+0000 7f419b6fb640 1 --2- 172.21.15.37:0/713513125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41940b9f00 0x7f41941e3520 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.477+0000 7f419b6fb640 1 --2- 172.21.15.37:0/713513125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41940b3ab0 0x7f41940a57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.477+0000 7f419b6fb640 1 -- 172.21.15.37:0/713513125 >> 172.21.15.37:0/713513125 conn(0x7f41940c0420 msgr2=0x7f41940c0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.477+0000 7f419b6fb640 1 -- 172.21.15.37:0/713513125 shutdown_connections 2023-12-19T16:07:32.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.477+0000 7f419b6fb640 1 -- 172.21.15.37:0/713513125 wait complete. 2023-12-19T16:07:32.492 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T16:07:32.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.606+0000 7f89d9141640 1 Processor -- start 2023-12-19T16:07:32.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.606+0000 7f89d9141640 1 -- start start 2023-12-19T16:07:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.607+0000 7f89d9141640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f89d40b79a0 0x7f89d40bc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.607+0000 7f89d9141640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89d40b64a0 0x7f89d40b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.607+0000 7f89d9141640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d40b8ba0 con 0x7f89d414ad50 2023-12-19T16:07:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.607+0000 7f89d9141640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d406cd70 con 0x7f89d40b79a0 2023-12-19T16:07:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.607+0000 7f89d9141640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d40b8e80 con 0x7f89d40b64a0 2023-12-19T16:07:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.607+0000 7f89d259c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89d40b64a0 0x7f89d40b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.607+0000 7f89d2d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f89d40b79a0 0x7f89d40bc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.607+0000 7f89d259c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89d40b64a0 0x7f89d40b68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:41224/0 (socket says 172.21.15.37:41224) 2023-12-19T16:07:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.607+0000 7f89d359e640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f89d414ad50 0x7f89d414b1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.37:32788/0 (socket says 172.21.15.37:32788) 2023-12-19T16:07:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.607+0000 7f89d259c640 1 -- 172.21.15.37:0/1470383728 learned_addr learned my addr 172.21.15.37:0/1470383728 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.607+0000 7f89d2d9d640 1 -- 172.21.15.37:0/1470383728 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89d40b64a0 msgr2=0x7f89d40b68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.607+0000 7f89d2d9d640 1 --2- 172.21.15.37:0/1470383728 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89d40b64a0 0x7f89d40b68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.607+0000 7f89d2d9d640 1 -- 172.21.15.37:0/1470383728 >> v1:172.21.15.78:6789/0 conn(0x7f89d414ad50 legacy=0x7f89d414b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.607+0000 7f89d2d9d640 1 -- 172.21.15.37:0/1470383728 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d40b9160 con 0x7f89d40b79a0 2023-12-19T16:07:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.607+0000 7f89d259c640 1 --2- 172.21.15.37:0/1470383728 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89d40b64a0 0x7f89d40b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:07:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.608+0000 7f89d2d9d640 1 --2- 172.21.15.37:0/1470383728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89d40b79a0 0x7f89d40bc660 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0097a0 tx=0x7f89cc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57b9b819e4e5e619 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.608+0000 7f89d1d9b640 1 -- 172.21.15.37:0/1470383728 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc030610 con 0x7f89d40b79a0 2023-12-19T16:07:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.608+0000 7f89d1d9b640 1 -- 172.21.15.37:0/1470383728 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc030770 con 0x7f89d40b79a0 2023-12-19T16:07:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.608+0000 7f89d1d9b640 1 -- 172.21.15.37:0/1470383728 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc030b00 con 0x7f89d40b79a0 2023-12-19T16:07:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.609+0000 7f89d9141640 1 -- 172.21.15.37:0/1470383728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89d40b79a0 msgr2=0x7f89d40bc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.609+0000 7f89d9141640 1 --2- 172.21.15.37:0/1470383728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89d40b79a0 0x7f89d40bc660 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0097a0 tx=0x7f89cc02b960 comp rx=0 tx=0).stop 2023-12-19T16:07:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.609+0000 7f89d9141640 1 -- 172.21.15.37:0/1470383728 shutdown_connections 2023-12-19T16:07:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.609+0000 7f89d9141640 1 --2- 172.21.15.37:0/1470383728 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89d40b64a0 0x7f89d40b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.609+0000 7f89d9141640 1 --2- 172.21.15.37:0/1470383728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89d40b79a0 0x7f89d40bc660 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.609+0000 7f89d9141640 1 -- 172.21.15.37:0/1470383728 >> 172.21.15.37:0/1470383728 conn(0x7f89d40c0330 msgr2=0x7f89d40c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.609+0000 7f89d9141640 1 -- 172.21.15.37:0/1470383728 shutdown_connections 2023-12-19T16:07:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.609+0000 7f89d9141640 1 -- 172.21.15.37:0/1470383728 wait complete. 2023-12-19T16:07:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.610+0000 7f89d9141640 1 Processor -- start 2023-12-19T16:07:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.610+0000 7f89d9141640 1 -- start start 2023-12-19T16:07:32.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.611+0000 7f89d9141640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89d40b64a0 0x7f89d40afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:32.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.611+0000 7f89d9141640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89d40b79a0 0x7f89d40b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:32.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.611+0000 7f89d9141640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89d414ad50 0x7f89d414d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:32.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.611+0000 7f89d9141640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d414e900 con 0x7f89d40b79a0 2023-12-19T16:07:32.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.611+0000 7f89d9141640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d40ae6c0 con 0x7f89d40b64a0 2023-12-19T16:07:32.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.611+0000 7f89d9141640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d40ae9a0 con 0x7f89d414ad50 2023-12-19T16:07:32.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.611+0000 7f89d259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89d40b79a0 0x7f89d40b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:32.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.611+0000 7f89d259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89d40b79a0 0x7f89d40b0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58368/0 (socket says 172.21.15.37:58368) 2023-12-19T16:07:32.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.611+0000 7f89d259c640 1 -- 172.21.15.37:0/26075106 learned_addr learned my addr 172.21.15.37:0/26075106 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.611+0000 7f89d2d9d640 1 --2- 172.21.15.37:0/26075106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89d40b64a0 0x7f89d40afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.611+0000 7f89d359e640 1 --2- 172.21.15.37:0/26075106 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89d414ad50 0x7f89d414d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.611+0000 7f89d259c640 1 -- 172.21.15.37:0/26075106 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89d414ad50 msgr2=0x7f89d414d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.611+0000 7f89d259c640 1 --2- 172.21.15.37:0/26075106 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89d414ad50 0x7f89d414d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.611+0000 7f89d259c640 1 -- 172.21.15.37:0/26075106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89d40b64a0 msgr2=0x7f89d40afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.611+0000 7f89d259c640 1 --2- 172.21.15.37:0/26075106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89d40b64a0 0x7f89d40afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.611+0000 7f89d259c640 1 -- 172.21.15.37:0/26075106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89bc0094d0 con 0x7f89d40b79a0 2023-12-19T16:07:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.612+0000 7f89d259c640 1 --2- 172.21.15.37:0/26075106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89d40b79a0 0x7f89d40b0320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00e9d0 tx=0x7f89bc00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.612+0000 7f89cb7fe640 1 -- 172.21.15.37:0/26075106 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc00ca60 con 0x7f89d40b79a0 2023-12-19T16:07:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.612+0000 7f89cb7fe640 1 -- 172.21.15.37:0/26075106 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc00cbc0 con 0x7f89d40b79a0 2023-12-19T16:07:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.612+0000 7f89d9141640 1 -- 172.21.15.37:0/26075106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89cc009400 con 0x7f89d40b79a0 2023-12-19T16:07:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.612+0000 7f89cb7fe640 1 -- 172.21.15.37:0/26075106 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc013470 con 0x7f89d40b79a0 2023-12-19T16:07:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.612+0000 7f89d9141640 1 -- 172.21.15.37:0/26075106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d40aef60 con 0x7f89d40b79a0 2023-12-19T16:07:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.613+0000 7f89d9141640 1 -- 172.21.15.37:0/26075106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d40ae800 con 0x7f89d40b79a0 2023-12-19T16:07:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.614+0000 7f89cb7fe640 1 -- 172.21.15.37:0/26075106 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f89bc0135d0 con 0x7f89d40b79a0 2023-12-19T16:07:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.614+0000 7f89cb7fe640 1 --2- 172.21.15.37:0/26075106 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f89b406a430 0x7f89b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.614+0000 7f89cb7fe640 1 -- 172.21.15.37:0/26075106 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f89bc088bf0 con 0x7f89d40b79a0 2023-12-19T16:07:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.614+0000 7f89d2d9d640 1 --2- 172.21.15.37:0/26075106 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f89b406a430 0x7f89b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.615+0000 7f89d2d9d640 1 --2- 172.21.15.37:0/26075106 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f89b406a430 0x7f89b406c8f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f89cc036000 tx=0x7f89cc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.618+0000 7f89cb7fe640 1 -- 172.21.15.37:0/26075106 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f89d40ae800 con 0x7f89d40b79a0 2023-12-19T16:07:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:32.794+0000 7f89d9141640 1 -- 172.21.15.37:0/26075106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f89d40ae800 con 0x7f89d40b79a0 2023-12-19T16:07:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.485+0000 7f89cb7fe640 1 -- 172.21.15.37:0/26075106 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f89d40ae800 con 0x7f89d40b79a0 2023-12-19T16:07:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-12-19T16:07:33.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.489+0000 7f89d9141640 1 -- 172.21.15.37:0/26075106 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f89b406a430 msgr2=0x7f89b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:33.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.489+0000 7f89d9141640 1 --2- 172.21.15.37:0/26075106 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f89b406a430 0x7f89b406c8f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f89cc036000 tx=0x7f89cc008030 comp rx=0 tx=0).stop 2023-12-19T16:07:33.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.489+0000 7f89d9141640 1 -- 172.21.15.37:0/26075106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89d40b79a0 msgr2=0x7f89d40b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:33.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.489+0000 7f89d9141640 1 --2- 172.21.15.37:0/26075106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89d40b79a0 0x7f89d40b0320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00e9d0 tx=0x7f89bc00ee90 comp rx=0 tx=0).stop 2023-12-19T16:07:33.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.489+0000 7f89d9141640 1 -- 172.21.15.37:0/26075106 shutdown_connections 2023-12-19T16:07:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.489+0000 7f89d9141640 1 --2- 172.21.15.37:0/26075106 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f89b406a430 0x7f89b406c8f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.489+0000 7f89d9141640 1 --2- 172.21.15.37:0/26075106 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89d414ad50 0x7f89d414d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.489+0000 7f89d9141640 1 --2- 172.21.15.37:0/26075106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89d40b79a0 0x7f89d40b0320 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.489+0000 7f89d9141640 1 --2- 172.21.15.37:0/26075106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89d40b64a0 0x7f89d40afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.489+0000 7f89d9141640 1 -- 172.21.15.37:0/26075106 >> 172.21.15.37:0/26075106 conn(0x7f89d40c0330 msgr2=0x7f89d414b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.489+0000 7f89d9141640 1 -- 172.21.15.37:0/26075106 shutdown_connections 2023-12-19T16:07:33.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.489+0000 7f89d9141640 1 -- 172.21.15.37:0/26075106 wait complete. 2023-12-19T16:07:33.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T16:07:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.618+0000 7f48c8281640 1 Processor -- start 2023-12-19T16:07:33.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.618+0000 7f48c8281640 1 -- start start 2023-12-19T16:07:33.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.619+0000 7f48c8281640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f48c00b4010 0x7f48c0070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:33.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.619+0000 7f48c8281640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f48c0071490 0x7f48c0142660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:33.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.619+0000 7f48c8281640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c00b7f20 con 0x7f48c00b69b0 2023-12-19T16:07:33.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.619+0000 7f48c8281640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c00b7bf0 con 0x7f48c00b4010 2023-12-19T16:07:33.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.619+0000 7f48c8281640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c00b9780 con 0x7f48c0071490 2023-12-19T16:07:33.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.619+0000 7f48c601d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f48c00b69b0 0x7f48c00b8cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48278/0 (socket says 172.21.15.37:48278) 2023-12-19T16:07:33.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.619+0000 7f48c601d640 1 -- 172.21.15.37:0/2570694738 learned_addr learned my addr 172.21.15.37:0/2570694738 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:33.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.619+0000 7f48c581c640 1 --2- 172.21.15.37:0/2570694738 >> v2:172.21.15.37:3300/0 conn(0x7f48c00b4010 0x7f48c0070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:33.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.619+0000 7f48c681e640 1 --2- 172.21.15.37:0/2570694738 >> v2:172.21.15.78:3300/0 conn(0x7f48c0071490 0x7f48c0142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:33.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.620+0000 7f48c581c640 1 -- 172.21.15.37:0/2570694738 >> v2:172.21.15.78:3300/0 conn(0x7f48c0071490 msgr2=0x7f48c0142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:33.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.620+0000 7f48c581c640 1 --2- 172.21.15.37:0/2570694738 >> v2:172.21.15.78:3300/0 conn(0x7f48c0071490 0x7f48c0142660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:33.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.620+0000 7f48c581c640 1 -- 172.21.15.37:0/2570694738 >> v1:172.21.15.37:6789/0 conn(0x7f48c00b69b0 legacy=0x7f48c00b8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:33.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.620+0000 7f48c501b640 1 -- 172.21.15.37:0/2570694738 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278557265 0 0) 0x7f48c00b7f20 con 0x7f48c00b69b0 2023-12-19T16:07:33.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.620+0000 7f48c581c640 1 -- 172.21.15.37:0/2570694738 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c00b9a30 con 0x7f48c00b4010 2023-12-19T16:07:33.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.620+0000 7f48c581c640 1 --2- 172.21.15.37:0/2570694738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c00b4010 0x7f48c0070f50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f48c00b7e90 tx=0x7f48b402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ea4040fe982ef2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:33.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.620+0000 7f48c501b640 1 -- 172.21.15.37:0/2570694738 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b4030610 con 0x7f48c00b4010 2023-12-19T16:07:33.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.621+0000 7f48c501b640 1 -- 172.21.15.37:0/2570694738 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b4030770 con 0x7f48c00b4010 2023-12-19T16:07:33.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.621+0000 7f48c501b640 1 -- 172.21.15.37:0/2570694738 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b4030b00 con 0x7f48c00b4010 2023-12-19T16:07:33.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.621+0000 7f48c8281640 1 -- 172.21.15.37:0/2570694738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c00b4010 msgr2=0x7f48c0070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:33.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.621+0000 7f48c8281640 1 --2- 172.21.15.37:0/2570694738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c00b4010 0x7f48c0070f50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f48c00b7e90 tx=0x7f48b402b960 comp rx=0 tx=0).stop 2023-12-19T16:07:33.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.621+0000 7f48c8281640 1 -- 172.21.15.37:0/2570694738 shutdown_connections 2023-12-19T16:07:33.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.621+0000 7f48c8281640 1 --2- 172.21.15.37:0/2570694738 >> v2:172.21.15.78:3300/0 conn(0x7f48c0071490 0x7f48c0142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:33.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.621+0000 7f48c8281640 1 --2- 172.21.15.37:0/2570694738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c00b4010 0x7f48c0070f50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:33.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.621+0000 7f48c8281640 1 -- 172.21.15.37:0/2570694738 >> 172.21.15.37:0/2570694738 conn(0x7f48c006ae90 msgr2=0x7f48c006b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:33.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.621+0000 7f48c8281640 1 -- 172.21.15.37:0/2570694738 shutdown_connections 2023-12-19T16:07:33.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.621+0000 7f48c8281640 1 -- 172.21.15.37:0/2570694738 wait complete. 2023-12-19T16:07:33.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.622+0000 7f48c8281640 1 Processor -- start 2023-12-19T16:07:33.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.622+0000 7f48c8281640 1 -- start start 2023-12-19T16:07:33.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.623+0000 7f48c8281640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48c0071490 0x7f48c013f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:33.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.623+0000 7f48c8281640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48c00b69b0 0x7f48c0146770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:33.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.623+0000 7f48c8281640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c0144c40 0x7f48c0148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:33.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.623+0000 7f48c8281640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c0147340 con 0x7f48c0144c40 2023-12-19T16:07:33.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.623+0000 7f48c8281640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c013f870 con 0x7f48c00b69b0 2023-12-19T16:07:33.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.623+0000 7f48c8281640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c0146cb0 con 0x7f48c0071490 2023-12-19T16:07:33.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.623+0000 7f48c681e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c0144c40 0x7f48c0148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:33.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.623+0000 7f48c681e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c0144c40 0x7f48c0148f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58398/0 (socket says 172.21.15.37:58398) 2023-12-19T16:07:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.623+0000 7f48c681e640 1 -- 172.21.15.37:0/720521200 learned_addr learned my addr 172.21.15.37:0/720521200 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.623+0000 7f48c581c640 1 --2- 172.21.15.37:0/720521200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48c00b69b0 0x7f48c0146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.623+0000 7f48c601d640 1 --2- 172.21.15.37:0/720521200 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48c0071490 0x7f48c013f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.623+0000 7f48c681e640 1 -- 172.21.15.37:0/720521200 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48c0071490 msgr2=0x7f48c013f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.623+0000 7f48c681e640 1 --2- 172.21.15.37:0/720521200 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48c0071490 0x7f48c013f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.623+0000 7f48c681e640 1 -- 172.21.15.37:0/720521200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48c00b69b0 msgr2=0x7f48c0146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.623+0000 7f48c681e640 1 --2- 172.21.15.37:0/720521200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48c00b69b0 0x7f48c0146770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.623+0000 7f48c681e640 1 -- 172.21.15.37:0/720521200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b4009400 con 0x7f48c0144c40 2023-12-19T16:07:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.624+0000 7f48c681e640 1 --2- 172.21.15.37:0/720521200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c0144c40 0x7f48c0148f80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f48b000cd70 tx=0x7f48b000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.624+0000 7f48beffd640 1 -- 172.21.15.37:0/720521200 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b0003b90 con 0x7f48c0144c40 2023-12-19T16:07:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.624+0000 7f48beffd640 1 -- 172.21.15.37:0/720521200 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b0003cf0 con 0x7f48c0144c40 2023-12-19T16:07:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.624+0000 7f48c8281640 1 -- 172.21.15.37:0/720521200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c01d0940 con 0x7f48c0144c40 2023-12-19T16:07:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.624+0000 7f48beffd640 1 -- 172.21.15.37:0/720521200 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b0004240 con 0x7f48c0144c40 2023-12-19T16:07:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.624+0000 7f48c8281640 1 -- 172.21.15.37:0/720521200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c01484b0 con 0x7f48c0144c40 2023-12-19T16:07:33.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.625+0000 7f48c8281640 1 -- 172.21.15.37:0/720521200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c00b8390 con 0x7f48c0144c40 2023-12-19T16:07:33.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.625+0000 7f48beffd640 1 -- 172.21.15.37:0/720521200 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f48b00043a0 con 0x7f48c0144c40 2023-12-19T16:07:33.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.625+0000 7f48beffd640 1 --2- 172.21.15.37:0/720521200 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f48ac06a430 0x7f48ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:33.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.626+0000 7f48beffd640 1 -- 172.21.15.37:0/720521200 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f48b0012070 con 0x7f48c0144c40 2023-12-19T16:07:33.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.626+0000 7f48c601d640 1 --2- 172.21.15.37:0/720521200 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f48ac06a430 0x7f48ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:33.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.626+0000 7f48c601d640 1 --2- 172.21.15.37:0/720521200 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f48ac06a430 0x7f48ac06c8f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f48b8001670 tx=0x7f48b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:33.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.630+0000 7f48beffd640 1 -- 172.21.15.37:0/720521200 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f48c00b8390 con 0x7f48c0144c40 2023-12-19T16:07:33.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:33.806+0000 7f48c8281640 1 -- 172.21.15.37:0/720521200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f48c00b8390 con 0x7f48c0144c40 2023-12-19T16:07:34.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.489+0000 7f48beffd640 1 -- 172.21.15.37:0/720521200 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f48c00b8390 con 0x7f48c0144c40 2023-12-19T16:07:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-12-19T16:07:34.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.495+0000 7f48c8281640 1 -- 172.21.15.37:0/720521200 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f48ac06a430 msgr2=0x7f48ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:34.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.495+0000 7f48c8281640 1 --2- 172.21.15.37:0/720521200 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f48ac06a430 0x7f48ac06c8f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f48b8001670 tx=0x7f48b8009040 comp rx=0 tx=0).stop 2023-12-19T16:07:34.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.495+0000 7f48c8281640 1 -- 172.21.15.37:0/720521200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c0144c40 msgr2=0x7f48c0148f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:34.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.495+0000 7f48c8281640 1 --2- 172.21.15.37:0/720521200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c0144c40 0x7f48c0148f80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f48b000cd70 tx=0x7f48b000a660 comp rx=0 tx=0).stop 2023-12-19T16:07:34.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.495+0000 7f48c8281640 1 -- 172.21.15.37:0/720521200 shutdown_connections 2023-12-19T16:07:34.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.495+0000 7f48c8281640 1 --2- 172.21.15.37:0/720521200 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f48ac06a430 0x7f48ac06c8f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:34.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.495+0000 7f48c8281640 1 --2- 172.21.15.37:0/720521200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c0144c40 0x7f48c0148f80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:34.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.495+0000 7f48c8281640 1 --2- 172.21.15.37:0/720521200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48c00b69b0 0x7f48c0146770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:34.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.495+0000 7f48c8281640 1 --2- 172.21.15.37:0/720521200 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f48c0071490 0x7f48c013f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:34.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.495+0000 7f48c8281640 1 -- 172.21.15.37:0/720521200 >> 172.21.15.37:0/720521200 conn(0x7f48c006ae90 msgr2=0x7f48c00bd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:34.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.495+0000 7f48c8281640 1 -- 172.21.15.37:0/720521200 shutdown_connections 2023-12-19T16:07:34.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.495+0000 7f48c8281640 1 -- 172.21.15.37:0/720521200 wait complete. 2023-12-19T16:07:34.512 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T16:07:34.513 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T16:07:34.513 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T16:07:34.513 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:07:34.513 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T16:07:34.513 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T16:07:34.513 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T16:07:34.513 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:07:34.514 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T16:07:34.514 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T16:07:34.514 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T16:07:34.514 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:07:34.524 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T16:07:34.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T16:07:34.525 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T16:07:34.525 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T16:07:34.526 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T16:07:34.526 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T16:07:34.567 INFO:tasks.ceph.mds.a:Started 2023-12-19T16:07:34.567 DEBUG:teuthology.parallel:result is None 2023-12-19T16:07:34.568 INFO:tasks.ceph.mds.c:Started 2023-12-19T16:07:34.568 DEBUG:teuthology.parallel:result is None 2023-12-19T16:07:34.569 INFO:tasks.ceph.mds.b:Started 2023-12-19T16:07:34.569 DEBUG:teuthology.parallel:result is None 2023-12-19T16:07:34.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T16:07:34.649 INFO:tasks.ceph.mds.b.smithi078.stdout:starting mds.b at 2023-12-19T16:07:34.656 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-12-19T16:07:34.656 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-12-19T16:07:34.657 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-19T16:07:34.655+0000 7f4a7a2f8640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-12-19T16:07:34.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.690+0000 7f01ac015640 1 Processor -- start 2023-12-19T16:07:34.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.690+0000 7f01ac015640 1 -- start start 2023-12-19T16:07:34.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.691+0000 7f01ac015640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01a406af80 0x7f01a406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:34.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.691+0000 7f01ac015640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f01a41482a0 0x7f01a40b9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.691+0000 7f01ac015640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f01a4070960 0x7f01a40b6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.691+0000 7f01ac015640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a4147e10 con 0x7f01a41482a0 2023-12-19T16:07:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.691+0000 7f01ac015640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a4070df0 con 0x7f01a4070960 2023-12-19T16:07:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.691+0000 7f01ac015640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a4147800 con 0x7f01a406af80 2023-12-19T16:07:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.691+0000 7f01a95b0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f01a41482a0 0x7f01a40b9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.691+0000 7f01a95b0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f01a41482a0 0x7f01a40b9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58450/0 (socket says 172.21.15.37:58450) 2023-12-19T16:07:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.691+0000 7f01a95b0640 1 -- 172.21.15.37:0/1681237745 learned_addr learned my addr 172.21.15.37:0/1681237745 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.691+0000 7f01a9db1640 1 --2- 172.21.15.37:0/1681237745 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01a406af80 0x7f01a406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.691+0000 7f01aa5b2640 1 --2- 172.21.15.37:0/1681237745 >> v2:172.21.15.78:3300/0 conn(0x7f01a4070960 0x7f01a40b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.691+0000 7f01a95b0640 1 -- 172.21.15.37:0/1681237745 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01a406af80 msgr2=0x7f01a406fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.691+0000 7f01a95b0640 1 --2- 172.21.15.37:0/1681237745 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01a406af80 0x7f01a406fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.691+0000 7f01a95b0640 1 -- 172.21.15.37:0/1681237745 >> v2:172.21.15.78:3300/0 conn(0x7f01a4070960 msgr2=0x7f01a40b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:34.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.691+0000 7f01a95b0640 1 --2- 172.21.15.37:0/1681237745 >> v2:172.21.15.78:3300/0 conn(0x7f01a4070960 0x7f01a40b6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:34.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.691+0000 7f01a95b0640 1 -- 172.21.15.37:0/1681237745 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a406b360 con 0x7f01a41482a0 2023-12-19T16:07:34.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.692+0000 7f01a95b0640 1 --2- 172.21.15.37:0/1681237745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01a41482a0 0x7f01a40b9350 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f01a40b9020 tx=0x7f019402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7847529d46926c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:34.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.692+0000 7f01a8daf640 1 -- 172.21.15.37:0/1681237745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194031870 con 0x7f01a41482a0 2023-12-19T16:07:34.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.692+0000 7f01a8daf640 1 -- 172.21.15.37:0/1681237745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01940319d0 con 0x7f01a41482a0 2023-12-19T16:07:34.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.692+0000 7f01a8daf640 1 -- 172.21.15.37:0/1681237745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194031d60 con 0x7f01a41482a0 2023-12-19T16:07:34.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.693+0000 7f01ac015640 1 -- 172.21.15.37:0/1681237745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01a41482a0 msgr2=0x7f01a40b9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:34.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.693+0000 7f01ac015640 1 --2- 172.21.15.37:0/1681237745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01a41482a0 0x7f01a40b9350 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f01a40b9020 tx=0x7f019402b910 comp rx=0 tx=0).stop 2023-12-19T16:07:34.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.693+0000 7f01ac015640 1 -- 172.21.15.37:0/1681237745 shutdown_connections 2023-12-19T16:07:34.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.693+0000 7f01ac015640 1 --2- 172.21.15.37:0/1681237745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01a41482a0 0x7f01a40b9350 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:34.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.693+0000 7f01ac015640 1 --2- 172.21.15.37:0/1681237745 >> v2:172.21.15.78:3300/0 conn(0x7f01a4070960 0x7f01a40b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:34.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.693+0000 7f01ac015640 1 --2- 172.21.15.37:0/1681237745 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01a406af80 0x7f01a406fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:34.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.693+0000 7f01ac015640 1 -- 172.21.15.37:0/1681237745 >> 172.21.15.37:0/1681237745 conn(0x7f01a40bcfc0 msgr2=0x7f01a40bd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:34.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.693+0000 7f01ac015640 1 -- 172.21.15.37:0/1681237745 shutdown_connections 2023-12-19T16:07:34.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.693+0000 7f01ac015640 1 -- 172.21.15.37:0/1681237745 wait complete. 2023-12-19T16:07:34.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.694+0000 7f01ac015640 1 Processor -- start 2023-12-19T16:07:34.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.694+0000 7f01ac015640 1 -- start start 2023-12-19T16:07:34.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.695+0000 7f01ac015640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01a406af80 0x7f01a413c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:34.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.695+0000 7f01ac015640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01a4070960 0x7f01a41521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:34.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.695+0000 7f01ac015640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01a41482a0 0x7f01a4151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:34.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.695+0000 7f01ac015640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40bcd10 con 0x7f01a4070960 2023-12-19T16:07:34.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.695+0000 7f01ac015640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a413d1c0 con 0x7f01a406af80 2023-12-19T16:07:34.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.695+0000 7f01ac015640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a41506b0 con 0x7f01a41482a0 2023-12-19T16:07:34.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.695+0000 7f01a95b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01a4070960 0x7f01a41521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:34.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.695+0000 7f01a95b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01a4070960 0x7f01a41521b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58456/0 (socket says 172.21.15.37:58456) 2023-12-19T16:07:34.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.695+0000 7f01a95b0640 1 -- 172.21.15.37:0/3046638507 learned_addr learned my addr 172.21.15.37:0/3046638507 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:34.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.695+0000 7f01a9db1640 1 --2- 172.21.15.37:0/3046638507 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01a406af80 0x7f01a413c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:34.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.695+0000 7f01aa5b2640 1 --2- 172.21.15.37:0/3046638507 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01a41482a0 0x7f01a4151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:34.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.695+0000 7f01a95b0640 1 -- 172.21.15.37:0/3046638507 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01a41482a0 msgr2=0x7f01a4151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:34.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.695+0000 7f01a95b0640 1 --2- 172.21.15.37:0/3046638507 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01a41482a0 0x7f01a4151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:34.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.695+0000 7f01a95b0640 1 -- 172.21.15.37:0/3046638507 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01a406af80 msgr2=0x7f01a413c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:34.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.695+0000 7f01a95b0640 1 --2- 172.21.15.37:0/3046638507 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01a406af80 0x7f01a413c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:34.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.695+0000 7f01a95b0640 1 -- 172.21.15.37:0/3046638507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01940094d0 con 0x7f01a4070960 2023-12-19T16:07:34.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.695+0000 7f01a9db1640 1 --2- 172.21.15.37:0/3046638507 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01a406af80 0x7f01a413c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:07:34.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.696+0000 7f01a95b0640 1 --2- 172.21.15.37:0/3046638507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01a4070960 0x7f01a41521b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f019402b950 tx=0x7f01940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:34.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.696+0000 7f019a7fc640 1 -- 172.21.15.37:0/3046638507 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019403abe0 con 0x7f01a4070960 2023-12-19T16:07:34.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.696+0000 7f019a7fc640 1 -- 172.21.15.37:0/3046638507 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019403ad40 con 0x7f01a4070960 2023-12-19T16:07:34.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.696+0000 7f01ac015640 1 -- 172.21.15.37:0/3046638507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a41503b0 con 0x7f01a4070960 2023-12-19T16:07:34.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.696+0000 7f019a7fc640 1 -- 172.21.15.37:0/3046638507 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194044630 con 0x7f01a4070960 2023-12-19T16:07:34.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.696+0000 7f01ac015640 1 -- 172.21.15.37:0/3046638507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a4150bd0 con 0x7f01a4070960 2023-12-19T16:07:34.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.697+0000 7f01ac015640 1 -- 172.21.15.37:0/3046638507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a404e840 con 0x7f01a4070960 2023-12-19T16:07:34.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.697+0000 7f019a7fc640 1 -- 172.21.15.37:0/3046638507 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0194044790 con 0x7f01a4070960 2023-12-19T16:07:34.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.698+0000 7f019a7fc640 1 --2- 172.21.15.37:0/3046638507 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f018806a430 0x7f018806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:34.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.698+0000 7f019a7fc640 1 -- 172.21.15.37:0/3046638507 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f019402d040 con 0x7f01a4070960 2023-12-19T16:07:34.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.698+0000 7f01a9db1640 1 --2- 172.21.15.37:0/3046638507 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f018806a430 0x7f018806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:34.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.698+0000 7f01a9db1640 1 --2- 172.21.15.37:0/3046638507 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f018806a430 0x7f018806c8f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009eb0 tx=0x7f01a0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:34.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.702+0000 7f019a7fc640 1 -- 172.21.15.37:0/3046638507 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f01940764d0 con 0x7f01a4070960 2023-12-19T16:07:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:34.900+0000 7f01ac015640 1 -- 172.21.15.37:0/3046638507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f01a414bb80 con 0x7f01a4070960 2023-12-19T16:07:35.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.693+0000 7f019a7fc640 1 -- 172.21.15.37:0/3046638507 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0194079af0 con 0x7f01a4070960 2023-12-19T16:07:35.696 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-12-19T16:07:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.696+0000 7f01ac015640 1 -- 172.21.15.37:0/3046638507 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f018806a430 msgr2=0x7f018806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.696+0000 7f01ac015640 1 --2- 172.21.15.37:0/3046638507 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f018806a430 0x7f018806c8f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009eb0 tx=0x7f01a0009190 comp rx=0 tx=0).stop 2023-12-19T16:07:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.696+0000 7f01ac015640 1 -- 172.21.15.37:0/3046638507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01a4070960 msgr2=0x7f01a41521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.696+0000 7f01ac015640 1 --2- 172.21.15.37:0/3046638507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01a4070960 0x7f01a41521b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f019402b950 tx=0x7f01940046c0 comp rx=0 tx=0).stop 2023-12-19T16:07:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.696+0000 7f01ac015640 1 -- 172.21.15.37:0/3046638507 shutdown_connections 2023-12-19T16:07:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.696+0000 7f01ac015640 1 --2- 172.21.15.37:0/3046638507 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f018806a430 0x7f018806c8f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.696+0000 7f01ac015640 1 --2- 172.21.15.37:0/3046638507 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f01a41482a0 0x7f01a4151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.696+0000 7f01ac015640 1 --2- 172.21.15.37:0/3046638507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01a4070960 0x7f01a41521b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.696+0000 7f01ac015640 1 --2- 172.21.15.37:0/3046638507 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f01a406af80 0x7f01a413c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:35.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.696+0000 7f01ac015640 1 -- 172.21.15.37:0/3046638507 >> 172.21.15.37:0/3046638507 conn(0x7f01a40bcfc0 msgr2=0x7f01a413e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:35.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.696+0000 7f01ac015640 1 -- 172.21.15.37:0/3046638507 shutdown_connections 2023-12-19T16:07:35.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.696+0000 7f01ac015640 1 -- 172.21.15.37:0/3046638507 wait complete. 2023-12-19T16:07:35.712 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T16:07:35.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.822+0000 7fbffde12640 1 Processor -- start 2023-12-19T16:07:35.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.822+0000 7fbffde12640 1 -- start start 2023-12-19T16:07:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.822+0000 7fbffde12640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbff80bcdd0 0x7fbff80b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.822+0000 7fbffde12640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbff8144ea0 0x7fbff8155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.822+0000 7fbffde12640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff80bc6b0 con 0x7fbff80b64c0 2023-12-19T16:07:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.822+0000 7fbffde12640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff80b6900 con 0x7fbff8144ea0 2023-12-19T16:07:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.822+0000 7fbffde12640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff80a59f0 con 0x7fbff80bcdd0 2023-12-19T16:07:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.823+0000 7fbff7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbff8144ea0 0x7fbff8155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.823+0000 7fbff7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbff8144ea0 0x7fbff8155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58468/0 (socket says 172.21.15.37:58468) 2023-12-19T16:07:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.823+0000 7fbff7fff640 1 -- 172.21.15.37:0/1052343747 learned_addr learned my addr 172.21.15.37:0/1052343747 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.823+0000 7fbff77fe640 1 --2- 172.21.15.37:0/1052343747 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbff80bcdd0 0x7fbff80b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:35.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.823+0000 7fbff7fff640 1 -- 172.21.15.37:0/1052343747 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbff80bcdd0 msgr2=0x7fbff80b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.823+0000 7fbff7fff640 1 --2- 172.21.15.37:0/1052343747 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbff80bcdd0 0x7fbff80b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.823+0000 7fbff7fff640 1 -- 172.21.15.37:0/1052343747 >> v1:172.21.15.78:6789/0 conn(0x7fbff80b64c0 legacy=0x7fbff8144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.823+0000 7fbff7fff640 1 -- 172.21.15.37:0/1052343747 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff80bc0a0 con 0x7fbff8144ea0 2023-12-19T16:07:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.823+0000 7fbff77fe640 1 --2- 172.21.15.37:0/1052343747 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbff80bcdd0 0x7fbff80b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.824+0000 7fbff7fff640 1 --2- 172.21.15.37:0/1052343747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff8144ea0 0x7fbff8155340 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbff0009e50 tx=0x7fbff002bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8dc428c05dcaf9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.824+0000 7fbff67fc640 1 -- 172.21.15.37:0/1052343747 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff002cb90 con 0x7fbff8144ea0 2023-12-19T16:07:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.824+0000 7fbff67fc640 1 -- 172.21.15.37:0/1052343747 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff002ccf0 con 0x7fbff8144ea0 2023-12-19T16:07:35.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.824+0000 7fbff67fc640 1 -- 172.21.15.37:0/1052343747 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0034610 con 0x7fbff8144ea0 2023-12-19T16:07:35.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.824+0000 7fbffde12640 1 -- 172.21.15.37:0/1052343747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff8144ea0 msgr2=0x7fbff8155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:35.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.824+0000 7fbffde12640 1 --2- 172.21.15.37:0/1052343747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff8144ea0 0x7fbff8155340 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbff0009e50 tx=0x7fbff002bff0 comp rx=0 tx=0).stop 2023-12-19T16:07:35.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.824+0000 7fbffde12640 1 -- 172.21.15.37:0/1052343747 shutdown_connections 2023-12-19T16:07:35.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.824+0000 7fbffde12640 1 --2- 172.21.15.37:0/1052343747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff8144ea0 0x7fbff8155340 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:35.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.824+0000 7fbffde12640 1 --2- 172.21.15.37:0/1052343747 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbff80bcdd0 0x7fbff80b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:35.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.824+0000 7fbffde12640 1 -- 172.21.15.37:0/1052343747 >> 172.21.15.37:0/1052343747 conn(0x7fbff8071e60 msgr2=0x7fbff80c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:35.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.824+0000 7fbffde12640 1 -- 172.21.15.37:0/1052343747 shutdown_connections 2023-12-19T16:07:35.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.825+0000 7fbffde12640 1 -- 172.21.15.37:0/1052343747 wait complete. 2023-12-19T16:07:35.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.826+0000 7fbffde12640 1 Processor -- start 2023-12-19T16:07:35.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.826+0000 7fbffde12640 1 -- start start 2023-12-19T16:07:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.826+0000 7fbffde12640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff80b64c0 0x7fbff81e3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.826+0000 7fbffde12640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff80bcdd0 0x7fbff81e0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.826+0000 7fbffde12640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbff8144ea0 0x7fbff81477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.826+0000 7fbffde12640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff809a540 con 0x7fbff80bcdd0 2023-12-19T16:07:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.826+0000 7fbffde12640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff809a1a0 con 0x7fbff80b64c0 2023-12-19T16:07:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.826+0000 7fbffde12640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff81e3ea0 con 0x7fbff8144ea0 2023-12-19T16:07:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.826+0000 7fbff6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff80bcdd0 0x7fbff81e0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.827+0000 7fbff6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff80bcdd0 0x7fbff81e0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58480/0 (socket says 172.21.15.37:58480) 2023-12-19T16:07:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.827+0000 7fbff6ffd640 1 -- 172.21.15.37:0/2553345917 learned_addr learned my addr 172.21.15.37:0/2553345917 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.827+0000 7fbff7fff640 1 --2- 172.21.15.37:0/2553345917 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbff8144ea0 0x7fbff81477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.827+0000 7fbff77fe640 1 --2- 172.21.15.37:0/2553345917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff80b64c0 0x7fbff81e3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.827+0000 7fbff6ffd640 1 -- 172.21.15.37:0/2553345917 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbff8144ea0 msgr2=0x7fbff81477a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.827+0000 7fbff6ffd640 1 --2- 172.21.15.37:0/2553345917 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbff8144ea0 0x7fbff81477a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:35.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.827+0000 7fbff6ffd640 1 -- 172.21.15.37:0/2553345917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff80b64c0 msgr2=0x7fbff81e3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:35.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.827+0000 7fbff6ffd640 1 --2- 172.21.15.37:0/2553345917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff80b64c0 0x7fbff81e3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:35.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.827+0000 7fbff6ffd640 1 -- 172.21.15.37:0/2553345917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff0009b30 con 0x7fbff80bcdd0 2023-12-19T16:07:35.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.827+0000 7fbff7fff640 1 --2- 172.21.15.37:0/2553345917 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbff8144ea0 0x7fbff81477a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:35.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.827+0000 7fbff6ffd640 1 --2- 172.21.15.37:0/2553345917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff80bcdd0 0x7fbff81e0340 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00c400 tx=0x7fbfec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:35.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.827+0000 7fbfdffff640 1 -- 172.21.15.37:0/2553345917 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0052d0 con 0x7fbff80bcdd0 2023-12-19T16:07:35.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.827+0000 7fbfdffff640 1 -- 172.21.15.37:0/2553345917 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec005430 con 0x7fbff80bcdd0 2023-12-19T16:07:35.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.827+0000 7fbffde12640 1 -- 172.21.15.37:0/2553345917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff809b210 con 0x7fbff80bcdd0 2023-12-19T16:07:35.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.827+0000 7fbfdffff640 1 -- 172.21.15.37:0/2553345917 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec003830 con 0x7fbff80bcdd0 2023-12-19T16:07:35.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.827+0000 7fbffde12640 1 -- 172.21.15.37:0/2553345917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff8099ec0 con 0x7fbff80bcdd0 2023-12-19T16:07:35.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.828+0000 7fbffde12640 1 -- 172.21.15.37:0/2553345917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff804e840 con 0x7fbff80bcdd0 2023-12-19T16:07:35.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.829+0000 7fbfdffff640 1 -- 172.21.15.37:0/2553345917 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbfec003990 con 0x7fbff80bcdd0 2023-12-19T16:07:35.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.829+0000 7fbfdffff640 1 --2- 172.21.15.37:0/2553345917 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbfe406a460 0x7fbfe406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:35.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.829+0000 7fbfdffff640 1 -- 172.21.15.37:0/2553345917 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbfec087ae0 con 0x7fbff80bcdd0 2023-12-19T16:07:35.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.829+0000 7fbff77fe640 1 --2- 172.21.15.37:0/2553345917 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbfe406a460 0x7fbfe406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:35.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.830+0000 7fbff77fe640 1 --2- 172.21.15.37:0/2553345917 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbfe406a460 0x7fbfe406c920 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8006fd0 tx=0x7fbfe8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:35.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:35.833+0000 7fbfdffff640 1 -- 172.21.15.37:0/2553345917 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbfec0534b0 con 0x7fbff80bcdd0 2023-12-19T16:07:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.079+0000 7fbffde12640 1 -- 172.21.15.37:0/2553345917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbff8142df0 con 0x7fbff80bcdd0 2023-12-19T16:07:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.079+0000 7fbfdffff640 1 -- 172.21.15.37:0/2553345917 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+5491 (secure 0 0 0) 0x7fbfec056ad0 con 0x7fbff80bcdd0 2023-12-19T16:07:36.082 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:36.082 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-12-19T16:07:36.082 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-12-19T16:07:36.082 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.083 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-12-19T16:07:36.083 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBpv4FlP4BpCBAAgfkUeMmNn8OBM5d35sMCUA==", 2023-12-19T16:07:36.083 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.083 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-12-19T16:07:36.083 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-12-19T16:07:36.083 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-12-19T16:07:36.084 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-19T16:07:36.084 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.084 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.084 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.084 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-12-19T16:07:36.084 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBpv4FlTv+1FRAAeNi4yKzHJGBGZAxthW+Dsg==", 2023-12-19T16:07:36.084 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.085 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-12-19T16:07:36.085 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-12-19T16:07:36.085 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-12-19T16:07:36.085 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-19T16:07:36.085 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.085 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.085 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.086 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-12-19T16:07:36.086 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBpv4FlzIt8EBAAQvLFBV5luwDu+BiGH6v3CQ==", 2023-12-19T16:07:36.086 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.086 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-12-19T16:07:36.086 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-12-19T16:07:36.086 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-12-19T16:07:36.087 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-19T16:07:36.087 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.087 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.087 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.087 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-12-19T16:07:36.087 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBsv4FlQb0rNhAAEHu+gRZHJKTxweLVUxz5fA==", 2023-12-19T16:07:36.087 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.088 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-12-19T16:07:36.088 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-12-19T16:07:36.088 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-19T16:07:36.088 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.088 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.088 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.088 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-12-19T16:07:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBvv4Fl/UudNRAAOBkK7lIYw6GIgy2xr0fQqg==", 2023-12-19T16:07:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-12-19T16:07:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-12-19T16:07:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-19T16:07:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.090 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.090 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.090 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-12-19T16:07:36.090 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQByv4Fly1NtNBAAyP2Kvhf+gKEGWKA0V2H0KA==", 2023-12-19T16:07:36.090 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.090 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-12-19T16:07:36.091 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-12-19T16:07:36.091 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-19T16:07:36.091 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.091 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.091 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.091 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-12-19T16:07:36.091 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQB1v4Fl1/ufMxAArBxLZDYbRU5VjNyyAE7Vrg==", 2023-12-19T16:07:36.092 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.092 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-12-19T16:07:36.092 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-12-19T16:07:36.092 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-19T16:07:36.092 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.092 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.092 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.093 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-12-19T16:07:36.093 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQB8v4Fl3jYFARAAy0Cb61E3bzk5mJsWBB40rA==", 2023-12-19T16:07:36.093 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.093 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-12-19T16:07:36.093 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-12-19T16:07:36.094 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-19T16:07:36.094 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.094 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.094 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.094 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-12-19T16:07:36.094 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQB+v4FlRD1eOxAAxn6sz6udSIEGAE59ZqrX8w==", 2023-12-19T16:07:36.095 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.095 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-12-19T16:07:36.095 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-12-19T16:07:36.095 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-19T16:07:36.095 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.096 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.096 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.096 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-12-19T16:07:36.096 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCBv4Fl0FyLOhAAMceAAhu1QHvQhsYtpibqaQ==", 2023-12-19T16:07:36.096 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.096 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-12-19T16:07:36.097 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-12-19T16:07:36.097 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-19T16:07:36.097 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.097 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.097 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.098 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-12-19T16:07:36.098 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCEv4FlTH9OOBAApR3uYKIc910/V/QbOrVYwg==", 2023-12-19T16:07:36.098 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.098 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-12-19T16:07:36.098 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-12-19T16:07:36.098 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-19T16:07:36.099 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.099 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.099 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.099 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-12-19T16:07:36.099 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBpv4Fl/rMPIBAADjykw74HBVisjFfNFW6Wew==", 2023-12-19T16:07:36.099 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.100 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-12-19T16:07:36.100 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-12-19T16:07:36.100 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-12-19T16:07:36.100 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-12-19T16:07:36.100 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.100 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.100 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.101 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-12-19T16:07:36.101 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBov4FlDqP1FxAAgmeUG5CfJbsHOkLlF2UByQ==", 2023-12-19T16:07:36.101 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.101 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-12-19T16:07:36.101 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-12-19T16:07:36.101 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-12-19T16:07:36.102 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-19T16:07:36.102 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.102 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.102 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.102 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mds", 2023-12-19T16:07:36.102 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCKv4FlptqPHhAA4mpdq/rtFhe4NNN/vAjKKg==", 2023-12-19T16:07:36.103 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.103 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mds" 2023-12-19T16:07:36.103 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.103 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.103 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.103 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mgr", 2023-12-19T16:07:36.103 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCKv4FlJ+mPHhAAOIpUg6P/RmaVyJag/OUh6A==", 2023-12-19T16:07:36.103 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.103 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-19T16:07:36.103 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.103 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.103 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.103 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-osd", 2023-12-19T16:07:36.104 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCKv4FldfWPHhAAUuCbJMXKjqq1XfvlbcnzKA==", 2023-12-19T16:07:36.104 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.104 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-osd" 2023-12-19T16:07:36.104 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.104 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.104 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.104 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd", 2023-12-19T16:07:36.105 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCKv4FlRv+PHhAAd9/CTrMrLTWhfi2J88W+sg==", 2023-12-19T16:07:36.105 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.105 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-19T16:07:36.105 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.105 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.105 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.106 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-19T16:07:36.106 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCKv4FlJweQHhAAXluYgLHNDPl12gg2AFT1fw==", 2023-12-19T16:07:36.106 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.106 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-19T16:07:36.106 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.107 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.107 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.107 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rgw", 2023-12-19T16:07:36.107 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCKv4FlAA+QHhAAAKsjitcnOZ0CJbHSYnHVsw==", 2023-12-19T16:07:36.107 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.107 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-19T16:07:36.107 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.107 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.108 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.108 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-12-19T16:07:36.108 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBpv4FlP/OEBBAAFEoxM9gdEIx1ng/cGGi4JQ==", 2023-12-19T16:07:36.108 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.108 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-12-19T16:07:36.108 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-12-19T16:07:36.108 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-19T16:07:36.108 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.109 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-19T16:07:36.109 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:36.109 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-12-19T16:07:36.109 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBov4Flf1CCOxAAzSgCXan9Dmb0qjkyrz6lEw==", 2023-12-19T16:07:36.109 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-19T16:07:36.109 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-12-19T16:07:36.109 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-12-19T16:07:36.109 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-19T16:07:36.110 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.110 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:36.110 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-12-19T16:07:36.110 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-12-19T16:07:36.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.081+0000 7fbffde12640 1 -- 172.21.15.37:0/2553345917 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbfe406a460 msgr2=0x7fbfe406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.081+0000 7fbffde12640 1 --2- 172.21.15.37:0/2553345917 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbfe406a460 0x7fbfe406c920 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8006fd0 tx=0x7fbfe8008040 comp rx=0 tx=0).stop 2023-12-19T16:07:36.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.081+0000 7fbffde12640 1 -- 172.21.15.37:0/2553345917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff80bcdd0 msgr2=0x7fbff81e0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.081+0000 7fbffde12640 1 --2- 172.21.15.37:0/2553345917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff80bcdd0 0x7fbff81e0340 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00c400 tx=0x7fbfec00c8c0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.081+0000 7fbffde12640 1 -- 172.21.15.37:0/2553345917 shutdown_connections 2023-12-19T16:07:36.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.081+0000 7fbffde12640 1 --2- 172.21.15.37:0/2553345917 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbfe406a460 0x7fbfe406c920 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.081+0000 7fbffde12640 1 --2- 172.21.15.37:0/2553345917 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbff8144ea0 0x7fbff81477a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.081+0000 7fbffde12640 1 --2- 172.21.15.37:0/2553345917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbff80bcdd0 0x7fbff81e0340 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.081+0000 7fbffde12640 1 --2- 172.21.15.37:0/2553345917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff80b64c0 0x7fbff81e3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.081+0000 7fbffde12640 1 -- 172.21.15.37:0/2553345917 >> 172.21.15.37:0/2553345917 conn(0x7fbff8071e60 msgr2=0x7fbff80b5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:36.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.081+0000 7fbffde12640 1 -- 172.21.15.37:0/2553345917 shutdown_connections 2023-12-19T16:07:36.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.081+0000 7fbffde12640 1 -- 172.21.15.37:0/2553345917 wait complete. 2023-12-19T16:07:36.113 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-19T16:07:36.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.218+0000 7fad7821e640 1 Processor -- start 2023-12-19T16:07:36.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.218+0000 7fad7821e640 1 -- start start 2023-12-19T16:07:36.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.218+0000 7fad7821e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad7006acb0 0x7fad7006b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:36.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.218+0000 7fad7821e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad70145220 con 0x7fad7014edb0 2023-12-19T16:07:36.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.218+0000 7fad7821e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7006b720 con 0x7fad7014b7b0 2023-12-19T16:07:36.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.218+0000 7fad7821e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7014e0c0 con 0x7fad7006acb0 2023-12-19T16:07:36.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad757b9640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fad7014edb0 0x7fad700baa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48298/0 (socket says 172.21.15.37:48298) 2023-12-19T16:07:36.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad757b9640 1 -- 172.21.15.37:0/842457464 learned_addr learned my addr 172.21.15.37:0/842457464 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:36.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad767bb640 1 --2- 172.21.15.37:0/842457464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad7006acb0 0x7fad7006b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:36.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad74fb8640 1 -- 172.21.15.37:0/842457464 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583452249 0 0) 0x7fad60001110 con 0x7fad7014edb0 2023-12-19T16:07:36.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad74fb8640 1 -- 172.21.15.37:0/842457464 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad5c003520 con 0x7fad7014edb0 2023-12-19T16:07:36.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad74fb8640 1 -- 172.21.15.37:0/842457464 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498143573 0 0) 0x7fad7006b720 con 0x7fad7014b7b0 2023-12-19T16:07:36.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad74fb8640 1 -- 172.21.15.37:0/842457464 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad60001110 con 0x7fad7014b7b0 2023-12-19T16:07:36.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad74fb8640 1 -- 172.21.15.37:0/842457464 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2020643302 0 0) 0x7fad5c003520 con 0x7fad7014edb0 2023-12-19T16:07:36.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad74fb8640 1 -- 172.21.15.37:0/842457464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad7006acb0 msgr2=0x7fad7006b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:36.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad74fb8640 1 --2- 172.21.15.37:0/842457464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad7006acb0 0x7fad7006b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad74fb8640 1 -- 172.21.15.37:0/842457464 >> v1:172.21.15.78:6789/0 conn(0x7fad7014b7b0 legacy=0x7fad7014aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad74fb8640 1 -- 172.21.15.37:0/842457464 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad700bb150 con 0x7fad7014edb0 2023-12-19T16:07:36.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad74fb8640 1 -- 172.21.15.37:0/842457464 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7fad60001800 con 0x7fad7014edb0 2023-12-19T16:07:36.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad74fb8640 1 -- 172.21.15.37:0/842457464 >> v1:172.21.15.37:6789/0 conn(0x7fad7014edb0 legacy=0x7fad700baa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad74fb8640 1 --2- 172.21.15.37:0/842457464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad5c003b30 0x7fad5c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:36.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad74fb8640 1 --2- 172.21.15.37:0/842457464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5c0047c0 0x7fad5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:36.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad74fb8640 1 --2- 172.21.15.37:0/842457464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad7006acb0 0x7fad5c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad74fb8640 1 -- 172.21.15.37:0/842457464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7014e0c0 con 0x7fad5c0047c0 2023-12-19T16:07:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad74fb8640 1 -- 172.21.15.37:0/842457464 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c00ba30 con 0x7fad5c003b30 2023-12-19T16:07:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad74fb8640 1 -- 172.21.15.37:0/842457464 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c00bbc0 con 0x7fad7006acb0 2023-12-19T16:07:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad757b9640 1 --2- 172.21.15.37:0/842457464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5c0047c0 0x7fad5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad767bb640 1 --2- 172.21.15.37:0/842457464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad7006acb0 0x7fad5c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.219+0000 7fad75fba640 1 --2- 172.21.15.37:0/842457464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad5c003b30 0x7fad5c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:36.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.220+0000 7fad757b9640 1 -- 172.21.15.37:0/842457464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad7006acb0 msgr2=0x7fad5c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:36.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.220+0000 7fad757b9640 1 --2- 172.21.15.37:0/842457464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad7006acb0 0x7fad5c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.220+0000 7fad757b9640 1 -- 172.21.15.37:0/842457464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad5c003b30 msgr2=0x7fad5c003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:36.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.220+0000 7fad757b9640 1 --2- 172.21.15.37:0/842457464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad5c003b30 0x7fad5c003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.220+0000 7fad757b9640 1 -- 172.21.15.37:0/842457464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c003520 con 0x7fad5c0047c0 2023-12-19T16:07:36.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.220+0000 7fad757b9640 1 --2- 172.21.15.37:0/842457464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5c0047c0 0x7fad5c004c40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fad6000c160 tx=0x7fad5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afba0bceffe8125 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:36.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.220+0000 7fad74fb8640 1 -- 172.21.15.37:0/842457464 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60005ad0 con 0x7fad5c0047c0 2023-12-19T16:07:36.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.221+0000 7fad74fb8640 1 -- 172.21.15.37:0/842457464 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad60005c50 con 0x7fad5c0047c0 2023-12-19T16:07:36.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.221+0000 7fad74fb8640 1 -- 172.21.15.37:0/842457464 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6002c7c0 con 0x7fad5c0047c0 2023-12-19T16:07:36.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.221+0000 7fad7821e640 1 -- 172.21.15.37:0/842457464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5c0047c0 msgr2=0x7fad5c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.221+0000 7fad7821e640 1 --2- 172.21.15.37:0/842457464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5c0047c0 0x7fad5c004c40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fad6000c160 tx=0x7fad5c0057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.221+0000 7fad767bb640 1 -- 172.21.15.37:0/842457464 reap_dead start 2023-12-19T16:07:36.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.221+0000 7fad7821e640 1 -- 172.21.15.37:0/842457464 shutdown_connections 2023-12-19T16:07:36.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.221+0000 7fad7821e640 1 -- 172.21.15.37:0/842457464 >> 172.21.15.37:0/842457464 conn(0x7fad70069ba0 msgr2=0x7fad70069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:36.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.221+0000 7fad7821e640 1 -- 172.21.15.37:0/842457464 shutdown_connections 2023-12-19T16:07:36.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.221+0000 7fad7821e640 1 -- 172.21.15.37:0/842457464 wait complete. 2023-12-19T16:07:36.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.222+0000 7fad7821e640 1 Processor -- start 2023-12-19T16:07:36.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.222+0000 7fad7821e640 1 -- start start 2023-12-19T16:07:36.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.223+0000 7fad7821e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5c0047c0 0x7fad7013df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:36.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.223+0000 7fad7821e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad70141d50 0x7fad70140980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:36.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.223+0000 7fad7821e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad7013f170 0x7fad70147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:36.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.223+0000 7fad7821e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad70140ec0 con 0x7fad5c0047c0 2023-12-19T16:07:36.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.223+0000 7fad7821e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad701e0320 con 0x7fad7013f170 2023-12-19T16:07:36.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.223+0000 7fad7821e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad701e05a0 con 0x7fad70141d50 2023-12-19T16:07:36.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.223+0000 7fad75fba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5c0047c0 0x7fad7013df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:36.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.223+0000 7fad75fba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5c0047c0 0x7fad7013df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58498/0 (socket says 172.21.15.37:58498) 2023-12-19T16:07:36.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.223+0000 7fad75fba640 1 -- 172.21.15.37:0/498416688 learned_addr learned my addr 172.21.15.37:0/498416688 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:36.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.223+0000 7fad767bb640 1 --2- 172.21.15.37:0/498416688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad7013f170 0x7fad70147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:36.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.223+0000 7fad757b9640 1 --2- 172.21.15.37:0/498416688 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad70141d50 0x7fad70140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:36.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.223+0000 7fad75fba640 1 -- 172.21.15.37:0/498416688 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad70141d50 msgr2=0x7fad70140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.223+0000 7fad75fba640 1 --2- 172.21.15.37:0/498416688 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad70141d50 0x7fad70140980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.223+0000 7fad75fba640 1 -- 172.21.15.37:0/498416688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad7013f170 msgr2=0x7fad70147f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.223+0000 7fad75fba640 1 --2- 172.21.15.37:0/498416688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad7013f170 0x7fad70147f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.223+0000 7fad75fba640 1 -- 172.21.15.37:0/498416688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad701e0880 con 0x7fad5c0047c0 2023-12-19T16:07:36.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.223+0000 7fad75fba640 1 --2- 172.21.15.37:0/498416688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5c0047c0 0x7fad7013df80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00f7a0 tx=0x7fad6c00fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:36.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.224+0000 7fad667fc640 1 -- 172.21.15.37:0/498416688 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c00fe50 con 0x7fad5c0047c0 2023-12-19T16:07:36.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.224+0000 7fad667fc640 1 -- 172.21.15.37:0/498416688 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c005320 con 0x7fad5c0047c0 2023-12-19T16:07:36.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.224+0000 7fad7821e640 1 -- 172.21.15.37:0/498416688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad701e0b60 con 0x7fad5c0047c0 2023-12-19T16:07:36.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.224+0000 7fad667fc640 1 -- 172.21.15.37:0/498416688 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c007290 con 0x7fad5c0047c0 2023-12-19T16:07:36.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.224+0000 7fad7821e640 1 -- 172.21.15.37:0/498416688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad701e1080 con 0x7fad5c0047c0 2023-12-19T16:07:36.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.225+0000 7fad7821e640 1 -- 172.21.15.37:0/498416688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad701e1270 con 0x7fad5c0047c0 2023-12-19T16:07:36.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.225+0000 7fad667fc640 1 -- 172.21.15.37:0/498416688 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fad6c0073f0 con 0x7fad5c0047c0 2023-12-19T16:07:36.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.225+0000 7fad667fc640 1 --2- 172.21.15.37:0/498416688 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fad5406a460 0x7fad5406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:36.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.226+0000 7fad667fc640 1 -- 172.21.15.37:0/498416688 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fad6c087bb0 con 0x7fad5c0047c0 2023-12-19T16:07:36.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.226+0000 7fad757b9640 1 --2- 172.21.15.37:0/498416688 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fad5406a460 0x7fad5406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:36.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.226+0000 7fad757b9640 1 --2- 172.21.15.37:0/498416688 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fad5406a460 0x7fad5406c920 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fad60034000 tx=0x7fad60007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:36.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.230+0000 7fad667fc640 1 -- 172.21.15.37:0/498416688 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fad6c053580 con 0x7fad5c0047c0 2023-12-19T16:07:36.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.471+0000 7fad7821e640 1 -- 172.21.15.37:0/498416688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fad701e0d50 con 0x7fad5c0047c0 2023-12-19T16:07:36.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.474+0000 7fad667fc640 1 -- 172.21.15.37:0/498416688 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fad6c005490 con 0x7fad5c0047c0 2023-12-19T16:07:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.476+0000 7fad7821e640 1 -- 172.21.15.37:0/498416688 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fad5406a460 msgr2=0x7fad5406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.476+0000 7fad7821e640 1 --2- 172.21.15.37:0/498416688 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fad5406a460 0x7fad5406c920 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fad60034000 tx=0x7fad60007000 comp rx=0 tx=0).stop 2023-12-19T16:07:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.476+0000 7fad7821e640 1 -- 172.21.15.37:0/498416688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5c0047c0 msgr2=0x7fad7013df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.476+0000 7fad7821e640 1 --2- 172.21.15.37:0/498416688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5c0047c0 0x7fad7013df80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00f7a0 tx=0x7fad6c00fc60 comp rx=0 tx=0).stop 2023-12-19T16:07:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.476+0000 7fad7821e640 1 -- 172.21.15.37:0/498416688 shutdown_connections 2023-12-19T16:07:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.476+0000 7fad7821e640 1 --2- 172.21.15.37:0/498416688 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fad5406a460 0x7fad5406c920 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.476+0000 7fad7821e640 1 --2- 172.21.15.37:0/498416688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad7013f170 0x7fad70147f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.476+0000 7fad7821e640 1 --2- 172.21.15.37:0/498416688 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad70141d50 0x7fad70140980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.476+0000 7fad7821e640 1 --2- 172.21.15.37:0/498416688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5c0047c0 0x7fad7013df80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.476+0000 7fad7821e640 1 -- 172.21.15.37:0/498416688 >> 172.21.15.37:0/498416688 conn(0x7fad70069ba0 msgr2=0x7fad7014cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.476+0000 7fad7821e640 1 -- 172.21.15.37:0/498416688 shutdown_connections 2023-12-19T16:07:36.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.476+0000 7fad7821e640 1 -- 172.21.15.37:0/498416688 wait complete. 2023-12-19T16:07:36.489 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-19T16:07:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.595+0000 7fc90db39640 1 Processor -- start 2023-12-19T16:07:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.595+0000 7fc90db39640 1 -- start start 2023-12-19T16:07:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.595+0000 7fc90db39640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc908144c80 0x7fc90806abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.595+0000 7fc90db39640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc90814e350 0x7fc9081552a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.595+0000 7fc90db39640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc90806f3f0 con 0x7fc90814df10 2023-12-19T16:07:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.595+0000 7fc90db39640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc908145060 con 0x7fc90814e350 2023-12-19T16:07:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.595+0000 7fc90db39640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc90806f920 con 0x7fc908144c80 2023-12-19T16:07:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.595+0000 7fc907fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc90814e350 0x7fc9081552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.595+0000 7fc906ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc90814df10 0x7fc9080b86d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48304/0 (socket says 172.21.15.37:48304) 2023-12-19T16:07:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.595+0000 7fc906ffd640 1 -- 172.21.15.37:0/1216731469 learned_addr learned my addr 172.21.15.37:0/1216731469 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.595+0000 7fc907fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc90814e350 0x7fc9081552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58500/0 (socket says 172.21.15.37:58500) 2023-12-19T16:07:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.596+0000 7fc9077fe640 1 --2- 172.21.15.37:0/1216731469 >> v2:172.21.15.78:3300/0 conn(0x7fc908144c80 0x7fc90806abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.596+0000 7fc907fff640 1 -- 172.21.15.37:0/1216731469 >> v2:172.21.15.78:3300/0 conn(0x7fc908144c80 msgr2=0x7fc90806abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.596+0000 7fc907fff640 1 --2- 172.21.15.37:0/1216731469 >> v2:172.21.15.78:3300/0 conn(0x7fc908144c80 0x7fc90806abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.596+0000 7fc907fff640 1 -- 172.21.15.37:0/1216731469 >> v1:172.21.15.37:6789/0 conn(0x7fc90814df10 legacy=0x7fc9080b86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.596+0000 7fc9067fc640 1 -- 172.21.15.37:0/1216731469 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1440060405 0 0) 0x7fc90806f3f0 con 0x7fc90814df10 2023-12-19T16:07:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.596+0000 7fc907fff640 1 -- 172.21.15.37:0/1216731469 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90806f640 con 0x7fc90814e350 2023-12-19T16:07:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.596+0000 7fc907fff640 1 --2- 172.21.15.37:0/1216731469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc90814e350 0x7fc9081552a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc9080b8420 tx=0x7fc90002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c240c3634ace0c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.597+0000 7fc9067fc640 1 -- 172.21.15.37:0/1216731469 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90002cbf0 con 0x7fc90814e350 2023-12-19T16:07:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.597+0000 7fc9067fc640 1 -- 172.21.15.37:0/1216731469 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90002cd50 con 0x7fc90814e350 2023-12-19T16:07:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.597+0000 7fc9067fc640 1 -- 172.21.15.37:0/1216731469 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc900034660 con 0x7fc90814e350 2023-12-19T16:07:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.597+0000 7fc90db39640 1 -- 172.21.15.37:0/1216731469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc90814e350 msgr2=0x7fc9081552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.597+0000 7fc90db39640 1 --2- 172.21.15.37:0/1216731469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc90814e350 0x7fc9081552a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc9080b8420 tx=0x7fc90002be40 comp rx=0 tx=0).stop 2023-12-19T16:07:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.597+0000 7fc90db39640 1 -- 172.21.15.37:0/1216731469 shutdown_connections 2023-12-19T16:07:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.597+0000 7fc90db39640 1 --2- 172.21.15.37:0/1216731469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc90814e350 0x7fc9081552a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.597+0000 7fc90db39640 1 --2- 172.21.15.37:0/1216731469 >> v2:172.21.15.78:3300/0 conn(0x7fc908144c80 0x7fc90806abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.597+0000 7fc90db39640 1 -- 172.21.15.37:0/1216731469 >> 172.21.15.37:0/1216731469 conn(0x7fc9080b9100 msgr2=0x7fc9080b9510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.597+0000 7fc90db39640 1 -- 172.21.15.37:0/1216731469 shutdown_connections 2023-12-19T16:07:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.597+0000 7fc90db39640 1 -- 172.21.15.37:0/1216731469 wait complete. 2023-12-19T16:07:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.598+0000 7fc90db39640 1 Processor -- start 2023-12-19T16:07:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.598+0000 7fc90db39640 1 -- start start 2023-12-19T16:07:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.599+0000 7fc90db39640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc908144c80 0x7fc90813fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.599+0000 7fc90db39640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc90814df10 0x7fc90813a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.599+0000 7fc90db39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc90814e350 0x7fc9081dfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.599+0000 7fc90db39640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9081e2ab0 con 0x7fc90814e350 2023-12-19T16:07:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.599+0000 7fc90db39640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc908148d70 con 0x7fc90814df10 2023-12-19T16:07:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.599+0000 7fc90db39640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc908149050 con 0x7fc908144c80 2023-12-19T16:07:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.599+0000 7fc907fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc90814e350 0x7fc9081dfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.599+0000 7fc907fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc90814e350 0x7fc9081dfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58516/0 (socket says 172.21.15.37:58516) 2023-12-19T16:07:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.599+0000 7fc907fff640 1 -- 172.21.15.37:0/2844344783 learned_addr learned my addr 172.21.15.37:0/2844344783 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:36.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.599+0000 7fc906ffd640 1 --2- 172.21.15.37:0/2844344783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc90814df10 0x7fc90813a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:36.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.599+0000 7fc907fff640 1 -- 172.21.15.37:0/2844344783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc908144c80 msgr2=0x7fc90813fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.599+0000 7fc907fff640 1 --2- 172.21.15.37:0/2844344783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc908144c80 0x7fc90813fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.599+0000 7fc907fff640 1 -- 172.21.15.37:0/2844344783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc90814df10 msgr2=0x7fc90813a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.599+0000 7fc907fff640 1 --2- 172.21.15.37:0/2844344783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc90814df10 0x7fc90813a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.599+0000 7fc907fff640 1 -- 172.21.15.37:0/2844344783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc900009a70 con 0x7fc90814e350 2023-12-19T16:07:36.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.600+0000 7fc907fff640 1 --2- 172.21.15.37:0/2844344783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc90814e350 0x7fc9081dfc10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc900009e80 tx=0x7fc900004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:36.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.600+0000 7fc8effff640 1 -- 172.21.15.37:0/2844344783 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc900040650 con 0x7fc90814e350 2023-12-19T16:07:36.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.600+0000 7fc8effff640 1 -- 172.21.15.37:0/2844344783 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9000407d0 con 0x7fc90814e350 2023-12-19T16:07:36.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.600+0000 7fc8effff640 1 -- 172.21.15.37:0/2844344783 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc900040b80 con 0x7fc90814e350 2023-12-19T16:07:36.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.600+0000 7fc90db39640 1 -- 172.21.15.37:0/2844344783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9081df6f0 con 0x7fc90814e350 2023-12-19T16:07:36.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.600+0000 7fc90db39640 1 -- 172.21.15.37:0/2844344783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc908149330 con 0x7fc90814e350 2023-12-19T16:07:36.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.601+0000 7fc90db39640 1 -- 172.21.15.37:0/2844344783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9081df540 con 0x7fc90814e350 2023-12-19T16:07:36.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.601+0000 7fc8effff640 1 -- 172.21.15.37:0/2844344783 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc900040ce0 con 0x7fc90814e350 2023-12-19T16:07:36.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.602+0000 7fc8effff640 1 --2- 172.21.15.37:0/2844344783 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc8f406a430 0x7fc8f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:36.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.602+0000 7fc8effff640 1 -- 172.21.15.37:0/2844344783 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc9000ab550 con 0x7fc90814e350 2023-12-19T16:07:36.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.602+0000 7fc9077fe640 1 --2- 172.21.15.37:0/2844344783 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc8f406a430 0x7fc8f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:36.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.602+0000 7fc9077fe640 1 --2- 172.21.15.37:0/2844344783 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc8f406a430 0x7fc8f406c8f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8006fd0 tx=0x7fc8f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:36.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.606+0000 7fc8effff640 1 -- 172.21.15.37:0/2844344783 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc900076e90 con 0x7fc90814e350 2023-12-19T16:07:36.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.847+0000 7fc90db39640 1 -- 172.21.15.37:0/2844344783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fc908070680 con 0x7fc90814e350 2023-12-19T16:07:36.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.851+0000 7fc8effff640 1 -- 172.21.15.37:0/2844344783 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc90007a4b0 con 0x7fc90814e350 2023-12-19T16:07:36.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.852+0000 7fc90db39640 1 -- 172.21.15.37:0/2844344783 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc8f406a430 msgr2=0x7fc8f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.852+0000 7fc90db39640 1 --2- 172.21.15.37:0/2844344783 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc8f406a430 0x7fc8f406c8f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8006fd0 tx=0x7fc8f8008040 comp rx=0 tx=0).stop 2023-12-19T16:07:36.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.852+0000 7fc90db39640 1 -- 172.21.15.37:0/2844344783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc90814e350 msgr2=0x7fc9081dfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.852+0000 7fc90db39640 1 --2- 172.21.15.37:0/2844344783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc90814e350 0x7fc9081dfc10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc900009e80 tx=0x7fc900004a40 comp rx=0 tx=0).stop 2023-12-19T16:07:36.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.852+0000 7fc90db39640 1 -- 172.21.15.37:0/2844344783 shutdown_connections 2023-12-19T16:07:36.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.852+0000 7fc90db39640 1 --2- 172.21.15.37:0/2844344783 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fc8f406a430 0x7fc8f406c8f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.852+0000 7fc90db39640 1 --2- 172.21.15.37:0/2844344783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc90814e350 0x7fc9081dfc10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.852+0000 7fc90db39640 1 --2- 172.21.15.37:0/2844344783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc90814df10 0x7fc90813a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.852+0000 7fc90db39640 1 --2- 172.21.15.37:0/2844344783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc908144c80 0x7fc90813fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.852+0000 7fc90db39640 1 -- 172.21.15.37:0/2844344783 >> 172.21.15.37:0/2844344783 conn(0x7fc9080b9100 msgr2=0x7fc908142480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:36.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.853+0000 7fc90db39640 1 -- 172.21.15.37:0/2844344783 shutdown_connections 2023-12-19T16:07:36.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.853+0000 7fc90db39640 1 -- 172.21.15.37:0/2844344783 wait complete. 2023-12-19T16:07:36.865 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-19T16:07:36.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.970+0000 7fce293fd640 1 Processor -- start 2023-12-19T16:07:36.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.970+0000 7fce293fd640 1 -- start start 2023-12-19T16:07:36.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.971+0000 7fce293fd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fce240b6690 0x7fce24144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:36.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.971+0000 7fce293fd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce240bc6b0 con 0x7fce24144cd0 2023-12-19T16:07:36.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.971+0000 7fce293fd640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce240a59f0 con 0x7fce240bcdd0 2023-12-19T16:07:36.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.971+0000 7fce293fd640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce240bc0a0 con 0x7fce240b6690 2023-12-19T16:07:36.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.971+0000 7fce237fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fce24144cd0 0x7fce24155340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48314/0 (socket says 172.21.15.37:48314) 2023-12-19T16:07:36.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.971+0000 7fce237fe640 1 -- 172.21.15.37:0/958508113 learned_addr learned my addr 172.21.15.37:0/958508113 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:36.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.971+0000 7fce227fc640 1 --2- 172.21.15.37:0/958508113 >> v2:172.21.15.78:3300/0 conn(0x7fce240b6690 0x7fce24144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:36.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.971+0000 7fce21ffb640 1 -- 172.21.15.37:0/958508113 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156489455 0 0) 0x7fce240bc6b0 con 0x7fce24144cd0 2023-12-19T16:07:36.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.971+0000 7fce21ffb640 1 -- 172.21.15.37:0/958508113 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce10003520 con 0x7fce24144cd0 2023-12-19T16:07:36.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.972+0000 7fce227fc640 1 -- 172.21.15.37:0/958508113 >> v1:172.21.15.78:6789/0 conn(0x7fce240bcdd0 legacy=0x7fce240b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.972+0000 7fce21ffb640 1 -- 172.21.15.37:0/958508113 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2417449748 0 0) 0x7fce10003520 con 0x7fce24144cd0 2023-12-19T16:07:36.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.972+0000 7fce227fc640 1 -- 172.21.15.37:0/958508113 >> v1:172.21.15.37:6789/0 conn(0x7fce24144cd0 legacy=0x7fce24155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.972+0000 7fce227fc640 1 -- 172.21.15.37:0/958508113 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce240bc340 con 0x7fce240b6690 2023-12-19T16:07:36.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.972+0000 7fce227fc640 1 --2- 172.21.15.37:0/958508113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce240b6690 0x7fce24144790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fce240a5b80 tx=0x7fce0c02b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=196d66fe55545ccd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:36.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.973+0000 7fce21ffb640 1 -- 172.21.15.37:0/958508113 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce140019f0 con 0x7fce240b6690 2023-12-19T16:07:36.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.973+0000 7fce21ffb640 1 -- 172.21.15.37:0/958508113 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c031580 con 0x7fce240b6690 2023-12-19T16:07:36.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.973+0000 7fce21ffb640 1 -- 172.21.15.37:0/958508113 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c031910 con 0x7fce240b6690 2023-12-19T16:07:36.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.973+0000 7fce293fd640 1 -- 172.21.15.37:0/958508113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce240b6690 msgr2=0x7fce24144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.973+0000 7fce293fd640 1 --2- 172.21.15.37:0/958508113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce240b6690 0x7fce24144790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fce240a5b80 tx=0x7fce0c02b8a0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.973+0000 7fce293fd640 1 -- 172.21.15.37:0/958508113 shutdown_connections 2023-12-19T16:07:36.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.973+0000 7fce293fd640 1 --2- 172.21.15.37:0/958508113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce240b6690 0x7fce24144790 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.973+0000 7fce293fd640 1 -- 172.21.15.37:0/958508113 >> 172.21.15.37:0/958508113 conn(0x7fce24071e60 msgr2=0x7fce240c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:36.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.973+0000 7fce293fd640 1 -- 172.21.15.37:0/958508113 shutdown_connections 2023-12-19T16:07:36.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.973+0000 7fce293fd640 1 -- 172.21.15.37:0/958508113 wait complete. 2023-12-19T16:07:36.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.974+0000 7fce293fd640 1 Processor -- start 2023-12-19T16:07:36.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.974+0000 7fce293fd640 1 -- start start 2023-12-19T16:07:36.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.975+0000 7fce293fd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce240b6690 0x7fce241e2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:36.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.975+0000 7fce293fd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce240bcdd0 0x7fce24145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:36.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.975+0000 7fce293fd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce24144cd0 0x7fce2414b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.975+0000 7fce293fd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2414b010 con 0x7fce240b6690 2023-12-19T16:07:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.975+0000 7fce293fd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2414a2a0 con 0x7fce24144cd0 2023-12-19T16:07:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.975+0000 7fce293fd640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2414b2b0 con 0x7fce240bcdd0 2023-12-19T16:07:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.975+0000 7fce22ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce240b6690 0x7fce241e2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.975+0000 7fce22ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce240b6690 0x7fce241e2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58522/0 (socket says 172.21.15.37:58522) 2023-12-19T16:07:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.975+0000 7fce22ffd640 1 -- 172.21.15.37:0/2584620911 learned_addr learned my addr 172.21.15.37:0/2584620911 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.975+0000 7fce237fe640 1 --2- 172.21.15.37:0/2584620911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce24144cd0 0x7fce2414b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.975+0000 7fce227fc640 1 --2- 172.21.15.37:0/2584620911 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce240bcdd0 0x7fce24145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.975+0000 7fce22ffd640 1 -- 172.21.15.37:0/2584620911 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce240bcdd0 msgr2=0x7fce24145410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.976+0000 7fce22ffd640 1 --2- 172.21.15.37:0/2584620911 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce240bcdd0 0x7fce24145410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.976+0000 7fce22ffd640 1 -- 172.21.15.37:0/2584620911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce24144cd0 msgr2=0x7fce2414b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.976+0000 7fce22ffd640 1 --2- 172.21.15.37:0/2584620911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce24144cd0 0x7fce2414b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.976+0000 7fce22ffd640 1 -- 172.21.15.37:0/2584620911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c009400 con 0x7fce240b6690 2023-12-19T16:07:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.976+0000 7fce237fe640 1 --2- 172.21.15.37:0/2584620911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce24144cd0 0x7fce2414b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:36.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.976+0000 7fce22ffd640 1 --2- 172.21.15.37:0/2584620911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce240b6690 0x7fce241e2c70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00c450 tx=0x7fce1c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:36.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.976+0000 7fce1b7fe640 1 -- 172.21.15.37:0/2584620911 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c0052d0 con 0x7fce240b6690 2023-12-19T16:07:36.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.976+0000 7fce1b7fe640 1 -- 172.21.15.37:0/2584620911 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1c005430 con 0x7fce240b6690 2023-12-19T16:07:36.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.976+0000 7fce1b7fe640 1 -- 172.21.15.37:0/2584620911 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1c012870 con 0x7fce240b6690 2023-12-19T16:07:36.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.976+0000 7fce293fd640 1 -- 172.21.15.37:0/2584620911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce24148550 con 0x7fce240b6690 2023-12-19T16:07:36.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.976+0000 7fce293fd640 1 -- 172.21.15.37:0/2584620911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce24146a10 con 0x7fce240b6690 2023-12-19T16:07:36.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.977+0000 7fce293fd640 1 -- 172.21.15.37:0/2584620911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce24148740 con 0x7fce240b6690 2023-12-19T16:07:36.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.977+0000 7fce1b7fe640 1 -- 172.21.15.37:0/2584620911 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fce1c0129d0 con 0x7fce240b6690 2023-12-19T16:07:36.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.978+0000 7fce1b7fe640 1 --2- 172.21.15.37:0/2584620911 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fce0406a460 0x7fce0406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:36.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.978+0000 7fce1b7fe640 1 -- 172.21.15.37:0/2584620911 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fce1c088090 con 0x7fce240b6690 2023-12-19T16:07:36.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.978+0000 7fce227fc640 1 --2- 172.21.15.37:0/2584620911 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fce0406a460 0x7fce0406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:36.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.978+0000 7fce227fc640 1 --2- 172.21.15.37:0/2584620911 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fce0406a460 0x7fce0406c920 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fce0c036000 tx=0x7fce0c03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:36.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:36.982+0000 7fce1b7fe640 1 -- 172.21.15.37:0/2584620911 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fce1c0539d0 con 0x7fce240b6690 2023-12-19T16:07:37.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.222+0000 7fce293fd640 1 -- 172.21.15.37:0/2584620911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fce240b5480 con 0x7fce240b6690 2023-12-19T16:07:37.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.226+0000 7fce1b7fe640 1 -- 172.21.15.37:0/2584620911 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fce1c056ff0 con 0x7fce240b6690 2023-12-19T16:07:37.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.228+0000 7fce293fd640 1 -- 172.21.15.37:0/2584620911 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fce0406a460 msgr2=0x7fce0406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:37.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.228+0000 7fce293fd640 1 --2- 172.21.15.37:0/2584620911 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fce0406a460 0x7fce0406c920 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fce0c036000 tx=0x7fce0c03d040 comp rx=0 tx=0).stop 2023-12-19T16:07:37.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.228+0000 7fce293fd640 1 -- 172.21.15.37:0/2584620911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce240b6690 msgr2=0x7fce241e2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:37.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.228+0000 7fce293fd640 1 --2- 172.21.15.37:0/2584620911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce240b6690 0x7fce241e2c70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00c450 tx=0x7fce1c00c910 comp rx=0 tx=0).stop 2023-12-19T16:07:37.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.228+0000 7fce293fd640 1 -- 172.21.15.37:0/2584620911 shutdown_connections 2023-12-19T16:07:37.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.228+0000 7fce293fd640 1 --2- 172.21.15.37:0/2584620911 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fce0406a460 0x7fce0406c920 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.228+0000 7fce293fd640 1 --2- 172.21.15.37:0/2584620911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce24144cd0 0x7fce2414b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.228+0000 7fce293fd640 1 --2- 172.21.15.37:0/2584620911 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce240bcdd0 0x7fce24145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.228+0000 7fce293fd640 1 --2- 172.21.15.37:0/2584620911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce240b6690 0x7fce241e2c70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.228+0000 7fce293fd640 1 -- 172.21.15.37:0/2584620911 >> 172.21.15.37:0/2584620911 conn(0x7fce24071e60 msgr2=0x7fce24143010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:37.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.228+0000 7fce293fd640 1 -- 172.21.15.37:0/2584620911 shutdown_connections 2023-12-19T16:07:37.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.228+0000 7fce293fd640 1 -- 172.21.15.37:0/2584620911 wait complete. 2023-12-19T16:07:37.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-19T16:07:37.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.345+0000 7f8f43b16640 1 Processor -- start 2023-12-19T16:07:37.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.345+0000 7f8f43b16640 1 -- start start 2023-12-19T16:07:37.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.346+0000 7f8f43b16640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8f3c14aab0 0x7f8f3c156390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:37.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.346+0000 7f8f43b16640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3c070d30 con 0x7f8f3c0711c0 2023-12-19T16:07:37.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.346+0000 7f8f43b16640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3c0b6f60 con 0x7f8f3c069ba0 2023-12-19T16:07:37.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.346+0000 7f8f43b16640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3c0715c0 con 0x7f8f3c14aab0 2023-12-19T16:07:37.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.346+0000 7f8f420b3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8f3c14aab0 0x7f8f3c156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:37.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.346+0000 7f8f410b1640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8f3c0711c0 0x7f8f3c069f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48322/0 (socket says 172.21.15.37:48322) 2023-12-19T16:07:37.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.346+0000 7f8f410b1640 1 -- 172.21.15.37:0/1210708387 learned_addr learned my addr 172.21.15.37:0/1210708387 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:37.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.347+0000 7f8f420b3640 1 -- 172.21.15.37:0/1210708387 >> v1:172.21.15.78:6789/0 conn(0x7f8f3c069ba0 legacy=0x7f8f3c0b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:37.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.347+0000 7f8f420b3640 1 -- 172.21.15.37:0/1210708387 >> v1:172.21.15.37:6789/0 conn(0x7f8f3c0711c0 legacy=0x7f8f3c069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:37.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.347+0000 7f8f420b3640 1 -- 172.21.15.37:0/1210708387 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c071720 con 0x7f8f3c14aab0 2023-12-19T16:07:37.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.347+0000 7f8f408b0640 1 -- 172.21.15.37:0/1210708387 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211519551 0 0) 0x7f8f3c070d30 con 0x7f8f3c0711c0 2023-12-19T16:07:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.347+0000 7f8f420b3640 1 --2- 172.21.15.37:0/1210708387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f3c14aab0 0x7f8f3c156390 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009d90 tx=0x7f8f3802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e24e8f19a19c2c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.347+0000 7f8f408b0640 1 -- 172.21.15.37:0/1210708387 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3802cd00 con 0x7f8f3c14aab0 2023-12-19T16:07:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.347+0000 7f8f408b0640 1 -- 172.21.15.37:0/1210708387 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3802ce60 con 0x7f8f3c14aab0 2023-12-19T16:07:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.348+0000 7f8f408b0640 1 -- 172.21.15.37:0/1210708387 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38034660 con 0x7f8f3c14aab0 2023-12-19T16:07:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.348+0000 7f8f43b16640 1 -- 172.21.15.37:0/1210708387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f3c14aab0 msgr2=0x7f8f3c156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.348+0000 7f8f43b16640 1 --2- 172.21.15.37:0/1210708387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f3c14aab0 0x7f8f3c156390 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009d90 tx=0x7f8f3802bf50 comp rx=0 tx=0).stop 2023-12-19T16:07:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.348+0000 7f8f43b16640 1 -- 172.21.15.37:0/1210708387 shutdown_connections 2023-12-19T16:07:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.348+0000 7f8f43b16640 1 --2- 172.21.15.37:0/1210708387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f3c14aab0 0x7f8f3c156390 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.348+0000 7f8f43b16640 1 -- 172.21.15.37:0/1210708387 >> 172.21.15.37:0/1210708387 conn(0x7f8f3c0b9c30 msgr2=0x7f8f3c0ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.348+0000 7f8f43b16640 1 -- 172.21.15.37:0/1210708387 shutdown_connections 2023-12-19T16:07:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.348+0000 7f8f43b16640 1 -- 172.21.15.37:0/1210708387 wait complete. 2023-12-19T16:07:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.349+0000 7f8f43b16640 1 Processor -- start 2023-12-19T16:07:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.349+0000 7f8f43b16640 1 -- start start 2023-12-19T16:07:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f43b16640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f3c069ba0 0x7f8f3c146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f43b16640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f3c0711c0 0x7f8f3c14d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f43b16640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f3c14aab0 0x7f8f3c1dfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f43b16640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c147980 con 0x7f8f3c14aab0 2023-12-19T16:07:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f43b16640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c148650 con 0x7f8f3c0711c0 2023-12-19T16:07:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f43b16640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c148d50 con 0x7f8f3c069ba0 2023-12-19T16:07:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f420b3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f3c14aab0 0x7f8f3c1dfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f420b3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f3c14aab0 0x7f8f3c1dfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58528/0 (socket says 172.21.15.37:58528) 2023-12-19T16:07:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f420b3640 1 -- 172.21.15.37:0/418742416 learned_addr learned my addr 172.21.15.37:0/418742416 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f418b2640 1 --2- 172.21.15.37:0/418742416 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f3c069ba0 0x7f8f3c146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f410b1640 1 --2- 172.21.15.37:0/418742416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f3c0711c0 0x7f8f3c14d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f420b3640 1 -- 172.21.15.37:0/418742416 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f3c069ba0 msgr2=0x7f8f3c146ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f420b3640 1 --2- 172.21.15.37:0/418742416 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f3c069ba0 0x7f8f3c146ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f420b3640 1 -- 172.21.15.37:0/418742416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f3c0711c0 msgr2=0x7f8f3c14d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f420b3640 1 --2- 172.21.15.37:0/418742416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f3c0711c0 0x7f8f3c14d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f420b3640 1 -- 172.21.15.37:0/418742416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f38009a70 con 0x7f8f3c14aab0 2023-12-19T16:07:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f410b1640 1 --2- 172.21.15.37:0/418742416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f3c0711c0 0x7f8f3c14d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f420b3640 1 --2- 172.21.15.37:0/418742416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f3c14aab0 0x7f8f3c1dfdc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8f3802c560 tx=0x7f8f38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f327fc640 1 -- 172.21.15.37:0/418742416 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3803f680 con 0x7f8f3c14aab0 2023-12-19T16:07:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f327fc640 1 -- 172.21.15.37:0/418742416 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3803f7e0 con 0x7f8f3c14aab0 2023-12-19T16:07:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.350+0000 7f8f43b16640 1 -- 172.21.15.37:0/418742416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3c149030 con 0x7f8f3c14aab0 2023-12-19T16:07:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.351+0000 7f8f327fc640 1 -- 172.21.15.37:0/418742416 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3803fb50 con 0x7f8f3c14aab0 2023-12-19T16:07:37.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.351+0000 7f8f43b16640 1 -- 172.21.15.37:0/418742416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3c148a00 con 0x7f8f3c14aab0 2023-12-19T16:07:37.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.351+0000 7f8f43b16640 1 -- 172.21.15.37:0/418742416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3c149550 con 0x7f8f3c14aab0 2023-12-19T16:07:37.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.352+0000 7f8f327fc640 1 -- 172.21.15.37:0/418742416 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8f3803b040 con 0x7f8f3c14aab0 2023-12-19T16:07:37.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.352+0000 7f8f327fc640 1 --2- 172.21.15.37:0/418742416 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8f2006a430 0x7f8f2006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:37.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.352+0000 7f8f327fc640 1 -- 172.21.15.37:0/418742416 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8f380ab200 con 0x7f8f3c14aab0 2023-12-19T16:07:37.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.353+0000 7f8f418b2640 1 --2- 172.21.15.37:0/418742416 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8f2006a430 0x7f8f2006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:37.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.353+0000 7f8f418b2640 1 --2- 172.21.15.37:0/418742416 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8f2006a430 0x7f8f2006c8f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8f34006fd0 tx=0x7f8f34008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:37.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.357+0000 7f8f327fc640 1 -- 172.21.15.37:0/418742416 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8f3c149550 con 0x7f8f3c14aab0 2023-12-19T16:07:37.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.601+0000 7f8f43b16640 1 -- 172.21.15.37:0/418742416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f8f3c149550 con 0x7f8f3c14aab0 2023-12-19T16:07:37.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.604+0000 7f8f327fc640 1 -- 172.21.15.37:0/418742416 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8f3c149550 con 0x7f8f3c14aab0 2023-12-19T16:07:37.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.606+0000 7f8f43b16640 1 -- 172.21.15.37:0/418742416 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8f2006a430 msgr2=0x7f8f2006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:37.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.606+0000 7f8f43b16640 1 --2- 172.21.15.37:0/418742416 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8f2006a430 0x7f8f2006c8f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8f34006fd0 tx=0x7f8f34008040 comp rx=0 tx=0).stop 2023-12-19T16:07:37.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.606+0000 7f8f43b16640 1 -- 172.21.15.37:0/418742416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f3c14aab0 msgr2=0x7f8f3c1dfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:37.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.606+0000 7f8f43b16640 1 --2- 172.21.15.37:0/418742416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f3c14aab0 0x7f8f3c1dfdc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8f3802c560 tx=0x7f8f38004a40 comp rx=0 tx=0).stop 2023-12-19T16:07:37.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.607+0000 7f8f43b16640 1 -- 172.21.15.37:0/418742416 shutdown_connections 2023-12-19T16:07:37.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.607+0000 7f8f43b16640 1 --2- 172.21.15.37:0/418742416 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8f2006a430 0x7f8f2006c8f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.607+0000 7f8f43b16640 1 --2- 172.21.15.37:0/418742416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f3c14aab0 0x7f8f3c1dfdc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.607+0000 7f8f43b16640 1 --2- 172.21.15.37:0/418742416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f3c0711c0 0x7f8f3c14d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.607+0000 7f8f43b16640 1 --2- 172.21.15.37:0/418742416 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8f3c069ba0 0x7f8f3c146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.607+0000 7f8f43b16640 1 -- 172.21.15.37:0/418742416 >> 172.21.15.37:0/418742416 conn(0x7f8f3c0b9c30 msgr2=0x7f8f3c1444b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:37.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.607+0000 7f8f43b16640 1 -- 172.21.15.37:0/418742416 shutdown_connections 2023-12-19T16:07:37.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.607+0000 7f8f43b16640 1 -- 172.21.15.37:0/418742416 wait complete. 2023-12-19T16:07:37.619 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-19T16:07:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.724+0000 7f2121b89640 1 Processor -- start 2023-12-19T16:07:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.724+0000 7f2121b89640 1 -- start start 2023-12-19T16:07:37.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.725+0000 7f2121b89640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f211c0bcdd0 0x7f211c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:37.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.725+0000 7f2121b89640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f211c0b64c0 0x7f211c144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:37.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.725+0000 7f2121b89640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c0bc6b0 con 0x7f211c144cd0 2023-12-19T16:07:37.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.725+0000 7f2121b89640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211c0b6900 con 0x7f211c0b64c0 2023-12-19T16:07:37.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.725+0000 7f2121b89640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0a59f0 con 0x7f211c0bcdd0 2023-12-19T16:07:37.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.725+0000 7f211affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f211c0b64c0 0x7f211c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:37.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.725+0000 7f211affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f211c0b64c0 0x7f211c144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58540/0 (socket says 172.21.15.37:58540) 2023-12-19T16:07:37.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.725+0000 7f211affd640 1 -- 172.21.15.37:0/1156606323 learned_addr learned my addr 172.21.15.37:0/1156606323 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:37.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.725+0000 7f211bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f211c144cd0 0x7f211c14e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48336/0 (socket says 172.21.15.37:48336) 2023-12-19T16:07:37.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.725+0000 7f211b7fe640 1 --2- 172.21.15.37:0/1156606323 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f211c0bcdd0 0x7f211c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:37.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.725+0000 7f211affd640 1 -- 172.21.15.37:0/1156606323 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f211c0bcdd0 msgr2=0x7f211c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:37.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.725+0000 7f211affd640 1 --2- 172.21.15.37:0/1156606323 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f211c0bcdd0 0x7f211c0b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.725+0000 7f211affd640 1 -- 172.21.15.37:0/1156606323 >> v1:172.21.15.37:6789/0 conn(0x7f211c144cd0 legacy=0x7f211c14e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:37.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.725+0000 7f211affd640 1 -- 172.21.15.37:0/1156606323 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c0bc0a0 con 0x7f211c0b64c0 2023-12-19T16:07:37.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.725+0000 7f211b7fe640 1 --2- 172.21.15.37:0/1156606323 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f211c0bcdd0 0x7f211c0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:37.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.726+0000 7f211affd640 1 --2- 172.21.15.37:0/1156606323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f211c0b64c0 0x7f211c144790 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f210c009870 tx=0x7f210c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20807bf724cb432 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:37.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.726+0000 7f211a7fc640 1 -- 172.21.15.37:0/1156606323 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c02f840 con 0x7f211c0b64c0 2023-12-19T16:07:37.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.726+0000 7f211a7fc640 1 -- 172.21.15.37:0/1156606323 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c02f9a0 con 0x7f211c0b64c0 2023-12-19T16:07:37.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.726+0000 7f211a7fc640 1 -- 172.21.15.37:0/1156606323 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c02fd30 con 0x7f211c0b64c0 2023-12-19T16:07:37.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.727+0000 7f2121b89640 1 -- 172.21.15.37:0/1156606323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f211c0b64c0 msgr2=0x7f211c144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:37.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.727+0000 7f2121b89640 1 --2- 172.21.15.37:0/1156606323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f211c0b64c0 0x7f211c144790 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f210c009870 tx=0x7f210c02ba20 comp rx=0 tx=0).stop 2023-12-19T16:07:37.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.727+0000 7f2121b89640 1 -- 172.21.15.37:0/1156606323 shutdown_connections 2023-12-19T16:07:37.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.727+0000 7f2121b89640 1 --2- 172.21.15.37:0/1156606323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f211c0b64c0 0x7f211c144790 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.727+0000 7f2121b89640 1 --2- 172.21.15.37:0/1156606323 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f211c0bcdd0 0x7f211c0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.727+0000 7f2121b89640 1 -- 172.21.15.37:0/1156606323 >> 172.21.15.37:0/1156606323 conn(0x7f211c071e60 msgr2=0x7f211c0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:37.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.727+0000 7f2121b89640 1 -- 172.21.15.37:0/1156606323 shutdown_connections 2023-12-19T16:07:37.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.727+0000 7f2121b89640 1 -- 172.21.15.37:0/1156606323 wait complete. 2023-12-19T16:07:37.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.728+0000 7f2121b89640 1 Processor -- start 2023-12-19T16:07:37.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.728+0000 7f2121b89640 1 -- start start 2023-12-19T16:07:37.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.728+0000 7f2121b89640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f211c0b64c0 0x7f211c148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:37.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.728+0000 7f2121b89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f211c0bcdd0 0x7f211c1e0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:37.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f2121b89640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f211c144cd0 0x7f211c1e0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:37.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f2121b89640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c14af20 con 0x7f211c0bcdd0 2023-12-19T16:07:37.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f2121b89640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c14a5c0 con 0x7f211c0b64c0 2023-12-19T16:07:37.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f2121b89640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c14a860 con 0x7f211c144cd0 2023-12-19T16:07:37.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f211affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f211c0bcdd0 0x7f211c1e0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:37.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f211affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f211c0bcdd0 0x7f211c1e0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58550/0 (socket says 172.21.15.37:58550) 2023-12-19T16:07:37.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f211affd640 1 -- 172.21.15.37:0/1690444268 learned_addr learned my addr 172.21.15.37:0/1690444268 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:37.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f211bfff640 1 --2- 172.21.15.37:0/1690444268 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f211c144cd0 0x7f211c1e0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:37.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f211b7fe640 1 --2- 172.21.15.37:0/1690444268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f211c0b64c0 0x7f211c148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:37.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f211affd640 1 -- 172.21.15.37:0/1690444268 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f211c144cd0 msgr2=0x7f211c1e0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f211affd640 1 --2- 172.21.15.37:0/1690444268 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f211c144cd0 0x7f211c1e0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f211affd640 1 -- 172.21.15.37:0/1690444268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f211c0b64c0 msgr2=0x7f211c148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f211affd640 1 --2- 172.21.15.37:0/1690444268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f211c0b64c0 0x7f211c148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f211affd640 1 -- 172.21.15.37:0/1690444268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210c0094d0 con 0x7f211c0bcdd0 2023-12-19T16:07:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f211affd640 1 --2- 172.21.15.37:0/1690444268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f211c0bcdd0 0x7f211c1e0350 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f210c009870 tx=0x7f210c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f2113fff640 1 -- 172.21.15.37:0/1690444268 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c037d10 con 0x7f211c0bcdd0 2023-12-19T16:07:37.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f2113fff640 1 -- 172.21.15.37:0/1690444268 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c037e70 con 0x7f211c0bcdd0 2023-12-19T16:07:37.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f2113fff640 1 -- 172.21.15.37:0/1690444268 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c041620 con 0x7f211c0bcdd0 2023-12-19T16:07:37.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f2121b89640 1 -- 172.21.15.37:0/1690444268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211c14ab40 con 0x7f211c0bcdd0 2023-12-19T16:07:37.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.729+0000 7f2121b89640 1 -- 172.21.15.37:0/1690444268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211c14bba0 con 0x7f211c0bcdd0 2023-12-19T16:07:37.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.730+0000 7f2121b89640 1 -- 172.21.15.37:0/1690444268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211c1e01a0 con 0x7f211c0bcdd0 2023-12-19T16:07:37.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.731+0000 7f2113fff640 1 -- 172.21.15.37:0/1690444268 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f210c041780 con 0x7f211c0bcdd0 2023-12-19T16:07:37.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.731+0000 7f2113fff640 1 --2- 172.21.15.37:0/1690444268 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f20fc06a430 0x7f20fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:37.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.731+0000 7f2113fff640 1 -- 172.21.15.37:0/1690444268 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f210c03c070 con 0x7f211c0bcdd0 2023-12-19T16:07:37.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.731+0000 7f211b7fe640 1 --2- 172.21.15.37:0/1690444268 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f20fc06a430 0x7f20fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:37.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.732+0000 7f211b7fe640 1 --2- 172.21.15.37:0/1690444268 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f20fc06a430 0x7f20fc06c8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f210400a990 tx=0x7f2104008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:37.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.735+0000 7f2113fff640 1 -- 172.21.15.37:0/1690444268 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f210c076e50 con 0x7f211c0bcdd0 2023-12-19T16:07:37.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.975+0000 7f2121b89640 1 -- 172.21.15.37:0/1690444268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f211c14b060 con 0x7f211c0bcdd0 2023-12-19T16:07:37.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.979+0000 7f2113fff640 1 -- 172.21.15.37:0/1690444268 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f210c07a470 con 0x7f211c0bcdd0 2023-12-19T16:07:37.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.981+0000 7f2121b89640 1 -- 172.21.15.37:0/1690444268 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f20fc06a430 msgr2=0x7f20fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:37.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.981+0000 7f2121b89640 1 --2- 172.21.15.37:0/1690444268 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f20fc06a430 0x7f20fc06c8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f210400a990 tx=0x7f2104008040 comp rx=0 tx=0).stop 2023-12-19T16:07:37.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.981+0000 7f2121b89640 1 -- 172.21.15.37:0/1690444268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f211c0bcdd0 msgr2=0x7f211c1e0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:37.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.981+0000 7f2121b89640 1 --2- 172.21.15.37:0/1690444268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f211c0bcdd0 0x7f211c1e0350 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f210c009870 tx=0x7f210c004730 comp rx=0 tx=0).stop 2023-12-19T16:07:37.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.981+0000 7f2121b89640 1 -- 172.21.15.37:0/1690444268 shutdown_connections 2023-12-19T16:07:37.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.981+0000 7f2121b89640 1 --2- 172.21.15.37:0/1690444268 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f20fc06a430 0x7f20fc06c8f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.981+0000 7f2121b89640 1 --2- 172.21.15.37:0/1690444268 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f211c144cd0 0x7f211c1e0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.981+0000 7f2121b89640 1 --2- 172.21.15.37:0/1690444268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f211c0bcdd0 0x7f211c1e0350 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.981+0000 7f2121b89640 1 --2- 172.21.15.37:0/1690444268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f211c0b64c0 0x7f211c148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:37.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.981+0000 7f2121b89640 1 -- 172.21.15.37:0/1690444268 >> 172.21.15.37:0/1690444268 conn(0x7f211c071e60 msgr2=0x7f211c0b8010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:37.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.981+0000 7f2121b89640 1 -- 172.21.15.37:0/1690444268 shutdown_connections 2023-12-19T16:07:37.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:37.981+0000 7f2121b89640 1 -- 172.21.15.37:0/1690444268 wait complete. 2023-12-19T16:07:37.994 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-19T16:07:38.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.099+0000 7f4a2c896640 1 Processor -- start 2023-12-19T16:07:38.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.099+0000 7f4a2c896640 1 -- start start 2023-12-19T16:07:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.099+0000 7f4a2c896640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4a280b6690 0x7f4a28144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.099+0000 7f4a2c896640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a28144cd0 0x7f4a28155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.100+0000 7f4a2c896640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a280bc6b0 con 0x7f4a280bcdd0 2023-12-19T16:07:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.100+0000 7f4a2c896640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a280a59f0 con 0x7f4a280b6690 2023-12-19T16:07:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.100+0000 7f4a2c896640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280bc0a0 con 0x7f4a28144cd0 2023-12-19T16:07:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.100+0000 7f4a1dd9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4a280b6690 0x7f4a28144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.100+0000 7f4a2659c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4a280bcdd0 0x7f4a280b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48342/0 (socket says 172.21.15.37:48342) 2023-12-19T16:07:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.100+0000 7f4a2659c640 1 -- 172.21.15.37:0/92433322 learned_addr learned my addr 172.21.15.37:0/92433322 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.100+0000 7f4a26d9d640 1 --2- 172.21.15.37:0/92433322 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a28144cd0 0x7f4a28155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.100+0000 7f4a1dd9b640 1 -- 172.21.15.37:0/92433322 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a28144cd0 msgr2=0x7f4a28155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.100+0000 7f4a1dd9b640 1 --2- 172.21.15.37:0/92433322 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a28144cd0 0x7f4a28155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.100+0000 7f4a1dd9b640 1 -- 172.21.15.37:0/92433322 >> v1:172.21.15.37:6789/0 conn(0x7f4a280bcdd0 legacy=0x7f4a280b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.100+0000 7f4a25d9b640 1 -- 172.21.15.37:0/92433322 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901438445 0 0) 0x7f4a280bc6b0 con 0x7f4a280bcdd0 2023-12-19T16:07:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.100+0000 7f4a1dd9b640 1 -- 172.21.15.37:0/92433322 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a280bc340 con 0x7f4a280b6690 2023-12-19T16:07:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.101+0000 7f4a1dd9b640 1 --2- 172.21.15.37:0/92433322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a280b6690 0x7f4a28144790 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4a180097a0 tx=0x7f4a1802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406febe2e6105faa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.101+0000 7f4a25d9b640 1 -- 172.21.15.37:0/92433322 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18030610 con 0x7f4a280b6690 2023-12-19T16:07:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.101+0000 7f4a25d9b640 1 -- 172.21.15.37:0/92433322 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a18030770 con 0x7f4a280b6690 2023-12-19T16:07:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.101+0000 7f4a25d9b640 1 -- 172.21.15.37:0/92433322 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18030b00 con 0x7f4a280b6690 2023-12-19T16:07:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.101+0000 7f4a2c896640 1 -- 172.21.15.37:0/92433322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a280b6690 msgr2=0x7f4a28144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.101+0000 7f4a2c896640 1 --2- 172.21.15.37:0/92433322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a280b6690 0x7f4a28144790 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4a180097a0 tx=0x7f4a1802b960 comp rx=0 tx=0).stop 2023-12-19T16:07:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.101+0000 7f4a2c896640 1 -- 172.21.15.37:0/92433322 shutdown_connections 2023-12-19T16:07:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.101+0000 7f4a2c896640 1 --2- 172.21.15.37:0/92433322 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a28144cd0 0x7f4a28155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.101+0000 7f4a2c896640 1 --2- 172.21.15.37:0/92433322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a280b6690 0x7f4a28144790 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.101+0000 7f4a2c896640 1 -- 172.21.15.37:0/92433322 >> 172.21.15.37:0/92433322 conn(0x7f4a28071e60 msgr2=0x7f4a280c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.101+0000 7f4a2c896640 1 -- 172.21.15.37:0/92433322 shutdown_connections 2023-12-19T16:07:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.101+0000 7f4a2c896640 1 -- 172.21.15.37:0/92433322 wait complete. 2023-12-19T16:07:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.103+0000 7f4a2c896640 1 Processor -- start 2023-12-19T16:07:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.103+0000 7f4a2c896640 1 -- start start 2023-12-19T16:07:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.103+0000 7f4a2c896640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a280b6690 0x7f4a280be3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a2c896640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a280bcdd0 0x7f4a280bf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a2c896640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a28144cd0 0x7f4a2813f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a2c896640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280bf2e0 con 0x7f4a28144cd0 2023-12-19T16:07:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a2c896640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a28146110 con 0x7f4a280b6690 2023-12-19T16:07:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a2c896640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280bf040 con 0x7f4a280bcdd0 2023-12-19T16:07:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a26d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a28144cd0 0x7f4a2813f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a26d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a28144cd0 0x7f4a2813f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58568/0 (socket says 172.21.15.37:58568) 2023-12-19T16:07:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a26d9d640 1 -- 172.21.15.37:0/3259311795 learned_addr learned my addr 172.21.15.37:0/3259311795 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a2659c640 1 --2- 172.21.15.37:0/3259311795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a280b6690 0x7f4a280be3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a1dd9b640 1 --2- 172.21.15.37:0/3259311795 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a280bcdd0 0x7f4a280bf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a26d9d640 1 -- 172.21.15.37:0/3259311795 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a280bcdd0 msgr2=0x7f4a280bf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a26d9d640 1 --2- 172.21.15.37:0/3259311795 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a280bcdd0 0x7f4a280bf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a26d9d640 1 -- 172.21.15.37:0/3259311795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a280b6690 msgr2=0x7f4a280be3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a26d9d640 1 --2- 172.21.15.37:0/3259311795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a280b6690 0x7f4a280be3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a26d9d640 1 -- 172.21.15.37:0/3259311795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a18009400 con 0x7f4a28144cd0 2023-12-19T16:07:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a26d9d640 1 --2- 172.21.15.37:0/3259311795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a28144cd0 0x7f4a2813f050 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000efc0 tx=0x7f4a2000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a1f7fe640 1 -- 172.21.15.37:0/3259311795 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a20009ba0 con 0x7f4a28144cd0 2023-12-19T16:07:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a1f7fe640 1 -- 172.21.15.37:0/3259311795 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2000f040 con 0x7f4a28144cd0 2023-12-19T16:07:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a1f7fe640 1 -- 172.21.15.37:0/3259311795 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a200146c0 con 0x7f4a28144cd0 2023-12-19T16:07:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.104+0000 7f4a2c896640 1 -- 172.21.15.37:0/3259311795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a281d3aa0 con 0x7f4a28144cd0 2023-12-19T16:07:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.105+0000 7f4a2c896640 1 -- 172.21.15.37:0/3259311795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2814b3b0 con 0x7f4a28144cd0 2023-12-19T16:07:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.105+0000 7f4a2c896640 1 -- 172.21.15.37:0/3259311795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a280be110 con 0x7f4a28144cd0 2023-12-19T16:07:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.106+0000 7f4a1f7fe640 1 -- 172.21.15.37:0/3259311795 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4a20014820 con 0x7f4a28144cd0 2023-12-19T16:07:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.106+0000 7f4a1f7fe640 1 --2- 172.21.15.37:0/3259311795 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4a0c06a430 0x7f4a0c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.106+0000 7f4a1f7fe640 1 -- 172.21.15.37:0/3259311795 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4a20088ed0 con 0x7f4a28144cd0 2023-12-19T16:07:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.107+0000 7f4a2659c640 1 --2- 172.21.15.37:0/3259311795 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4a0c06a430 0x7f4a0c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.107+0000 7f4a2659c640 1 --2- 172.21.15.37:0/3259311795 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4a0c06a430 0x7f4a0c06c8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4a10000f60 tx=0x7f4a10007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.110+0000 7f4a1f7fe640 1 -- 172.21.15.37:0/3259311795 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4a280be110 con 0x7f4a28144cd0 2023-12-19T16:07:38.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.351+0000 7f4a2c896640 1 -- 172.21.15.37:0/3259311795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f4a280be110 con 0x7f4a28144cd0 2023-12-19T16:07:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.355+0000 7f4a1f7fe640 1 -- 172.21.15.37:0/3259311795 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4a280be110 con 0x7f4a28144cd0 2023-12-19T16:07:38.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.357+0000 7f4a2c896640 1 -- 172.21.15.37:0/3259311795 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4a0c06a430 msgr2=0x7f4a0c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:38.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.357+0000 7f4a2c896640 1 --2- 172.21.15.37:0/3259311795 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4a0c06a430 0x7f4a0c06c8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4a10000f60 tx=0x7f4a10007d50 comp rx=0 tx=0).stop 2023-12-19T16:07:38.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.357+0000 7f4a2c896640 1 -- 172.21.15.37:0/3259311795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a28144cd0 msgr2=0x7f4a2813f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:38.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.357+0000 7f4a2c896640 1 --2- 172.21.15.37:0/3259311795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a28144cd0 0x7f4a2813f050 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000efc0 tx=0x7f4a2000c490 comp rx=0 tx=0).stop 2023-12-19T16:07:38.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.357+0000 7f4a2c896640 1 -- 172.21.15.37:0/3259311795 shutdown_connections 2023-12-19T16:07:38.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.357+0000 7f4a2c896640 1 --2- 172.21.15.37:0/3259311795 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4a0c06a430 0x7f4a0c06c8f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.357+0000 7f4a2c896640 1 --2- 172.21.15.37:0/3259311795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a28144cd0 0x7f4a2813f050 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.357+0000 7f4a2c896640 1 --2- 172.21.15.37:0/3259311795 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a280bcdd0 0x7f4a280bf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.357+0000 7f4a2c896640 1 --2- 172.21.15.37:0/3259311795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a280b6690 0x7f4a280be3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.357+0000 7f4a2c896640 1 -- 172.21.15.37:0/3259311795 >> 172.21.15.37:0/3259311795 conn(0x7f4a28071e60 msgr2=0x7f4a280b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.357+0000 7f4a2c896640 1 -- 172.21.15.37:0/3259311795 shutdown_connections 2023-12-19T16:07:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.358+0000 7f4a2c896640 1 -- 172.21.15.37:0/3259311795 wait complete. 2023-12-19T16:07:38.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:07:38.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.475+0000 7f8847fd5640 1 Processor -- start 2023-12-19T16:07:38.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.476+0000 7f8847fd5640 1 -- start start 2023-12-19T16:07:38.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.476+0000 7f8847fd5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f88400b6690 0x7f8840144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.476+0000 7f8847fd5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88400bc6b0 con 0x7f8840144cd0 2023-12-19T16:07:38.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.476+0000 7f8847fd5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88400a59f0 con 0x7f88400bcdd0 2023-12-19T16:07:38.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.476+0000 7f8847fd5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88400bc0a0 con 0x7f88400b6690 2023-12-19T16:07:38.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.476+0000 7f8846572640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8840144cd0 0x7f8840155340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48344/0 (socket says 172.21.15.37:48344) 2023-12-19T16:07:38.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8846572640 1 -- 172.21.15.37:0/1014329702 learned_addr learned my addr 172.21.15.37:0/1014329702 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:38.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8845570640 1 --2- 172.21.15.37:0/1014329702 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f88400b6690 0x7f8840144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8844d6f640 1 -- 172.21.15.37:0/1014329702 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266353032 0 0) 0x7f88400bc6b0 con 0x7f8840144cd0 2023-12-19T16:07:38.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8844d6f640 1 -- 172.21.15.37:0/1014329702 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f882c003520 con 0x7f8840144cd0 2023-12-19T16:07:38.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8844d6f640 1 -- 172.21.15.37:0/1014329702 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2651996905 0 0) 0x7f882c003520 con 0x7f8840144cd0 2023-12-19T16:07:38.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8844d6f640 1 -- 172.21.15.37:0/1014329702 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f88400b6690 msgr2=0x7f8840144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:38.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8844d6f640 1 --2- 172.21.15.37:0/1014329702 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f88400b6690 0x7f8840144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8844d6f640 1 -- 172.21.15.37:0/1014329702 >> v1:172.21.15.78:6789/0 conn(0x7f88400bcdd0 legacy=0x7f88400b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:38.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8844d6f640 1 -- 172.21.15.37:0/1014329702 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88400bc340 con 0x7f8840144cd0 2023-12-19T16:07:38.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8844d6f640 1 -- 172.21.15.37:0/1014329702 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f88380019f0 con 0x7f8840144cd0 2023-12-19T16:07:38.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8844d6f640 1 -- 172.21.15.37:0/1014329702 >> v1:172.21.15.37:6789/0 conn(0x7f8840144cd0 legacy=0x7f8840155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:38.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8844d6f640 1 --2- 172.21.15.37:0/1014329702 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f88400b6690 0x7f882c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8844d6f640 1 --2- 172.21.15.37:0/1014329702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f882c003ee0 0x7f882c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8844d6f640 1 --2- 172.21.15.37:0/1014329702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f882c004d00 0x7f882c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8844d6f640 1 -- 172.21.15.37:0/1014329702 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88400bc0a0 con 0x7f882c003ee0 2023-12-19T16:07:38.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8844d6f640 1 -- 172.21.15.37:0/1014329702 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c00b9e0 con 0x7f882c004d00 2023-12-19T16:07:38.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8844d6f640 1 -- 172.21.15.37:0/1014329702 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882c00bba0 con 0x7f88400b6690 2023-12-19T16:07:38.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8845570640 1 --2- 172.21.15.37:0/1014329702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f882c003ee0 0x7f882c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8845d71640 1 --2- 172.21.15.37:0/1014329702 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f88400b6690 0x7f882c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.477+0000 7f8846572640 1 --2- 172.21.15.37:0/1014329702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f882c004d00 0x7f882c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.478+0000 7f8845570640 1 -- 172.21.15.37:0/1014329702 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f88400b6690 msgr2=0x7f882c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:38.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.478+0000 7f8845570640 1 --2- 172.21.15.37:0/1014329702 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f88400b6690 0x7f882c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.478+0000 7f8845570640 1 -- 172.21.15.37:0/1014329702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f882c004d00 msgr2=0x7f882c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:38.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.478+0000 7f8845570640 1 --2- 172.21.15.37:0/1014329702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f882c004d00 0x7f882c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.478+0000 7f8845570640 1 -- 172.21.15.37:0/1014329702 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c003520 con 0x7f882c003ee0 2023-12-19T16:07:38.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.478+0000 7f8845570640 1 --2- 172.21.15.37:0/1014329702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f882c003ee0 0x7f882c0047c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8830009ac0 tx=0x7f882c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30862b6c2f01864a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:38.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.478+0000 7f8844d6f640 1 -- 172.21.15.37:0/1014329702 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883002c600 con 0x7f882c003ee0 2023-12-19T16:07:38.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.478+0000 7f8844d6f640 1 -- 172.21.15.37:0/1014329702 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883002c760 con 0x7f882c003ee0 2023-12-19T16:07:38.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.478+0000 7f8844d6f640 1 -- 172.21.15.37:0/1014329702 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883002caf0 con 0x7f882c003ee0 2023-12-19T16:07:38.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.479+0000 7f8847fd5640 1 -- 172.21.15.37:0/1014329702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f882c003ee0 msgr2=0x7f882c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:38.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.479+0000 7f8847fd5640 1 --2- 172.21.15.37:0/1014329702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f882c003ee0 0x7f882c0047c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8830009ac0 tx=0x7f882c0057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.479+0000 7f8846572640 1 -- 172.21.15.37:0/1014329702 reap_dead start 2023-12-19T16:07:38.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.479+0000 7f8847fd5640 1 -- 172.21.15.37:0/1014329702 shutdown_connections 2023-12-19T16:07:38.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.479+0000 7f8847fd5640 1 -- 172.21.15.37:0/1014329702 >> 172.21.15.37:0/1014329702 conn(0x7f8840071e60 msgr2=0x7f88400c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:38.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.479+0000 7f8847fd5640 1 -- 172.21.15.37:0/1014329702 shutdown_connections 2023-12-19T16:07:38.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.479+0000 7f8847fd5640 1 -- 172.21.15.37:0/1014329702 wait complete. 2023-12-19T16:07:38.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.480+0000 7f8847fd5640 1 Processor -- start 2023-12-19T16:07:38.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.480+0000 7f8847fd5640 1 -- start start 2023-12-19T16:07:38.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f8847fd5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f882c003ee0 0x7f88400bf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f8847fd5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884014b9c0 0x7f884013d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f8847fd5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88401e3720 0x7f88401e3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f8847fd5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88401e3300 con 0x7f88401e3720 2023-12-19T16:07:38.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f8847fd5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8840148410 con 0x7f884014b9c0 2023-12-19T16:07:38.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f8847fd5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88401e02e0 con 0x7f882c003ee0 2023-12-19T16:07:38.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f8846572640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88401e3720 0x7f88401e3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f8846572640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88401e3720 0x7f88401e3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58586/0 (socket says 172.21.15.37:58586) 2023-12-19T16:07:38.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f8846572640 1 -- 172.21.15.37:0/4215607968 learned_addr learned my addr 172.21.15.37:0/4215607968 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:38.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f8845d71640 1 --2- 172.21.15.37:0/4215607968 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f882c003ee0 0x7f88400bf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f8845570640 1 --2- 172.21.15.37:0/4215607968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884014b9c0 0x7f884013d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f8846572640 1 -- 172.21.15.37:0/4215607968 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f882c003ee0 msgr2=0x7f88400bf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:38.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f8846572640 1 --2- 172.21.15.37:0/4215607968 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f882c003ee0 0x7f88400bf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f8846572640 1 -- 172.21.15.37:0/4215607968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884014b9c0 msgr2=0x7f884013d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:38.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f8846572640 1 --2- 172.21.15.37:0/4215607968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884014b9c0 0x7f884013d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f8846572640 1 -- 172.21.15.37:0/4215607968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88401e40e0 con 0x7f88401e3720 2023-12-19T16:07:38.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f8846572640 1 --2- 172.21.15.37:0/4215607968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88401e3720 0x7f88401e3ba0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8838000f80 tx=0x7f8838007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:38.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f88367fc640 1 -- 172.21.15.37:0/4215607968 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883800ac20 con 0x7f88401e3720 2023-12-19T16:07:38.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f88367fc640 1 -- 172.21.15.37:0/4215607968 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883800ada0 con 0x7f88401e3720 2023-12-19T16:07:38.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f8847fd5640 1 -- 172.21.15.37:0/4215607968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88401e0520 con 0x7f88401e3720 2023-12-19T16:07:38.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.481+0000 7f88367fc640 1 -- 172.21.15.37:0/4215607968 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838013630 con 0x7f88401e3720 2023-12-19T16:07:38.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.482+0000 7f8847fd5640 1 -- 172.21.15.37:0/4215607968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88401e0ae0 con 0x7f88401e3720 2023-12-19T16:07:38.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.483+0000 7f8847fd5640 1 -- 172.21.15.37:0/4215607968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88401e0c70 con 0x7f88401e3720 2023-12-19T16:07:38.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.483+0000 7f88367fc640 1 -- 172.21.15.37:0/4215607968 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8838013790 con 0x7f88401e3720 2023-12-19T16:07:38.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.483+0000 7f88367fc640 1 --2- 172.21.15.37:0/4215607968 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f882406a430 0x7f882406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.483+0000 7f88367fc640 1 -- 172.21.15.37:0/4215607968 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8838088e80 con 0x7f88401e3720 2023-12-19T16:07:38.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.483+0000 7f8845d71640 1 --2- 172.21.15.37:0/4215607968 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f882406a430 0x7f882406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.484+0000 7f8845d71640 1 --2- 172.21.15.37:0/4215607968 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f882406a430 0x7f882406c8f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f883c001910 tx=0x7f883c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:38.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.487+0000 7f88367fc640 1 -- 172.21.15.37:0/4215607968 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8838054900 con 0x7f88401e3720 2023-12-19T16:07:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.663+0000 7f8847fd5640 1 -- 172.21.15.37:0/4215607968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f884004e840 con 0x7f88401e3720 2023-12-19T16:07:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.664+0000 7f88367fc640 1 -- 172.21.15.37:0/4215607968 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+12341 (secure 0 0 0) 0x7f8838017070 con 0x7f88401e3720 2023-12-19T16:07:38.666 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:38.666 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:07:35.690407+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:07:38.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.666+0000 7f8847fd5640 1 -- 172.21.15.37:0/4215607968 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f882406a430 msgr2=0x7f882406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:38.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.666+0000 7f8847fd5640 1 --2- 172.21.15.37:0/4215607968 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f882406a430 0x7f882406c8f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f883c001910 tx=0x7f883c009040 comp rx=0 tx=0).stop 2023-12-19T16:07:38.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.666+0000 7f8847fd5640 1 -- 172.21.15.37:0/4215607968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88401e3720 msgr2=0x7f88401e3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:38.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.666+0000 7f8847fd5640 1 --2- 172.21.15.37:0/4215607968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88401e3720 0x7f88401e3ba0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8838000f80 tx=0x7f8838007bd0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.666+0000 7f8847fd5640 1 -- 172.21.15.37:0/4215607968 shutdown_connections 2023-12-19T16:07:38.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.666+0000 7f8847fd5640 1 --2- 172.21.15.37:0/4215607968 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f882406a430 0x7f882406c8f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.666+0000 7f8847fd5640 1 --2- 172.21.15.37:0/4215607968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88401e3720 0x7f88401e3ba0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.666+0000 7f8847fd5640 1 --2- 172.21.15.37:0/4215607968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884014b9c0 0x7f884013d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.666+0000 7f8847fd5640 1 --2- 172.21.15.37:0/4215607968 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f882c003ee0 0x7f88400bf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.666+0000 7f8847fd5640 1 -- 172.21.15.37:0/4215607968 >> 172.21.15.37:0/4215607968 conn(0x7f8840071e60 msgr2=0x7f88401422b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:38.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.666+0000 7f8847fd5640 1 -- 172.21.15.37:0/4215607968 shutdown_connections 2023-12-19T16:07:38.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.666+0000 7f8847fd5640 1 -- 172.21.15.37:0/4215607968 wait complete. 2023-12-19T16:07:38.679 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:06:46.684027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:07:38.679 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:07:38.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.786+0000 7f92ac773640 1 Processor -- start 2023-12-19T16:07:38.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.786+0000 7f92ac773640 1 -- start start 2023-12-19T16:07:38.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.787+0000 7f92ac773640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f92a40bf510 0x7f92a40be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.787+0000 7f92ac773640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92a406a950 0x7f92a40bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.787+0000 7f92ac773640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a40bfa50 con 0x7f92a40bb140 2023-12-19T16:07:38.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.787+0000 7f92ac773640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a40bbda0 con 0x7f92a406a950 2023-12-19T16:07:38.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.787+0000 7f92ac773640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a406b040 con 0x7f92a40bf510 2023-12-19T16:07:38.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.787+0000 7f92aad10640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92a406a950 0x7f92a40bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.787+0000 7f92aad10640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92a406a950 0x7f92a40bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58588/0 (socket says 172.21.15.37:58588) 2023-12-19T16:07:38.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.787+0000 7f92aad10640 1 -- 172.21.15.37:0/1859282852 learned_addr learned my addr 172.21.15.37:0/1859282852 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:38.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.787+0000 7f92a9d0e640 1 --2- 172.21.15.37:0/1859282852 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f92a40bf510 0x7f92a40be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.787+0000 7f92aad10640 1 -- 172.21.15.37:0/1859282852 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f92a40bf510 msgr2=0x7f92a40be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:38.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.787+0000 7f92aad10640 1 --2- 172.21.15.37:0/1859282852 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f92a40bf510 0x7f92a40be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.787+0000 7f92aad10640 1 -- 172.21.15.37:0/1859282852 >> v1:172.21.15.78:6789/0 conn(0x7f92a40bb140 legacy=0x7f92a40bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:38.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.787+0000 7f92aad10640 1 -- 172.21.15.37:0/1859282852 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a40bb520 con 0x7f92a406a950 2023-12-19T16:07:38.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.788+0000 7f92aad10640 1 --2- 172.21.15.37:0/1859282852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a406a950 0x7f92a40bfee0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9294009e50 tx=0x7f929402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fcc4eb31d55b131 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:38.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.788+0000 7f92a950d640 1 -- 172.21.15.37:0/1859282852 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929402ca70 con 0x7f92a406a950 2023-12-19T16:07:38.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.788+0000 7f92a950d640 1 -- 172.21.15.37:0/1859282852 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929402cbd0 con 0x7f92a406a950 2023-12-19T16:07:38.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.788+0000 7f92a950d640 1 -- 172.21.15.37:0/1859282852 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92940343f0 con 0x7f92a406a950 2023-12-19T16:07:38.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.789+0000 7f92ac773640 1 -- 172.21.15.37:0/1859282852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a406a950 msgr2=0x7f92a40bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:38.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.789+0000 7f92ac773640 1 --2- 172.21.15.37:0/1859282852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a406a950 0x7f92a40bfee0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9294009e50 tx=0x7f929402bed0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.789+0000 7f92ac773640 1 -- 172.21.15.37:0/1859282852 shutdown_connections 2023-12-19T16:07:38.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.789+0000 7f92ac773640 1 --2- 172.21.15.37:0/1859282852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a406a950 0x7f92a40bfee0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.789+0000 7f92ac773640 1 --2- 172.21.15.37:0/1859282852 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f92a40bf510 0x7f92a40be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.789+0000 7f92ac773640 1 -- 172.21.15.37:0/1859282852 >> 172.21.15.37:0/1859282852 conn(0x7f92a40bcfd0 msgr2=0x7f92a40bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:38.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.789+0000 7f92ac773640 1 -- 172.21.15.37:0/1859282852 shutdown_connections 2023-12-19T16:07:38.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.789+0000 7f92ac773640 1 -- 172.21.15.37:0/1859282852 wait complete. 2023-12-19T16:07:38.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.790+0000 7f92ac773640 1 Processor -- start 2023-12-19T16:07:38.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.790+0000 7f92ac773640 1 -- start start 2023-12-19T16:07:38.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92ac773640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a406a950 0x7f92a41465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92ac773640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92a40bb140 0x7f92a4144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92ac773640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f92a40bf510 0x7f92a41453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92ac773640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a4146b30 con 0x7f92a406a950 2023-12-19T16:07:38.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92ac773640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a41e08d0 con 0x7f92a40bb140 2023-12-19T16:07:38.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92ac773640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a41dffa0 con 0x7f92a40bf510 2023-12-19T16:07:38.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92aa50f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a406a950 0x7f92a41465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92aa50f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a406a950 0x7f92a41465f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58592/0 (socket says 172.21.15.37:58592) 2023-12-19T16:07:38.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92aa50f640 1 -- 172.21.15.37:0/2465145936 learned_addr learned my addr 172.21.15.37:0/2465145936 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:38.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92a9d0e640 1 --2- 172.21.15.37:0/2465145936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92a40bb140 0x7f92a4144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92aad10640 1 --2- 172.21.15.37:0/2465145936 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f92a40bf510 0x7f92a41453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92aa50f640 1 -- 172.21.15.37:0/2465145936 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f92a40bf510 msgr2=0x7f92a41453b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:38.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92aa50f640 1 --2- 172.21.15.37:0/2465145936 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f92a40bf510 0x7f92a41453b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92aa50f640 1 -- 172.21.15.37:0/2465145936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92a40bb140 msgr2=0x7f92a4144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:38.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92aa50f640 1 --2- 172.21.15.37:0/2465145936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92a40bb140 0x7f92a4144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92aa50f640 1 -- 172.21.15.37:0/2465145936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9294009b30 con 0x7f92a406a950 2023-12-19T16:07:38.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92aa50f640 1 --2- 172.21.15.37:0/2465145936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a406a950 0x7f92a41465f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f929c00c400 tx=0x7f929c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:38.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92a2ffd640 1 -- 172.21.15.37:0/2465145936 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c0052d0 con 0x7f92a406a950 2023-12-19T16:07:38.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92a2ffd640 1 -- 172.21.15.37:0/2465145936 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929c005430 con 0x7f92a406a950 2023-12-19T16:07:38.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92ac773640 1 -- 172.21.15.37:0/2465145936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a41e0280 con 0x7f92a406a950 2023-12-19T16:07:38.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92a2ffd640 1 -- 172.21.15.37:0/2465145936 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c003830 con 0x7f92a406a950 2023-12-19T16:07:38.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.791+0000 7f92ac773640 1 -- 172.21.15.37:0/2465145936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a41dfc70 con 0x7f92a406a950 2023-12-19T16:07:38.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.792+0000 7f92ac773640 1 -- 172.21.15.37:0/2465145936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a40a61f0 con 0x7f92a406a950 2023-12-19T16:07:38.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.793+0000 7f92a2ffd640 1 -- 172.21.15.37:0/2465145936 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f929c003990 con 0x7f92a406a950 2023-12-19T16:07:38.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.793+0000 7f92a2ffd640 1 --2- 172.21.15.37:0/2465145936 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f929006a460 0x7f929006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:38.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.793+0000 7f92a2ffd640 1 -- 172.21.15.37:0/2465145936 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f929c087a30 con 0x7f92a406a950 2023-12-19T16:07:38.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.794+0000 7f92a9d0e640 1 --2- 172.21.15.37:0/2465145936 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f929006a460 0x7f929006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:38.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.794+0000 7f92a9d0e640 1 --2- 172.21.15.37:0/2465145936 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f929006a460 0x7f929006c920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f92a40a4c20 tx=0x7f9298009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:38.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.798+0000 7f92a2ffd640 1 -- 172.21.15.37:0/2465145936 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f929c0534b0 con 0x7f92a406a950 2023-12-19T16:07:38.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.975+0000 7f92ac773640 1 -- 172.21.15.37:0/2465145936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92a40740a0 con 0x7f92a406a950 2023-12-19T16:07:38.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.975+0000 7f92a2ffd640 1 -- 172.21.15.37:0/2465145936 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f929c017020 con 0x7f92a406a950 2023-12-19T16:07:38.977 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-19T16:07:38.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.977+0000 7f92ac773640 1 -- 172.21.15.37:0/2465145936 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f929006a460 msgr2=0x7f929006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:38.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.977+0000 7f92ac773640 1 --2- 172.21.15.37:0/2465145936 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f929006a460 0x7f929006c920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f92a40a4c20 tx=0x7f9298009190 comp rx=0 tx=0).stop 2023-12-19T16:07:38.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.977+0000 7f92ac773640 1 -- 172.21.15.37:0/2465145936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a406a950 msgr2=0x7f92a41465f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:38.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.977+0000 7f92ac773640 1 --2- 172.21.15.37:0/2465145936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a406a950 0x7f92a41465f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f929c00c400 tx=0x7f929c00c8c0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.977+0000 7f92ac773640 1 -- 172.21.15.37:0/2465145936 shutdown_connections 2023-12-19T16:07:38.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.977+0000 7f92ac773640 1 --2- 172.21.15.37:0/2465145936 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f929006a460 0x7f929006c920 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.977+0000 7f92ac773640 1 --2- 172.21.15.37:0/2465145936 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f92a40bf510 0x7f92a41453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.977+0000 7f92ac773640 1 --2- 172.21.15.37:0/2465145936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92a40bb140 0x7f92a4144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.977+0000 7f92ac773640 1 --2- 172.21.15.37:0/2465145936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a406a950 0x7f92a41465f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:38.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.977+0000 7f92ac773640 1 -- 172.21.15.37:0/2465145936 >> 172.21.15.37:0/2465145936 conn(0x7f92a40bcfd0 msgr2=0x7f92a40a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:38.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.977+0000 7f92ac773640 1 -- 172.21.15.37:0/2465145936 shutdown_connections 2023-12-19T16:07:38.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:38.977+0000 7f92ac773640 1 -- 172.21.15.37:0/2465145936 wait complete. 2023-12-19T16:07:38.990 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T16:07:39.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.094+0000 7f7a2f0ab640 1 Processor -- start 2023-12-19T16:07:39.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.094+0000 7f7a2f0ab640 1 -- start start 2023-12-19T16:07:39.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.094+0000 7f7a2f0ab640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7a28144e30 0x7f7a280b7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:39.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.094+0000 7f7a2f0ab640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a280b8b40 0x7f7a28155320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:39.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.094+0000 7f7a2f0ab640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a280b6da0 con 0x7f7a280bab80 2023-12-19T16:07:39.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.094+0000 7f7a2f0ab640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a280b8090 con 0x7f7a28144e30 2023-12-19T16:07:39.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.094+0000 7f7a2f0ab640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2814afe0 con 0x7f7a280b8b40 2023-12-19T16:07:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.095+0000 7f7a2ce47640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7a28144e30 0x7f7a280b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.095+0000 7f7a2ce47640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7a28144e30 0x7f7a280b7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58594/0 (socket says 172.21.15.37:58594) 2023-12-19T16:07:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.095+0000 7f7a2ce47640 1 -- 172.21.15.37:0/2453435944 learned_addr learned my addr 172.21.15.37:0/2453435944 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.095+0000 7f7a2d648640 1 --2- 172.21.15.37:0/2453435944 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a280b8b40 0x7f7a28155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.095+0000 7f7a2ce47640 1 -- 172.21.15.37:0/2453435944 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a280b8b40 msgr2=0x7f7a28155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.095+0000 7f7a2ce47640 1 --2- 172.21.15.37:0/2453435944 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a280b8b40 0x7f7a28155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.095+0000 7f7a2ce47640 1 -- 172.21.15.37:0/2453435944 >> v1:172.21.15.78:6789/0 conn(0x7f7a280bab80 legacy=0x7f7a2814b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.095+0000 7f7a2ce47640 1 -- 172.21.15.37:0/2453435944 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a28145210 con 0x7f7a28144e30 2023-12-19T16:07:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.095+0000 7f7a2d648640 1 --2- 172.21.15.37:0/2453435944 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a280b8b40 0x7f7a28155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:39.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.096+0000 7f7a2ce47640 1 --2- 172.21.15.37:0/2453435944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a28144e30 0x7f7a280b7600 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c0098a0 tx=0x7f7a1c02ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd19c6455a20836 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:39.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.096+0000 7f7a277fe640 1 -- 172.21.15.37:0/2453435944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c02f830 con 0x7f7a28144e30 2023-12-19T16:07:39.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.096+0000 7f7a277fe640 1 -- 172.21.15.37:0/2453435944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c02f990 con 0x7f7a28144e30 2023-12-19T16:07:39.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.096+0000 7f7a277fe640 1 -- 172.21.15.37:0/2453435944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c02fd20 con 0x7f7a28144e30 2023-12-19T16:07:39.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.096+0000 7f7a2f0ab640 1 -- 172.21.15.37:0/2453435944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a28144e30 msgr2=0x7f7a280b7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:39.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.096+0000 7f7a2f0ab640 1 --2- 172.21.15.37:0/2453435944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a28144e30 0x7f7a280b7600 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c0098a0 tx=0x7f7a1c02ba10 comp rx=0 tx=0).stop 2023-12-19T16:07:39.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.096+0000 7f7a2f0ab640 1 -- 172.21.15.37:0/2453435944 shutdown_connections 2023-12-19T16:07:39.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.096+0000 7f7a2f0ab640 1 --2- 172.21.15.37:0/2453435944 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a280b8b40 0x7f7a28155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:39.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.096+0000 7f7a2f0ab640 1 --2- 172.21.15.37:0/2453435944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a28144e30 0x7f7a280b7600 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:39.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.096+0000 7f7a2f0ab640 1 -- 172.21.15.37:0/2453435944 >> 172.21.15.37:0/2453435944 conn(0x7f7a280c0200 msgr2=0x7f7a280c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:39.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.096+0000 7f7a2f0ab640 1 -- 172.21.15.37:0/2453435944 shutdown_connections 2023-12-19T16:07:39.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.097+0000 7f7a2f0ab640 1 -- 172.21.15.37:0/2453435944 wait complete. 2023-12-19T16:07:39.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.098+0000 7f7a2f0ab640 1 Processor -- start 2023-12-19T16:07:39.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.098+0000 7f7a2f0ab640 1 -- start start 2023-12-19T16:07:39.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.098+0000 7f7a2f0ab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a280b8b40 0x7f7a280a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:39.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.098+0000 7f7a2f0ab640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a280bab80 0x7f7a281e2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:39.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.098+0000 7f7a2f0ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a28144e30 0x7f7a280ac660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:39.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.098+0000 7f7a2f0ab640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a280ac240 con 0x7f7a280b8b40 2023-12-19T16:07:39.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.098+0000 7f7a2f0ab640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a280aa7a0 con 0x7f7a28144e30 2023-12-19T16:07:39.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.098+0000 7f7a2f0ab640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a280abbe0 con 0x7f7a280bab80 2023-12-19T16:07:39.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.098+0000 7f7a2ce47640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a280b8b40 0x7f7a280a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:39.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.098+0000 7f7a2ce47640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a280b8b40 0x7f7a280a9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58604/0 (socket says 172.21.15.37:58604) 2023-12-19T16:07:39.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.098+0000 7f7a2ce47640 1 -- 172.21.15.37:0/412655951 learned_addr learned my addr 172.21.15.37:0/412655951 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:39.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.099+0000 7f7a2d648640 1 --2- 172.21.15.37:0/412655951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a28144e30 0x7f7a280ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:39.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.099+0000 7f7a27fff640 1 --2- 172.21.15.37:0/412655951 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a280bab80 0x7f7a281e2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:39.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.099+0000 7f7a2ce47640 1 -- 172.21.15.37:0/412655951 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a280bab80 msgr2=0x7f7a281e2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:39.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.099+0000 7f7a2ce47640 1 --2- 172.21.15.37:0/412655951 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a280bab80 0x7f7a281e2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:39.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.099+0000 7f7a2ce47640 1 -- 172.21.15.37:0/412655951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a28144e30 msgr2=0x7f7a280ac660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:39.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.099+0000 7f7a2ce47640 1 --2- 172.21.15.37:0/412655951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a28144e30 0x7f7a280ac660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:39.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.099+0000 7f7a2ce47640 1 -- 172.21.15.37:0/412655951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c0094d0 con 0x7f7a280b8b40 2023-12-19T16:07:39.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.099+0000 7f7a2d648640 1 --2- 172.21.15.37:0/412655951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a28144e30 0x7f7a280ac660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:39.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.099+0000 7f7a2ce47640 1 --2- 172.21.15.37:0/412655951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a280b8b40 0x7f7a280a9ec0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c02ba50 tx=0x7f7a1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:39.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.099+0000 7f7a257fa640 1 -- 172.21.15.37:0/412655951 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c037c40 con 0x7f7a280b8b40 2023-12-19T16:07:39.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.099+0000 7f7a257fa640 1 -- 172.21.15.37:0/412655951 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c037da0 con 0x7f7a280b8b40 2023-12-19T16:07:39.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.099+0000 7f7a2f0ab640 1 -- 172.21.15.37:0/412655951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a280aa4c0 con 0x7f7a280b8b40 2023-12-19T16:07:39.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.099+0000 7f7a257fa640 1 -- 172.21.15.37:0/412655951 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0426c0 con 0x7f7a280b8b40 2023-12-19T16:07:39.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.099+0000 7f7a2f0ab640 1 -- 172.21.15.37:0/412655951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a28148f80 con 0x7f7a280b8b40 2023-12-19T16:07:39.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.100+0000 7f7a2f0ab640 1 -- 172.21.15.37:0/412655951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a280bfd90 con 0x7f7a280b8b40 2023-12-19T16:07:39.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.100+0000 7f7a257fa640 1 -- 172.21.15.37:0/412655951 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7a1c02d3c0 con 0x7f7a280b8b40 2023-12-19T16:07:39.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.101+0000 7f7a257fa640 1 --2- 172.21.15.37:0/412655951 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7a0c06a460 0x7f7a0c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:39.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.101+0000 7f7a257fa640 1 -- 172.21.15.37:0/412655951 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7a1c03c070 con 0x7f7a280b8b40 2023-12-19T16:07:39.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.101+0000 7f7a27fff640 1 --2- 172.21.15.37:0/412655951 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7a0c06a460 0x7f7a0c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:39.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.102+0000 7f7a27fff640 1 --2- 172.21.15.37:0/412655951 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7a0c06a460 0x7f7a0c06c920 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7a280a96d0 tx=0x7f7a14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:39.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.105+0000 7f7a257fa640 1 -- 172.21.15.37:0/412655951 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7a1c076610 con 0x7f7a280b8b40 2023-12-19T16:07:39.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.285+0000 7f7a2f0ab640 1 -- 172.21.15.37:0/412655951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7a280ac4b0 con 0x7f7a280b8b40 2023-12-19T16:07:39.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.286+0000 7f7a257fa640 1 -- 172.21.15.37:0/412655951 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7a1c047070 con 0x7f7a280b8b40 2023-12-19T16:07:39.288 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:39.288 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-12-19T16:07:39.288 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-19T16:07:39.288 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-12-19T16:07:39.288 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-12-19T16:07:39.289 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-19T16:07:39.289 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-12-19T16:07:39.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.288+0000 7f7a2f0ab640 1 -- 172.21.15.37:0/412655951 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7a0c06a460 msgr2=0x7f7a0c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:39.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.288+0000 7f7a2f0ab640 1 --2- 172.21.15.37:0/412655951 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7a0c06a460 0x7f7a0c06c920 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7a280a96d0 tx=0x7f7a14009040 comp rx=0 tx=0).stop 2023-12-19T16:07:39.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.288+0000 7f7a2f0ab640 1 -- 172.21.15.37:0/412655951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a280b8b40 msgr2=0x7f7a280a9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:39.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.288+0000 7f7a2f0ab640 1 --2- 172.21.15.37:0/412655951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a280b8b40 0x7f7a280a9ec0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c02ba50 tx=0x7f7a1c004730 comp rx=0 tx=0).stop 2023-12-19T16:07:39.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.288+0000 7f7a2f0ab640 1 -- 172.21.15.37:0/412655951 shutdown_connections 2023-12-19T16:07:39.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.288+0000 7f7a2f0ab640 1 --2- 172.21.15.37:0/412655951 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7a0c06a460 0x7f7a0c06c920 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:39.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.288+0000 7f7a2f0ab640 1 --2- 172.21.15.37:0/412655951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a28144e30 0x7f7a280ac660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:39.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.288+0000 7f7a2f0ab640 1 --2- 172.21.15.37:0/412655951 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a280bab80 0x7f7a281e2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:39.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.288+0000 7f7a2f0ab640 1 --2- 172.21.15.37:0/412655951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a280b8b40 0x7f7a280a9ec0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:39.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.288+0000 7f7a2f0ab640 1 -- 172.21.15.37:0/412655951 >> 172.21.15.37:0/412655951 conn(0x7f7a280c0200 msgr2=0x7f7a280b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:39.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.288+0000 7f7a2f0ab640 1 -- 172.21.15.37:0/412655951 shutdown_connections 2023-12-19T16:07:39.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.288+0000 7f7a2f0ab640 1 -- 172.21.15.37:0/412655951 wait complete. 2023-12-19T16:07:39.300 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T16:07:39.300 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T16:07:39.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.408+0000 7f2ae8ca0640 1 Processor -- start 2023-12-19T16:07:39.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.408+0000 7f2ae8ca0640 1 -- start start 2023-12-19T16:07:39.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.409+0000 7f2ae8ca0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ae40b79a0 0x7f2ae40bc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.409+0000 7f2ae8ca0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2ae40b64a0 0x7f2ae40b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.409+0000 7f2ae8ca0640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae40b8ba0 con 0x7f2ae414ad50 2023-12-19T16:07:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.409+0000 7f2ae8ca0640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae406cd70 con 0x7f2ae40b64a0 2023-12-19T16:07:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.409+0000 7f2ae8ca0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae40b8e80 con 0x7f2ae40b79a0 2023-12-19T16:07:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.409+0000 7f2ae259c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ae40b79a0 0x7f2ae40bc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.409+0000 7f2ae1d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2ae40b64a0 0x7f2ae40b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.409+0000 7f2ae2d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2ae414ad50 0x7f2ae414b1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.37:32860/0 (socket says 172.21.15.37:32860) 2023-12-19T16:07:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.409+0000 7f2ae2d9d640 1 -- 172.21.15.37:0/2812222080 learned_addr learned my addr 172.21.15.37:0/2812222080 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.409+0000 7f2ae1d9b640 1 -- 172.21.15.37:0/2812222080 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ae40b79a0 msgr2=0x7f2ae40bc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.409+0000 7f2ae1d9b640 1 --2- 172.21.15.37:0/2812222080 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ae40b79a0 0x7f2ae40bc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.409+0000 7f2ae1d9b640 1 -- 172.21.15.37:0/2812222080 >> v1:172.21.15.78:6789/0 conn(0x7f2ae414ad50 legacy=0x7f2ae414b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.410+0000 7f2ae1d9b640 1 -- 172.21.15.37:0/2812222080 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae40b9160 con 0x7f2ae40b64a0 2023-12-19T16:07:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.410+0000 7f2ae159a640 1 -- 172.21.15.37:0/2812222080 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855233865 0 0) 0x7f2ae40b8ba0 con 0x7f2ae414ad50 2023-12-19T16:07:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.410+0000 7f2ae259c640 1 --2- 172.21.15.37:0/2812222080 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ae40b79a0 0x7f2ae40bc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:07:39.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.410+0000 7f2ae1d9b640 1 --2- 172.21.15.37:0/2812222080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae40b64a0 0x7f2ae40b68c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80097a0 tx=0x7f2ad802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de6f2617aca2bf97 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:39.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.410+0000 7f2ae159a640 1 -- 172.21.15.37:0/2812222080 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8030610 con 0x7f2ae40b64a0 2023-12-19T16:07:39.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.410+0000 7f2ae159a640 1 -- 172.21.15.37:0/2812222080 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad8030770 con 0x7f2ae40b64a0 2023-12-19T16:07:39.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.411+0000 7f2ae159a640 1 -- 172.21.15.37:0/2812222080 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8030b00 con 0x7f2ae40b64a0 2023-12-19T16:07:39.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.411+0000 7f2ae8ca0640 1 -- 172.21.15.37:0/2812222080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae40b64a0 msgr2=0x7f2ae40b68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:39.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.411+0000 7f2ae8ca0640 1 --2- 172.21.15.37:0/2812222080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae40b64a0 0x7f2ae40b68c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80097a0 tx=0x7f2ad802b960 comp rx=0 tx=0).stop 2023-12-19T16:07:39.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.411+0000 7f2ae8ca0640 1 -- 172.21.15.37:0/2812222080 shutdown_connections 2023-12-19T16:07:39.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.411+0000 7f2ae8ca0640 1 --2- 172.21.15.37:0/2812222080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae40b64a0 0x7f2ae40b68c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:39.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.411+0000 7f2ae8ca0640 1 --2- 172.21.15.37:0/2812222080 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ae40b79a0 0x7f2ae40bc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:39.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.411+0000 7f2ae8ca0640 1 -- 172.21.15.37:0/2812222080 >> 172.21.15.37:0/2812222080 conn(0x7f2ae40c0330 msgr2=0x7f2ae40c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:39.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.411+0000 7f2ae8ca0640 1 -- 172.21.15.37:0/2812222080 shutdown_connections 2023-12-19T16:07:39.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.411+0000 7f2ae8ca0640 1 -- 172.21.15.37:0/2812222080 wait complete. 2023-12-19T16:07:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.412+0000 7f2ae8ca0640 1 Processor -- start 2023-12-19T16:07:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.412+0000 7f2ae8ca0640 1 -- start start 2023-12-19T16:07:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.413+0000 7f2ae8ca0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ae40b64a0 0x7f2ae414e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.413+0000 7f2ae8ca0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ae40b79a0 0x7f2ae40ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.413+0000 7f2ae8ca0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae414ad50 0x7f2ae41458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.413+0000 7f2ae8ca0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae414e660 con 0x7f2ae40b64a0 2023-12-19T16:07:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.413+0000 7f2ae8ca0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae4147260 con 0x7f2ae414ad50 2023-12-19T16:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.413+0000 7f2ae8ca0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae41dfd00 con 0x7f2ae40b79a0 2023-12-19T16:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.413+0000 7f2ae259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ae40b64a0 0x7f2ae414e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.413+0000 7f2ae259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ae40b64a0 0x7f2ae414e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58620/0 (socket says 172.21.15.37:58620) 2023-12-19T16:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.413+0000 7f2ae259c640 1 -- 172.21.15.37:0/3335362632 learned_addr learned my addr 172.21.15.37:0/3335362632 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.413+0000 7f2ae2d9d640 1 --2- 172.21.15.37:0/3335362632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae414ad50 0x7f2ae41458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.413+0000 7f2ae1d9b640 1 --2- 172.21.15.37:0/3335362632 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ae40b79a0 0x7f2ae40ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.413+0000 7f2ae259c640 1 -- 172.21.15.37:0/3335362632 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ae40b79a0 msgr2=0x7f2ae40ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.413+0000 7f2ae259c640 1 --2- 172.21.15.37:0/3335362632 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ae40b79a0 0x7f2ae40ad740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.413+0000 7f2ae259c640 1 -- 172.21.15.37:0/3335362632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae414ad50 msgr2=0x7f2ae41458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.413+0000 7f2ae259c640 1 --2- 172.21.15.37:0/3335362632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae414ad50 0x7f2ae41458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.413+0000 7f2ae259c640 1 -- 172.21.15.37:0/3335362632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc009400 con 0x7f2ae40b64a0 2023-12-19T16:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.413+0000 7f2ae1d9b640 1 --2- 172.21.15.37:0/3335362632 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ae40b79a0 0x7f2ae40ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.414+0000 7f2ae259c640 1 --2- 172.21.15.37:0/3335362632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ae40b64a0 0x7f2ae414e120 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00ebe0 tx=0x7f2adc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.414+0000 7f2ad2ffd640 1 -- 172.21.15.37:0/3335362632 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc009760 con 0x7f2ae40b64a0 2023-12-19T16:07:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.414+0000 7f2ad2ffd640 1 -- 172.21.15.37:0/3335362632 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc00cc30 con 0x7f2ae40b64a0 2023-12-19T16:07:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.414+0000 7f2ae8ca0640 1 -- 172.21.15.37:0/3335362632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad8009400 con 0x7f2ae40b64a0 2023-12-19T16:07:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.414+0000 7f2ad2ffd640 1 -- 172.21.15.37:0/3335362632 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc00eee0 con 0x7f2ae40b64a0 2023-12-19T16:07:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.414+0000 7f2ae8ca0640 1 -- 172.21.15.37:0/3335362632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae41dff50 con 0x7f2ae40b64a0 2023-12-19T16:07:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.415+0000 7f2ae8ca0640 1 -- 172.21.15.37:0/3335362632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae4144f60 con 0x7f2ae40b64a0 2023-12-19T16:07:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.415+0000 7f2ad2ffd640 1 -- 172.21.15.37:0/3335362632 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2adc013470 con 0x7f2ae40b64a0 2023-12-19T16:07:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.416+0000 7f2ad2ffd640 1 --2- 172.21.15.37:0/3335362632 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2ac406a460 0x7f2ac406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.416+0000 7f2ad2ffd640 1 -- 172.21.15.37:0/3335362632 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2adc0888a0 con 0x7f2ae40b64a0 2023-12-19T16:07:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.416+0000 7f2ae1d9b640 1 --2- 172.21.15.37:0/3335362632 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2ac406a460 0x7f2ac406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.416+0000 7f2ae1d9b640 1 --2- 172.21.15.37:0/3335362632 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2ac406a460 0x7f2ac406c920 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8036000 tx=0x7f2ad8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:39.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.420+0000 7f2ad2ffd640 1 -- 172.21.15.37:0/3335362632 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2adc054200 con 0x7f2ae40b64a0 2023-12-19T16:07:39.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:39.595+0000 7f2ae8ca0640 1 -- 172.21.15.37:0/3335362632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2ae404e840 con 0x7f2ae40b64a0 2023-12-19T16:07:40.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.515+0000 7f2ad2ffd640 1 -- 172.21.15.37:0/3335362632 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2adc0170b0 con 0x7f2ae40b64a0 2023-12-19T16:07:40.518 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-12-19T16:07:40.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.518+0000 7f2ae8ca0640 1 -- 172.21.15.37:0/3335362632 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2ac406a460 msgr2=0x7f2ac406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:40.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.518+0000 7f2ae8ca0640 1 --2- 172.21.15.37:0/3335362632 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2ac406a460 0x7f2ac406c920 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8036000 tx=0x7f2ad8008030 comp rx=0 tx=0).stop 2023-12-19T16:07:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.518+0000 7f2ae8ca0640 1 -- 172.21.15.37:0/3335362632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ae40b64a0 msgr2=0x7f2ae414e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.518+0000 7f2ae8ca0640 1 --2- 172.21.15.37:0/3335362632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ae40b64a0 0x7f2ae414e120 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00ebe0 tx=0x7f2adc00c520 comp rx=0 tx=0).stop 2023-12-19T16:07:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.518+0000 7f2ae8ca0640 1 -- 172.21.15.37:0/3335362632 shutdown_connections 2023-12-19T16:07:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.518+0000 7f2ae8ca0640 1 --2- 172.21.15.37:0/3335362632 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2ac406a460 0x7f2ac406c920 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.518+0000 7f2ae8ca0640 1 --2- 172.21.15.37:0/3335362632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ae414ad50 0x7f2ae41458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.518+0000 7f2ae8ca0640 1 --2- 172.21.15.37:0/3335362632 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2ae40b79a0 0x7f2ae40ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.518+0000 7f2ae8ca0640 1 --2- 172.21.15.37:0/3335362632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ae40b64a0 0x7f2ae414e120 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.518+0000 7f2ae8ca0640 1 -- 172.21.15.37:0/3335362632 >> 172.21.15.37:0/3335362632 conn(0x7f2ae40c0330 msgr2=0x7f2ae40b9440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.518+0000 7f2ae8ca0640 1 -- 172.21.15.37:0/3335362632 shutdown_connections 2023-12-19T16:07:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.518+0000 7f2ae8ca0640 1 -- 172.21.15.37:0/3335362632 wait complete. 2023-12-19T16:07:40.535 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T16:07:40.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.653+0000 7f32da6d5640 1 Processor -- start 2023-12-19T16:07:40.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.653+0000 7f32da6d5640 1 -- start start 2023-12-19T16:07:40.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.654+0000 7f32da6d5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32d4144ec0 0x7f32d40bc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:40.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.654+0000 7f32da6d5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f32d414dfc0 0x7f32d4155350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:40.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.654+0000 7f32da6d5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d40bd820 con 0x7f32d4144ae0 2023-12-19T16:07:40.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.654+0000 7f32da6d5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d414e4b0 con 0x7f32d414dfc0 2023-12-19T16:07:40.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.654+0000 7f32da6d5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d40b8f80 con 0x7f32d4144ec0 2023-12-19T16:07:40.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.654+0000 7f32d8c72640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f32d414dfc0 0x7f32d4155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:40.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.654+0000 7f32d8c72640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f32d414dfc0 0x7f32d4155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37664/0 (socket says 172.21.15.37:37664) 2023-12-19T16:07:40.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.654+0000 7f32d8c72640 1 -- 172.21.15.37:0/1624261536 learned_addr learned my addr 172.21.15.37:0/1624261536 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:40.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.654+0000 7f32d8c72640 1 -- 172.21.15.37:0/1624261536 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32d4144ec0 msgr2=0x7f32d40bc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:40.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.654+0000 7f32d37fe640 1 --2- 172.21.15.37:0/1624261536 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32d4144ec0 0x7f32d40bc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:40.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.654+0000 7f32d8c72640 1 --2- 172.21.15.37:0/1624261536 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32d4144ec0 0x7f32d40bc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:40.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.654+0000 7f32d8c72640 1 -- 172.21.15.37:0/1624261536 >> v1:172.21.15.78:6789/0 conn(0x7f32d4144ae0 legacy=0x7f32d40bd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:40.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.654+0000 7f32d8c72640 1 -- 172.21.15.37:0/1624261536 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d40b9260 con 0x7f32d414dfc0 2023-12-19T16:07:40.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.655+0000 7f32d8c72640 1 --2- 172.21.15.37:0/1624261536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d414dfc0 0x7f32d4155350 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f32cc009e50 tx=0x7f32cc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597f5e9e0c3d962 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:40.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.655+0000 7f32d2ffd640 1 -- 172.21.15.37:0/1624261536 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc02cb00 con 0x7f32d414dfc0 2023-12-19T16:07:40.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.655+0000 7f32d2ffd640 1 -- 172.21.15.37:0/1624261536 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32cc02cc60 con 0x7f32d414dfc0 2023-12-19T16:07:40.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.655+0000 7f32d2ffd640 1 -- 172.21.15.37:0/1624261536 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc0343f0 con 0x7f32d414dfc0 2023-12-19T16:07:40.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.656+0000 7f32da6d5640 1 -- 172.21.15.37:0/1624261536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d414dfc0 msgr2=0x7f32d4155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:40.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.656+0000 7f32da6d5640 1 --2- 172.21.15.37:0/1624261536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d414dfc0 0x7f32d4155350 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f32cc009e50 tx=0x7f32cc02bf60 comp rx=0 tx=0).stop 2023-12-19T16:07:40.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.656+0000 7f32da6d5640 1 -- 172.21.15.37:0/1624261536 shutdown_connections 2023-12-19T16:07:40.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.656+0000 7f32da6d5640 1 --2- 172.21.15.37:0/1624261536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d414dfc0 0x7f32d4155350 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:40.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.656+0000 7f32da6d5640 1 --2- 172.21.15.37:0/1624261536 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32d4144ec0 0x7f32d40bc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:40.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.656+0000 7f32da6d5640 1 -- 172.21.15.37:0/1624261536 >> 172.21.15.37:0/1624261536 conn(0x7f32d40714b0 msgr2=0x7f32d40718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:40.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.656+0000 7f32da6d5640 1 -- 172.21.15.37:0/1624261536 shutdown_connections 2023-12-19T16:07:40.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.656+0000 7f32da6d5640 1 -- 172.21.15.37:0/1624261536 wait complete. 2023-12-19T16:07:40.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.657+0000 7f32da6d5640 1 Processor -- start 2023-12-19T16:07:40.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.657+0000 7f32da6d5640 1 -- start start 2023-12-19T16:07:40.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.658+0000 7f32da6d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d4144ae0 0x7f32d40af750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:40.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.658+0000 7f32da6d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d4144ec0 0x7f32d41e3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:40.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.658+0000 7f32da6d5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32d414dfc0 0x7f32d40bfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:40.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.658+0000 7f32da6d5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d40b0e70 con 0x7f32d4144ae0 2023-12-19T16:07:40.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.658+0000 7f32da6d5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d414b510 con 0x7f32d4144ec0 2023-12-19T16:07:40.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.658+0000 7f32da6d5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d40c0400 con 0x7f32d414dfc0 2023-12-19T16:07:40.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.658+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d4144ae0 0x7f32d40af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:40.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.658+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d4144ae0 0x7f32d40af750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37680/0 (socket says 172.21.15.37:37680) 2023-12-19T16:07:40.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.658+0000 7f32d3fff640 1 -- 172.21.15.37:0/4089237784 learned_addr learned my addr 172.21.15.37:0/4089237784 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:40.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.658+0000 7f32d8c72640 1 --2- 172.21.15.37:0/4089237784 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32d414dfc0 0x7f32d40bfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:40.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.658+0000 7f32d37fe640 1 --2- 172.21.15.37:0/4089237784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d4144ec0 0x7f32d41e3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:40.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.658+0000 7f32d3fff640 1 -- 172.21.15.37:0/4089237784 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32d414dfc0 msgr2=0x7f32d40bfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:40.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.658+0000 7f32d3fff640 1 --2- 172.21.15.37:0/4089237784 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32d414dfc0 0x7f32d40bfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:40.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.658+0000 7f32d3fff640 1 -- 172.21.15.37:0/4089237784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d4144ec0 msgr2=0x7f32d41e3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:40.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.658+0000 7f32d3fff640 1 --2- 172.21.15.37:0/4089237784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d4144ec0 0x7f32d41e3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:40.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.658+0000 7f32d3fff640 1 -- 172.21.15.37:0/4089237784 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc009b30 con 0x7f32d4144ae0 2023-12-19T16:07:40.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.658+0000 7f32d8c72640 1 --2- 172.21.15.37:0/4089237784 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32d414dfc0 0x7f32d40bfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:40.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.658+0000 7f32d3fff640 1 --2- 172.21.15.37:0/4089237784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d4144ae0 0x7f32d40af750 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f32c400c460 tx=0x7f32c400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:40.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.659+0000 7f32d0ff9640 1 -- 172.21.15.37:0/4089237784 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c40052d0 con 0x7f32d4144ae0 2023-12-19T16:07:40.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.659+0000 7f32d0ff9640 1 -- 172.21.15.37:0/4089237784 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c4005430 con 0x7f32d4144ae0 2023-12-19T16:07:40.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.659+0000 7f32da6d5640 1 -- 172.21.15.37:0/4089237784 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d40aef90 con 0x7f32d4144ae0 2023-12-19T16:07:40.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.659+0000 7f32d0ff9640 1 -- 172.21.15.37:0/4089237784 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c4012870 con 0x7f32d4144ae0 2023-12-19T16:07:40.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.659+0000 7f32da6d5640 1 -- 172.21.15.37:0/4089237784 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d40b0860 con 0x7f32d4144ae0 2023-12-19T16:07:40.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.659+0000 7f32da6d5640 1 -- 172.21.15.37:0/4089237784 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d4073680 con 0x7f32d4144ae0 2023-12-19T16:07:40.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.660+0000 7f32d0ff9640 1 -- 172.21.15.37:0/4089237784 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f32c40129d0 con 0x7f32d4144ae0 2023-12-19T16:07:40.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.661+0000 7f32d0ff9640 1 --2- 172.21.15.37:0/4089237784 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f32b406a430 0x7f32b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:40.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.661+0000 7f32d0ff9640 1 -- 172.21.15.37:0/4089237784 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f32c4088b70 con 0x7f32d4144ae0 2023-12-19T16:07:40.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.661+0000 7f32d37fe640 1 --2- 172.21.15.37:0/4089237784 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f32b406a430 0x7f32b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:40.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.661+0000 7f32d37fe640 1 --2- 172.21.15.37:0/4089237784 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f32b406a430 0x7f32b406c8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f32d40ada40 tx=0x7f32bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:40.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.665+0000 7f32d0ff9640 1 -- 172.21.15.37:0/4089237784 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f32c40544b0 con 0x7f32d4144ae0 2023-12-19T16:07:40.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:40.841+0000 7f32da6d5640 1 -- 172.21.15.37:0/4089237784 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f32d4071b70 con 0x7f32d4144ae0 2023-12-19T16:07:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.525+0000 7f32d0ff9640 1 -- 172.21.15.37:0/4089237784 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7f32c4057ad0 con 0x7f32d4144ae0 2023-12-19T16:07:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-12-19T16:07:41.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.535+0000 7f32da6d5640 1 -- 172.21.15.37:0/4089237784 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f32b406a430 msgr2=0x7f32b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:41.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.535+0000 7f32da6d5640 1 --2- 172.21.15.37:0/4089237784 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f32b406a430 0x7f32b406c8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f32d40ada40 tx=0x7f32bc008040 comp rx=0 tx=0).stop 2023-12-19T16:07:41.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.535+0000 7f32da6d5640 1 -- 172.21.15.37:0/4089237784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d4144ae0 msgr2=0x7f32d40af750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:41.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.535+0000 7f32da6d5640 1 --2- 172.21.15.37:0/4089237784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d4144ae0 0x7f32d40af750 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f32c400c460 tx=0x7f32c400c920 comp rx=0 tx=0).stop 2023-12-19T16:07:41.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.540+0000 7f32da6d5640 1 -- 172.21.15.37:0/4089237784 shutdown_connections 2023-12-19T16:07:41.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.540+0000 7f32da6d5640 1 --2- 172.21.15.37:0/4089237784 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f32b406a430 0x7f32b406c8f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:41.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.540+0000 7f32da6d5640 1 --2- 172.21.15.37:0/4089237784 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f32d414dfc0 0x7f32d40bfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:41.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.540+0000 7f32da6d5640 1 --2- 172.21.15.37:0/4089237784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32d4144ec0 0x7f32d41e3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:41.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.540+0000 7f32da6d5640 1 --2- 172.21.15.37:0/4089237784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d4144ae0 0x7f32d40af750 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:41.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.540+0000 7f32da6d5640 1 -- 172.21.15.37:0/4089237784 >> 172.21.15.37:0/4089237784 conn(0x7f32d40714b0 msgr2=0x7f32d4072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:41.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.541+0000 7f32da6d5640 1 -- 172.21.15.37:0/4089237784 shutdown_connections 2023-12-19T16:07:41.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.541+0000 7f32da6d5640 1 -- 172.21.15.37:0/4089237784 wait complete. 2023-12-19T16:07:41.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T16:07:41.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.670+0000 7f85ebe41640 1 Processor -- start 2023-12-19T16:07:41.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.671+0000 7f85ebe41640 1 -- start start 2023-12-19T16:07:41.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.671+0000 7f85ebe41640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85e406ae20 0x7f85e406f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:41.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.671+0000 7f85ebe41640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85e4071f20 0x7f85e406ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:41.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.671+0000 7f85ebe41640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e4070990 con 0x7f85e4070520 2023-12-19T16:07:41.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.671+0000 7f85ebe41640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e4071190 con 0x7f85e4071f20 2023-12-19T16:07:41.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.671+0000 7f85ebe41640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40b6a20 con 0x7f85e406ae20 2023-12-19T16:07:41.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.671+0000 7f85e93dc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85e4071f20 0x7f85e406ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:41.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.671+0000 7f85e93dc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85e4071f20 0x7f85e406ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37688/0 (socket says 172.21.15.37:37688) 2023-12-19T16:07:41.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.671+0000 7f85e93dc640 1 -- 172.21.15.37:0/1624022243 learned_addr learned my addr 172.21.15.37:0/1624022243 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:41.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.671+0000 7f85ea3de640 1 --1- 172.21.15.37:0/1624022243 >> v1:172.21.15.37:6789/0 conn(0x7f85e4070520 0x7f85e41449c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43294/0 (socket says 172.21.15.37:43294) 2023-12-19T16:07:41.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.672+0000 7f85e9bdd640 1 --2- 172.21.15.37:0/1624022243 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85e406ae20 0x7f85e406f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:41.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.672+0000 7f85e93dc640 1 -- 172.21.15.37:0/1624022243 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85e406ae20 msgr2=0x7f85e406f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:41.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.672+0000 7f85e93dc640 1 --2- 172.21.15.37:0/1624022243 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85e406ae20 0x7f85e406f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:41.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.672+0000 7f85e93dc640 1 -- 172.21.15.37:0/1624022243 >> v1:172.21.15.37:6789/0 conn(0x7f85e4070520 legacy=0x7f85e41449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:41.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.672+0000 7f85e93dc640 1 -- 172.21.15.37:0/1624022243 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e40b8170 con 0x7f85e4071f20 2023-12-19T16:07:41.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.672+0000 7f85e8bdb640 1 -- 172.21.15.37:0/1624022243 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823519150 0 0) 0x7f85e4070990 con 0x7f85e4070520 2023-12-19T16:07:41.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.672+0000 7f85e93dc640 1 --2- 172.21.15.37:0/1624022243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e4071f20 0x7f85e406ffe0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009870 tx=0x7f85d402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403a7b8afe20de03 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:41.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.673+0000 7f85e8bdb640 1 -- 172.21.15.37:0/1624022243 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d402f840 con 0x7f85e4071f20 2023-12-19T16:07:41.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.673+0000 7f85e8bdb640 1 -- 172.21.15.37:0/1624022243 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d402f9a0 con 0x7f85e4071f20 2023-12-19T16:07:41.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.673+0000 7f85e8bdb640 1 -- 172.21.15.37:0/1624022243 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d402fd30 con 0x7f85e4071f20 2023-12-19T16:07:41.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.673+0000 7f85ebe41640 1 -- 172.21.15.37:0/1624022243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e4071f20 msgr2=0x7f85e406ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:41.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.673+0000 7f85ebe41640 1 --2- 172.21.15.37:0/1624022243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e4071f20 0x7f85e406ffe0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009870 tx=0x7f85d402ba20 comp rx=0 tx=0).stop 2023-12-19T16:07:41.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.673+0000 7f85ebe41640 1 -- 172.21.15.37:0/1624022243 shutdown_connections 2023-12-19T16:07:41.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.673+0000 7f85ebe41640 1 --2- 172.21.15.37:0/1624022243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e4071f20 0x7f85e406ffe0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:41.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.673+0000 7f85ebe41640 1 --2- 172.21.15.37:0/1624022243 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85e406ae20 0x7f85e406f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:41.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.673+0000 7f85ebe41640 1 -- 172.21.15.37:0/1624022243 >> 172.21.15.37:0/1624022243 conn(0x7f85e40b91b0 msgr2=0x7f85e40b95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:41.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.673+0000 7f85ebe41640 1 -- 172.21.15.37:0/1624022243 shutdown_connections 2023-12-19T16:07:41.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.673+0000 7f85ebe41640 1 -- 172.21.15.37:0/1624022243 wait complete. 2023-12-19T16:07:41.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.674+0000 7f85ebe41640 1 Processor -- start 2023-12-19T16:07:41.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.674+0000 7f85ebe41640 1 -- start start 2023-12-19T16:07:41.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.675+0000 7f85ebe41640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e406ae20 0x7f85e40ac910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:41.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.675+0000 7f85ebe41640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85e4070520 0x7f85e41e3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:41.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.675+0000 7f85ebe41640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85e4071f20 0x7f85e40af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:41.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.675+0000 7f85ebe41640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40af5e0 con 0x7f85e406ae20 2023-12-19T16:07:41.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.675+0000 7f85ebe41640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40af800 con 0x7f85e4070520 2023-12-19T16:07:41.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.675+0000 7f85ebe41640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e41e3490 con 0x7f85e4071f20 2023-12-19T16:07:41.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.675+0000 7f85e9bdd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e406ae20 0x7f85e40ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:41.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.675+0000 7f85e9bdd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e406ae20 0x7f85e40ac910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37690/0 (socket says 172.21.15.37:37690) 2023-12-19T16:07:41.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.675+0000 7f85e9bdd640 1 -- 172.21.15.37:0/4095465164 learned_addr learned my addr 172.21.15.37:0/4095465164 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:41.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.675+0000 7f85e93dc640 1 --2- 172.21.15.37:0/4095465164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85e4070520 0x7f85e41e3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:41.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.675+0000 7f85ea3de640 1 --2- 172.21.15.37:0/4095465164 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85e4071f20 0x7f85e40af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:41.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.676+0000 7f85e9bdd640 1 -- 172.21.15.37:0/4095465164 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85e4071f20 msgr2=0x7f85e40af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:41.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.676+0000 7f85e9bdd640 1 --2- 172.21.15.37:0/4095465164 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85e4071f20 0x7f85e40af0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:41.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.676+0000 7f85e9bdd640 1 -- 172.21.15.37:0/4095465164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85e4070520 msgr2=0x7f85e41e3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:41.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.676+0000 7f85e9bdd640 1 --2- 172.21.15.37:0/4095465164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85e4070520 0x7f85e41e3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:41.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.676+0000 7f85e9bdd640 1 -- 172.21.15.37:0/4095465164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d40094d0 con 0x7f85e406ae20 2023-12-19T16:07:41.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.676+0000 7f85e93dc640 1 --2- 172.21.15.37:0/4095465164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85e4070520 0x7f85e41e3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:41.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.676+0000 7f85ea3de640 1 --2- 172.21.15.37:0/4095465164 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85e4071f20 0x7f85e40af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:41.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.676+0000 7f85e9bdd640 1 --2- 172.21.15.37:0/4095465164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e406ae20 0x7f85e40ac910 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f85e000e9b0 tx=0x7f85e000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:41.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.676+0000 7f85da7fc640 1 -- 172.21.15.37:0/4095465164 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0009670 con 0x7f85e406ae20 2023-12-19T16:07:41.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.676+0000 7f85da7fc640 1 -- 172.21.15.37:0/4095465164 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e000c9a0 con 0x7f85e406ae20 2023-12-19T16:07:41.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.676+0000 7f85ebe41640 1 -- 172.21.15.37:0/4095465164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e41e2e80 con 0x7f85e406ae20 2023-12-19T16:07:41.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.676+0000 7f85da7fc640 1 -- 172.21.15.37:0/4095465164 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e000cd50 con 0x7f85e406ae20 2023-12-19T16:07:41.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.676+0000 7f85ebe41640 1 -- 172.21.15.37:0/4095465164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e4145000 con 0x7f85e406ae20 2023-12-19T16:07:41.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.677+0000 7f85ebe41640 1 -- 172.21.15.37:0/4095465164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e40740a0 con 0x7f85e406ae20 2023-12-19T16:07:41.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.677+0000 7f85da7fc640 1 -- 172.21.15.37:0/4095465164 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f85e0013470 con 0x7f85e406ae20 2023-12-19T16:07:41.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.678+0000 7f85da7fc640 1 --2- 172.21.15.37:0/4095465164 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f85c806a460 0x7f85c806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:41.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.678+0000 7f85da7fc640 1 -- 172.21.15.37:0/4095465164 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f85e0088d90 con 0x7f85e406ae20 2023-12-19T16:07:41.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.678+0000 7f85e93dc640 1 --2- 172.21.15.37:0/4095465164 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f85c806a460 0x7f85c806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:41.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.679+0000 7f85e93dc640 1 --2- 172.21.15.37:0/4095465164 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f85c806a460 0x7f85c806c920 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f85d4036000 tx=0x7f85d4039040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:41.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.682+0000 7f85da7fc640 1 -- 172.21.15.37:0/4095465164 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f85e0054470 con 0x7f85e406ae20 2023-12-19T16:07:41.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.895+0000 7f85ebe41640 1 -- 172.21.15.37:0/4095465164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f85e40bc130 con 0x7f85e406ae20 2023-12-19T16:07:41.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.901+0000 7f85da7fc640 1 -- 172.21.15.37:0/4095465164 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f85e0057a90 con 0x7f85e406ae20 2023-12-19T16:07:41.903 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 4 and data pool 5 2023-12-19T16:07:41.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.905+0000 7f85ebe41640 1 -- 172.21.15.37:0/4095465164 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f85c806a460 msgr2=0x7f85c806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:41.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.905+0000 7f85ebe41640 1 --2- 172.21.15.37:0/4095465164 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f85c806a460 0x7f85c806c920 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f85d4036000 tx=0x7f85d4039040 comp rx=0 tx=0).stop 2023-12-19T16:07:41.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.905+0000 7f85ebe41640 1 -- 172.21.15.37:0/4095465164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e406ae20 msgr2=0x7f85e40ac910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:41.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.905+0000 7f85ebe41640 1 --2- 172.21.15.37:0/4095465164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e406ae20 0x7f85e40ac910 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f85e000e9b0 tx=0x7f85e000ee70 comp rx=0 tx=0).stop 2023-12-19T16:07:41.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.909+0000 7f85ebe41640 1 -- 172.21.15.37:0/4095465164 shutdown_connections 2023-12-19T16:07:41.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.909+0000 7f85ebe41640 1 --2- 172.21.15.37:0/4095465164 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f85c806a460 0x7f85c806c920 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:41.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.909+0000 7f85ebe41640 1 --2- 172.21.15.37:0/4095465164 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f85e4071f20 0x7f85e40af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:41.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.909+0000 7f85ebe41640 1 --2- 172.21.15.37:0/4095465164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85e4070520 0x7f85e41e3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:41.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.909+0000 7f85ebe41640 1 --2- 172.21.15.37:0/4095465164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e406ae20 0x7f85e40ac910 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:41.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.909+0000 7f85ebe41640 1 -- 172.21.15.37:0/4095465164 >> 172.21.15.37:0/4095465164 conn(0x7f85e40b91b0 msgr2=0x7f85e40b9590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:41.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.910+0000 7f85ebe41640 1 -- 172.21.15.37:0/4095465164 shutdown_connections 2023-12-19T16:07:41.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:41.911+0000 7f85ebe41640 1 -- 172.21.15.37:0/4095465164 wait complete. 2023-12-19T16:07:41.934 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:07:42.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.037+0000 7f772925f640 1 Processor -- start 2023-12-19T16:07:42.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.037+0000 7f772925f640 1 -- start start 2023-12-19T16:07:42.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.037+0000 7f772925f640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77240b6690 0x7f7724144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:42.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.037+0000 7f772925f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77240bc6b0 con 0x7f7724144cd0 2023-12-19T16:07:42.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.037+0000 7f772925f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77240a59f0 con 0x7f77240bcdd0 2023-12-19T16:07:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.037+0000 7f772925f640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77240bc0a0 con 0x7f77240b6690 2023-12-19T16:07:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.037+0000 7f772359e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7724144cd0 0x7f7724155340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43300/0 (socket says 172.21.15.37:43300) 2023-12-19T16:07:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.037+0000 7f772359e640 1 -- 172.21.15.37:0/2156549418 learned_addr learned my addr 172.21.15.37:0/2156549418 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.038+0000 7f772259c640 1 --2- 172.21.15.37:0/2156549418 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77240b6690 0x7f7724144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.038+0000 7f7721d9b640 1 -- 172.21.15.37:0/2156549418 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096119598 0 0) 0x7f77240bc6b0 con 0x7f7724144cd0 2023-12-19T16:07:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.038+0000 7f7721d9b640 1 -- 172.21.15.37:0/2156549418 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7710003520 con 0x7f7724144cd0 2023-12-19T16:07:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.038+0000 7f7721d9b640 1 -- 172.21.15.37:0/2156549418 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288028920 0 0) 0x7f77240a59f0 con 0x7f77240bcdd0 2023-12-19T16:07:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.038+0000 7f7721d9b640 1 -- 172.21.15.37:0/2156549418 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77240bc6b0 con 0x7f77240bcdd0 2023-12-19T16:07:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.038+0000 7f7721d9b640 1 -- 172.21.15.37:0/2156549418 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 987533577 0 0) 0x7f7710003520 con 0x7f7724144cd0 2023-12-19T16:07:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.038+0000 7f772259c640 1 -- 172.21.15.37:0/2156549418 >> v1:172.21.15.78:6789/0 conn(0x7f77240bcdd0 legacy=0x7f77240b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.038+0000 7f772259c640 1 -- 172.21.15.37:0/2156549418 >> v1:172.21.15.37:6789/0 conn(0x7f7724144cd0 legacy=0x7f7724155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.038+0000 7f772259c640 1 -- 172.21.15.37:0/2156549418 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77240bc340 con 0x7f77240b6690 2023-12-19T16:07:42.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.039+0000 7f772259c640 1 --2- 172.21.15.37:0/2156549418 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77240b6690 0x7f7724144790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f770c0097d0 tx=0x7f770c02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b7f8509f3f15338 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:42.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.039+0000 7f7721d9b640 1 -- 172.21.15.37:0/2156549418 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77140019f0 con 0x7f77240b6690 2023-12-19T16:07:42.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.039+0000 7f7721d9b640 1 -- 172.21.15.37:0/2156549418 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c031580 con 0x7f77240b6690 2023-12-19T16:07:42.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.039+0000 7f7721d9b640 1 -- 172.21.15.37:0/2156549418 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0318f0 con 0x7f77240b6690 2023-12-19T16:07:42.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.039+0000 7f772925f640 1 -- 172.21.15.37:0/2156549418 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77240b6690 msgr2=0x7f7724144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:42.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.039+0000 7f772925f640 1 --2- 172.21.15.37:0/2156549418 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77240b6690 0x7f7724144790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f770c0097d0 tx=0x7f770c02b8a0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.040+0000 7f772925f640 1 -- 172.21.15.37:0/2156549418 shutdown_connections 2023-12-19T16:07:42.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.040+0000 7f772925f640 1 --2- 172.21.15.37:0/2156549418 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77240b6690 0x7f7724144790 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.040+0000 7f772925f640 1 -- 172.21.15.37:0/2156549418 >> 172.21.15.37:0/2156549418 conn(0x7f7724071e60 msgr2=0x7f77240c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:42.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.040+0000 7f772925f640 1 -- 172.21.15.37:0/2156549418 shutdown_connections 2023-12-19T16:07:42.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.040+0000 7f772925f640 1 -- 172.21.15.37:0/2156549418 wait complete. 2023-12-19T16:07:42.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.041+0000 7f772925f640 1 Processor -- start 2023-12-19T16:07:42.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.041+0000 7f772925f640 1 -- start start 2023-12-19T16:07:42.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f772925f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77240b6690 0x7f772413fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:42.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f772925f640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77240bcdd0 0x7f772413ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:42.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f772925f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7724144cd0 0x7f77240bf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:42.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f772925f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7724140130 con 0x7f77240b6690 2023-12-19T16:07:42.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f772925f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77241d3140 con 0x7f7724144cd0 2023-12-19T16:07:42.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f772925f640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77241d4480 con 0x7f77240bcdd0 2023-12-19T16:07:42.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f7722d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77240b6690 0x7f772413fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:42.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f7722d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77240b6690 0x7f772413fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37698/0 (socket says 172.21.15.37:37698) 2023-12-19T16:07:42.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f7722d9d640 1 -- 172.21.15.37:0/657539618 learned_addr learned my addr 172.21.15.37:0/657539618 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:42.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f772259c640 1 --2- 172.21.15.37:0/657539618 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77240bcdd0 0x7f772413ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:42.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f772359e640 1 --2- 172.21.15.37:0/657539618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7724144cd0 0x7f77240bf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:42.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f7722d9d640 1 -- 172.21.15.37:0/657539618 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77240bcdd0 msgr2=0x7f772413ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:42.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f7722d9d640 1 --2- 172.21.15.37:0/657539618 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77240bcdd0 0x7f772413ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f7722d9d640 1 -- 172.21.15.37:0/657539618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7724144cd0 msgr2=0x7f77240bf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:42.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f7722d9d640 1 --2- 172.21.15.37:0/657539618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7724144cd0 0x7f77240bf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f7722d9d640 1 -- 172.21.15.37:0/657539618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c009400 con 0x7f77240b6690 2023-12-19T16:07:42.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f7722d9d640 1 --2- 172.21.15.37:0/657539618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77240b6690 0x7f772413fbf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f771c00c490 tx=0x7f771c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:42.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f771b7fe640 1 -- 172.21.15.37:0/657539618 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c0052d0 con 0x7f77240b6690 2023-12-19T16:07:42.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f771b7fe640 1 -- 172.21.15.37:0/657539618 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771c005430 con 0x7f77240b6690 2023-12-19T16:07:42.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f772925f640 1 -- 172.21.15.37:0/657539618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77241d4670 con 0x7f77240b6690 2023-12-19T16:07:42.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f771b7fe640 1 -- 172.21.15.37:0/657539618 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c012870 con 0x7f77240b6690 2023-12-19T16:07:42.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.042+0000 7f772925f640 1 -- 172.21.15.37:0/657539618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77240bba50 con 0x7f77240b6690 2023-12-19T16:07:42.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.043+0000 7f772925f640 1 -- 172.21.15.37:0/657539618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77240b5480 con 0x7f77240b6690 2023-12-19T16:07:42.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.044+0000 7f771b7fe640 1 -- 172.21.15.37:0/657539618 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f771c0129d0 con 0x7f77240b6690 2023-12-19T16:07:42.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.044+0000 7f771b7fe640 1 --2- 172.21.15.37:0/657539618 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f770406a430 0x7f770406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:42.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.044+0000 7f771b7fe640 1 -- 172.21.15.37:0/657539618 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f771c088310 con 0x7f77240b6690 2023-12-19T16:07:42.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.044+0000 7f772259c640 1 --2- 172.21.15.37:0/657539618 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f770406a430 0x7f770406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:42.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.045+0000 7f772259c640 1 --2- 172.21.15.37:0/657539618 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f770406a430 0x7f770406c8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f770c036000 tx=0x7f770c03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:42.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.049+0000 7f771b7fe640 1 -- 172.21.15.37:0/657539618 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f771c053a40 con 0x7f77240b6690 2023-12-19T16:07:42.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.223+0000 7f772925f640 1 -- 172.21.15.37:0/657539618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f772404e840 con 0x7f77240b6690 2023-12-19T16:07:42.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.225+0000 7f771b7fe640 1 -- 172.21.15.37:0/657539618 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16066 (secure 0 0 0) 0x7f771c057060 con 0x7f77240b6690 2023-12-19T16:07:42.227 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:42.227 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:07:41.896885+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:07:39.626181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T16:07:40.871535+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:07:42.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.226+0000 7f772925f640 1 -- 172.21.15.37:0/657539618 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f770406a430 msgr2=0x7f770406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:42.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.226+0000 7f772925f640 1 --2- 172.21.15.37:0/657539618 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f770406a430 0x7f770406c8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f770c036000 tx=0x7f770c03d040 comp rx=0 tx=0).stop 2023-12-19T16:07:42.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.226+0000 7f772925f640 1 -- 172.21.15.37:0/657539618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77240b6690 msgr2=0x7f772413fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:42.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.226+0000 7f772925f640 1 --2- 172.21.15.37:0/657539618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77240b6690 0x7f772413fbf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f771c00c490 tx=0x7f771c00c950 comp rx=0 tx=0).stop 2023-12-19T16:07:42.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.227+0000 7f772925f640 1 -- 172.21.15.37:0/657539618 shutdown_connections 2023-12-19T16:07:42.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.227+0000 7f772925f640 1 --2- 172.21.15.37:0/657539618 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f770406a430 0x7f770406c8f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.227+0000 7f772925f640 1 --2- 172.21.15.37:0/657539618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7724144cd0 0x7f77240bf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.227+0000 7f772925f640 1 --2- 172.21.15.37:0/657539618 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77240bcdd0 0x7f772413ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.227+0000 7f772925f640 1 --2- 172.21.15.37:0/657539618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77240b6690 0x7f772413fbf0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.227+0000 7f772925f640 1 -- 172.21.15.37:0/657539618 >> 172.21.15.37:0/657539618 conn(0x7f7724071e60 msgr2=0x7f77241d50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:42.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.227+0000 7f772925f640 1 -- 172.21.15.37:0/657539618 shutdown_connections 2023-12-19T16:07:42.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.227+0000 7f772925f640 1 -- 172.21.15.37:0/657539618 wait complete. 2023-12-19T16:07:42.240 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:07:42.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.343+0000 7f5e6eae5640 1 Processor -- start 2023-12-19T16:07:42.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.344+0000 7f5e6eae5640 1 -- start start 2023-12-19T16:07:42.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.344+0000 7f5e6eae5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5e68144d60 0x7f5e6814aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:42.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.344+0000 7f5e6eae5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e6806ae00 0x7f5e680baa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:42.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.344+0000 7f5e6eae5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e68145140 con 0x7f5e680b9a60 2023-12-19T16:07:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.344+0000 7f5e6eae5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6806b320 con 0x7f5e6806ae00 2023-12-19T16:07:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.344+0000 7f5e6eae5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6806b600 con 0x7f5e68144d60 2023-12-19T16:07:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.344+0000 7f5e67fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e6806ae00 0x7f5e680baa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.344+0000 7f5e6d082640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5e680b9a60 0x7f5e68070d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43314/0 (socket says 172.21.15.37:43314) 2023-12-19T16:07:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.344+0000 7f5e67fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e6806ae00 0x7f5e680baa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37702/0 (socket says 172.21.15.37:37702) 2023-12-19T16:07:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.344+0000 7f5e6d082640 1 -- 172.21.15.37:0/75921660 learned_addr learned my addr 172.21.15.37:0/75921660 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.345+0000 7f5e6c881640 1 --2- 172.21.15.37:0/75921660 >> v2:172.21.15.78:3300/0 conn(0x7f5e68144d60 0x7f5e6814aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.345+0000 7f5e67fff640 1 -- 172.21.15.37:0/75921660 >> v2:172.21.15.78:3300/0 conn(0x7f5e68144d60 msgr2=0x7f5e6814aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.345+0000 7f5e67fff640 1 --2- 172.21.15.37:0/75921660 >> v2:172.21.15.78:3300/0 conn(0x7f5e68144d60 0x7f5e6814aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.345+0000 7f5e67fff640 1 -- 172.21.15.37:0/75921660 >> v1:172.21.15.37:6789/0 conn(0x7f5e680b9a60 legacy=0x7f5e68070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.345+0000 7f5e677fe640 1 -- 172.21.15.37:0/75921660 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093915256 0 0) 0x7f5e68145140 con 0x7f5e680b9a60 2023-12-19T16:07:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.345+0000 7f5e67fff640 1 -- 172.21.15.37:0/75921660 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e680b9260 con 0x7f5e6806ae00 2023-12-19T16:07:42.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.345+0000 7f5e67fff640 1 --2- 172.21.15.37:0/75921660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e6806ae00 0x7f5e680baa80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5e68071d40 tx=0x7f5e5802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35cb3f5e0e2e25a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:42.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.346+0000 7f5e677fe640 1 -- 172.21.15.37:0/75921660 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58030610 con 0x7f5e6806ae00 2023-12-19T16:07:42.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.346+0000 7f5e677fe640 1 -- 172.21.15.37:0/75921660 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e58030770 con 0x7f5e6806ae00 2023-12-19T16:07:42.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.346+0000 7f5e677fe640 1 -- 172.21.15.37:0/75921660 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58030b00 con 0x7f5e6806ae00 2023-12-19T16:07:42.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.346+0000 7f5e6eae5640 1 -- 172.21.15.37:0/75921660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e6806ae00 msgr2=0x7f5e680baa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:42.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.346+0000 7f5e6eae5640 1 --2- 172.21.15.37:0/75921660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e6806ae00 0x7f5e680baa80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5e68071d40 tx=0x7f5e5802b960 comp rx=0 tx=0).stop 2023-12-19T16:07:42.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.346+0000 7f5e6eae5640 1 -- 172.21.15.37:0/75921660 shutdown_connections 2023-12-19T16:07:42.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.346+0000 7f5e6eae5640 1 --2- 172.21.15.37:0/75921660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e6806ae00 0x7f5e680baa80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.346+0000 7f5e6eae5640 1 --2- 172.21.15.37:0/75921660 >> v2:172.21.15.78:3300/0 conn(0x7f5e68144d60 0x7f5e6814aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.346+0000 7f5e6eae5640 1 -- 172.21.15.37:0/75921660 >> 172.21.15.37:0/75921660 conn(0x7f5e68069ba0 msgr2=0x7f5e68069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:42.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.346+0000 7f5e6eae5640 1 -- 172.21.15.37:0/75921660 shutdown_connections 2023-12-19T16:07:42.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.346+0000 7f5e6eae5640 1 -- 172.21.15.37:0/75921660 wait complete. 2023-12-19T16:07:42.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.347+0000 7f5e6eae5640 1 Processor -- start 2023-12-19T16:07:42.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.347+0000 7f5e6eae5640 1 -- start start 2023-12-19T16:07:42.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.348+0000 7f5e6eae5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6806ae00 0x7f5e6814a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:42.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.348+0000 7f5e6eae5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e680b9a60 0x7f5e681e3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:42.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.348+0000 7f5e6eae5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5e68144d60 0x7f5e680b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:42.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.348+0000 7f5e6eae5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6814a5f0 con 0x7f5e680b9a60 2023-12-19T16:07:42.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.348+0000 7f5e6eae5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e68145370 con 0x7f5e6806ae00 2023-12-19T16:07:42.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.348+0000 7f5e6eae5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6813f120 con 0x7f5e68144d60 2023-12-19T16:07:42.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.348+0000 7f5e67fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e680b9a60 0x7f5e681e3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:42.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.348+0000 7f5e67fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e680b9a60 0x7f5e681e3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37706/0 (socket says 172.21.15.37:37706) 2023-12-19T16:07:42.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.348+0000 7f5e67fff640 1 -- 172.21.15.37:0/1787242922 learned_addr learned my addr 172.21.15.37:0/1787242922 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:42.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.348+0000 7f5e6c881640 1 --2- 172.21.15.37:0/1787242922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6806ae00 0x7f5e6814a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:42.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.348+0000 7f5e6d082640 1 --2- 172.21.15.37:0/1787242922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5e68144d60 0x7f5e680b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:42.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.348+0000 7f5e67fff640 1 -- 172.21.15.37:0/1787242922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5e68144d60 msgr2=0x7f5e680b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:42.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.348+0000 7f5e67fff640 1 --2- 172.21.15.37:0/1787242922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5e68144d60 0x7f5e680b63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.348+0000 7f5e67fff640 1 -- 172.21.15.37:0/1787242922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6806ae00 msgr2=0x7f5e6814a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:42.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.348+0000 7f5e67fff640 1 --2- 172.21.15.37:0/1787242922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6806ae00 0x7f5e6814a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.348+0000 7f5e67fff640 1 -- 172.21.15.37:0/1787242922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e58009400 con 0x7f5e680b9a60 2023-12-19T16:07:42.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.348+0000 7f5e6c881640 1 --2- 172.21.15.37:0/1787242922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6806ae00 0x7f5e6814a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:42.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.349+0000 7f5e67fff640 1 --2- 172.21.15.37:0/1787242922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e680b9a60 0x7f5e681e3520 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009890 tx=0x7f5e580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:42.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.349+0000 7f5e657fa640 1 -- 172.21.15.37:0/1787242922 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58039c90 con 0x7f5e680b9a60 2023-12-19T16:07:42.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.349+0000 7f5e657fa640 1 -- 172.21.15.37:0/1787242922 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5803f040 con 0x7f5e680b9a60 2023-12-19T16:07:42.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.349+0000 7f5e6eae5640 1 -- 172.21.15.37:0/1787242922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e68140900 con 0x7f5e680b9a60 2023-12-19T16:07:42.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.349+0000 7f5e657fa640 1 -- 172.21.15.37:0/1787242922 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58004270 con 0x7f5e680b9a60 2023-12-19T16:07:42.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.349+0000 7f5e6eae5640 1 -- 172.21.15.37:0/1787242922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e68140e80 con 0x7f5e680b9a60 2023-12-19T16:07:42.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.350+0000 7f5e6eae5640 1 -- 172.21.15.37:0/1787242922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e681410a0 con 0x7f5e680b9a60 2023-12-19T16:07:42.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.350+0000 7f5e657fa640 1 -- 172.21.15.37:0/1787242922 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5e580043d0 con 0x7f5e680b9a60 2023-12-19T16:07:42.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.351+0000 7f5e657fa640 1 --2- 172.21.15.37:0/1787242922 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5e4806a430 0x7f5e4806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:42.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.351+0000 7f5e657fa640 1 -- 172.21.15.37:0/1787242922 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e580aa8b0 con 0x7f5e680b9a60 2023-12-19T16:07:42.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.351+0000 7f5e6c881640 1 --2- 172.21.15.37:0/1787242922 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5e4806a430 0x7f5e4806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:42.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.351+0000 7f5e6c881640 1 --2- 172.21.15.37:0/1787242922 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5e4806a430 0x7f5e4806c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009fd0 tx=0x7f5e6000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:42.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.355+0000 7f5e657fa640 1 -- 172.21.15.37:0/1787242922 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5e58075fc0 con 0x7f5e680b9a60 2023-12-19T16:07:42.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.534+0000 7f5e6eae5640 1 -- 172.21.15.37:0/1787242922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e6804e840 con 0x7f5e680b9a60 2023-12-19T16:07:42.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.535+0000 7f5e657fa640 1 -- 172.21.15.37:0/1787242922 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16066 (secure 0 0 0) 0x7f5e58048090 con 0x7f5e680b9a60 2023-12-19T16:07:42.538 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:42.538 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:07:41.896885+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:07:39.626181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T16:07:40.871535+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:07:42.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.538+0000 7f5e6eae5640 1 -- 172.21.15.37:0/1787242922 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5e4806a430 msgr2=0x7f5e4806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:42.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.538+0000 7f5e6eae5640 1 --2- 172.21.15.37:0/1787242922 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5e4806a430 0x7f5e4806c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009fd0 tx=0x7f5e6000b040 comp rx=0 tx=0).stop 2023-12-19T16:07:42.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.538+0000 7f5e6eae5640 1 -- 172.21.15.37:0/1787242922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e680b9a60 msgr2=0x7f5e681e3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:42.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.538+0000 7f5e6eae5640 1 --2- 172.21.15.37:0/1787242922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e680b9a60 0x7f5e681e3520 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009890 tx=0x7f5e580046c0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.538+0000 7f5e6eae5640 1 -- 172.21.15.37:0/1787242922 shutdown_connections 2023-12-19T16:07:42.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.538+0000 7f5e6eae5640 1 --2- 172.21.15.37:0/1787242922 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f5e4806a430 0x7f5e4806c8f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.538+0000 7f5e6eae5640 1 --2- 172.21.15.37:0/1787242922 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5e68144d60 0x7f5e680b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.538+0000 7f5e6eae5640 1 --2- 172.21.15.37:0/1787242922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e680b9a60 0x7f5e681e3520 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.538+0000 7f5e6eae5640 1 --2- 172.21.15.37:0/1787242922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6806ae00 0x7f5e6814a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.538+0000 7f5e6eae5640 1 -- 172.21.15.37:0/1787242922 >> 172.21.15.37:0/1787242922 conn(0x7f5e68069ba0 msgr2=0x7f5e68069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:42.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.538+0000 7f5e6eae5640 1 -- 172.21.15.37:0/1787242922 shutdown_connections 2023-12-19T16:07:42.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.538+0000 7f5e6eae5640 1 -- 172.21.15.37:0/1787242922 wait complete. 2023-12-19T16:07:42.551 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T16:07:42.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.658+0000 7fa621807640 1 Processor -- start 2023-12-19T16:07:42.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.658+0000 7fa621807640 1 -- start start 2023-12-19T16:07:42.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.659+0000 7fa621807640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa61c0bb140 0x7fa61c0be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:42.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.659+0000 7fa621807640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa61c0bf510 0x7fa61c0bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:42.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.659+0000 7fa621807640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61c0bfa50 con 0x7fa61c06a950 2023-12-19T16:07:42.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.659+0000 7fa621807640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61c0bbda0 con 0x7fa61c0bf510 2023-12-19T16:07:42.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.659+0000 7fa621807640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c06b040 con 0x7fa61c0bb140 2023-12-19T16:07:42.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.659+0000 7fa61b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa61c0bf510 0x7fa61c0bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:42.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.659+0000 7fa61b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa61c0bf510 0x7fa61c0bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37708/0 (socket says 172.21.15.37:37708) 2023-12-19T16:07:42.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.659+0000 7fa61a7fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa61c06a950 0x7fa61c0bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43322/0 (socket says 172.21.15.37:43322) 2023-12-19T16:07:42.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.659+0000 7fa61b7fe640 1 -- 172.21.15.37:0/1198743274 learned_addr learned my addr 172.21.15.37:0/1198743274 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:42.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.659+0000 7fa61affd640 1 --2- 172.21.15.37:0/1198743274 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa61c0bb140 0x7fa61c0be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:42.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.659+0000 7fa61b7fe640 1 -- 172.21.15.37:0/1198743274 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa61c0bb140 msgr2=0x7fa61c0be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:42.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.659+0000 7fa61b7fe640 1 --2- 172.21.15.37:0/1198743274 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa61c0bb140 0x7fa61c0be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.659+0000 7fa61b7fe640 1 -- 172.21.15.37:0/1198743274 >> v1:172.21.15.37:6789/0 conn(0x7fa61c06a950 legacy=0x7fa61c0bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:42.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.659+0000 7fa61b7fe640 1 -- 172.21.15.37:0/1198743274 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c0bb520 con 0x7fa61c0bf510 2023-12-19T16:07:42.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.659+0000 7fa619ffb640 1 -- 172.21.15.37:0/1198743274 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270400142 0 0) 0x7fa61c0bfa50 con 0x7fa61c06a950 2023-12-19T16:07:42.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.659+0000 7fa61affd640 1 --2- 172.21.15.37:0/1198743274 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa61c0bb140 0x7fa61c0be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:42.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.660+0000 7fa61b7fe640 1 --2- 172.21.15.37:0/1198743274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa61c0bf510 0x7fa61c0bfee0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009e50 tx=0x7fa60c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac562ba6e941d13d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:42.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.660+0000 7fa619ffb640 1 -- 172.21.15.37:0/1198743274 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c02ca70 con 0x7fa61c0bf510 2023-12-19T16:07:42.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.660+0000 7fa619ffb640 1 -- 172.21.15.37:0/1198743274 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60c02cbd0 con 0x7fa61c0bf510 2023-12-19T16:07:42.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.660+0000 7fa619ffb640 1 -- 172.21.15.37:0/1198743274 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c0343f0 con 0x7fa61c0bf510 2023-12-19T16:07:42.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.660+0000 7fa621807640 1 -- 172.21.15.37:0/1198743274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa61c0bf510 msgr2=0x7fa61c0bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:42.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.660+0000 7fa621807640 1 --2- 172.21.15.37:0/1198743274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa61c0bf510 0x7fa61c0bfee0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009e50 tx=0x7fa60c02bed0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.661+0000 7fa621807640 1 -- 172.21.15.37:0/1198743274 shutdown_connections 2023-12-19T16:07:42.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.661+0000 7fa621807640 1 --2- 172.21.15.37:0/1198743274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa61c0bf510 0x7fa61c0bfee0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.661+0000 7fa621807640 1 --2- 172.21.15.37:0/1198743274 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa61c0bb140 0x7fa61c0be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.661+0000 7fa621807640 1 -- 172.21.15.37:0/1198743274 >> 172.21.15.37:0/1198743274 conn(0x7fa61c0bcfd0 msgr2=0x7fa61c0bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:42.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.661+0000 7fa621807640 1 -- 172.21.15.37:0/1198743274 shutdown_connections 2023-12-19T16:07:42.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.661+0000 7fa621807640 1 -- 172.21.15.37:0/1198743274 wait complete. 2023-12-19T16:07:42.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.662+0000 7fa621807640 1 Processor -- start 2023-12-19T16:07:42.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.662+0000 7fa621807640 1 -- start start 2023-12-19T16:07:42.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.662+0000 7fa621807640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa61c06a950 0x7fa61c14cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:42.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa621807640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa61c0bb140 0x7fa61c1443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:42.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa621807640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c0bf510 0x7fa61c144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:42.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa621807640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c14d480 con 0x7fa61c06a950 2023-12-19T16:07:42.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa621807640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c147f00 con 0x7fa61c0bf510 2023-12-19T16:07:42.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa621807640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c14f080 con 0x7fa61c0bb140 2023-12-19T16:07:42.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa61affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa61c06a950 0x7fa61c14cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:42.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa61affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa61c06a950 0x7fa61c14cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37724/0 (socket says 172.21.15.37:37724) 2023-12-19T16:07:42.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa61affd640 1 -- 172.21.15.37:0/2580039452 learned_addr learned my addr 172.21.15.37:0/2580039452 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:42.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa61a7fc640 1 --2- 172.21.15.37:0/2580039452 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa61c0bb140 0x7fa61c1443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:42.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa61b7fe640 1 --2- 172.21.15.37:0/2580039452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c0bf510 0x7fa61c144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:42.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa61affd640 1 -- 172.21.15.37:0/2580039452 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa61c0bb140 msgr2=0x7fa61c1443e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:42.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa61affd640 1 --2- 172.21.15.37:0/2580039452 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa61c0bb140 0x7fa61c1443e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa61affd640 1 -- 172.21.15.37:0/2580039452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c0bf510 msgr2=0x7fa61c144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:42.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa61affd640 1 --2- 172.21.15.37:0/2580039452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c0bf510 0x7fa61c144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa61affd640 1 -- 172.21.15.37:0/2580039452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c009b30 con 0x7fa61c06a950 2023-12-19T16:07:42.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa61affd640 1 --2- 172.21.15.37:0/2580039452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa61c06a950 0x7fa61c14cf40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa61400d7d0 tx=0x7fa61400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:42.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa613fff640 1 -- 172.21.15.37:0/2580039452 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614004030 con 0x7fa61c06a950 2023-12-19T16:07:42.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa613fff640 1 -- 172.21.15.37:0/2580039452 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa614004190 con 0x7fa61c06a950 2023-12-19T16:07:42.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa621807640 1 -- 172.21.15.37:0/2580039452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61c147420 con 0x7fa61c06a950 2023-12-19T16:07:42.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa613fff640 1 -- 172.21.15.37:0/2580039452 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614004520 con 0x7fa61c06a950 2023-12-19T16:07:42.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.663+0000 7fa621807640 1 -- 172.21.15.37:0/2580039452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61c1479e0 con 0x7fa61c06a950 2023-12-19T16:07:42.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.664+0000 7fa621807640 1 -- 172.21.15.37:0/2580039452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61c0740a0 con 0x7fa61c06a950 2023-12-19T16:07:42.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.665+0000 7fa613fff640 1 -- 172.21.15.37:0/2580039452 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa6140096a0 con 0x7fa61c06a950 2023-12-19T16:07:42.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.665+0000 7fa613fff640 1 --2- 172.21.15.37:0/2580039452 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa5fc06a430 0x7fa5fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:42.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.665+0000 7fa613fff640 1 -- 172.21.15.37:0/2580039452 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa614088970 con 0x7fa61c06a950 2023-12-19T16:07:42.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.666+0000 7fa61a7fc640 1 --2- 172.21.15.37:0/2580039452 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa5fc06a430 0x7fa5fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:42.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.666+0000 7fa61a7fc640 1 --2- 172.21.15.37:0/2580039452 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa5fc06a430 0x7fa5fc06c8f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa61c14ca80 tx=0x7fa604007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:42.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.669+0000 7fa613fff640 1 -- 172.21.15.37:0/2580039452 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa614054000 con 0x7fa61c06a950 2023-12-19T16:07:42.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.882+0000 7fa621807640 1 -- 172.21.15.37:0/2580039452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa61c14cab0 con 0x7fa61c06a950 2023-12-19T16:07:42.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.901+0000 7fa613fff640 1 -- 172.21.15.37:0/2580039452 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa614057620 con 0x7fa61c06a950 2023-12-19T16:07:42.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.902+0000 7fa621807640 1 -- 172.21.15.37:0/2580039452 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa5fc06a430 msgr2=0x7fa5fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:42.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.902+0000 7fa621807640 1 --2- 172.21.15.37:0/2580039452 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa5fc06a430 0x7fa5fc06c8f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa61c14ca80 tx=0x7fa604007de0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.903+0000 7fa621807640 1 -- 172.21.15.37:0/2580039452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa61c06a950 msgr2=0x7fa61c14cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:42.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.903+0000 7fa621807640 1 --2- 172.21.15.37:0/2580039452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa61c06a950 0x7fa61c14cf40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa61400d7d0 tx=0x7fa61400dc90 comp rx=0 tx=0).stop 2023-12-19T16:07:42.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.903+0000 7fa621807640 1 -- 172.21.15.37:0/2580039452 shutdown_connections 2023-12-19T16:07:42.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.903+0000 7fa621807640 1 --2- 172.21.15.37:0/2580039452 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa5fc06a430 0x7fa5fc06c8f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.903+0000 7fa621807640 1 --2- 172.21.15.37:0/2580039452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa61c0bf510 0x7fa61c144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.903+0000 7fa621807640 1 --2- 172.21.15.37:0/2580039452 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa61c0bb140 0x7fa61c1443e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.903+0000 7fa621807640 1 --2- 172.21.15.37:0/2580039452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa61c06a950 0x7fa61c14cf40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:42.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.903+0000 7fa621807640 1 -- 172.21.15.37:0/2580039452 >> 172.21.15.37:0/2580039452 conn(0x7fa61c0bcfd0 msgr2=0x7fa61c0a44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:42.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.903+0000 7fa621807640 1 -- 172.21.15.37:0/2580039452 shutdown_connections 2023-12-19T16:07:42.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:42.903+0000 7fa621807640 1 -- 172.21.15.37:0/2580039452 wait complete. 2023-12-19T16:07:42.917 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T16:07:42.918 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T16:07:43.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.024+0000 7fceb9621640 1 Processor -- start 2023-12-19T16:07:43.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.024+0000 7fceb9621640 1 -- start start 2023-12-19T16:07:43.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb9621640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fceb40bf510 0x7fceb40be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:43.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb9621640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb40bfa50 con 0x7fceb40bb140 2023-12-19T16:07:43.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb9621640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb406b040 con 0x7fceb406a950 2023-12-19T16:07:43.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb9621640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb40bbda0 con 0x7fceb40bf510 2023-12-19T16:07:43.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb2ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fceb40bb140 0x7fceb40bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43334/0 (socket says 172.21.15.37:43334) 2023-12-19T16:07:43.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb2ffd640 1 -- 172.21.15.37:0/1163700351 learned_addr learned my addr 172.21.15.37:0/1163700351 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:43.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb27fc640 1 -- 172.21.15.37:0/1163700351 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663197122 0 0) 0x7fceb40bfa50 con 0x7fceb40bb140 2023-12-19T16:07:43.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb27fc640 1 -- 172.21.15.37:0/1163700351 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcea0003520 con 0x7fceb40bb140 2023-12-19T16:07:43.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceabfff640 1 --2- 172.21.15.37:0/1163700351 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fceb40bf510 0x7fceb40be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:43.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb27fc640 1 -- 172.21.15.37:0/1163700351 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3644752135 0 0) 0x7fcea0003520 con 0x7fceb40bb140 2023-12-19T16:07:43.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb27fc640 1 -- 172.21.15.37:0/1163700351 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fceb40bf510 msgr2=0x7fceb40be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:43.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb27fc640 1 --2- 172.21.15.37:0/1163700351 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fceb40bf510 0x7fceb40be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:43.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb27fc640 1 -- 172.21.15.37:0/1163700351 >> v1:172.21.15.78:6789/0 conn(0x7fceb406a950 legacy=0x7fceb4155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:43.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb27fc640 1 -- 172.21.15.37:0/1163700351 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb40bb520 con 0x7fceb40bb140 2023-12-19T16:07:43.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb27fc640 1 -- 172.21.15.37:0/1163700351 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7fcea4001670 con 0x7fceb40bb140 2023-12-19T16:07:43.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb27fc640 1 -- 172.21.15.37:0/1163700351 >> v1:172.21.15.37:6789/0 conn(0x7fceb40bb140 legacy=0x7fceb40bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:43.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb27fc640 1 --2- 172.21.15.37:0/1163700351 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fceb40bf510 0x7fcea00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:43.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb27fc640 1 --2- 172.21.15.37:0/1163700351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea0003fd0 0x7fcea00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:43.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb27fc640 1 --2- 172.21.15.37:0/1163700351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcea0004d00 0x7fcea0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:43.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb27fc640 1 -- 172.21.15.37:0/1163700351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea000bb10 con 0x7fcea0003fd0 2023-12-19T16:07:43.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb27fc640 1 -- 172.21.15.37:0/1163700351 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea000bc80 con 0x7fcea0004d00 2023-12-19T16:07:43.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.025+0000 7fceb27fc640 1 -- 172.21.15.37:0/1163700351 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea000be40 con 0x7fceb40bf510 2023-12-19T16:07:43.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.026+0000 7fceabfff640 1 --2- 172.21.15.37:0/1163700351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea0003fd0 0x7fcea00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:43.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.026+0000 7fceb2ffd640 1 --2- 172.21.15.37:0/1163700351 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fceb40bf510 0x7fcea00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:43.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.026+0000 7fceb37fe640 1 --2- 172.21.15.37:0/1163700351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcea0004d00 0x7fcea0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:43.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.026+0000 7fceabfff640 1 -- 172.21.15.37:0/1163700351 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fceb40bf510 msgr2=0x7fcea00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:43.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.026+0000 7fceabfff640 1 --2- 172.21.15.37:0/1163700351 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fceb40bf510 0x7fcea00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:43.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.026+0000 7fceabfff640 1 -- 172.21.15.37:0/1163700351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcea0004d00 msgr2=0x7fcea0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:43.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.026+0000 7fceabfff640 1 --2- 172.21.15.37:0/1163700351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcea0004d00 0x7fcea0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:43.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.026+0000 7fceabfff640 1 -- 172.21.15.37:0/1163700351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea0003520 con 0x7fcea0003fd0 2023-12-19T16:07:43.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.027+0000 7fceabfff640 1 --2- 172.21.15.37:0/1163700351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea0003fd0 0x7fcea00047c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fceb406bb10 tx=0x7fcea00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe634014527eda80 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:43.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.027+0000 7fceb27fc640 1 -- 172.21.15.37:0/1163700351 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c0325f0 con 0x7fcea0003fd0 2023-12-19T16:07:43.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.027+0000 7fceb27fc640 1 -- 172.21.15.37:0/1163700351 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c032750 con 0x7fcea0003fd0 2023-12-19T16:07:43.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.027+0000 7fceb27fc640 1 -- 172.21.15.37:0/1163700351 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c032ae0 con 0x7fcea0003fd0 2023-12-19T16:07:43.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.027+0000 7fceb9621640 1 -- 172.21.15.37:0/1163700351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea0003fd0 msgr2=0x7fcea00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:43.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.027+0000 7fceb9621640 1 --2- 172.21.15.37:0/1163700351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea0003fd0 0x7fcea00047c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fceb406bb10 tx=0x7fcea00057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:43.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.027+0000 7fceb37fe640 1 -- 172.21.15.37:0/1163700351 reap_dead start 2023-12-19T16:07:43.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.027+0000 7fceb9621640 1 -- 172.21.15.37:0/1163700351 shutdown_connections 2023-12-19T16:07:43.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.027+0000 7fceb9621640 1 -- 172.21.15.37:0/1163700351 >> 172.21.15.37:0/1163700351 conn(0x7fceb40bcfd0 msgr2=0x7fceb40bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:43.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.027+0000 7fceb9621640 1 -- 172.21.15.37:0/1163700351 shutdown_connections 2023-12-19T16:07:43.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.027+0000 7fceb9621640 1 -- 172.21.15.37:0/1163700351 wait complete. 2023-12-19T16:07:43.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.028+0000 7fceb9621640 1 Processor -- start 2023-12-19T16:07:43.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.028+0000 7fceb9621640 1 -- start start 2023-12-19T16:07:43.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.029+0000 7fceb9621640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea0003fd0 0x7fceb4143b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:43.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.029+0000 7fceb9621640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fceb40a2460 0x7fceb4146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:43.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.029+0000 7fceb9621640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fceb40b2fc0 0x7fceb40b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:43.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.029+0000 7fceb9621640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb40b3980 con 0x7fcea0003fd0 2023-12-19T16:07:43.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.029+0000 7fceb9621640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb41449e0 con 0x7fceb40b2fc0 2023-12-19T16:07:43.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.029+0000 7fceb9621640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb4144cc0 con 0x7fceb40a2460 2023-12-19T16:07:43.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.029+0000 7fceb2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea0003fd0 0x7fceb4143b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:43.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.029+0000 7fceb2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea0003fd0 0x7fceb4143b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37736/0 (socket says 172.21.15.37:37736) 2023-12-19T16:07:43.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.029+0000 7fceb2ffd640 1 -- 172.21.15.37:0/1788765993 learned_addr learned my addr 172.21.15.37:0/1788765993 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:43.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.029+0000 7fceb37fe640 1 --2- 172.21.15.37:0/1788765993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fceb40b2fc0 0x7fceb40b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:43.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.029+0000 7fceabfff640 1 --2- 172.21.15.37:0/1788765993 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fceb40a2460 0x7fceb4146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:43.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.029+0000 7fceb2ffd640 1 -- 172.21.15.37:0/1788765993 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fceb40a2460 msgr2=0x7fceb4146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:43.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.029+0000 7fceb2ffd640 1 --2- 172.21.15.37:0/1788765993 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fceb40a2460 0x7fceb4146e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:43.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.029+0000 7fceb2ffd640 1 -- 172.21.15.37:0/1788765993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fceb40b2fc0 msgr2=0x7fceb40b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:43.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.029+0000 7fceb2ffd640 1 --2- 172.21.15.37:0/1788765993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fceb40b2fc0 0x7fceb40b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:43.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.029+0000 7fceb2ffd640 1 -- 172.21.15.37:0/1788765993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb40b72c0 con 0x7fcea0003fd0 2023-12-19T16:07:43.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.029+0000 7fceb37fe640 1 --2- 172.21.15.37:0/1788765993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fceb40b2fc0 0x7fceb40b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:43.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.030+0000 7fceb2ffd640 1 --2- 172.21.15.37:0/1788765993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea0003fd0 0x7fceb4143b60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcea40072c0 tx=0x7fcea4007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:43.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.030+0000 7fceab7fe640 1 -- 172.21.15.37:0/1788765993 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea400f960 con 0x7fcea0003fd0 2023-12-19T16:07:43.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.030+0000 7fceab7fe640 1 -- 172.21.15.37:0/1788765993 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea400fac0 con 0x7fcea0003fd0 2023-12-19T16:07:43.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.030+0000 7fceb9621640 1 -- 172.21.15.37:0/1788765993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb4144600 con 0x7fcea0003fd0 2023-12-19T16:07:43.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.030+0000 7fceab7fe640 1 -- 172.21.15.37:0/1788765993 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea400fe70 con 0x7fcea0003fd0 2023-12-19T16:07:43.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.030+0000 7fceb9621640 1 -- 172.21.15.37:0/1788765993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb41e36c0 con 0x7fcea0003fd0 2023-12-19T16:07:43.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.031+0000 7fceb9621640 1 -- 172.21.15.37:0/1788765993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb4144b20 con 0x7fcea0003fd0 2023-12-19T16:07:43.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.031+0000 7fceab7fe640 1 -- 172.21.15.37:0/1788765993 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcea401d460 con 0x7fcea0003fd0 2023-12-19T16:07:43.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.032+0000 7fceab7fe640 1 --2- 172.21.15.37:0/1788765993 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fce9406a430 0x7fce9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:43.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.032+0000 7fceab7fe640 1 -- 172.21.15.37:0/1788765993 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcea4088a70 con 0x7fcea0003fd0 2023-12-19T16:07:43.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.032+0000 7fceabfff640 1 --2- 172.21.15.37:0/1788765993 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fce9406a430 0x7fce9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:43.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.032+0000 7fceabfff640 1 --2- 172.21.15.37:0/1788765993 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fce9406a430 0x7fce9406c8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fceb40bf8f0 tx=0x7fce9c03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:43.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.036+0000 7fceab7fe640 1 -- 172.21.15.37:0/1788765993 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fceb4144b20 con 0x7fcea0003fd0 2023-12-19T16:07:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.248+0000 7fceb9621640 1 -- 172.21.15.37:0/1788765993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fceb4144b20 con 0x7fcea0003fd0 2023-12-19T16:07:43.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.908+0000 7fceab7fe640 1 -- 172.21.15.37:0/1788765993 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7fceb4144b20 con 0x7fcea0003fd0 2023-12-19T16:07:43.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.911+0000 7fceb9621640 1 -- 172.21.15.37:0/1788765993 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fce9406a430 msgr2=0x7fce9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:43.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.911+0000 7fceb9621640 1 --2- 172.21.15.37:0/1788765993 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fce9406a430 0x7fce9406c8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fceb40bf8f0 tx=0x7fce9c03d040 comp rx=0 tx=0).stop 2023-12-19T16:07:43.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.911+0000 7fceb9621640 1 -- 172.21.15.37:0/1788765993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea0003fd0 msgr2=0x7fceb4143b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:43.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.911+0000 7fceb9621640 1 --2- 172.21.15.37:0/1788765993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea0003fd0 0x7fceb4143b60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcea40072c0 tx=0x7fcea4007780 comp rx=0 tx=0).stop 2023-12-19T16:07:43.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.911+0000 7fceb9621640 1 -- 172.21.15.37:0/1788765993 shutdown_connections 2023-12-19T16:07:43.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.911+0000 7fceb9621640 1 --2- 172.21.15.37:0/1788765993 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fce9406a430 0x7fce9406c8f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:43.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.911+0000 7fceb9621640 1 --2- 172.21.15.37:0/1788765993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fceb40b2fc0 0x7fceb40b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:43.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.911+0000 7fceb9621640 1 --2- 172.21.15.37:0/1788765993 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fceb40a2460 0x7fceb4146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:43.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.911+0000 7fceb9621640 1 --2- 172.21.15.37:0/1788765993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea0003fd0 0x7fceb4143b60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:43.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.911+0000 7fceb9621640 1 -- 172.21.15.37:0/1788765993 >> 172.21.15.37:0/1788765993 conn(0x7fceb40bcfd0 msgr2=0x7fceb40a36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:43.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.911+0000 7fceb9621640 1 -- 172.21.15.37:0/1788765993 shutdown_connections 2023-12-19T16:07:43.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:43.911+0000 7fceb9621640 1 -- 172.21.15.37:0/1788765993 wait complete. 2023-12-19T16:07:43.926 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T16:07:43.926 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:07:44.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.036+0000 7f3ddf7d2640 1 Processor -- start 2023-12-19T16:07:44.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.036+0000 7f3ddf7d2640 1 -- start start 2023-12-19T16:07:44.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.037+0000 7f3ddf7d2640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3dd8070830 0x7f3dd8141620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.037+0000 7f3ddf7d2640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dd8141b60 0x7f3dd8152020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.037+0000 7f3ddf7d2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd81477b0 con 0x7f3dd806a120 2023-12-19T16:07:44.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.037+0000 7f3ddf7d2640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd8148650 con 0x7f3dd8070830 2023-12-19T16:07:44.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.037+0000 7f3ddf7d2640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd8071320 con 0x7f3dd8141b60 2023-12-19T16:07:44.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.037+0000 7f3ddd56e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3dd806a120 0x7f3dd8147f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43350/0 (socket says 172.21.15.37:43350) 2023-12-19T16:07:44.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.037+0000 7f3ddd56e640 1 -- 172.21.15.37:0/2505428267 learned_addr learned my addr 172.21.15.37:0/2505428267 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:44.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.037+0000 7f3ddcd6d640 1 --2- 172.21.15.37:0/2505428267 >> v2:172.21.15.78:3300/0 conn(0x7f3dd8070830 0x7f3dd8141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.037+0000 7f3dddd6f640 1 --2- 172.21.15.37:0/2505428267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dd8141b60 0x7f3dd8152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.037+0000 7f3dcffff640 1 -- 172.21.15.37:0/2505428267 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640596441 0 0) 0x7f3dd81477b0 con 0x7f3dd806a120 2023-12-19T16:07:44.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.037+0000 7f3dcffff640 1 -- 172.21.15.37:0/2505428267 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dc4003520 con 0x7f3dd806a120 2023-12-19T16:07:44.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.037+0000 7f3dcffff640 1 -- 172.21.15.37:0/2505428267 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1836249716 0 0) 0x7f3dc4003520 con 0x7f3dd806a120 2023-12-19T16:07:44.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.037+0000 7f3dcffff640 1 -- 172.21.15.37:0/2505428267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dd8141b60 msgr2=0x7f3dd8152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:44.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.037+0000 7f3dcffff640 1 --2- 172.21.15.37:0/2505428267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dd8141b60 0x7f3dd8152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.037+0000 7f3dcffff640 1 -- 172.21.15.37:0/2505428267 >> v2:172.21.15.78:3300/0 conn(0x7f3dd8070830 msgr2=0x7f3dd8141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:44.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.037+0000 7f3dcffff640 1 --2- 172.21.15.37:0/2505428267 >> v2:172.21.15.78:3300/0 conn(0x7f3dd8070830 0x7f3dd8141620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.037+0000 7f3dcffff640 1 -- 172.21.15.37:0/2505428267 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd8147a20 con 0x7f3dd806a120 2023-12-19T16:07:44.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.037+0000 7f3dcffff640 1 -- 172.21.15.37:0/2505428267 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f3dd4001670 con 0x7f3dd806a120 2023-12-19T16:07:44.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.038+0000 7f3dcffff640 1 -- 172.21.15.37:0/2505428267 >> v1:172.21.15.37:6789/0 conn(0x7f3dd806a120 legacy=0x7f3dd8147f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:44.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.038+0000 7f3dcffff640 1 --2- 172.21.15.37:0/2505428267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dc4003970 0x7f3dc4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.038+0000 7f3dcffff640 1 --2- 172.21.15.37:0/2505428267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dc40047c0 0x7f3dc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.038+0000 7f3dcffff640 1 --2- 172.21.15.37:0/2505428267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dd8141b60 0x7f3dc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.038+0000 7f3dcffff640 1 -- 172.21.15.37:0/2505428267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd8148650 con 0x7f3dc40047c0 2023-12-19T16:07:44.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.038+0000 7f3dcffff640 1 -- 172.21.15.37:0/2505428267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd8071320 con 0x7f3dc4003970 2023-12-19T16:07:44.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.038+0000 7f3dcffff640 1 -- 172.21.15.37:0/2505428267 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc400b980 con 0x7f3dd8141b60 2023-12-19T16:07:44.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.038+0000 7f3ddcd6d640 1 --2- 172.21.15.37:0/2505428267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dc40047c0 0x7f3dc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.038+0000 7f3ddd56e640 1 --2- 172.21.15.37:0/2505428267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dc4003970 0x7f3dc4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.038+0000 7f3dddd6f640 1 --2- 172.21.15.37:0/2505428267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dd8141b60 0x7f3dc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.038+0000 7f3ddcd6d640 1 -- 172.21.15.37:0/2505428267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dd8141b60 msgr2=0x7f3dc4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:44.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.038+0000 7f3ddcd6d640 1 --2- 172.21.15.37:0/2505428267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dd8141b60 0x7f3dc4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.038+0000 7f3ddcd6d640 1 -- 172.21.15.37:0/2505428267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dc4003970 msgr2=0x7f3dc4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:44.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.038+0000 7f3ddcd6d640 1 --2- 172.21.15.37:0/2505428267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dc4003970 0x7f3dc4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.038+0000 7f3ddcd6d640 1 -- 172.21.15.37:0/2505428267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc4003520 con 0x7f3dc40047c0 2023-12-19T16:07:44.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.038+0000 7f3dddd6f640 1 --2- 172.21.15.37:0/2505428267 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dd8141b60 0x7f3dc4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:44.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.039+0000 7f3ddcd6d640 1 --2- 172.21.15.37:0/2505428267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dc40047c0 0x7f3dc4004c40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009ac0 tx=0x7f3dc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4687622c2a6033a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:44.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.039+0000 7f3dcffff640 1 -- 172.21.15.37:0/2505428267 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc802c710 con 0x7f3dc40047c0 2023-12-19T16:07:44.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.039+0000 7f3dcffff640 1 -- 172.21.15.37:0/2505428267 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc802c870 con 0x7f3dc40047c0 2023-12-19T16:07:44.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.039+0000 7f3dcffff640 1 -- 172.21.15.37:0/2505428267 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc802cc00 con 0x7f3dc40047c0 2023-12-19T16:07:44.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.039+0000 7f3ddf7d2640 1 -- 172.21.15.37:0/2505428267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dc40047c0 msgr2=0x7f3dc4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:44.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.039+0000 7f3ddf7d2640 1 --2- 172.21.15.37:0/2505428267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dc40047c0 0x7f3dc4004c40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009ac0 tx=0x7f3dc40057f0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.039+0000 7f3dddd6f640 1 -- 172.21.15.37:0/2505428267 reap_dead start 2023-12-19T16:07:44.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.039+0000 7f3ddf7d2640 1 -- 172.21.15.37:0/2505428267 shutdown_connections 2023-12-19T16:07:44.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.039+0000 7f3ddf7d2640 1 -- 172.21.15.37:0/2505428267 >> 172.21.15.37:0/2505428267 conn(0x7f3dd80bc220 msgr2=0x7f3dd80bc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:44.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.039+0000 7f3ddf7d2640 1 -- 172.21.15.37:0/2505428267 shutdown_connections 2023-12-19T16:07:44.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.039+0000 7f3ddf7d2640 1 -- 172.21.15.37:0/2505428267 wait complete. 2023-12-19T16:07:44.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.040+0000 7f3ddf7d2640 1 Processor -- start 2023-12-19T16:07:44.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.041+0000 7f3ddf7d2640 1 -- start start 2023-12-19T16:07:44.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.041+0000 7f3ddf7d2640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dc40047c0 0x7f3dd81e0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.041+0000 7f3ddf7d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd81499a0 0x7f3dd814a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.041+0000 7f3ddf7d2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dd8148860 0x7f3dd814a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.041+0000 7f3ddf7d2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd8149380 con 0x7f3dd81499a0 2023-12-19T16:07:44.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.041+0000 7f3ddf7d2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd8149660 con 0x7f3dd8148860 2023-12-19T16:07:44.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.041+0000 7f3ddf7d2640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd81e1970 con 0x7f3dc40047c0 2023-12-19T16:07:44.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.041+0000 7f3ddcd6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd81499a0 0x7f3dd814a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.041+0000 7f3ddcd6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd81499a0 0x7f3dd814a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37758/0 (socket says 172.21.15.37:37758) 2023-12-19T16:07:44.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.041+0000 7f3ddcd6d640 1 -- 172.21.15.37:0/3556797220 learned_addr learned my addr 172.21.15.37:0/3556797220 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:44.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.041+0000 7f3dddd6f640 1 --2- 172.21.15.37:0/3556797220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dd8148860 0x7f3dd814a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.041+0000 7f3ddd56e640 1 --2- 172.21.15.37:0/3556797220 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dc40047c0 0x7f3dd81e0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.042+0000 7f3ddcd6d640 1 -- 172.21.15.37:0/3556797220 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dc40047c0 msgr2=0x7f3dd81e0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:44.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.042+0000 7f3ddcd6d640 1 --2- 172.21.15.37:0/3556797220 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dc40047c0 0x7f3dd81e0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.042+0000 7f3ddcd6d640 1 -- 172.21.15.37:0/3556797220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dd8148860 msgr2=0x7f3dd814a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:44.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.042+0000 7f3ddcd6d640 1 --2- 172.21.15.37:0/3556797220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dd8148860 0x7f3dd814a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.042+0000 7f3ddcd6d640 1 -- 172.21.15.37:0/3556797220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd80bb950 con 0x7f3dd81499a0 2023-12-19T16:07:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.042+0000 7f3ddd56e640 1 --2- 172.21.15.37:0/3556797220 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dc40047c0 0x7f3dd81e0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.042+0000 7f3ddcd6d640 1 --2- 172.21.15.37:0/3556797220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd81499a0 0x7f3dd814a440 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3dc802c2b0 tx=0x7f3dc8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.042+0000 7f3dcdffb640 1 -- 172.21.15.37:0/3556797220 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8003810 con 0x7f3dd81499a0 2023-12-19T16:07:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.042+0000 7f3dcdffb640 1 -- 172.21.15.37:0/3556797220 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc802de90 con 0x7f3dd81499a0 2023-12-19T16:07:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.042+0000 7f3dcdffb640 1 -- 172.21.15.37:0/3556797220 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8003b70 con 0x7f3dd81499a0 2023-12-19T16:07:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.042+0000 7f3ddf7d2640 1 -- 172.21.15.37:0/3556797220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd80bbae0 con 0x7f3dd81499a0 2023-12-19T16:07:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.042+0000 7f3ddf7d2640 1 -- 172.21.15.37:0/3556797220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd81e16e0 con 0x7f3dd81499a0 2023-12-19T16:07:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.043+0000 7f3ddf7d2640 1 -- 172.21.15.37:0/3556797220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd81e1b30 con 0x7f3dd81499a0 2023-12-19T16:07:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.044+0000 7f3dcdffb640 1 -- 172.21.15.37:0/3556797220 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3dc8003cd0 con 0x7f3dd81499a0 2023-12-19T16:07:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.044+0000 7f3dcdffb640 1 --2- 172.21.15.37:0/3556797220 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3dbc06a460 0x7f3dbc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.044+0000 7f3dcdffb640 1 -- 172.21.15.37:0/3556797220 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3dc80aa7b0 con 0x7f3dd81499a0 2023-12-19T16:07:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.044+0000 7f3ddd56e640 1 --2- 172.21.15.37:0/3556797220 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3dbc06a460 0x7f3dbc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.045+0000 7f3ddd56e640 1 --2- 172.21.15.37:0/3556797220 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3dbc06a460 0x7f3dbc06c920 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4001050 tx=0x7f3dd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:44.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.048+0000 7f3dcdffb640 1 -- 172.21.15.37:0/3556797220 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3dc8075dc0 con 0x7f3dd81499a0 2023-12-19T16:07:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.258+0000 7f3ddf7d2640 1 -- 172.21.15.37:0/3556797220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3dd80665a0 con 0x7f3dd81499a0 2023-12-19T16:07:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.259+0000 7f3dcdffb640 1 -- 172.21.15.37:0/3556797220 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3946 (secure 0 0 0) 0x7f3dc80793e0 con 0x7f3dd81499a0 2023-12-19T16:07:44.261 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:44.261 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/19970234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":19970234},{"type":"v1","addr":"172.21.15.37:6834","nonce":19970234}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2974397450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2974397450},{"type":"v1","addr":"172.21.15.78:6835","nonce":2974397450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:07:41.897266+0000","modified":"2023-12-19T16:07:43.904067+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1604445250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1604445250},{"type":"v1","addr":"172.21.15.37:6835","nonce":1604445250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T16:07:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 13 2023-12-19T16:07:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.260+0000 7f3ddf7d2640 1 -- 172.21.15.37:0/3556797220 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3dbc06a460 msgr2=0x7f3dbc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.260+0000 7f3ddf7d2640 1 --2- 172.21.15.37:0/3556797220 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3dbc06a460 0x7f3dbc06c920 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4001050 tx=0x7f3dd4009040 comp rx=0 tx=0).stop 2023-12-19T16:07:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.260+0000 7f3ddf7d2640 1 -- 172.21.15.37:0/3556797220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd81499a0 msgr2=0x7f3dd814a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.260+0000 7f3ddf7d2640 1 --2- 172.21.15.37:0/3556797220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd81499a0 0x7f3dd814a440 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3dc802c2b0 tx=0x7f3dc8004730 comp rx=0 tx=0).stop 2023-12-19T16:07:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.260+0000 7f3ddf7d2640 1 -- 172.21.15.37:0/3556797220 shutdown_connections 2023-12-19T16:07:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.260+0000 7f3ddf7d2640 1 --2- 172.21.15.37:0/3556797220 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3dbc06a460 0x7f3dbc06c920 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.260+0000 7f3ddf7d2640 1 --2- 172.21.15.37:0/3556797220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dd8148860 0x7f3dd814a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.260+0000 7f3ddf7d2640 1 --2- 172.21.15.37:0/3556797220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd81499a0 0x7f3dd814a440 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.260+0000 7f3ddf7d2640 1 --2- 172.21.15.37:0/3556797220 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3dc40047c0 0x7f3dd81e0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.260+0000 7f3ddf7d2640 1 -- 172.21.15.37:0/3556797220 >> 172.21.15.37:0/3556797220 conn(0x7f3dd80bc220 msgr2=0x7f3dd806fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.261+0000 7f3ddf7d2640 1 -- 172.21.15.37:0/3556797220 shutdown_connections 2023-12-19T16:07:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.261+0000 7f3ddf7d2640 1 -- 172.21.15.37:0/3556797220 wait complete. 2023-12-19T16:07:44.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:07:44.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.377+0000 7f287857e640 1 Processor -- start 2023-12-19T16:07:44.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.377+0000 7f287857e640 1 -- start start 2023-12-19T16:07:44.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.378+0000 7f287857e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f28700b6690 0x7f2870144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.378+0000 7f287857e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2870144cd0 0x7f2870155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.378+0000 7f287857e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28700bc6b0 con 0x7f28700bcdd0 2023-12-19T16:07:44.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.378+0000 7f287857e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28700a59f0 con 0x7f2870144cd0 2023-12-19T16:07:44.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.378+0000 7f287857e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28700bc0a0 con 0x7f28700b6690 2023-12-19T16:07:44.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.378+0000 7f2876b1b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2870144cd0 0x7f2870155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.378+0000 7f287631a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f28700bcdd0 0x7f28700b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43366/0 (socket says 172.21.15.37:43366) 2023-12-19T16:07:44.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.378+0000 7f2876b1b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2870144cd0 0x7f2870155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37772/0 (socket says 172.21.15.37:37772) 2023-12-19T16:07:44.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.378+0000 7f287631a640 1 -- 172.21.15.37:0/1502610178 learned_addr learned my addr 172.21.15.37:0/1502610178 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:44.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.378+0000 7f2875b19640 1 --2- 172.21.15.37:0/1502610178 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f28700b6690 0x7f2870144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.378+0000 7f2876b1b640 1 -- 172.21.15.37:0/1502610178 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f28700b6690 msgr2=0x7f2870144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:44.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.378+0000 7f2876b1b640 1 --2- 172.21.15.37:0/1502610178 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f28700b6690 0x7f2870144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.378+0000 7f2876b1b640 1 -- 172.21.15.37:0/1502610178 >> v1:172.21.15.37:6789/0 conn(0x7f28700bcdd0 legacy=0x7f28700b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:44.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.378+0000 7f2876b1b640 1 -- 172.21.15.37:0/1502610178 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28700bc340 con 0x7f2870144cd0 2023-12-19T16:07:44.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.378+0000 7f2875318640 1 -- 172.21.15.37:0/1502610178 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446817507 0 0) 0x7f28700bc6b0 con 0x7f28700bcdd0 2023-12-19T16:07:44.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.379+0000 7f2876b1b640 1 --2- 172.21.15.37:0/1502610178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2870144cd0 0x7f2870155340 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2860009d90 tx=0x7f286002bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867bcd71b9eccccc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:44.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.379+0000 7f2875318640 1 -- 172.21.15.37:0/1502610178 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286002cce0 con 0x7f2870144cd0 2023-12-19T16:07:44.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.379+0000 7f2875318640 1 -- 172.21.15.37:0/1502610178 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286002ce40 con 0x7f2870144cd0 2023-12-19T16:07:44.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.379+0000 7f2875318640 1 -- 172.21.15.37:0/1502610178 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860034660 con 0x7f2870144cd0 2023-12-19T16:07:44.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.380+0000 7f287857e640 1 -- 172.21.15.37:0/1502610178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2870144cd0 msgr2=0x7f2870155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:44.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.380+0000 7f287857e640 1 --2- 172.21.15.37:0/1502610178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2870144cd0 0x7f2870155340 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2860009d90 tx=0x7f286002bf30 comp rx=0 tx=0).stop 2023-12-19T16:07:44.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.380+0000 7f287857e640 1 -- 172.21.15.37:0/1502610178 shutdown_connections 2023-12-19T16:07:44.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.380+0000 7f287857e640 1 --2- 172.21.15.37:0/1502610178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2870144cd0 0x7f2870155340 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.380+0000 7f287857e640 1 --2- 172.21.15.37:0/1502610178 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f28700b6690 0x7f2870144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.380+0000 7f287857e640 1 -- 172.21.15.37:0/1502610178 >> 172.21.15.37:0/1502610178 conn(0x7f2870071e60 msgr2=0x7f28700c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:44.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.380+0000 7f287857e640 1 -- 172.21.15.37:0/1502610178 shutdown_connections 2023-12-19T16:07:44.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.380+0000 7f287857e640 1 -- 172.21.15.37:0/1502610178 wait complete. 2023-12-19T16:07:44.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.381+0000 7f287857e640 1 Processor -- start 2023-12-19T16:07:44.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.381+0000 7f287857e640 1 -- start start 2023-12-19T16:07:44.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f287857e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f28700b6690 0x7f2870145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f287857e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28700bcdd0 0x7f2870143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f287857e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2870144cd0 0x7f287013d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f287857e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2870143850 con 0x7f2870144cd0 2023-12-19T16:07:44.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f287857e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28701d2dc0 con 0x7f28700bcdd0 2023-12-19T16:07:44.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f287857e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28701d3060 con 0x7f28700b6690 2023-12-19T16:07:44.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f2876b1b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2870144cd0 0x7f287013d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f2876b1b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2870144cd0 0x7f287013d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37784/0 (socket says 172.21.15.37:37784) 2023-12-19T16:07:44.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f2876b1b640 1 -- 172.21.15.37:0/1891457071 learned_addr learned my addr 172.21.15.37:0/1891457071 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:44.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f2875b19640 1 --2- 172.21.15.37:0/1891457071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28700bcdd0 0x7f2870143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f287631a640 1 --2- 172.21.15.37:0/1891457071 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f28700b6690 0x7f2870145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f2876b1b640 1 -- 172.21.15.37:0/1891457071 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f28700b6690 msgr2=0x7f2870145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:44.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f2876b1b640 1 --2- 172.21.15.37:0/1891457071 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f28700b6690 0x7f2870145c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f2876b1b640 1 -- 172.21.15.37:0/1891457071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28700bcdd0 msgr2=0x7f2870143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:44.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f2876b1b640 1 --2- 172.21.15.37:0/1891457071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28700bcdd0 0x7f2870143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f2876b1b640 1 -- 172.21.15.37:0/1891457071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2860009a70 con 0x7f2870144cd0 2023-12-19T16:07:44.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f287631a640 1 --2- 172.21.15.37:0/1891457071 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f28700b6690 0x7f2870145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:44.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f2876b1b640 1 --2- 172.21.15.37:0/1891457071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2870144cd0 0x7f287013d720 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2860009d90 tx=0x7f2860004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:44.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f286effd640 1 -- 172.21.15.37:0/1891457071 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286003f680 con 0x7f2870144cd0 2023-12-19T16:07:44.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.382+0000 7f286effd640 1 -- 172.21.15.37:0/1891457071 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286003f7e0 con 0x7f2870144cd0 2023-12-19T16:07:44.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.383+0000 7f287857e640 1 -- 172.21.15.37:0/1891457071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28701d3340 con 0x7f2870144cd0 2023-12-19T16:07:44.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.383+0000 7f286effd640 1 -- 172.21.15.37:0/1891457071 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286003fb70 con 0x7f2870144cd0 2023-12-19T16:07:44.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.383+0000 7f287857e640 1 -- 172.21.15.37:0/1891457071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28701462f0 con 0x7f2870144cd0 2023-12-19T16:07:44.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.383+0000 7f287857e640 1 -- 172.21.15.37:0/1891457071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28701d3800 con 0x7f2870144cd0 2023-12-19T16:07:44.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.384+0000 7f286effd640 1 -- 172.21.15.37:0/1891457071 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f286003b040 con 0x7f2870144cd0 2023-12-19T16:07:44.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.384+0000 7f286effd640 1 --2- 172.21.15.37:0/1891457071 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f285c06a430 0x7f285c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.384+0000 7f286effd640 1 -- 172.21.15.37:0/1891457071 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28600aaf10 con 0x7f2870144cd0 2023-12-19T16:07:44.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.384+0000 7f287631a640 1 --2- 172.21.15.37:0/1891457071 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f285c06a430 0x7f285c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.385+0000 7f287631a640 1 --2- 172.21.15.37:0/1891457071 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f285c06a430 0x7f285c06c8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2868000f60 tx=0x7f2868009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:44.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.389+0000 7f286effd640 1 -- 172.21.15.37:0/1891457071 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2860076500 con 0x7f2870144cd0 2023-12-19T16:07:44.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.567+0000 7f287857e640 1 -- 172.21.15.37:0/1891457071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f287004e840 con 0x7f2870144cd0 2023-12-19T16:07:44.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.568+0000 7f286effd640 1 -- 172.21.15.37:0/1891457071 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16053 (secure 0 0 0) 0x7f2860079b20 con 0x7f2870144cd0 2023-12-19T16:07:44.570 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:44.571 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:07:42.899048+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:07:39.626181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T16:07:40.871535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:07:44.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.570+0000 7f287857e640 1 -- 172.21.15.37:0/1891457071 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f285c06a430 msgr2=0x7f285c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:44.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.570+0000 7f287857e640 1 --2- 172.21.15.37:0/1891457071 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f285c06a430 0x7f285c06c8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2868000f60 tx=0x7f2868009040 comp rx=0 tx=0).stop 2023-12-19T16:07:44.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.570+0000 7f287857e640 1 -- 172.21.15.37:0/1891457071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2870144cd0 msgr2=0x7f287013d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:44.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.570+0000 7f287857e640 1 --2- 172.21.15.37:0/1891457071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2870144cd0 0x7f287013d720 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2860009d90 tx=0x7f2860004a40 comp rx=0 tx=0).stop 2023-12-19T16:07:44.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.571+0000 7f287857e640 1 -- 172.21.15.37:0/1891457071 shutdown_connections 2023-12-19T16:07:44.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.571+0000 7f287857e640 1 --2- 172.21.15.37:0/1891457071 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f285c06a430 0x7f285c06c8f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.571+0000 7f287857e640 1 --2- 172.21.15.37:0/1891457071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2870144cd0 0x7f287013d720 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.571+0000 7f287857e640 1 --2- 172.21.15.37:0/1891457071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28700bcdd0 0x7f2870143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.571+0000 7f287857e640 1 --2- 172.21.15.37:0/1891457071 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f28700b6690 0x7f2870145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.571+0000 7f287857e640 1 -- 172.21.15.37:0/1891457071 >> 172.21.15.37:0/1891457071 conn(0x7f2870071e60 msgr2=0x7f28700b8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:44.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.571+0000 7f287857e640 1 -- 172.21.15.37:0/1891457071 shutdown_connections 2023-12-19T16:07:44.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.571+0000 7f287857e640 1 -- 172.21.15.37:0/1891457071 wait complete. 2023-12-19T16:07:44.584 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T16:07:44.584 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:07:44.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.687+0000 7fababa70640 1 Processor -- start 2023-12-19T16:07:44.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.688+0000 7fababa70640 1 -- start start 2023-12-19T16:07:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.688+0000 7fababa70640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faba414b7b0 0x7faba414aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.688+0000 7fababa70640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba4145220 con 0x7faba414edb0 2023-12-19T16:07:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.688+0000 7fababa70640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba406b720 con 0x7faba406acb0 2023-12-19T16:07:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.688+0000 7fababa70640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba414e0c0 con 0x7faba414b7b0 2023-12-19T16:07:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.688+0000 7faba900b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faba414edb0 0x7faba40baa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43370/0 (socket says 172.21.15.37:43370) 2023-12-19T16:07:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.688+0000 7faba900b640 1 -- 172.21.15.37:0/2596147020 learned_addr learned my addr 172.21.15.37:0/2596147020 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.688+0000 7faba980c640 1 --2- 172.21.15.37:0/2596147020 >> v2:172.21.15.78:3300/0 conn(0x7faba414b7b0 0x7faba414aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.689+0000 7faba880a640 1 -- 172.21.15.37:0/2596147020 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314035540 0 0) 0x7fab94001110 con 0x7faba414edb0 2023-12-19T16:07:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.689+0000 7faba880a640 1 -- 172.21.15.37:0/2596147020 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab90003520 con 0x7faba414edb0 2023-12-19T16:07:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.689+0000 7faba880a640 1 -- 172.21.15.37:0/2596147020 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2138193577 0 0) 0x7faba406b720 con 0x7faba406acb0 2023-12-19T16:07:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.689+0000 7faba880a640 1 -- 172.21.15.37:0/2596147020 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab94001110 con 0x7faba406acb0 2023-12-19T16:07:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.689+0000 7faba880a640 1 -- 172.21.15.37:0/2596147020 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1782128637 0 0) 0x7fab90003520 con 0x7faba414edb0 2023-12-19T16:07:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.689+0000 7faba980c640 1 -- 172.21.15.37:0/2596147020 >> v1:172.21.15.78:6789/0 conn(0x7faba406acb0 legacy=0x7faba4155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.689+0000 7faba980c640 1 -- 172.21.15.37:0/2596147020 >> v1:172.21.15.37:6789/0 conn(0x7faba414edb0 legacy=0x7faba40baa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.689+0000 7faba980c640 1 -- 172.21.15.37:0/2596147020 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba40bb150 con 0x7faba414b7b0 2023-12-19T16:07:44.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.690+0000 7faba980c640 1 --2- 172.21.15.37:0/2596147020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faba414b7b0 0x7faba414aaf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faba414e200 tx=0x7faba002b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1adf598a0f61dd1b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:44.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.690+0000 7faba880a640 1 -- 172.21.15.37:0/2596147020 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94001800 con 0x7faba414b7b0 2023-12-19T16:07:44.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.690+0000 7faba880a640 1 -- 172.21.15.37:0/2596147020 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba00314f0 con 0x7faba414b7b0 2023-12-19T16:07:44.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.690+0000 7faba880a640 1 -- 172.21.15.37:0/2596147020 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba0031880 con 0x7faba414b7b0 2023-12-19T16:07:44.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.690+0000 7fababa70640 1 -- 172.21.15.37:0/2596147020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faba414b7b0 msgr2=0x7faba414aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:44.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.690+0000 7fababa70640 1 --2- 172.21.15.37:0/2596147020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faba414b7b0 0x7faba414aaf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faba414e200 tx=0x7faba002b810 comp rx=0 tx=0).stop 2023-12-19T16:07:44.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.690+0000 7fababa70640 1 -- 172.21.15.37:0/2596147020 shutdown_connections 2023-12-19T16:07:44.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.690+0000 7fababa70640 1 --2- 172.21.15.37:0/2596147020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faba414b7b0 0x7faba414aaf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.690+0000 7fababa70640 1 -- 172.21.15.37:0/2596147020 >> 172.21.15.37:0/2596147020 conn(0x7faba4069ba0 msgr2=0x7faba4069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:44.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.691+0000 7fababa70640 1 -- 172.21.15.37:0/2596147020 shutdown_connections 2023-12-19T16:07:44.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.691+0000 7fababa70640 1 -- 172.21.15.37:0/2596147020 wait complete. 2023-12-19T16:07:44.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.691+0000 7fababa70640 1 Processor -- start 2023-12-19T16:07:44.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.692+0000 7fababa70640 1 -- start start 2023-12-19T16:07:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.692+0000 7fababa70640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faba406acb0 0x7faba40ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.692+0000 7fababa70640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faba414b7b0 0x7faba40ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.692+0000 7fababa70640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba414edb0 0x7faba40ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.692+0000 7fababa70640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba40ad540 con 0x7faba414edb0 2023-12-19T16:07:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.692+0000 7fababa70640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba4149d90 con 0x7faba406acb0 2023-12-19T16:07:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.692+0000 7fababa70640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba4149fe0 con 0x7faba414b7b0 2023-12-19T16:07:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.692+0000 7fabaa00d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba414edb0 0x7faba40ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.692+0000 7fabaa00d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba414edb0 0x7faba40ab8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37798/0 (socket says 172.21.15.37:37798) 2023-12-19T16:07:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.692+0000 7fabaa00d640 1 -- 172.21.15.37:0/383745757 learned_addr learned my addr 172.21.15.37:0/383745757 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.692+0000 7faba980c640 1 --2- 172.21.15.37:0/383745757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faba406acb0 0x7faba40ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.692+0000 7faba900b640 1 --2- 172.21.15.37:0/383745757 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faba414b7b0 0x7faba40ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.693+0000 7fabaa00d640 1 -- 172.21.15.37:0/383745757 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faba414b7b0 msgr2=0x7faba40ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.693+0000 7fabaa00d640 1 --2- 172.21.15.37:0/383745757 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faba414b7b0 0x7faba40ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.693+0000 7fabaa00d640 1 -- 172.21.15.37:0/383745757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faba406acb0 msgr2=0x7faba40ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:44.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.693+0000 7fabaa00d640 1 --2- 172.21.15.37:0/383745757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faba406acb0 0x7faba40ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.693+0000 7fabaa00d640 1 -- 172.21.15.37:0/383745757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba0009400 con 0x7faba414edb0 2023-12-19T16:07:44.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.693+0000 7faba980c640 1 --2- 172.21.15.37:0/383745757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faba406acb0 0x7faba40ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:44.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.693+0000 7fabaa00d640 1 --2- 172.21.15.37:0/383745757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba414edb0 0x7faba40ab8c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00c7c0 tx=0x7fab9c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:44.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.693+0000 7fab9a7fc640 1 -- 172.21.15.37:0/383745757 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c003b70 con 0x7faba414edb0 2023-12-19T16:07:44.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.693+0000 7fab9a7fc640 1 -- 172.21.15.37:0/383745757 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c003cd0 con 0x7faba414edb0 2023-12-19T16:07:44.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.693+0000 7fab9a7fc640 1 -- 172.21.15.37:0/383745757 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c00aa50 con 0x7faba414edb0 2023-12-19T16:07:44.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.693+0000 7fababa70640 1 -- 172.21.15.37:0/383745757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba40ac9a0 con 0x7faba414edb0 2023-12-19T16:07:44.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.693+0000 7fababa70640 1 -- 172.21.15.37:0/383745757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba41490c0 con 0x7faba414edb0 2023-12-19T16:07:44.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.694+0000 7fababa70640 1 -- 172.21.15.37:0/383745757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba404e840 con 0x7faba414edb0 2023-12-19T16:07:44.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.694+0000 7fab9a7fc640 1 -- 172.21.15.37:0/383745757 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fab9c00abb0 con 0x7faba414edb0 2023-12-19T16:07:44.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.695+0000 7fab9a7fc640 1 --2- 172.21.15.37:0/383745757 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fab8806a430 0x7fab8806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:44.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.695+0000 7fab9a7fc640 1 -- 172.21.15.37:0/383745757 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab9c088760 con 0x7faba414edb0 2023-12-19T16:07:44.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.695+0000 7faba980c640 1 --2- 172.21.15.37:0/383745757 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fab8806a430 0x7fab8806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:44.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.695+0000 7faba980c640 1 --2- 172.21.15.37:0/383745757 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fab8806a430 0x7fab8806c8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faba0036000 tx=0x7faba0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:44.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.699+0000 7fab9a7fc640 1 -- 172.21.15.37:0/383745757 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fab9c053de0 con 0x7faba414edb0 2023-12-19T16:07:44.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.871+0000 7fababa70640 1 -- 172.21.15.37:0/383745757 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faba414e5b0 con 0x7fab8806a430 2023-12-19T16:07:44.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.878+0000 7fab9a7fc640 1 -- 172.21.15.37:0/383745757 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+261740 (secure 0 0 0) 0x7faba0031a10 con 0x7fab8806a430 2023-12-19T16:07:44.884 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:44.885 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-19T16:07:44.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.881+0000 7fababa70640 1 -- 172.21.15.37:0/383745757 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fab8806a430 msgr2=0x7fab8806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:44.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.881+0000 7fababa70640 1 --2- 172.21.15.37:0/383745757 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fab8806a430 0x7fab8806c8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faba0036000 tx=0x7faba0008030 comp rx=0 tx=0).stop 2023-12-19T16:07:44.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.881+0000 7fababa70640 1 -- 172.21.15.37:0/383745757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba414edb0 msgr2=0x7faba40ab8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:44.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.881+0000 7fababa70640 1 --2- 172.21.15.37:0/383745757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba414edb0 0x7faba40ab8c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00c7c0 tx=0x7fab9c00cc80 comp rx=0 tx=0).stop 2023-12-19T16:07:44.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.881+0000 7fababa70640 1 -- 172.21.15.37:0/383745757 shutdown_connections 2023-12-19T16:07:44.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.881+0000 7fababa70640 1 --2- 172.21.15.37:0/383745757 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fab8806a430 0x7fab8806c8f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.881+0000 7fababa70640 1 --2- 172.21.15.37:0/383745757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba414edb0 0x7faba40ab8c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.881+0000 7fababa70640 1 --2- 172.21.15.37:0/383745757 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faba414b7b0 0x7faba40ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.881+0000 7fababa70640 1 --2- 172.21.15.37:0/383745757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faba406acb0 0x7faba40ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:44.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.881+0000 7fababa70640 1 -- 172.21.15.37:0/383745757 >> 172.21.15.37:0/383745757 conn(0x7faba4069ba0 msgr2=0x7faba40b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:44.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.881+0000 7fababa70640 1 -- 172.21.15.37:0/383745757 shutdown_connections 2023-12-19T16:07:44.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:44.881+0000 7fababa70640 1 -- 172.21.15.37:0/383745757 wait complete. 2023-12-19T16:07:44.894 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-12-19T16:07:44.642123+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":3678208,"data_stored":2100096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.123105"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530870+0000","last_change":"2023-12-19T16:07:41.530870+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530870+0000","last_undegraded":"2023-12-19T16:07:41.530870+0000","last_fullsized":"2023-12-19T16:07:41.530870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:04:25.127879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.534432+0000","last_change":"2023-12-19T16:07:41.534432+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.534432+0000","last_undegraded":"2023-12-19T16:07:41.534432+0000","last_fullsized":"2023-12-19T16:07:41.534432+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:07:52.335635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529877+0000","last_change":"2023-12-19T16:07:41.529877+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529877+0000","last_undegraded":"2023-12-19T16:07:41.529877+0000","last_fullsized":"2023-12-19T16:07:41.529877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:05:34.739335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530124+0000","last_change":"2023-12-19T16:07:41.530124+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530124+0000","last_undegraded":"2023-12-19T16:07:41.530124+0000","last_fullsized":"2023-12-19T16:07:41.530124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:45:40.959769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.537184+0000","last_change":"2023-12-19T16:07:41.537184+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.537184+0000","last_undegraded":"2023-12-19T16:07:41.537184+0000","last_fullsized":"2023-12-19T16:07:41.537184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:26:49.877822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.533601+0000","last_change":"2023-12-19T16:07:41.533601+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.533601+0000","last_undegraded":"2023-12-19T16:07:41.533601+0000","last_fullsized":"2023-12-19T16:07:41.533601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:18.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525873+0000","last_change":"2023-12-19T16:07:41.525873+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525873+0000","last_undegraded":"2023-12-19T16:07:41.525873+0000","last_fullsized":"2023-12-19T16:07:41.525873+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:15:19.041369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527524+0000","last_change":"2023-12-19T16:07:41.527524+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527524+0000","last_undegraded":"2023-12-19T16:07:41.527524+0000","last_fullsized":"2023-12-19T16:07:41.527524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:42.867424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525066+0000","last_change":"2023-12-19T16:07:41.525066+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525066+0000","last_undegraded":"2023-12-19T16:07:41.525066+0000","last_fullsized":"2023-12-19T16:07:41.525066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:07:54.635072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529841+0000","last_change":"2023-12-19T16:07:41.529841+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529841+0000","last_undegraded":"2023-12-19T16:07:41.529841+0000","last_fullsized":"2023-12-19T16:07:41.529841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:15:19.041369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.524671+0000","last_change":"2023-12-19T16:07:41.524671+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.524671+0000","last_undegraded":"2023-12-19T16:07:41.524671+0000","last_fullsized":"2023-12-19T16:07:41.524671+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:32.203742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531252+0000","last_change":"2023-12-19T16:07:41.531252+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531252+0000","last_undegraded":"2023-12-19T16:07:41.531252+0000","last_fullsized":"2023-12-19T16:07:41.531252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:32.203742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.536620+0000","last_change":"2023-12-19T16:07:41.536620+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.536620+0000","last_undegraded":"2023-12-19T16:07:41.536620+0000","last_fullsized":"2023-12-19T16:07:41.536620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:43.921544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532874+0000","last_change":"2023-12-19T16:07:41.532874+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532874+0000","last_undegraded":"2023-12-19T16:07:41.532874+0000","last_fullsized":"2023-12-19T16:07:41.532874+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:25:30.826214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529784+0000","last_change":"2023-12-19T16:07:41.529784+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529784+0000","last_undegraded":"2023-12-19T16:07:41.529784+0000","last_fullsized":"2023-12-19T16:07:41.529784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:03:01.998993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525126+0000","last_change":"2023-12-19T16:07:41.525126+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525126+0000","last_undegraded":"2023-12-19T16:07:41.525126+0000","last_fullsized":"2023-12-19T16:07:41.525126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:18.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.524684+0000","last_change":"2023-12-19T16:07:41.524684+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.524684+0000","last_undegraded":"2023-12-19T16:07:41.524684+0000","last_fullsized":"2023-12-19T16:07:41.524684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:25:30.826214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529238+0000","last_change":"2023-12-19T16:07:41.529238+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529238+0000","last_undegraded":"2023-12-19T16:07:41.529238+0000","last_fullsized":"2023-12-19T16:07:41.529238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:51.385493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531471+0000","last_change":"2023-12-19T16:07:41.531471+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531471+0000","last_undegraded":"2023-12-19T16:07:41.531471+0000","last_fullsized":"2023-12-19T16:07:41.531471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:27.607901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532210+0000","last_change":"2023-12-19T16:07:41.532210+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532210+0000","last_undegraded":"2023-12-19T16:07:41.532210+0000","last_fullsized":"2023-12-19T16:07:41.532210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:57.756446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.528412+0000","last_change":"2023-12-19T16:07:41.528412+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.528412+0000","last_undegraded":"2023-12-19T16:07:41.528412+0000","last_fullsized":"2023-12-19T16:07:41.528412+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:22.467159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525781+0000","last_change":"2023-12-19T16:07:41.525781+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525781+0000","last_undegraded":"2023-12-19T16:07:41.525781+0000","last_fullsized":"2023-12-19T16:07:41.525781+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:30:03.606200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531959+0000","last_change":"2023-12-19T16:07:41.531959+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531959+0000","last_undegraded":"2023-12-19T16:07:41.531959+0000","last_fullsized":"2023-12-19T16:07:41.531959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:49.018092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529594+0000","last_change":"2023-12-19T16:07:41.529594+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529594+0000","last_undegraded":"2023-12-19T16:07:41.529594+0000","last_fullsized":"2023-12-19T16:07:41.529594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:42.867424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.528676+0000","last_change":"2023-12-19T16:07:41.528676+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.528676+0000","last_undegraded":"2023-12-19T16:07:41.528676+0000","last_fullsized":"2023-12-19T16:07:41.528676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:51.385493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.528656+0000","last_change":"2023-12-19T16:07:41.528656+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.528656+0000","last_undegraded":"2023-12-19T16:07:41.528656+0000","last_fullsized":"2023-12-19T16:07:41.528656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:42.867424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530116+0000","last_change":"2023-12-19T16:07:41.530116+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530116+0000","last_undegraded":"2023-12-19T16:07:41.530116+0000","last_fullsized":"2023-12-19T16:07:41.530116+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:09.783023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530639+0000","last_change":"2023-12-19T16:07:41.530639+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530639+0000","last_undegraded":"2023-12-19T16:07:41.530639+0000","last_fullsized":"2023-12-19T16:07:41.530639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:25:30.826214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527975+0000","last_change":"2023-12-19T16:07:41.527975+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527975+0000","last_undegraded":"2023-12-19T16:07:41.527975+0000","last_fullsized":"2023-12-19T16:07:41.527975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:09.783023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525699+0000","last_change":"2023-12-19T16:07:41.525699+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525699+0000","last_undegraded":"2023-12-19T16:07:41.525699+0000","last_fullsized":"2023-12-19T16:07:41.525699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:23.495455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529951+0000","last_change":"2023-12-19T16:07:41.529951+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529951+0000","last_undegraded":"2023-12-19T16:07:41.529951+0000","last_fullsized":"2023-12-19T16:07:41.529951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:06:55.803278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527111+0000","last_change":"2023-12-19T16:07:41.527111+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527111+0000","last_undegraded":"2023-12-19T16:07:41.527111+0000","last_fullsized":"2023-12-19T16:07:41.527111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:51.385493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531569+0000","last_change":"2023-12-19T16:07:41.531569+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531569+0000","last_undegraded":"2023-12-19T16:07:41.531569+0000","last_fullsized":"2023-12-19T16:07:41.531569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:07:54.635072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.540818+0000","last_change":"2023-12-19T16:07:41.539770+0000","last_active":"2023-12-19T16:07:41.540818+0000","last_peered":"2023-12-19T16:07:41.540818+0000","last_clean":"2023-12-19T16:07:41.540818+0000","last_became_active":"2023-12-19T16:07:41.539351+0000","last_became_peered":"2023-12-19T16:07:41.539351+0000","last_unstale":"2023-12-19T16:07:41.540818+0000","last_undegraded":"2023-12-19T16:07:41.540818+0000","last_fullsized":"2023-12-19T16:07:41.540818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:57.073133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530465+0000","last_change":"2023-12-19T16:07:41.530465+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530465+0000","last_undegraded":"2023-12-19T16:07:41.530465+0000","last_fullsized":"2023-12-19T16:07:41.530465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:25:19.019112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.541611+0000","last_change":"2023-12-19T16:07:41.539319+0000","last_active":"2023-12-19T16:07:41.541611+0000","last_peered":"2023-12-19T16:07:41.541611+0000","last_clean":"2023-12-19T16:07:41.541611+0000","last_became_active":"2023-12-19T16:07:41.539008+0000","last_became_peered":"2023-12-19T16:07:41.539008+0000","last_unstale":"2023-12-19T16:07:41.541611+0000","last_undegraded":"2023-12-19T16:07:41.541611+0000","last_fullsized":"2023-12-19T16:07:41.541611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:33.056284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527427+0000","last_change":"2023-12-19T16:07:41.527427+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527427+0000","last_undegraded":"2023-12-19T16:07:41.527427+0000","last_fullsized":"2023-12-19T16:07:41.527427+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:45:40.959769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545626+0000","last_change":"2023-12-19T16:07:41.544330+0000","last_active":"2023-12-19T16:07:41.545626+0000","last_peered":"2023-12-19T16:07:41.545626+0000","last_clean":"2023-12-19T16:07:41.545626+0000","last_became_active":"2023-12-19T16:07:41.544039+0000","last_became_peered":"2023-12-19T16:07:41.544039+0000","last_unstale":"2023-12-19T16:07:41.545626+0000","last_undegraded":"2023-12-19T16:07:41.545626+0000","last_fullsized":"2023-12-19T16:07:41.545626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:04.614913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.528051+0000","last_change":"2023-12-19T16:07:41.528051+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.528051+0000","last_undegraded":"2023-12-19T16:07:41.528051+0000","last_fullsized":"2023-12-19T16:07:41.528051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:54.332659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.544840+0000","last_change":"2023-12-19T16:07:41.538998+0000","last_active":"2023-12-19T16:07:41.544840+0000","last_peered":"2023-12-19T16:07:41.544840+0000","last_clean":"2023-12-19T16:07:41.544840+0000","last_became_active":"2023-12-19T16:07:41.538718+0000","last_became_peered":"2023-12-19T16:07:41.538718+0000","last_unstale":"2023-12-19T16:07:41.544840+0000","last_undegraded":"2023-12-19T16:07:41.544840+0000","last_fullsized":"2023-12-19T16:07:41.544840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:56:08.338813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525160+0000","last_change":"2023-12-19T16:07:41.525160+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525160+0000","last_undegraded":"2023-12-19T16:07:41.525160+0000","last_fullsized":"2023-12-19T16:07:41.525160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:30:03.606200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.542347+0000","last_change":"2023-12-19T16:07:41.540990+0000","last_active":"2023-12-19T16:07:41.542347+0000","last_peered":"2023-12-19T16:07:41.542347+0000","last_clean":"2023-12-19T16:07:41.542347+0000","last_became_active":"2023-12-19T16:07:41.540782+0000","last_became_peered":"2023-12-19T16:07:41.540782+0000","last_unstale":"2023-12-19T16:07:41.542347+0000","last_undegraded":"2023-12-19T16:07:41.542347+0000","last_fullsized":"2023-12-19T16:07:41.542347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:56.749124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531408+0000","last_change":"2023-12-19T16:07:41.531408+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531408+0000","last_undegraded":"2023-12-19T16:07:41.531408+0000","last_fullsized":"2023-12-19T16:07:41.531408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:23.495455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.541485+0000","last_change":"2023-12-19T16:07:41.540194+0000","last_active":"2023-12-19T16:07:41.541485+0000","last_peered":"2023-12-19T16:07:41.541485+0000","last_clean":"2023-12-19T16:07:41.541485+0000","last_became_active":"2023-12-19T16:07:41.539841+0000","last_became_peered":"2023-12-19T16:07:41.539841+0000","last_unstale":"2023-12-19T16:07:41.541485+0000","last_undegraded":"2023-12-19T16:07:41.541485+0000","last_fullsized":"2023-12-19T16:07:41.541485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:35.910905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525861+0000","last_change":"2023-12-19T16:07:41.525861+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525861+0000","last_undegraded":"2023-12-19T16:07:41.525861+0000","last_fullsized":"2023-12-19T16:07:41.525861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:54.332659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545362+0000","last_change":"2023-12-19T16:07:41.543547+0000","last_active":"2023-12-19T16:07:41.545362+0000","last_peered":"2023-12-19T16:07:41.545362+0000","last_clean":"2023-12-19T16:07:41.545362+0000","last_became_active":"2023-12-19T16:07:41.543289+0000","last_became_peered":"2023-12-19T16:07:41.543289+0000","last_unstale":"2023-12-19T16:07:41.545362+0000","last_undegraded":"2023-12-19T16:07:41.545362+0000","last_fullsized":"2023-12-19T16:07:41.545362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:48.955394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530232+0000","last_change":"2023-12-19T16:07:41.530232+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530232+0000","last_undegraded":"2023-12-19T16:07:41.530232+0000","last_fullsized":"2023-12-19T16:07:41.530232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:22.467159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.537161+0000","last_change":"2023-12-19T16:07:41.534939+0000","last_active":"2023-12-19T16:07:41.537161+0000","last_peered":"2023-12-19T16:07:41.537161+0000","last_clean":"2023-12-19T16:07:41.537161+0000","last_became_active":"2023-12-19T16:07:41.534662+0000","last_became_peered":"2023-12-19T16:07:41.534662+0000","last_unstale":"2023-12-19T16:07:41.537161+0000","last_undegraded":"2023-12-19T16:07:41.537161+0000","last_fullsized":"2023-12-19T16:07:41.537161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:41.884274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529250+0000","last_change":"2023-12-19T16:07:41.529250+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529250+0000","last_undegraded":"2023-12-19T16:07:41.529250+0000","last_fullsized":"2023-12-19T16:07:41.529250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:18.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.542172+0000","last_change":"2023-12-19T16:07:41.539076+0000","last_active":"2023-12-19T16:07:41.542172+0000","last_peered":"2023-12-19T16:07:41.542172+0000","last_clean":"2023-12-19T16:07:41.542172+0000","last_became_active":"2023-12-19T16:07:41.538793+0000","last_became_peered":"2023-12-19T16:07:41.538793+0000","last_unstale":"2023-12-19T16:07:41.542172+0000","last_undegraded":"2023-12-19T16:07:41.542172+0000","last_fullsized":"2023-12-19T16:07:41.542172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:42:25.311467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530117+0000","last_change":"2023-12-19T16:07:41.530117+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530117+0000","last_undegraded":"2023-12-19T16:07:41.530117+0000","last_fullsized":"2023-12-19T16:07:41.530117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:05:34.739335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.544976+0000","last_change":"2023-12-19T16:07:41.543028+0000","last_active":"2023-12-19T16:07:41.544976+0000","last_peered":"2023-12-19T16:07:41.544976+0000","last_clean":"2023-12-19T16:07:41.544976+0000","last_became_active":"2023-12-19T16:07:41.542523+0000","last_became_peered":"2023-12-19T16:07:41.542523+0000","last_unstale":"2023-12-19T16:07:41.544976+0000","last_undegraded":"2023-12-19T16:07:41.544976+0000","last_fullsized":"2023-12-19T16:07:41.544976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:26:48.870501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532322+0000","last_change":"2023-12-19T16:07:41.532322+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532322+0000","last_undegraded":"2023-12-19T16:07:41.532322+0000","last_fullsized":"2023-12-19T16:07:41.532322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:32.203742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538529+0000","last_change":"2023-12-19T16:07:41.534899+0000","last_active":"2023-12-19T16:07:41.538529+0000","last_peered":"2023-12-19T16:07:41.538529+0000","last_clean":"2023-12-19T16:07:41.538529+0000","last_became_active":"2023-12-19T16:07:41.534601+0000","last_became_peered":"2023-12-19T16:07:41.534601+0000","last_unstale":"2023-12-19T16:07:41.538529+0000","last_undegraded":"2023-12-19T16:07:41.538529+0000","last_fullsized":"2023-12-19T16:07:41.538529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:42.994812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530322+0000","last_change":"2023-12-19T16:07:41.530322+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530322+0000","last_undegraded":"2023-12-19T16:07:41.530322+0000","last_fullsized":"2023-12-19T16:07:41.530322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:27.607901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545470+0000","last_change":"2023-12-19T16:07:41.543958+0000","last_active":"2023-12-19T16:07:41.545470+0000","last_peered":"2023-12-19T16:07:41.545470+0000","last_clean":"2023-12-19T16:07:41.545470+0000","last_became_active":"2023-12-19T16:07:41.543503+0000","last_became_peered":"2023-12-19T16:07:41.543503+0000","last_unstale":"2023-12-19T16:07:41.545470+0000","last_undegraded":"2023-12-19T16:07:41.545470+0000","last_fullsized":"2023-12-19T16:07:41.545470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:25:18.011790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530356+0000","last_change":"2023-12-19T16:07:41.530356+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530356+0000","last_undegraded":"2023-12-19T16:07:41.530356+0000","last_fullsized":"2023-12-19T16:07:41.530356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:15.031639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.537202+0000","last_change":"2023-12-19T16:07:41.534556+0000","last_active":"2023-12-19T16:07:41.537202+0000","last_peered":"2023-12-19T16:07:41.537202+0000","last_clean":"2023-12-19T16:07:41.537202+0000","last_became_active":"2023-12-19T16:07:41.534265+0000","last_became_peered":"2023-12-19T16:07:41.534265+0000","last_unstale":"2023-12-19T16:07:41.537202+0000","last_undegraded":"2023-12-19T16:07:41.537202+0000","last_fullsized":"2023-12-19T16:07:41.537202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:16:33.732599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531449+0000","last_change":"2023-12-19T16:07:41.531449+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531449+0000","last_undegraded":"2023-12-19T16:07:41.531449+0000","last_fullsized":"2023-12-19T16:07:41.531449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:14:36.093257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.543193+0000","last_change":"2023-12-19T16:07:41.541301+0000","last_active":"2023-12-19T16:07:41.543193+0000","last_peered":"2023-12-19T16:07:41.543193+0000","last_clean":"2023-12-19T16:07:41.543193+0000","last_became_active":"2023-12-19T16:07:41.540995+0000","last_became_peered":"2023-12-19T16:07:41.540995+0000","last_unstale":"2023-12-19T16:07:41.543193+0000","last_undegraded":"2023-12-19T16:07:41.543193+0000","last_fullsized":"2023-12-19T16:07:41.543193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:04.614913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.526664+0000","last_change":"2023-12-19T16:07:41.526664+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.526664+0000","last_undegraded":"2023-12-19T16:07:41.526664+0000","last_fullsized":"2023-12-19T16:07:41.526664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:09.783023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545015+0000","last_change":"2023-12-19T16:07:41.540432+0000","last_active":"2023-12-19T16:07:41.545015+0000","last_peered":"2023-12-19T16:07:41.545015+0000","last_clean":"2023-12-19T16:07:41.545015+0000","last_became_active":"2023-12-19T16:07:41.540087+0000","last_became_peered":"2023-12-19T16:07:41.540087+0000","last_unstale":"2023-12-19T16:07:41.545015+0000","last_undegraded":"2023-12-19T16:07:41.545015+0000","last_fullsized":"2023-12-19T16:07:41.545015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:04:24.120557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529369+0000","last_change":"2023-12-19T16:07:41.529369+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529369+0000","last_undegraded":"2023-12-19T16:07:41.529369+0000","last_fullsized":"2023-12-19T16:07:41.529369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:44.002133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538459+0000","last_change":"2023-12-19T16:07:41.534179+0000","last_active":"2023-12-19T16:07:41.538459+0000","last_peered":"2023-12-19T16:07:41.538459+0000","last_clean":"2023-12-19T16:07:41.538459+0000","last_became_active":"2023-12-19T16:07:41.533903+0000","last_became_peered":"2023-12-19T16:07:41.533903+0000","last_unstale":"2023-12-19T16:07:41.538459+0000","last_undegraded":"2023-12-19T16:07:41.538459+0000","last_fullsized":"2023-12-19T16:07:41.538459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:42.994812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.526582+0000","last_change":"2023-12-19T16:07:41.526582+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.526582+0000","last_undegraded":"2023-12-19T16:07:41.526582+0000","last_fullsized":"2023-12-19T16:07:41.526582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:49.018092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.542338+0000","last_change":"2023-12-19T16:07:41.539027+0000","last_active":"2023-12-19T16:07:41.542338+0000","last_peered":"2023-12-19T16:07:41.542338+0000","last_clean":"2023-12-19T16:07:41.542338+0000","last_became_active":"2023-12-19T16:07:41.538640+0000","last_became_peered":"2023-12-19T16:07:41.538640+0000","last_unstale":"2023-12-19T16:07:41.542338+0000","last_undegraded":"2023-12-19T16:07:41.542338+0000","last_fullsized":"2023-12-19T16:07:41.542338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:33.056284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530904+0000","last_change":"2023-12-19T16:07:41.530904+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530904+0000","last_undegraded":"2023-12-19T16:07:41.530904+0000","last_fullsized":"2023-12-19T16:07:41.530904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:15:19.041369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538397+0000","last_change":"2023-12-19T16:07:41.535833+0000","last_active":"2023-12-19T16:07:41.538397+0000","last_peered":"2023-12-19T16:07:41.538397+0000","last_clean":"2023-12-19T16:07:41.538397+0000","last_became_active":"2023-12-19T16:07:41.535489+0000","last_became_peered":"2023-12-19T16:07:41.535489+0000","last_unstale":"2023-12-19T16:07:41.538397+0000","last_undegraded":"2023-12-19T16:07:41.538397+0000","last_fullsized":"2023-12-19T16:07:41.538397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:57.073133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529391+0000","last_change":"2023-12-19T16:07:41.529391+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529391+0000","last_undegraded":"2023-12-19T16:07:41.529391+0000","last_fullsized":"2023-12-19T16:07:41.529391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:30:03.606200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.537077+0000","last_change":"2023-12-19T16:07:41.534514+0000","last_active":"2023-12-19T16:07:41.537077+0000","last_peered":"2023-12-19T16:07:41.537077+0000","last_clean":"2023-12-19T16:07:41.537077+0000","last_became_active":"2023-12-19T16:07:41.532360+0000","last_became_peered":"2023-12-19T16:07:41.532360+0000","last_unstale":"2023-12-19T16:07:41.537077+0000","last_undegraded":"2023-12-19T16:07:41.537077+0000","last_fullsized":"2023-12-19T16:07:41.537077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:52.291611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532089+0000","last_change":"2023-12-19T16:07:41.532089+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532089+0000","last_undegraded":"2023-12-19T16:07:41.532089+0000","last_fullsized":"2023-12-19T16:07:41.532089+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:53.298933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.542372+0000","last_change":"2023-12-19T16:07:41.541032+0000","last_active":"2023-12-19T16:07:41.542372+0000","last_peered":"2023-12-19T16:07:41.542372+0000","last_clean":"2023-12-19T16:07:41.542372+0000","last_became_active":"2023-12-19T16:07:41.540678+0000","last_became_peered":"2023-12-19T16:07:41.540678+0000","last_unstale":"2023-12-19T16:07:41.542372+0000","last_undegraded":"2023-12-19T16:07:41.542372+0000","last_fullsized":"2023-12-19T16:07:41.542372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:42.914223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531219+0000","last_change":"2023-12-19T16:07:41.531219+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531219+0000","last_undegraded":"2023-12-19T16:07:41.531219+0000","last_fullsized":"2023-12-19T16:07:41.531219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:36.918227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.543129+0000","last_change":"2023-12-19T16:07:41.540982+0000","last_active":"2023-12-19T16:07:41.543129+0000","last_peered":"2023-12-19T16:07:41.543129+0000","last_clean":"2023-12-19T16:07:41.543129+0000","last_became_active":"2023-12-19T16:07:41.540654+0000","last_became_peered":"2023-12-19T16:07:41.540654+0000","last_unstale":"2023-12-19T16:07:41.543129+0000","last_undegraded":"2023-12-19T16:07:41.543129+0000","last_fullsized":"2023-12-19T16:07:41.543129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:48.955394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531185+0000","last_change":"2023-12-19T16:07:41.531185+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531185+0000","last_undegraded":"2023-12-19T16:07:41.531185+0000","last_fullsized":"2023-12-19T16:07:41.531185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:42.891596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.543765+0000","last_change":"2023-12-19T16:07:41.543300+0000","last_active":"2023-12-19T16:07:41.543765+0000","last_peered":"2023-12-19T16:07:41.543765+0000","last_clean":"2023-12-19T16:07:41.543765+0000","last_became_active":"2023-12-19T16:07:41.543098+0000","last_became_peered":"2023-12-19T16:07:41.543098+0000","last_unstale":"2023-12-19T16:07:41.543765+0000","last_undegraded":"2023-12-19T16:07:41.543765+0000","last_fullsized":"2023-12-19T16:07:41.543765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:16:33.732599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530754+0000","last_change":"2023-12-19T16:07:41.530754+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530754+0000","last_undegraded":"2023-12-19T16:07:41.530754+0000","last_fullsized":"2023-12-19T16:07:41.530754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:22.382499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538409+0000","last_change":"2023-12-19T16:07:41.536582+0000","last_active":"2023-12-19T16:07:41.538409+0000","last_peered":"2023-12-19T16:07:41.538409+0000","last_clean":"2023-12-19T16:07:41.538409+0000","last_became_active":"2023-12-19T16:07:41.536322+0000","last_became_peered":"2023-12-19T16:07:41.536322+0000","last_unstale":"2023-12-19T16:07:41.538409+0000","last_undegraded":"2023-12-19T16:07:41.538409+0000","last_fullsized":"2023-12-19T16:07:41.538409+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:40:35.184260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.526708+0000","last_change":"2023-12-19T16:07:41.526708+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.526708+0000","last_undegraded":"2023-12-19T16:07:41.526708+0000","last_fullsized":"2023-12-19T16:07:41.526708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:03:01.998993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.540447+0000","last_change":"2023-12-19T16:07:41.537907+0000","last_active":"2023-12-19T16:07:41.540447+0000","last_peered":"2023-12-19T16:07:41.540447+0000","last_clean":"2023-12-19T16:07:41.540447+0000","last_became_active":"2023-12-19T16:07:41.537096+0000","last_became_peered":"2023-12-19T16:07:41.537096+0000","last_unstale":"2023-12-19T16:07:41.540447+0000","last_undegraded":"2023-12-19T16:07:41.540447+0000","last_fullsized":"2023-12-19T16:07:41.540447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:04:24.120557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530063+0000","last_change":"2023-12-19T16:07:41.530063+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530063+0000","last_undegraded":"2023-12-19T16:07:41.530063+0000","last_fullsized":"2023-12-19T16:07:41.530063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:58.080454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.540808+0000","last_change":"2023-12-19T16:07:41.535728+0000","last_active":"2023-12-19T16:07:41.540808+0000","last_peered":"2023-12-19T16:07:41.540808+0000","last_clean":"2023-12-19T16:07:41.540808+0000","last_became_active":"2023-12-19T16:07:41.535425+0000","last_became_peered":"2023-12-19T16:07:41.535425+0000","last_unstale":"2023-12-19T16:07:41.540808+0000","last_undegraded":"2023-12-19T16:07:41.540808+0000","last_fullsized":"2023-12-19T16:07:41.540808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:42.914223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530466+0000","last_change":"2023-12-19T16:07:41.530466+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530466+0000","last_undegraded":"2023-12-19T16:07:41.530466+0000","last_fullsized":"2023-12-19T16:07:41.530466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:14:36.093257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.544582+0000","last_change":"2023-12-19T16:07:41.541840+0000","last_active":"2023-12-19T16:07:41.544582+0000","last_peered":"2023-12-19T16:07:41.544582+0000","last_clean":"2023-12-19T16:07:41.544582+0000","last_became_active":"2023-12-19T16:07:41.541418+0000","last_became_peered":"2023-12-19T16:07:41.541418+0000","last_unstale":"2023-12-19T16:07:41.544582+0000","last_undegraded":"2023-12-19T16:07:41.544582+0000","last_fullsized":"2023-12-19T16:07:41.544582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:04.614913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531700+0000","last_change":"2023-12-19T16:07:41.531700+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531700+0000","last_undegraded":"2023-12-19T16:07:41.531700+0000","last_fullsized":"2023-12-19T16:07:41.531700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:54.332659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545380+0000","last_change":"2023-12-19T16:07:41.543692+0000","last_active":"2023-12-19T16:07:41.545380+0000","last_peered":"2023-12-19T16:07:41.545380+0000","last_clean":"2023-12-19T16:07:41.545380+0000","last_became_active":"2023-12-19T16:07:41.543404+0000","last_became_peered":"2023-12-19T16:07:41.543404+0000","last_unstale":"2023-12-19T16:07:41.545380+0000","last_undegraded":"2023-12-19T16:07:41.545380+0000","last_fullsized":"2023-12-19T16:07:41.545380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:56.749124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530470+0000","last_change":"2023-12-19T16:07:41.530470+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530470+0000","last_undegraded":"2023-12-19T16:07:41.530470+0000","last_fullsized":"2023-12-19T16:07:41.530470+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:40:14.146826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.543106+0000","last_change":"2023-12-19T16:07:41.540450+0000","last_active":"2023-12-19T16:07:41.543106+0000","last_peered":"2023-12-19T16:07:41.543106+0000","last_clean":"2023-12-19T16:07:41.543106+0000","last_became_active":"2023-12-19T16:07:41.540084+0000","last_became_peered":"2023-12-19T16:07:41.540084+0000","last_unstale":"2023-12-19T16:07:41.543106+0000","last_undegraded":"2023-12-19T16:07:41.543106+0000","last_fullsized":"2023-12-19T16:07:41.543106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:42.914223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532505+0000","last_change":"2023-12-19T16:07:41.532505+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532505+0000","last_undegraded":"2023-12-19T16:07:41.532505+0000","last_fullsized":"2023-12-19T16:07:41.532505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:40:14.146826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.540767+0000","last_change":"2023-12-19T16:07:41.535019+0000","last_active":"2023-12-19T16:07:41.540767+0000","last_peered":"2023-12-19T16:07:41.540767+0000","last_clean":"2023-12-19T16:07:41.540767+0000","last_became_active":"2023-12-19T16:07:41.534739+0000","last_became_peered":"2023-12-19T16:07:41.534739+0000","last_unstale":"2023-12-19T16:07:41.540767+0000","last_undegraded":"2023-12-19T16:07:41.540767+0000","last_fullsized":"2023-12-19T16:07:41.540767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:26:48.870501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529252+0000","last_change":"2023-12-19T16:07:41.529252+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529252+0000","last_undegraded":"2023-12-19T16:07:41.529252+0000","last_fullsized":"2023-12-19T16:07:41.529252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:03:01.998993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538389+0000","last_change":"2023-12-19T16:07:41.535225+0000","last_active":"2023-12-19T16:07:41.538389+0000","last_peered":"2023-12-19T16:07:41.538389+0000","last_clean":"2023-12-19T16:07:41.538389+0000","last_became_active":"2023-12-19T16:07:41.534968+0000","last_became_peered":"2023-12-19T16:07:41.534968+0000","last_unstale":"2023-12-19T16:07:41.538389+0000","last_undegraded":"2023-12-19T16:07:41.538389+0000","last_fullsized":"2023-12-19T16:07:41.538389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:21.375178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527409+0000","last_change":"2023-12-19T16:07:41.527409+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527409+0000","last_undegraded":"2023-12-19T16:07:41.527409+0000","last_fullsized":"2023-12-19T16:07:41.527409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:15.031639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.544867+0000","last_change":"2023-12-19T16:07:41.539795+0000","last_active":"2023-12-19T16:07:41.544867+0000","last_peered":"2023-12-19T16:07:41.544867+0000","last_clean":"2023-12-19T16:07:41.544867+0000","last_became_active":"2023-12-19T16:07:41.539479+0000","last_became_peered":"2023-12-19T16:07:41.539479+0000","last_unstale":"2023-12-19T16:07:41.544867+0000","last_undegraded":"2023-12-19T16:07:41.544867+0000","last_fullsized":"2023-12-19T16:07:41.544867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:06:54.795957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525642+0000","last_change":"2023-12-19T16:07:41.525642+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525642+0000","last_undegraded":"2023-12-19T16:07:41.525642+0000","last_fullsized":"2023-12-19T16:07:41.525642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:15.031639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.539048+0000","last_change":"2023-12-19T16:07:41.537380+0000","last_active":"2023-12-19T16:07:41.539048+0000","last_peered":"2023-12-19T16:07:41.539048+0000","last_clean":"2023-12-19T16:07:41.539048+0000","last_became_active":"2023-12-19T16:07:41.537122+0000","last_became_peered":"2023-12-19T16:07:41.537122+0000","last_unstale":"2023-12-19T16:07:41.539048+0000","last_undegraded":"2023-12-19T16:07:41.539048+0000","last_fullsized":"2023-12-19T16:07:41.539048+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:35.910905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-19T16:07:40.520774+0000","last_change":"2023-12-19T16:06:47.761389+0000","last_active":"2023-12-19T16:07:40.520774+0000","last_peered":"2023-12-19T16:07:40.520774+0000","last_clean":"2023-12-19T16:07:40.520774+0000","last_became_active":"2023-12-19T16:06:47.760252+0000","last_became_peered":"2023-12-19T16:06:47.760252+0000","last_unstale":"2023-12-19T16:07:40.520774+0000","last_undegraded":"2023-12-19T16:07:40.520774+0000","last_fullsized":"2023-12-19T16:07:40.520774+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_clean_scrub_stamp":"2023-12-19T16:06:46.706871+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:09.167979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":905216,"data_stored":705288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":905216,"data_stored":705288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:07:44.899 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:07:45.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.038+0000 7f36971ab640 1 Processor -- start 2023-12-19T16:07:45.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.038+0000 7f36971ab640 1 -- start start 2023-12-19T16:07:45.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.039+0000 7f36971ab640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36900b6690 0x7f3690144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:45.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.039+0000 7f36971ab640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3690144cd0 0x7f3690155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:45.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.039+0000 7f36971ab640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36900bc6b0 con 0x7f36900bcdd0 2023-12-19T16:07:45.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.039+0000 7f36971ab640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36900a59f0 con 0x7f3690144cd0 2023-12-19T16:07:45.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.039+0000 7f36971ab640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36900bc0a0 con 0x7f36900b6690 2023-12-19T16:07:45.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.039+0000 7f3695748640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3690144cd0 0x7f3690155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:45.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.039+0000 7f3695748640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3690144cd0 0x7f3690155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37802/0 (socket says 172.21.15.37:37802) 2023-12-19T16:07:45.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.039+0000 7f3695748640 1 -- 172.21.15.37:0/371402971 learned_addr learned my addr 172.21.15.37:0/371402971 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:45.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.039+0000 7f368ffff640 1 --2- 172.21.15.37:0/371402971 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36900b6690 0x7f3690144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:45.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.039+0000 7f3695748640 1 -- 172.21.15.37:0/371402971 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36900b6690 msgr2=0x7f3690144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:45.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.039+0000 7f3695748640 1 --2- 172.21.15.37:0/371402971 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36900b6690 0x7f3690144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.039+0000 7f3695748640 1 -- 172.21.15.37:0/371402971 >> v1:172.21.15.78:6789/0 conn(0x7f36900bcdd0 legacy=0x7f36900b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:45.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.039+0000 7f3695748640 1 -- 172.21.15.37:0/371402971 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36900bc340 con 0x7f3690144cd0 2023-12-19T16:07:45.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.040+0000 7f3695748640 1 --2- 172.21.15.37:0/371402971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3690144cd0 0x7f3690155340 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3688009e50 tx=0x7f368802bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a90beb7bf737ee server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:45.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.040+0000 7f368f7fe640 1 -- 172.21.15.37:0/371402971 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368802cb90 con 0x7f3690144cd0 2023-12-19T16:07:45.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.040+0000 7f368f7fe640 1 -- 172.21.15.37:0/371402971 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368802ccf0 con 0x7f3690144cd0 2023-12-19T16:07:45.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.040+0000 7f368f7fe640 1 -- 172.21.15.37:0/371402971 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3688034610 con 0x7f3690144cd0 2023-12-19T16:07:45.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.041+0000 7f36971ab640 1 -- 172.21.15.37:0/371402971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3690144cd0 msgr2=0x7f3690155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:45.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.041+0000 7f36971ab640 1 --2- 172.21.15.37:0/371402971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3690144cd0 0x7f3690155340 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3688009e50 tx=0x7f368802bff0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.041+0000 7f36971ab640 1 -- 172.21.15.37:0/371402971 shutdown_connections 2023-12-19T16:07:45.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.041+0000 7f36971ab640 1 --2- 172.21.15.37:0/371402971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3690144cd0 0x7f3690155340 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.041+0000 7f36971ab640 1 --2- 172.21.15.37:0/371402971 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36900b6690 0x7f3690144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.041+0000 7f36971ab640 1 -- 172.21.15.37:0/371402971 >> 172.21.15.37:0/371402971 conn(0x7f3690071e60 msgr2=0x7f36900c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:45.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.041+0000 7f36971ab640 1 -- 172.21.15.37:0/371402971 shutdown_connections 2023-12-19T16:07:45.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.041+0000 7f36971ab640 1 -- 172.21.15.37:0/371402971 wait complete. 2023-12-19T16:07:45.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.042+0000 7f36971ab640 1 Processor -- start 2023-12-19T16:07:45.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.042+0000 7f36971ab640 1 -- start start 2023-12-19T16:07:45.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f36971ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36900b6690 0x7f369014a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:45.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f36971ab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36900bcdd0 0x7f36901453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:45.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f36971ab640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3690144cd0 0x7f3690147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:45.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f36971ab640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369014b9c0 con 0x7f36900bcdd0 2023-12-19T16:07:45.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f36971ab640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3690148310 con 0x7f36900b6690 2023-12-19T16:07:45.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f36971ab640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369014b6e0 con 0x7f3690144cd0 2023-12-19T16:07:45.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f368ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36900bcdd0 0x7f36901453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f368ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36900bcdd0 0x7f36901453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37814/0 (socket says 172.21.15.37:37814) 2023-12-19T16:07:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f368ffff640 1 -- 172.21.15.37:0/630447003 learned_addr learned my addr 172.21.15.37:0/630447003 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f3694f47640 1 --2- 172.21.15.37:0/630447003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36900b6690 0x7f369014a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f3695748640 1 --2- 172.21.15.37:0/630447003 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3690144cd0 0x7f3690147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f368ffff640 1 -- 172.21.15.37:0/630447003 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3690144cd0 msgr2=0x7f3690147c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f368ffff640 1 --2- 172.21.15.37:0/630447003 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3690144cd0 0x7f3690147c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f368ffff640 1 -- 172.21.15.37:0/630447003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36900b6690 msgr2=0x7f369014a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f368ffff640 1 --2- 172.21.15.37:0/630447003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36900b6690 0x7f369014a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f368ffff640 1 -- 172.21.15.37:0/630447003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3688009b30 con 0x7f36900bcdd0 2023-12-19T16:07:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f368ffff640 1 --2- 172.21.15.37:0/630447003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36900bcdd0 0x7f36901453f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f367c00e870 tx=0x7f367c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f368d7fa640 1 -- 172.21.15.37:0/630447003 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c0094f0 con 0x7f36900bcdd0 2023-12-19T16:07:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f368d7fa640 1 -- 172.21.15.37:0/630447003 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c00c940 con 0x7f36900bcdd0 2023-12-19T16:07:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f36971ab640 1 -- 172.21.15.37:0/630447003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36901e3c40 con 0x7f36900bcdd0 2023-12-19T16:07:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f368d7fa640 1 -- 172.21.15.37:0/630447003 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c00ccf0 con 0x7f36900bcdd0 2023-12-19T16:07:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.043+0000 7f36971ab640 1 -- 172.21.15.37:0/630447003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369014aa10 con 0x7f36900bcdd0 2023-12-19T16:07:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.044+0000 7f36971ab640 1 -- 172.21.15.37:0/630447003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3690149db0 con 0x7f36900bcdd0 2023-12-19T16:07:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.045+0000 7f368d7fa640 1 -- 172.21.15.37:0/630447003 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f367c013470 con 0x7f36900bcdd0 2023-12-19T16:07:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.045+0000 7f368d7fa640 1 --2- 172.21.15.37:0/630447003 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f367406a430 0x7f367406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.045+0000 7f368d7fa640 1 -- 172.21.15.37:0/630447003 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f367c0888e0 con 0x7f36900bcdd0 2023-12-19T16:07:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.045+0000 7f3694f47640 1 --2- 172.21.15.37:0/630447003 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f367406a430 0x7f367406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.046+0000 7f3694f47640 1 --2- 172.21.15.37:0/630447003 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f367406a430 0x7f367406c8f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3684000f60 tx=0x7f3684009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:45.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.049+0000 7f368d7fa640 1 -- 172.21.15.37:0/630447003 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3690149db0 con 0x7f36900bcdd0 2023-12-19T16:07:45.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.223+0000 7f36971ab640 1 -- 172.21.15.37:0/630447003 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3690145180 con 0x7f367406a430 2023-12-19T16:07:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.230+0000 7f368d7fa640 1 -- 172.21.15.37:0/630447003 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+261740 (secure 0 0 0) 0x7f3684001d10 con 0x7f367406a430 2023-12-19T16:07:45.235 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-19T16:07:45.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.233+0000 7f36971ab640 1 -- 172.21.15.37:0/630447003 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f367406a430 msgr2=0x7f367406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:45.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.233+0000 7f36971ab640 1 --2- 172.21.15.37:0/630447003 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f367406a430 0x7f367406c8f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3684000f60 tx=0x7f3684009040 comp rx=0 tx=0).stop 2023-12-19T16:07:45.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.233+0000 7f36971ab640 1 -- 172.21.15.37:0/630447003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36900bcdd0 msgr2=0x7f36901453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:45.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.233+0000 7f36971ab640 1 --2- 172.21.15.37:0/630447003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36900bcdd0 0x7f36901453f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f367c00e870 tx=0x7f367c00ed30 comp rx=0 tx=0).stop 2023-12-19T16:07:45.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.233+0000 7f36971ab640 1 -- 172.21.15.37:0/630447003 shutdown_connections 2023-12-19T16:07:45.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.233+0000 7f36971ab640 1 --2- 172.21.15.37:0/630447003 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f367406a430 0x7f367406c8f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.233+0000 7f36971ab640 1 --2- 172.21.15.37:0/630447003 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3690144cd0 0x7f3690147c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.233+0000 7f36971ab640 1 --2- 172.21.15.37:0/630447003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36900bcdd0 0x7f36901453f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.233+0000 7f36971ab640 1 --2- 172.21.15.37:0/630447003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36900b6690 0x7f369014a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.233+0000 7f36971ab640 1 -- 172.21.15.37:0/630447003 >> 172.21.15.37:0/630447003 conn(0x7f3690071e60 msgr2=0x7f36900b88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:45.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.233+0000 7f36971ab640 1 -- 172.21.15.37:0/630447003 shutdown_connections 2023-12-19T16:07:45.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.233+0000 7f36971ab640 1 -- 172.21.15.37:0/630447003 wait complete. 2023-12-19T16:07:45.246 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-12-19T16:07:44.642123+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":3678208,"data_stored":2100096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.123105"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530870+0000","last_change":"2023-12-19T16:07:41.530870+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530870+0000","last_undegraded":"2023-12-19T16:07:41.530870+0000","last_fullsized":"2023-12-19T16:07:41.530870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:04:25.127879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.534432+0000","last_change":"2023-12-19T16:07:41.534432+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.534432+0000","last_undegraded":"2023-12-19T16:07:41.534432+0000","last_fullsized":"2023-12-19T16:07:41.534432+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:07:52.335635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529877+0000","last_change":"2023-12-19T16:07:41.529877+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529877+0000","last_undegraded":"2023-12-19T16:07:41.529877+0000","last_fullsized":"2023-12-19T16:07:41.529877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:05:34.739335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530124+0000","last_change":"2023-12-19T16:07:41.530124+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530124+0000","last_undegraded":"2023-12-19T16:07:41.530124+0000","last_fullsized":"2023-12-19T16:07:41.530124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:45:40.959769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.537184+0000","last_change":"2023-12-19T16:07:41.537184+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.537184+0000","last_undegraded":"2023-12-19T16:07:41.537184+0000","last_fullsized":"2023-12-19T16:07:41.537184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:26:49.877822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.533601+0000","last_change":"2023-12-19T16:07:41.533601+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.533601+0000","last_undegraded":"2023-12-19T16:07:41.533601+0000","last_fullsized":"2023-12-19T16:07:41.533601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:18.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525873+0000","last_change":"2023-12-19T16:07:41.525873+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525873+0000","last_undegraded":"2023-12-19T16:07:41.525873+0000","last_fullsized":"2023-12-19T16:07:41.525873+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:15:19.041369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527524+0000","last_change":"2023-12-19T16:07:41.527524+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527524+0000","last_undegraded":"2023-12-19T16:07:41.527524+0000","last_fullsized":"2023-12-19T16:07:41.527524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:42.867424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525066+0000","last_change":"2023-12-19T16:07:41.525066+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525066+0000","last_undegraded":"2023-12-19T16:07:41.525066+0000","last_fullsized":"2023-12-19T16:07:41.525066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:07:54.635072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529841+0000","last_change":"2023-12-19T16:07:41.529841+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529841+0000","last_undegraded":"2023-12-19T16:07:41.529841+0000","last_fullsized":"2023-12-19T16:07:41.529841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:15:19.041369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.524671+0000","last_change":"2023-12-19T16:07:41.524671+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.524671+0000","last_undegraded":"2023-12-19T16:07:41.524671+0000","last_fullsized":"2023-12-19T16:07:41.524671+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:32.203742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531252+0000","last_change":"2023-12-19T16:07:41.531252+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531252+0000","last_undegraded":"2023-12-19T16:07:41.531252+0000","last_fullsized":"2023-12-19T16:07:41.531252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:32.203742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.536620+0000","last_change":"2023-12-19T16:07:41.536620+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.536620+0000","last_undegraded":"2023-12-19T16:07:41.536620+0000","last_fullsized":"2023-12-19T16:07:41.536620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:43.921544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532874+0000","last_change":"2023-12-19T16:07:41.532874+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532874+0000","last_undegraded":"2023-12-19T16:07:41.532874+0000","last_fullsized":"2023-12-19T16:07:41.532874+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:25:30.826214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529784+0000","last_change":"2023-12-19T16:07:41.529784+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529784+0000","last_undegraded":"2023-12-19T16:07:41.529784+0000","last_fullsized":"2023-12-19T16:07:41.529784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:03:01.998993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525126+0000","last_change":"2023-12-19T16:07:41.525126+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525126+0000","last_undegraded":"2023-12-19T16:07:41.525126+0000","last_fullsized":"2023-12-19T16:07:41.525126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:18.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.524684+0000","last_change":"2023-12-19T16:07:41.524684+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.524684+0000","last_undegraded":"2023-12-19T16:07:41.524684+0000","last_fullsized":"2023-12-19T16:07:41.524684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:25:30.826214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529238+0000","last_change":"2023-12-19T16:07:41.529238+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529238+0000","last_undegraded":"2023-12-19T16:07:41.529238+0000","last_fullsized":"2023-12-19T16:07:41.529238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:51.385493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531471+0000","last_change":"2023-12-19T16:07:41.531471+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531471+0000","last_undegraded":"2023-12-19T16:07:41.531471+0000","last_fullsized":"2023-12-19T16:07:41.531471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:27.607901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532210+0000","last_change":"2023-12-19T16:07:41.532210+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532210+0000","last_undegraded":"2023-12-19T16:07:41.532210+0000","last_fullsized":"2023-12-19T16:07:41.532210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:57.756446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.528412+0000","last_change":"2023-12-19T16:07:41.528412+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.528412+0000","last_undegraded":"2023-12-19T16:07:41.528412+0000","last_fullsized":"2023-12-19T16:07:41.528412+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:22.467159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525781+0000","last_change":"2023-12-19T16:07:41.525781+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525781+0000","last_undegraded":"2023-12-19T16:07:41.525781+0000","last_fullsized":"2023-12-19T16:07:41.525781+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:30:03.606200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531959+0000","last_change":"2023-12-19T16:07:41.531959+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531959+0000","last_undegraded":"2023-12-19T16:07:41.531959+0000","last_fullsized":"2023-12-19T16:07:41.531959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:49.018092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529594+0000","last_change":"2023-12-19T16:07:41.529594+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529594+0000","last_undegraded":"2023-12-19T16:07:41.529594+0000","last_fullsized":"2023-12-19T16:07:41.529594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:42.867424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.528676+0000","last_change":"2023-12-19T16:07:41.528676+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.528676+0000","last_undegraded":"2023-12-19T16:07:41.528676+0000","last_fullsized":"2023-12-19T16:07:41.528676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:51.385493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.528656+0000","last_change":"2023-12-19T16:07:41.528656+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.528656+0000","last_undegraded":"2023-12-19T16:07:41.528656+0000","last_fullsized":"2023-12-19T16:07:41.528656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:42.867424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530116+0000","last_change":"2023-12-19T16:07:41.530116+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530116+0000","last_undegraded":"2023-12-19T16:07:41.530116+0000","last_fullsized":"2023-12-19T16:07:41.530116+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:09.783023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530639+0000","last_change":"2023-12-19T16:07:41.530639+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530639+0000","last_undegraded":"2023-12-19T16:07:41.530639+0000","last_fullsized":"2023-12-19T16:07:41.530639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:25:30.826214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527975+0000","last_change":"2023-12-19T16:07:41.527975+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527975+0000","last_undegraded":"2023-12-19T16:07:41.527975+0000","last_fullsized":"2023-12-19T16:07:41.527975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:09.783023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525699+0000","last_change":"2023-12-19T16:07:41.525699+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525699+0000","last_undegraded":"2023-12-19T16:07:41.525699+0000","last_fullsized":"2023-12-19T16:07:41.525699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:23.495455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529951+0000","last_change":"2023-12-19T16:07:41.529951+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529951+0000","last_undegraded":"2023-12-19T16:07:41.529951+0000","last_fullsized":"2023-12-19T16:07:41.529951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:06:55.803278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527111+0000","last_change":"2023-12-19T16:07:41.527111+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527111+0000","last_undegraded":"2023-12-19T16:07:41.527111+0000","last_fullsized":"2023-12-19T16:07:41.527111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:51.385493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531569+0000","last_change":"2023-12-19T16:07:41.531569+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531569+0000","last_undegraded":"2023-12-19T16:07:41.531569+0000","last_fullsized":"2023-12-19T16:07:41.531569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:07:54.635072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.540818+0000","last_change":"2023-12-19T16:07:41.539770+0000","last_active":"2023-12-19T16:07:41.540818+0000","last_peered":"2023-12-19T16:07:41.540818+0000","last_clean":"2023-12-19T16:07:41.540818+0000","last_became_active":"2023-12-19T16:07:41.539351+0000","last_became_peered":"2023-12-19T16:07:41.539351+0000","last_unstale":"2023-12-19T16:07:41.540818+0000","last_undegraded":"2023-12-19T16:07:41.540818+0000","last_fullsized":"2023-12-19T16:07:41.540818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:57.073133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530465+0000","last_change":"2023-12-19T16:07:41.530465+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530465+0000","last_undegraded":"2023-12-19T16:07:41.530465+0000","last_fullsized":"2023-12-19T16:07:41.530465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:25:19.019112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.541611+0000","last_change":"2023-12-19T16:07:41.539319+0000","last_active":"2023-12-19T16:07:41.541611+0000","last_peered":"2023-12-19T16:07:41.541611+0000","last_clean":"2023-12-19T16:07:41.541611+0000","last_became_active":"2023-12-19T16:07:41.539008+0000","last_became_peered":"2023-12-19T16:07:41.539008+0000","last_unstale":"2023-12-19T16:07:41.541611+0000","last_undegraded":"2023-12-19T16:07:41.541611+0000","last_fullsized":"2023-12-19T16:07:41.541611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:33.056284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527427+0000","last_change":"2023-12-19T16:07:41.527427+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527427+0000","last_undegraded":"2023-12-19T16:07:41.527427+0000","last_fullsized":"2023-12-19T16:07:41.527427+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:45:40.959769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545626+0000","last_change":"2023-12-19T16:07:41.544330+0000","last_active":"2023-12-19T16:07:41.545626+0000","last_peered":"2023-12-19T16:07:41.545626+0000","last_clean":"2023-12-19T16:07:41.545626+0000","last_became_active":"2023-12-19T16:07:41.544039+0000","last_became_peered":"2023-12-19T16:07:41.544039+0000","last_unstale":"2023-12-19T16:07:41.545626+0000","last_undegraded":"2023-12-19T16:07:41.545626+0000","last_fullsized":"2023-12-19T16:07:41.545626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:04.614913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.528051+0000","last_change":"2023-12-19T16:07:41.528051+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.528051+0000","last_undegraded":"2023-12-19T16:07:41.528051+0000","last_fullsized":"2023-12-19T16:07:41.528051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:54.332659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.544840+0000","last_change":"2023-12-19T16:07:41.538998+0000","last_active":"2023-12-19T16:07:41.544840+0000","last_peered":"2023-12-19T16:07:41.544840+0000","last_clean":"2023-12-19T16:07:41.544840+0000","last_became_active":"2023-12-19T16:07:41.538718+0000","last_became_peered":"2023-12-19T16:07:41.538718+0000","last_unstale":"2023-12-19T16:07:41.544840+0000","last_undegraded":"2023-12-19T16:07:41.544840+0000","last_fullsized":"2023-12-19T16:07:41.544840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:56:08.338813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525160+0000","last_change":"2023-12-19T16:07:41.525160+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525160+0000","last_undegraded":"2023-12-19T16:07:41.525160+0000","last_fullsized":"2023-12-19T16:07:41.525160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:30:03.606200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.542347+0000","last_change":"2023-12-19T16:07:41.540990+0000","last_active":"2023-12-19T16:07:41.542347+0000","last_peered":"2023-12-19T16:07:41.542347+0000","last_clean":"2023-12-19T16:07:41.542347+0000","last_became_active":"2023-12-19T16:07:41.540782+0000","last_became_peered":"2023-12-19T16:07:41.540782+0000","last_unstale":"2023-12-19T16:07:41.542347+0000","last_undegraded":"2023-12-19T16:07:41.542347+0000","last_fullsized":"2023-12-19T16:07:41.542347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:56.749124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531408+0000","last_change":"2023-12-19T16:07:41.531408+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531408+0000","last_undegraded":"2023-12-19T16:07:41.531408+0000","last_fullsized":"2023-12-19T16:07:41.531408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:23.495455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.541485+0000","last_change":"2023-12-19T16:07:41.540194+0000","last_active":"2023-12-19T16:07:41.541485+0000","last_peered":"2023-12-19T16:07:41.541485+0000","last_clean":"2023-12-19T16:07:41.541485+0000","last_became_active":"2023-12-19T16:07:41.539841+0000","last_became_peered":"2023-12-19T16:07:41.539841+0000","last_unstale":"2023-12-19T16:07:41.541485+0000","last_undegraded":"2023-12-19T16:07:41.541485+0000","last_fullsized":"2023-12-19T16:07:41.541485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:35.910905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525861+0000","last_change":"2023-12-19T16:07:41.525861+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525861+0000","last_undegraded":"2023-12-19T16:07:41.525861+0000","last_fullsized":"2023-12-19T16:07:41.525861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:54.332659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545362+0000","last_change":"2023-12-19T16:07:41.543547+0000","last_active":"2023-12-19T16:07:41.545362+0000","last_peered":"2023-12-19T16:07:41.545362+0000","last_clean":"2023-12-19T16:07:41.545362+0000","last_became_active":"2023-12-19T16:07:41.543289+0000","last_became_peered":"2023-12-19T16:07:41.543289+0000","last_unstale":"2023-12-19T16:07:41.545362+0000","last_undegraded":"2023-12-19T16:07:41.545362+0000","last_fullsized":"2023-12-19T16:07:41.545362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:48.955394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530232+0000","last_change":"2023-12-19T16:07:41.530232+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530232+0000","last_undegraded":"2023-12-19T16:07:41.530232+0000","last_fullsized":"2023-12-19T16:07:41.530232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:22.467159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.537161+0000","last_change":"2023-12-19T16:07:41.534939+0000","last_active":"2023-12-19T16:07:41.537161+0000","last_peered":"2023-12-19T16:07:41.537161+0000","last_clean":"2023-12-19T16:07:41.537161+0000","last_became_active":"2023-12-19T16:07:41.534662+0000","last_became_peered":"2023-12-19T16:07:41.534662+0000","last_unstale":"2023-12-19T16:07:41.537161+0000","last_undegraded":"2023-12-19T16:07:41.537161+0000","last_fullsized":"2023-12-19T16:07:41.537161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:41.884274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529250+0000","last_change":"2023-12-19T16:07:41.529250+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529250+0000","last_undegraded":"2023-12-19T16:07:41.529250+0000","last_fullsized":"2023-12-19T16:07:41.529250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:18.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.542172+0000","last_change":"2023-12-19T16:07:41.539076+0000","last_active":"2023-12-19T16:07:41.542172+0000","last_peered":"2023-12-19T16:07:41.542172+0000","last_clean":"2023-12-19T16:07:41.542172+0000","last_became_active":"2023-12-19T16:07:41.538793+0000","last_became_peered":"2023-12-19T16:07:41.538793+0000","last_unstale":"2023-12-19T16:07:41.542172+0000","last_undegraded":"2023-12-19T16:07:41.542172+0000","last_fullsized":"2023-12-19T16:07:41.542172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:42:25.311467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530117+0000","last_change":"2023-12-19T16:07:41.530117+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530117+0000","last_undegraded":"2023-12-19T16:07:41.530117+0000","last_fullsized":"2023-12-19T16:07:41.530117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:05:34.739335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.544976+0000","last_change":"2023-12-19T16:07:41.543028+0000","last_active":"2023-12-19T16:07:41.544976+0000","last_peered":"2023-12-19T16:07:41.544976+0000","last_clean":"2023-12-19T16:07:41.544976+0000","last_became_active":"2023-12-19T16:07:41.542523+0000","last_became_peered":"2023-12-19T16:07:41.542523+0000","last_unstale":"2023-12-19T16:07:41.544976+0000","last_undegraded":"2023-12-19T16:07:41.544976+0000","last_fullsized":"2023-12-19T16:07:41.544976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:26:48.870501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532322+0000","last_change":"2023-12-19T16:07:41.532322+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532322+0000","last_undegraded":"2023-12-19T16:07:41.532322+0000","last_fullsized":"2023-12-19T16:07:41.532322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:32.203742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538529+0000","last_change":"2023-12-19T16:07:41.534899+0000","last_active":"2023-12-19T16:07:41.538529+0000","last_peered":"2023-12-19T16:07:41.538529+0000","last_clean":"2023-12-19T16:07:41.538529+0000","last_became_active":"2023-12-19T16:07:41.534601+0000","last_became_peered":"2023-12-19T16:07:41.534601+0000","last_unstale":"2023-12-19T16:07:41.538529+0000","last_undegraded":"2023-12-19T16:07:41.538529+0000","last_fullsized":"2023-12-19T16:07:41.538529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:42.994812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530322+0000","last_change":"2023-12-19T16:07:41.530322+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530322+0000","last_undegraded":"2023-12-19T16:07:41.530322+0000","last_fullsized":"2023-12-19T16:07:41.530322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:27.607901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545470+0000","last_change":"2023-12-19T16:07:41.543958+0000","last_active":"2023-12-19T16:07:41.545470+0000","last_peered":"2023-12-19T16:07:41.545470+0000","last_clean":"2023-12-19T16:07:41.545470+0000","last_became_active":"2023-12-19T16:07:41.543503+0000","last_became_peered":"2023-12-19T16:07:41.543503+0000","last_unstale":"2023-12-19T16:07:41.545470+0000","last_undegraded":"2023-12-19T16:07:41.545470+0000","last_fullsized":"2023-12-19T16:07:41.545470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:25:18.011790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530356+0000","last_change":"2023-12-19T16:07:41.530356+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530356+0000","last_undegraded":"2023-12-19T16:07:41.530356+0000","last_fullsized":"2023-12-19T16:07:41.530356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:15.031639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.537202+0000","last_change":"2023-12-19T16:07:41.534556+0000","last_active":"2023-12-19T16:07:41.537202+0000","last_peered":"2023-12-19T16:07:41.537202+0000","last_clean":"2023-12-19T16:07:41.537202+0000","last_became_active":"2023-12-19T16:07:41.534265+0000","last_became_peered":"2023-12-19T16:07:41.534265+0000","last_unstale":"2023-12-19T16:07:41.537202+0000","last_undegraded":"2023-12-19T16:07:41.537202+0000","last_fullsized":"2023-12-19T16:07:41.537202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:16:33.732599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531449+0000","last_change":"2023-12-19T16:07:41.531449+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531449+0000","last_undegraded":"2023-12-19T16:07:41.531449+0000","last_fullsized":"2023-12-19T16:07:41.531449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:14:36.093257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.543193+0000","last_change":"2023-12-19T16:07:41.541301+0000","last_active":"2023-12-19T16:07:41.543193+0000","last_peered":"2023-12-19T16:07:41.543193+0000","last_clean":"2023-12-19T16:07:41.543193+0000","last_became_active":"2023-12-19T16:07:41.540995+0000","last_became_peered":"2023-12-19T16:07:41.540995+0000","last_unstale":"2023-12-19T16:07:41.543193+0000","last_undegraded":"2023-12-19T16:07:41.543193+0000","last_fullsized":"2023-12-19T16:07:41.543193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:04.614913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.526664+0000","last_change":"2023-12-19T16:07:41.526664+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.526664+0000","last_undegraded":"2023-12-19T16:07:41.526664+0000","last_fullsized":"2023-12-19T16:07:41.526664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:09.783023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545015+0000","last_change":"2023-12-19T16:07:41.540432+0000","last_active":"2023-12-19T16:07:41.545015+0000","last_peered":"2023-12-19T16:07:41.545015+0000","last_clean":"2023-12-19T16:07:41.545015+0000","last_became_active":"2023-12-19T16:07:41.540087+0000","last_became_peered":"2023-12-19T16:07:41.540087+0000","last_unstale":"2023-12-19T16:07:41.545015+0000","last_undegraded":"2023-12-19T16:07:41.545015+0000","last_fullsized":"2023-12-19T16:07:41.545015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:04:24.120557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529369+0000","last_change":"2023-12-19T16:07:41.529369+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529369+0000","last_undegraded":"2023-12-19T16:07:41.529369+0000","last_fullsized":"2023-12-19T16:07:41.529369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:44.002133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538459+0000","last_change":"2023-12-19T16:07:41.534179+0000","last_active":"2023-12-19T16:07:41.538459+0000","last_peered":"2023-12-19T16:07:41.538459+0000","last_clean":"2023-12-19T16:07:41.538459+0000","last_became_active":"2023-12-19T16:07:41.533903+0000","last_became_peered":"2023-12-19T16:07:41.533903+0000","last_unstale":"2023-12-19T16:07:41.538459+0000","last_undegraded":"2023-12-19T16:07:41.538459+0000","last_fullsized":"2023-12-19T16:07:41.538459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:42.994812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.526582+0000","last_change":"2023-12-19T16:07:41.526582+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.526582+0000","last_undegraded":"2023-12-19T16:07:41.526582+0000","last_fullsized":"2023-12-19T16:07:41.526582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:49.018092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.542338+0000","last_change":"2023-12-19T16:07:41.539027+0000","last_active":"2023-12-19T16:07:41.542338+0000","last_peered":"2023-12-19T16:07:41.542338+0000","last_clean":"2023-12-19T16:07:41.542338+0000","last_became_active":"2023-12-19T16:07:41.538640+0000","last_became_peered":"2023-12-19T16:07:41.538640+0000","last_unstale":"2023-12-19T16:07:41.542338+0000","last_undegraded":"2023-12-19T16:07:41.542338+0000","last_fullsized":"2023-12-19T16:07:41.542338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:33.056284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530904+0000","last_change":"2023-12-19T16:07:41.530904+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530904+0000","last_undegraded":"2023-12-19T16:07:41.530904+0000","last_fullsized":"2023-12-19T16:07:41.530904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:15:19.041369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538397+0000","last_change":"2023-12-19T16:07:41.535833+0000","last_active":"2023-12-19T16:07:41.538397+0000","last_peered":"2023-12-19T16:07:41.538397+0000","last_clean":"2023-12-19T16:07:41.538397+0000","last_became_active":"2023-12-19T16:07:41.535489+0000","last_became_peered":"2023-12-19T16:07:41.535489+0000","last_unstale":"2023-12-19T16:07:41.538397+0000","last_undegraded":"2023-12-19T16:07:41.538397+0000","last_fullsized":"2023-12-19T16:07:41.538397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:57.073133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529391+0000","last_change":"2023-12-19T16:07:41.529391+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529391+0000","last_undegraded":"2023-12-19T16:07:41.529391+0000","last_fullsized":"2023-12-19T16:07:41.529391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:30:03.606200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.537077+0000","last_change":"2023-12-19T16:07:41.534514+0000","last_active":"2023-12-19T16:07:41.537077+0000","last_peered":"2023-12-19T16:07:41.537077+0000","last_clean":"2023-12-19T16:07:41.537077+0000","last_became_active":"2023-12-19T16:07:41.532360+0000","last_became_peered":"2023-12-19T16:07:41.532360+0000","last_unstale":"2023-12-19T16:07:41.537077+0000","last_undegraded":"2023-12-19T16:07:41.537077+0000","last_fullsized":"2023-12-19T16:07:41.537077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:52.291611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532089+0000","last_change":"2023-12-19T16:07:41.532089+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532089+0000","last_undegraded":"2023-12-19T16:07:41.532089+0000","last_fullsized":"2023-12-19T16:07:41.532089+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:53.298933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.542372+0000","last_change":"2023-12-19T16:07:41.541032+0000","last_active":"2023-12-19T16:07:41.542372+0000","last_peered":"2023-12-19T16:07:41.542372+0000","last_clean":"2023-12-19T16:07:41.542372+0000","last_became_active":"2023-12-19T16:07:41.540678+0000","last_became_peered":"2023-12-19T16:07:41.540678+0000","last_unstale":"2023-12-19T16:07:41.542372+0000","last_undegraded":"2023-12-19T16:07:41.542372+0000","last_fullsized":"2023-12-19T16:07:41.542372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:42.914223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531219+0000","last_change":"2023-12-19T16:07:41.531219+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531219+0000","last_undegraded":"2023-12-19T16:07:41.531219+0000","last_fullsized":"2023-12-19T16:07:41.531219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:36.918227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.543129+0000","last_change":"2023-12-19T16:07:41.540982+0000","last_active":"2023-12-19T16:07:41.543129+0000","last_peered":"2023-12-19T16:07:41.543129+0000","last_clean":"2023-12-19T16:07:41.543129+0000","last_became_active":"2023-12-19T16:07:41.540654+0000","last_became_peered":"2023-12-19T16:07:41.540654+0000","last_unstale":"2023-12-19T16:07:41.543129+0000","last_undegraded":"2023-12-19T16:07:41.543129+0000","last_fullsized":"2023-12-19T16:07:41.543129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:48.955394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531185+0000","last_change":"2023-12-19T16:07:41.531185+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531185+0000","last_undegraded":"2023-12-19T16:07:41.531185+0000","last_fullsized":"2023-12-19T16:07:41.531185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:42.891596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.543765+0000","last_change":"2023-12-19T16:07:41.543300+0000","last_active":"2023-12-19T16:07:41.543765+0000","last_peered":"2023-12-19T16:07:41.543765+0000","last_clean":"2023-12-19T16:07:41.543765+0000","last_became_active":"2023-12-19T16:07:41.543098+0000","last_became_peered":"2023-12-19T16:07:41.543098+0000","last_unstale":"2023-12-19T16:07:41.543765+0000","last_undegraded":"2023-12-19T16:07:41.543765+0000","last_fullsized":"2023-12-19T16:07:41.543765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:16:33.732599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530754+0000","last_change":"2023-12-19T16:07:41.530754+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530754+0000","last_undegraded":"2023-12-19T16:07:41.530754+0000","last_fullsized":"2023-12-19T16:07:41.530754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:22.382499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538409+0000","last_change":"2023-12-19T16:07:41.536582+0000","last_active":"2023-12-19T16:07:41.538409+0000","last_peered":"2023-12-19T16:07:41.538409+0000","last_clean":"2023-12-19T16:07:41.538409+0000","last_became_active":"2023-12-19T16:07:41.536322+0000","last_became_peered":"2023-12-19T16:07:41.536322+0000","last_unstale":"2023-12-19T16:07:41.538409+0000","last_undegraded":"2023-12-19T16:07:41.538409+0000","last_fullsized":"2023-12-19T16:07:41.538409+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:40:35.184260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.526708+0000","last_change":"2023-12-19T16:07:41.526708+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.526708+0000","last_undegraded":"2023-12-19T16:07:41.526708+0000","last_fullsized":"2023-12-19T16:07:41.526708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:03:01.998993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.540447+0000","last_change":"2023-12-19T16:07:41.537907+0000","last_active":"2023-12-19T16:07:41.540447+0000","last_peered":"2023-12-19T16:07:41.540447+0000","last_clean":"2023-12-19T16:07:41.540447+0000","last_became_active":"2023-12-19T16:07:41.537096+0000","last_became_peered":"2023-12-19T16:07:41.537096+0000","last_unstale":"2023-12-19T16:07:41.540447+0000","last_undegraded":"2023-12-19T16:07:41.540447+0000","last_fullsized":"2023-12-19T16:07:41.540447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:04:24.120557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530063+0000","last_change":"2023-12-19T16:07:41.530063+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530063+0000","last_undegraded":"2023-12-19T16:07:41.530063+0000","last_fullsized":"2023-12-19T16:07:41.530063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:58.080454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.540808+0000","last_change":"2023-12-19T16:07:41.535728+0000","last_active":"2023-12-19T16:07:41.540808+0000","last_peered":"2023-12-19T16:07:41.540808+0000","last_clean":"2023-12-19T16:07:41.540808+0000","last_became_active":"2023-12-19T16:07:41.535425+0000","last_became_peered":"2023-12-19T16:07:41.535425+0000","last_unstale":"2023-12-19T16:07:41.540808+0000","last_undegraded":"2023-12-19T16:07:41.540808+0000","last_fullsized":"2023-12-19T16:07:41.540808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:42.914223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530466+0000","last_change":"2023-12-19T16:07:41.530466+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530466+0000","last_undegraded":"2023-12-19T16:07:41.530466+0000","last_fullsized":"2023-12-19T16:07:41.530466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:14:36.093257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.544582+0000","last_change":"2023-12-19T16:07:41.541840+0000","last_active":"2023-12-19T16:07:41.544582+0000","last_peered":"2023-12-19T16:07:41.544582+0000","last_clean":"2023-12-19T16:07:41.544582+0000","last_became_active":"2023-12-19T16:07:41.541418+0000","last_became_peered":"2023-12-19T16:07:41.541418+0000","last_unstale":"2023-12-19T16:07:41.544582+0000","last_undegraded":"2023-12-19T16:07:41.544582+0000","last_fullsized":"2023-12-19T16:07:41.544582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:04.614913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531700+0000","last_change":"2023-12-19T16:07:41.531700+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531700+0000","last_undegraded":"2023-12-19T16:07:41.531700+0000","last_fullsized":"2023-12-19T16:07:41.531700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:54.332659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545380+0000","last_change":"2023-12-19T16:07:41.543692+0000","last_active":"2023-12-19T16:07:41.545380+0000","last_peered":"2023-12-19T16:07:41.545380+0000","last_clean":"2023-12-19T16:07:41.545380+0000","last_became_active":"2023-12-19T16:07:41.543404+0000","last_became_peered":"2023-12-19T16:07:41.543404+0000","last_unstale":"2023-12-19T16:07:41.545380+0000","last_undegraded":"2023-12-19T16:07:41.545380+0000","last_fullsized":"2023-12-19T16:07:41.545380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:56.749124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530470+0000","last_change":"2023-12-19T16:07:41.530470+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530470+0000","last_undegraded":"2023-12-19T16:07:41.530470+0000","last_fullsized":"2023-12-19T16:07:41.530470+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:40:14.146826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.543106+0000","last_change":"2023-12-19T16:07:41.540450+0000","last_active":"2023-12-19T16:07:41.543106+0000","last_peered":"2023-12-19T16:07:41.543106+0000","last_clean":"2023-12-19T16:07:41.543106+0000","last_became_active":"2023-12-19T16:07:41.540084+0000","last_became_peered":"2023-12-19T16:07:41.540084+0000","last_unstale":"2023-12-19T16:07:41.543106+0000","last_undegraded":"2023-12-19T16:07:41.543106+0000","last_fullsized":"2023-12-19T16:07:41.543106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:42.914223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532505+0000","last_change":"2023-12-19T16:07:41.532505+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532505+0000","last_undegraded":"2023-12-19T16:07:41.532505+0000","last_fullsized":"2023-12-19T16:07:41.532505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:40:14.146826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.540767+0000","last_change":"2023-12-19T16:07:41.535019+0000","last_active":"2023-12-19T16:07:41.540767+0000","last_peered":"2023-12-19T16:07:41.540767+0000","last_clean":"2023-12-19T16:07:41.540767+0000","last_became_active":"2023-12-19T16:07:41.534739+0000","last_became_peered":"2023-12-19T16:07:41.534739+0000","last_unstale":"2023-12-19T16:07:41.540767+0000","last_undegraded":"2023-12-19T16:07:41.540767+0000","last_fullsized":"2023-12-19T16:07:41.540767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:26:48.870501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529252+0000","last_change":"2023-12-19T16:07:41.529252+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529252+0000","last_undegraded":"2023-12-19T16:07:41.529252+0000","last_fullsized":"2023-12-19T16:07:41.529252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:03:01.998993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538389+0000","last_change":"2023-12-19T16:07:41.535225+0000","last_active":"2023-12-19T16:07:41.538389+0000","last_peered":"2023-12-19T16:07:41.538389+0000","last_clean":"2023-12-19T16:07:41.538389+0000","last_became_active":"2023-12-19T16:07:41.534968+0000","last_became_peered":"2023-12-19T16:07:41.534968+0000","last_unstale":"2023-12-19T16:07:41.538389+0000","last_undegraded":"2023-12-19T16:07:41.538389+0000","last_fullsized":"2023-12-19T16:07:41.538389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:21.375178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527409+0000","last_change":"2023-12-19T16:07:41.527409+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527409+0000","last_undegraded":"2023-12-19T16:07:41.527409+0000","last_fullsized":"2023-12-19T16:07:41.527409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:15.031639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.544867+0000","last_change":"2023-12-19T16:07:41.539795+0000","last_active":"2023-12-19T16:07:41.544867+0000","last_peered":"2023-12-19T16:07:41.544867+0000","last_clean":"2023-12-19T16:07:41.544867+0000","last_became_active":"2023-12-19T16:07:41.539479+0000","last_became_peered":"2023-12-19T16:07:41.539479+0000","last_unstale":"2023-12-19T16:07:41.544867+0000","last_undegraded":"2023-12-19T16:07:41.544867+0000","last_fullsized":"2023-12-19T16:07:41.544867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:06:54.795957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525642+0000","last_change":"2023-12-19T16:07:41.525642+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525642+0000","last_undegraded":"2023-12-19T16:07:41.525642+0000","last_fullsized":"2023-12-19T16:07:41.525642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:15.031639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.539048+0000","last_change":"2023-12-19T16:07:41.537380+0000","last_active":"2023-12-19T16:07:41.539048+0000","last_peered":"2023-12-19T16:07:41.539048+0000","last_clean":"2023-12-19T16:07:41.539048+0000","last_became_active":"2023-12-19T16:07:41.537122+0000","last_became_peered":"2023-12-19T16:07:41.537122+0000","last_unstale":"2023-12-19T16:07:41.539048+0000","last_undegraded":"2023-12-19T16:07:41.539048+0000","last_fullsized":"2023-12-19T16:07:41.539048+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:35.910905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-19T16:07:40.520774+0000","last_change":"2023-12-19T16:06:47.761389+0000","last_active":"2023-12-19T16:07:40.520774+0000","last_peered":"2023-12-19T16:07:40.520774+0000","last_clean":"2023-12-19T16:07:40.520774+0000","last_became_active":"2023-12-19T16:06:47.760252+0000","last_became_peered":"2023-12-19T16:06:47.760252+0000","last_unstale":"2023-12-19T16:07:40.520774+0000","last_undegraded":"2023-12-19T16:07:40.520774+0000","last_fullsized":"2023-12-19T16:07:40.520774+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_clean_scrub_stamp":"2023-12-19T16:06:46.706871+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:09.167979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":905216,"data_stored":705288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":905216,"data_stored":705288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:07:45.250 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:07:45.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.389+0000 7f8dc002c640 1 Processor -- start 2023-12-19T16:07:45.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.390+0000 7f8dc002c640 1 -- start start 2023-12-19T16:07:45.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.390+0000 7f8dc002c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8db806ae00 0x7f8db814aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:45.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.390+0000 7f8dc002c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8db80b9a60 0x7f8db81552b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:45.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.390+0000 7f8dc002c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8db8145140 con 0x7f8db8144d60 2023-12-19T16:07:45.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.390+0000 7f8dc002c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db80bb190 con 0x7f8db80b9a60 2023-12-19T16:07:45.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.390+0000 7f8dc002c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db806b320 con 0x7f8db806ae00 2023-12-19T16:07:45.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.390+0000 7f8dbe5c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8db80b9a60 0x7f8db81552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:45.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.390+0000 7f8dbddc8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8db8144d60 0x7f8db80baa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43386/0 (socket says 172.21.15.37:43386) 2023-12-19T16:07:45.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.390+0000 7f8dbddc8640 1 -- 172.21.15.37:0/1096573943 learned_addr learned my addr 172.21.15.37:0/1096573943 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:45.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.391+0000 7f8dbd5c7640 1 --2- 172.21.15.37:0/1096573943 >> v2:172.21.15.78:3300/0 conn(0x7f8db806ae00 0x7f8db814aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:45.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.391+0000 7f8dbe5c9640 1 -- 172.21.15.37:0/1096573943 >> v2:172.21.15.78:3300/0 conn(0x7f8db806ae00 msgr2=0x7f8db814aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:45.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.391+0000 7f8dbe5c9640 1 --2- 172.21.15.37:0/1096573943 >> v2:172.21.15.78:3300/0 conn(0x7f8db806ae00 0x7f8db814aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.391+0000 7f8dbe5c9640 1 -- 172.21.15.37:0/1096573943 >> v1:172.21.15.37:6789/0 conn(0x7f8db8144d60 legacy=0x7f8db80baa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:45.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.391+0000 7f8dbe5c9640 1 -- 172.21.15.37:0/1096573943 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db806b600 con 0x7f8db80b9a60 2023-12-19T16:07:45.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.391+0000 7f8dbcdc6640 1 -- 172.21.15.37:0/1096573943 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1067474657 0 0) 0x7f8db8145140 con 0x7f8db8144d60 2023-12-19T16:07:45.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.391+0000 7f8dbd5c7640 1 --2- 172.21.15.37:0/1096573943 >> v2:172.21.15.78:3300/0 conn(0x7f8db806ae00 0x7f8db814aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:45.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.391+0000 7f8dbe5c9640 1 --2- 172.21.15.37:0/1096573943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db80b9a60 0x7f8db81552b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8db806c410 tx=0x7f8db002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628f2c79c126b4f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:45.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.392+0000 7f8dbcdc6640 1 -- 172.21.15.37:0/1096573943 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db002cd00 con 0x7f8db80b9a60 2023-12-19T16:07:45.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.392+0000 7f8dbcdc6640 1 -- 172.21.15.37:0/1096573943 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db002ce60 con 0x7f8db80b9a60 2023-12-19T16:07:45.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.392+0000 7f8dbcdc6640 1 -- 172.21.15.37:0/1096573943 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db0034660 con 0x7f8db80b9a60 2023-12-19T16:07:45.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.392+0000 7f8dc002c640 1 -- 172.21.15.37:0/1096573943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db80b9a60 msgr2=0x7f8db81552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:45.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.392+0000 7f8dc002c640 1 --2- 172.21.15.37:0/1096573943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db80b9a60 0x7f8db81552b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8db806c410 tx=0x7f8db002bf50 comp rx=0 tx=0).stop 2023-12-19T16:07:45.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.392+0000 7f8dc002c640 1 -- 172.21.15.37:0/1096573943 shutdown_connections 2023-12-19T16:07:45.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.392+0000 7f8dc002c640 1 --2- 172.21.15.37:0/1096573943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db80b9a60 0x7f8db81552b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.392+0000 7f8dc002c640 1 --2- 172.21.15.37:0/1096573943 >> v2:172.21.15.78:3300/0 conn(0x7f8db806ae00 0x7f8db814aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.392+0000 7f8dc002c640 1 -- 172.21.15.37:0/1096573943 >> 172.21.15.37:0/1096573943 conn(0x7f8db8069ba0 msgr2=0x7f8db8069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:45.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.392+0000 7f8dc002c640 1 -- 172.21.15.37:0/1096573943 shutdown_connections 2023-12-19T16:07:45.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.392+0000 7f8dc002c640 1 -- 172.21.15.37:0/1096573943 wait complete. 2023-12-19T16:07:45.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.393+0000 7f8dc002c640 1 Processor -- start 2023-12-19T16:07:45.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.393+0000 7f8dc002c640 1 -- start start 2023-12-19T16:07:45.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.394+0000 7f8dc002c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8db806ae00 0x7f8db80b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:45.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.394+0000 7f8dc002c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db80b9a60 0x7f8db8145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:45.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.394+0000 7f8dc002c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8db8144d60 0x7f8db8146a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:45.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.394+0000 7f8dc002c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db8145ab0 con 0x7f8db80b9a60 2023-12-19T16:07:45.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.394+0000 7f8dc002c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db80b72b0 con 0x7f8db806ae00 2023-12-19T16:07:45.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.394+0000 7f8dc002c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db81462e0 con 0x7f8db8144d60 2023-12-19T16:07:45.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.394+0000 7f8dbd5c7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db80b9a60 0x7f8db8145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:45.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.394+0000 7f8dbd5c7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db80b9a60 0x7f8db8145570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37822/0 (socket says 172.21.15.37:37822) 2023-12-19T16:07:45.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.394+0000 7f8dbd5c7640 1 -- 172.21.15.37:0/1526313488 learned_addr learned my addr 172.21.15.37:0/1526313488 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:45.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.394+0000 7f8dbddc8640 1 --2- 172.21.15.37:0/1526313488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8db806ae00 0x7f8db80b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:45.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.394+0000 7f8dbe5c9640 1 --2- 172.21.15.37:0/1526313488 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8db8144d60 0x7f8db8146a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:45.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.394+0000 7f8dbd5c7640 1 -- 172.21.15.37:0/1526313488 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8db8144d60 msgr2=0x7f8db8146a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:45.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.394+0000 7f8dbd5c7640 1 --2- 172.21.15.37:0/1526313488 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8db8144d60 0x7f8db8146a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.394+0000 7f8dbd5c7640 1 -- 172.21.15.37:0/1526313488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8db806ae00 msgr2=0x7f8db80b5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:45.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.394+0000 7f8dbd5c7640 1 --2- 172.21.15.37:0/1526313488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8db806ae00 0x7f8db80b5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.394+0000 7f8dbd5c7640 1 -- 172.21.15.37:0/1526313488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db0009a70 con 0x7f8db80b9a60 2023-12-19T16:07:45.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.394+0000 7f8dbe5c9640 1 --2- 172.21.15.37:0/1526313488 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8db8144d60 0x7f8db8146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:45.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.395+0000 7f8dbd5c7640 1 --2- 172.21.15.37:0/1526313488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db80b9a60 0x7f8db8145570 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8da800e840 tx=0x7f8da800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:45.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.395+0000 7f8dae7fc640 1 -- 172.21.15.37:0/1526313488 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da8004230 con 0x7f8db80b9a60 2023-12-19T16:07:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.395+0000 7f8dae7fc640 1 -- 172.21.15.37:0/1526313488 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da8004390 con 0x7f8db80b9a60 2023-12-19T16:07:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.395+0000 7f8dc002c640 1 -- 172.21.15.37:0/1526313488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db8146fa0 con 0x7f8db80b9a60 2023-12-19T16:07:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.395+0000 7f8dae7fc640 1 -- 172.21.15.37:0/1526313488 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da800c8b0 con 0x7f8db80b9a60 2023-12-19T16:07:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.395+0000 7f8dc002c640 1 -- 172.21.15.37:0/1526313488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db8148090 con 0x7f8db80b9a60 2023-12-19T16:07:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.396+0000 7f8dc002c640 1 -- 172.21.15.37:0/1526313488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db804e840 con 0x7f8db80b9a60 2023-12-19T16:07:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.396+0000 7f8dae7fc640 1 -- 172.21.15.37:0/1526313488 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8da800ca10 con 0x7f8db80b9a60 2023-12-19T16:07:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.397+0000 7f8dae7fc640 1 --2- 172.21.15.37:0/1526313488 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8d9c06a430 0x7f8d9c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.397+0000 7f8dae7fc640 1 -- 172.21.15.37:0/1526313488 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8da80883c0 con 0x7f8db80b9a60 2023-12-19T16:07:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.397+0000 7f8dbddc8640 1 --2- 172.21.15.37:0/1526313488 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8d9c06a430 0x7f8d9c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:45.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.397+0000 7f8dbddc8640 1 --2- 172.21.15.37:0/1526313488 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8d9c06a430 0x7f8d9c06c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8db4007fd0 tx=0x7f8db4007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:45.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.401+0000 7f8dae7fc640 1 -- 172.21.15.37:0/1526313488 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8da8053af0 con 0x7f8db80b9a60 2023-12-19T16:07:45.500 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-19T16:07:45.497+0000 7f4a742ec640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T16:07:45.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.575+0000 7f8dc002c640 1 -- 172.21.15.37:0/1526313488 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8db80b9540 con 0x7f8d9c06a430 2023-12-19T16:07:45.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.582+0000 7f8dae7fc640 1 -- 172.21.15.37:0/1526313488 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+261740 (secure 0 0 0) 0x7f8db4004c70 con 0x7f8d9c06a430 2023-12-19T16:07:45.587 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:45.588 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-19T16:07:45.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.585+0000 7f8dc002c640 1 -- 172.21.15.37:0/1526313488 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8d9c06a430 msgr2=0x7f8d9c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:45.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.585+0000 7f8dc002c640 1 --2- 172.21.15.37:0/1526313488 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8d9c06a430 0x7f8d9c06c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8db4007fd0 tx=0x7f8db4007de0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.585+0000 7f8dc002c640 1 -- 172.21.15.37:0/1526313488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db80b9a60 msgr2=0x7f8db8145570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:45.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.585+0000 7f8dc002c640 1 --2- 172.21.15.37:0/1526313488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db80b9a60 0x7f8db8145570 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8da800e840 tx=0x7f8da800ed00 comp rx=0 tx=0).stop 2023-12-19T16:07:45.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.585+0000 7f8dc002c640 1 -- 172.21.15.37:0/1526313488 shutdown_connections 2023-12-19T16:07:45.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.585+0000 7f8dc002c640 1 --2- 172.21.15.37:0/1526313488 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8d9c06a430 0x7f8d9c06c8f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.585+0000 7f8dc002c640 1 --2- 172.21.15.37:0/1526313488 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8db8144d60 0x7f8db8146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.585+0000 7f8dc002c640 1 --2- 172.21.15.37:0/1526313488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db80b9a60 0x7f8db8145570 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.585+0000 7f8dc002c640 1 --2- 172.21.15.37:0/1526313488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8db806ae00 0x7f8db80b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.585+0000 7f8dc002c640 1 -- 172.21.15.37:0/1526313488 >> 172.21.15.37:0/1526313488 conn(0x7f8db8069ba0 msgr2=0x7f8db80baa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:45.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.585+0000 7f8dc002c640 1 -- 172.21.15.37:0/1526313488 shutdown_connections 2023-12-19T16:07:45.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.585+0000 7f8dc002c640 1 -- 172.21.15.37:0/1526313488 wait complete. 2023-12-19T16:07:45.597 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-12-19T16:07:44.642123+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":3678208,"data_stored":2100096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.123105"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530870+0000","last_change":"2023-12-19T16:07:41.530870+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530870+0000","last_undegraded":"2023-12-19T16:07:41.530870+0000","last_fullsized":"2023-12-19T16:07:41.530870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:04:25.127879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.534432+0000","last_change":"2023-12-19T16:07:41.534432+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.534432+0000","last_undegraded":"2023-12-19T16:07:41.534432+0000","last_fullsized":"2023-12-19T16:07:41.534432+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:07:52.335635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529877+0000","last_change":"2023-12-19T16:07:41.529877+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529877+0000","last_undegraded":"2023-12-19T16:07:41.529877+0000","last_fullsized":"2023-12-19T16:07:41.529877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:05:34.739335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530124+0000","last_change":"2023-12-19T16:07:41.530124+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530124+0000","last_undegraded":"2023-12-19T16:07:41.530124+0000","last_fullsized":"2023-12-19T16:07:41.530124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:45:40.959769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.537184+0000","last_change":"2023-12-19T16:07:41.537184+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.537184+0000","last_undegraded":"2023-12-19T16:07:41.537184+0000","last_fullsized":"2023-12-19T16:07:41.537184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:26:49.877822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.533601+0000","last_change":"2023-12-19T16:07:41.533601+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.533601+0000","last_undegraded":"2023-12-19T16:07:41.533601+0000","last_fullsized":"2023-12-19T16:07:41.533601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:18.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525873+0000","last_change":"2023-12-19T16:07:41.525873+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525873+0000","last_undegraded":"2023-12-19T16:07:41.525873+0000","last_fullsized":"2023-12-19T16:07:41.525873+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:15:19.041369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527524+0000","last_change":"2023-12-19T16:07:41.527524+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527524+0000","last_undegraded":"2023-12-19T16:07:41.527524+0000","last_fullsized":"2023-12-19T16:07:41.527524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:42.867424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525066+0000","last_change":"2023-12-19T16:07:41.525066+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525066+0000","last_undegraded":"2023-12-19T16:07:41.525066+0000","last_fullsized":"2023-12-19T16:07:41.525066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:07:54.635072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529841+0000","last_change":"2023-12-19T16:07:41.529841+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529841+0000","last_undegraded":"2023-12-19T16:07:41.529841+0000","last_fullsized":"2023-12-19T16:07:41.529841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:15:19.041369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.524671+0000","last_change":"2023-12-19T16:07:41.524671+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.524671+0000","last_undegraded":"2023-12-19T16:07:41.524671+0000","last_fullsized":"2023-12-19T16:07:41.524671+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:32.203742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531252+0000","last_change":"2023-12-19T16:07:41.531252+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531252+0000","last_undegraded":"2023-12-19T16:07:41.531252+0000","last_fullsized":"2023-12-19T16:07:41.531252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:32.203742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.536620+0000","last_change":"2023-12-19T16:07:41.536620+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.536620+0000","last_undegraded":"2023-12-19T16:07:41.536620+0000","last_fullsized":"2023-12-19T16:07:41.536620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:43.921544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532874+0000","last_change":"2023-12-19T16:07:41.532874+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532874+0000","last_undegraded":"2023-12-19T16:07:41.532874+0000","last_fullsized":"2023-12-19T16:07:41.532874+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:25:30.826214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529784+0000","last_change":"2023-12-19T16:07:41.529784+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529784+0000","last_undegraded":"2023-12-19T16:07:41.529784+0000","last_fullsized":"2023-12-19T16:07:41.529784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:03:01.998993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525126+0000","last_change":"2023-12-19T16:07:41.525126+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525126+0000","last_undegraded":"2023-12-19T16:07:41.525126+0000","last_fullsized":"2023-12-19T16:07:41.525126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:18.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.524684+0000","last_change":"2023-12-19T16:07:41.524684+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.524684+0000","last_undegraded":"2023-12-19T16:07:41.524684+0000","last_fullsized":"2023-12-19T16:07:41.524684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:25:30.826214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529238+0000","last_change":"2023-12-19T16:07:41.529238+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529238+0000","last_undegraded":"2023-12-19T16:07:41.529238+0000","last_fullsized":"2023-12-19T16:07:41.529238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:51.385493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531471+0000","last_change":"2023-12-19T16:07:41.531471+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531471+0000","last_undegraded":"2023-12-19T16:07:41.531471+0000","last_fullsized":"2023-12-19T16:07:41.531471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:27.607901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532210+0000","last_change":"2023-12-19T16:07:41.532210+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532210+0000","last_undegraded":"2023-12-19T16:07:41.532210+0000","last_fullsized":"2023-12-19T16:07:41.532210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:57.756446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.528412+0000","last_change":"2023-12-19T16:07:41.528412+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.528412+0000","last_undegraded":"2023-12-19T16:07:41.528412+0000","last_fullsized":"2023-12-19T16:07:41.528412+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:22.467159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525781+0000","last_change":"2023-12-19T16:07:41.525781+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525781+0000","last_undegraded":"2023-12-19T16:07:41.525781+0000","last_fullsized":"2023-12-19T16:07:41.525781+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:30:03.606200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531959+0000","last_change":"2023-12-19T16:07:41.531959+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531959+0000","last_undegraded":"2023-12-19T16:07:41.531959+0000","last_fullsized":"2023-12-19T16:07:41.531959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:49.018092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529594+0000","last_change":"2023-12-19T16:07:41.529594+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529594+0000","last_undegraded":"2023-12-19T16:07:41.529594+0000","last_fullsized":"2023-12-19T16:07:41.529594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:42.867424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.528676+0000","last_change":"2023-12-19T16:07:41.528676+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.528676+0000","last_undegraded":"2023-12-19T16:07:41.528676+0000","last_fullsized":"2023-12-19T16:07:41.528676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:51.385493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.528656+0000","last_change":"2023-12-19T16:07:41.528656+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.528656+0000","last_undegraded":"2023-12-19T16:07:41.528656+0000","last_fullsized":"2023-12-19T16:07:41.528656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:42.867424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530116+0000","last_change":"2023-12-19T16:07:41.530116+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530116+0000","last_undegraded":"2023-12-19T16:07:41.530116+0000","last_fullsized":"2023-12-19T16:07:41.530116+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:09.783023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530639+0000","last_change":"2023-12-19T16:07:41.530639+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530639+0000","last_undegraded":"2023-12-19T16:07:41.530639+0000","last_fullsized":"2023-12-19T16:07:41.530639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:25:30.826214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527975+0000","last_change":"2023-12-19T16:07:41.527975+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527975+0000","last_undegraded":"2023-12-19T16:07:41.527975+0000","last_fullsized":"2023-12-19T16:07:41.527975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:09.783023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525699+0000","last_change":"2023-12-19T16:07:41.525699+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525699+0000","last_undegraded":"2023-12-19T16:07:41.525699+0000","last_fullsized":"2023-12-19T16:07:41.525699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:23.495455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529951+0000","last_change":"2023-12-19T16:07:41.529951+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529951+0000","last_undegraded":"2023-12-19T16:07:41.529951+0000","last_fullsized":"2023-12-19T16:07:41.529951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:06:55.803278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527111+0000","last_change":"2023-12-19T16:07:41.527111+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527111+0000","last_undegraded":"2023-12-19T16:07:41.527111+0000","last_fullsized":"2023-12-19T16:07:41.527111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:51.385493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531569+0000","last_change":"2023-12-19T16:07:41.531569+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531569+0000","last_undegraded":"2023-12-19T16:07:41.531569+0000","last_fullsized":"2023-12-19T16:07:41.531569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:07:54.635072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.540818+0000","last_change":"2023-12-19T16:07:41.539770+0000","last_active":"2023-12-19T16:07:41.540818+0000","last_peered":"2023-12-19T16:07:41.540818+0000","last_clean":"2023-12-19T16:07:41.540818+0000","last_became_active":"2023-12-19T16:07:41.539351+0000","last_became_peered":"2023-12-19T16:07:41.539351+0000","last_unstale":"2023-12-19T16:07:41.540818+0000","last_undegraded":"2023-12-19T16:07:41.540818+0000","last_fullsized":"2023-12-19T16:07:41.540818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:57.073133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530465+0000","last_change":"2023-12-19T16:07:41.530465+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530465+0000","last_undegraded":"2023-12-19T16:07:41.530465+0000","last_fullsized":"2023-12-19T16:07:41.530465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:25:19.019112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.541611+0000","last_change":"2023-12-19T16:07:41.539319+0000","last_active":"2023-12-19T16:07:41.541611+0000","last_peered":"2023-12-19T16:07:41.541611+0000","last_clean":"2023-12-19T16:07:41.541611+0000","last_became_active":"2023-12-19T16:07:41.539008+0000","last_became_peered":"2023-12-19T16:07:41.539008+0000","last_unstale":"2023-12-19T16:07:41.541611+0000","last_undegraded":"2023-12-19T16:07:41.541611+0000","last_fullsized":"2023-12-19T16:07:41.541611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:33.056284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527427+0000","last_change":"2023-12-19T16:07:41.527427+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527427+0000","last_undegraded":"2023-12-19T16:07:41.527427+0000","last_fullsized":"2023-12-19T16:07:41.527427+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:45:40.959769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545626+0000","last_change":"2023-12-19T16:07:41.544330+0000","last_active":"2023-12-19T16:07:41.545626+0000","last_peered":"2023-12-19T16:07:41.545626+0000","last_clean":"2023-12-19T16:07:41.545626+0000","last_became_active":"2023-12-19T16:07:41.544039+0000","last_became_peered":"2023-12-19T16:07:41.544039+0000","last_unstale":"2023-12-19T16:07:41.545626+0000","last_undegraded":"2023-12-19T16:07:41.545626+0000","last_fullsized":"2023-12-19T16:07:41.545626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:04.614913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.528051+0000","last_change":"2023-12-19T16:07:41.528051+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.528051+0000","last_undegraded":"2023-12-19T16:07:41.528051+0000","last_fullsized":"2023-12-19T16:07:41.528051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:54.332659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.544840+0000","last_change":"2023-12-19T16:07:41.538998+0000","last_active":"2023-12-19T16:07:41.544840+0000","last_peered":"2023-12-19T16:07:41.544840+0000","last_clean":"2023-12-19T16:07:41.544840+0000","last_became_active":"2023-12-19T16:07:41.538718+0000","last_became_peered":"2023-12-19T16:07:41.538718+0000","last_unstale":"2023-12-19T16:07:41.544840+0000","last_undegraded":"2023-12-19T16:07:41.544840+0000","last_fullsized":"2023-12-19T16:07:41.544840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:56:08.338813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525160+0000","last_change":"2023-12-19T16:07:41.525160+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525160+0000","last_undegraded":"2023-12-19T16:07:41.525160+0000","last_fullsized":"2023-12-19T16:07:41.525160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:30:03.606200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.542347+0000","last_change":"2023-12-19T16:07:41.540990+0000","last_active":"2023-12-19T16:07:41.542347+0000","last_peered":"2023-12-19T16:07:41.542347+0000","last_clean":"2023-12-19T16:07:41.542347+0000","last_became_active":"2023-12-19T16:07:41.540782+0000","last_became_peered":"2023-12-19T16:07:41.540782+0000","last_unstale":"2023-12-19T16:07:41.542347+0000","last_undegraded":"2023-12-19T16:07:41.542347+0000","last_fullsized":"2023-12-19T16:07:41.542347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:56.749124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531408+0000","last_change":"2023-12-19T16:07:41.531408+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531408+0000","last_undegraded":"2023-12-19T16:07:41.531408+0000","last_fullsized":"2023-12-19T16:07:41.531408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:23.495455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.541485+0000","last_change":"2023-12-19T16:07:41.540194+0000","last_active":"2023-12-19T16:07:41.541485+0000","last_peered":"2023-12-19T16:07:41.541485+0000","last_clean":"2023-12-19T16:07:41.541485+0000","last_became_active":"2023-12-19T16:07:41.539841+0000","last_became_peered":"2023-12-19T16:07:41.539841+0000","last_unstale":"2023-12-19T16:07:41.541485+0000","last_undegraded":"2023-12-19T16:07:41.541485+0000","last_fullsized":"2023-12-19T16:07:41.541485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:35.910905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525861+0000","last_change":"2023-12-19T16:07:41.525861+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525861+0000","last_undegraded":"2023-12-19T16:07:41.525861+0000","last_fullsized":"2023-12-19T16:07:41.525861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:54.332659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545362+0000","last_change":"2023-12-19T16:07:41.543547+0000","last_active":"2023-12-19T16:07:41.545362+0000","last_peered":"2023-12-19T16:07:41.545362+0000","last_clean":"2023-12-19T16:07:41.545362+0000","last_became_active":"2023-12-19T16:07:41.543289+0000","last_became_peered":"2023-12-19T16:07:41.543289+0000","last_unstale":"2023-12-19T16:07:41.545362+0000","last_undegraded":"2023-12-19T16:07:41.545362+0000","last_fullsized":"2023-12-19T16:07:41.545362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:48.955394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530232+0000","last_change":"2023-12-19T16:07:41.530232+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530232+0000","last_undegraded":"2023-12-19T16:07:41.530232+0000","last_fullsized":"2023-12-19T16:07:41.530232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:22.467159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.537161+0000","last_change":"2023-12-19T16:07:41.534939+0000","last_active":"2023-12-19T16:07:41.537161+0000","last_peered":"2023-12-19T16:07:41.537161+0000","last_clean":"2023-12-19T16:07:41.537161+0000","last_became_active":"2023-12-19T16:07:41.534662+0000","last_became_peered":"2023-12-19T16:07:41.534662+0000","last_unstale":"2023-12-19T16:07:41.537161+0000","last_undegraded":"2023-12-19T16:07:41.537161+0000","last_fullsized":"2023-12-19T16:07:41.537161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:41.884274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529250+0000","last_change":"2023-12-19T16:07:41.529250+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529250+0000","last_undegraded":"2023-12-19T16:07:41.529250+0000","last_fullsized":"2023-12-19T16:07:41.529250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:18.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.542172+0000","last_change":"2023-12-19T16:07:41.539076+0000","last_active":"2023-12-19T16:07:41.542172+0000","last_peered":"2023-12-19T16:07:41.542172+0000","last_clean":"2023-12-19T16:07:41.542172+0000","last_became_active":"2023-12-19T16:07:41.538793+0000","last_became_peered":"2023-12-19T16:07:41.538793+0000","last_unstale":"2023-12-19T16:07:41.542172+0000","last_undegraded":"2023-12-19T16:07:41.542172+0000","last_fullsized":"2023-12-19T16:07:41.542172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:42:25.311467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530117+0000","last_change":"2023-12-19T16:07:41.530117+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530117+0000","last_undegraded":"2023-12-19T16:07:41.530117+0000","last_fullsized":"2023-12-19T16:07:41.530117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:05:34.739335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.544976+0000","last_change":"2023-12-19T16:07:41.543028+0000","last_active":"2023-12-19T16:07:41.544976+0000","last_peered":"2023-12-19T16:07:41.544976+0000","last_clean":"2023-12-19T16:07:41.544976+0000","last_became_active":"2023-12-19T16:07:41.542523+0000","last_became_peered":"2023-12-19T16:07:41.542523+0000","last_unstale":"2023-12-19T16:07:41.544976+0000","last_undegraded":"2023-12-19T16:07:41.544976+0000","last_fullsized":"2023-12-19T16:07:41.544976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:26:48.870501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532322+0000","last_change":"2023-12-19T16:07:41.532322+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532322+0000","last_undegraded":"2023-12-19T16:07:41.532322+0000","last_fullsized":"2023-12-19T16:07:41.532322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:32.203742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538529+0000","last_change":"2023-12-19T16:07:41.534899+0000","last_active":"2023-12-19T16:07:41.538529+0000","last_peered":"2023-12-19T16:07:41.538529+0000","last_clean":"2023-12-19T16:07:41.538529+0000","last_became_active":"2023-12-19T16:07:41.534601+0000","last_became_peered":"2023-12-19T16:07:41.534601+0000","last_unstale":"2023-12-19T16:07:41.538529+0000","last_undegraded":"2023-12-19T16:07:41.538529+0000","last_fullsized":"2023-12-19T16:07:41.538529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:42.994812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530322+0000","last_change":"2023-12-19T16:07:41.530322+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530322+0000","last_undegraded":"2023-12-19T16:07:41.530322+0000","last_fullsized":"2023-12-19T16:07:41.530322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:27.607901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545470+0000","last_change":"2023-12-19T16:07:41.543958+0000","last_active":"2023-12-19T16:07:41.545470+0000","last_peered":"2023-12-19T16:07:41.545470+0000","last_clean":"2023-12-19T16:07:41.545470+0000","last_became_active":"2023-12-19T16:07:41.543503+0000","last_became_peered":"2023-12-19T16:07:41.543503+0000","last_unstale":"2023-12-19T16:07:41.545470+0000","last_undegraded":"2023-12-19T16:07:41.545470+0000","last_fullsized":"2023-12-19T16:07:41.545470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:25:18.011790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530356+0000","last_change":"2023-12-19T16:07:41.530356+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530356+0000","last_undegraded":"2023-12-19T16:07:41.530356+0000","last_fullsized":"2023-12-19T16:07:41.530356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:15.031639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.537202+0000","last_change":"2023-12-19T16:07:41.534556+0000","last_active":"2023-12-19T16:07:41.537202+0000","last_peered":"2023-12-19T16:07:41.537202+0000","last_clean":"2023-12-19T16:07:41.537202+0000","last_became_active":"2023-12-19T16:07:41.534265+0000","last_became_peered":"2023-12-19T16:07:41.534265+0000","last_unstale":"2023-12-19T16:07:41.537202+0000","last_undegraded":"2023-12-19T16:07:41.537202+0000","last_fullsized":"2023-12-19T16:07:41.537202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:16:33.732599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531449+0000","last_change":"2023-12-19T16:07:41.531449+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531449+0000","last_undegraded":"2023-12-19T16:07:41.531449+0000","last_fullsized":"2023-12-19T16:07:41.531449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:14:36.093257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.543193+0000","last_change":"2023-12-19T16:07:41.541301+0000","last_active":"2023-12-19T16:07:41.543193+0000","last_peered":"2023-12-19T16:07:41.543193+0000","last_clean":"2023-12-19T16:07:41.543193+0000","last_became_active":"2023-12-19T16:07:41.540995+0000","last_became_peered":"2023-12-19T16:07:41.540995+0000","last_unstale":"2023-12-19T16:07:41.543193+0000","last_undegraded":"2023-12-19T16:07:41.543193+0000","last_fullsized":"2023-12-19T16:07:41.543193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:04.614913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.526664+0000","last_change":"2023-12-19T16:07:41.526664+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.526664+0000","last_undegraded":"2023-12-19T16:07:41.526664+0000","last_fullsized":"2023-12-19T16:07:41.526664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:09.783023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545015+0000","last_change":"2023-12-19T16:07:41.540432+0000","last_active":"2023-12-19T16:07:41.545015+0000","last_peered":"2023-12-19T16:07:41.545015+0000","last_clean":"2023-12-19T16:07:41.545015+0000","last_became_active":"2023-12-19T16:07:41.540087+0000","last_became_peered":"2023-12-19T16:07:41.540087+0000","last_unstale":"2023-12-19T16:07:41.545015+0000","last_undegraded":"2023-12-19T16:07:41.545015+0000","last_fullsized":"2023-12-19T16:07:41.545015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:04:24.120557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529369+0000","last_change":"2023-12-19T16:07:41.529369+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529369+0000","last_undegraded":"2023-12-19T16:07:41.529369+0000","last_fullsized":"2023-12-19T16:07:41.529369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:44.002133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538459+0000","last_change":"2023-12-19T16:07:41.534179+0000","last_active":"2023-12-19T16:07:41.538459+0000","last_peered":"2023-12-19T16:07:41.538459+0000","last_clean":"2023-12-19T16:07:41.538459+0000","last_became_active":"2023-12-19T16:07:41.533903+0000","last_became_peered":"2023-12-19T16:07:41.533903+0000","last_unstale":"2023-12-19T16:07:41.538459+0000","last_undegraded":"2023-12-19T16:07:41.538459+0000","last_fullsized":"2023-12-19T16:07:41.538459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:42.994812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.526582+0000","last_change":"2023-12-19T16:07:41.526582+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.526582+0000","last_undegraded":"2023-12-19T16:07:41.526582+0000","last_fullsized":"2023-12-19T16:07:41.526582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:49.018092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.542338+0000","last_change":"2023-12-19T16:07:41.539027+0000","last_active":"2023-12-19T16:07:41.542338+0000","last_peered":"2023-12-19T16:07:41.542338+0000","last_clean":"2023-12-19T16:07:41.542338+0000","last_became_active":"2023-12-19T16:07:41.538640+0000","last_became_peered":"2023-12-19T16:07:41.538640+0000","last_unstale":"2023-12-19T16:07:41.542338+0000","last_undegraded":"2023-12-19T16:07:41.542338+0000","last_fullsized":"2023-12-19T16:07:41.542338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:33.056284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530904+0000","last_change":"2023-12-19T16:07:41.530904+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530904+0000","last_undegraded":"2023-12-19T16:07:41.530904+0000","last_fullsized":"2023-12-19T16:07:41.530904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:15:19.041369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538397+0000","last_change":"2023-12-19T16:07:41.535833+0000","last_active":"2023-12-19T16:07:41.538397+0000","last_peered":"2023-12-19T16:07:41.538397+0000","last_clean":"2023-12-19T16:07:41.538397+0000","last_became_active":"2023-12-19T16:07:41.535489+0000","last_became_peered":"2023-12-19T16:07:41.535489+0000","last_unstale":"2023-12-19T16:07:41.538397+0000","last_undegraded":"2023-12-19T16:07:41.538397+0000","last_fullsized":"2023-12-19T16:07:41.538397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:57.073133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529391+0000","last_change":"2023-12-19T16:07:41.529391+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529391+0000","last_undegraded":"2023-12-19T16:07:41.529391+0000","last_fullsized":"2023-12-19T16:07:41.529391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:30:03.606200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.537077+0000","last_change":"2023-12-19T16:07:41.534514+0000","last_active":"2023-12-19T16:07:41.537077+0000","last_peered":"2023-12-19T16:07:41.537077+0000","last_clean":"2023-12-19T16:07:41.537077+0000","last_became_active":"2023-12-19T16:07:41.532360+0000","last_became_peered":"2023-12-19T16:07:41.532360+0000","last_unstale":"2023-12-19T16:07:41.537077+0000","last_undegraded":"2023-12-19T16:07:41.537077+0000","last_fullsized":"2023-12-19T16:07:41.537077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:52.291611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532089+0000","last_change":"2023-12-19T16:07:41.532089+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532089+0000","last_undegraded":"2023-12-19T16:07:41.532089+0000","last_fullsized":"2023-12-19T16:07:41.532089+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:53.298933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.542372+0000","last_change":"2023-12-19T16:07:41.541032+0000","last_active":"2023-12-19T16:07:41.542372+0000","last_peered":"2023-12-19T16:07:41.542372+0000","last_clean":"2023-12-19T16:07:41.542372+0000","last_became_active":"2023-12-19T16:07:41.540678+0000","last_became_peered":"2023-12-19T16:07:41.540678+0000","last_unstale":"2023-12-19T16:07:41.542372+0000","last_undegraded":"2023-12-19T16:07:41.542372+0000","last_fullsized":"2023-12-19T16:07:41.542372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:42.914223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531219+0000","last_change":"2023-12-19T16:07:41.531219+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531219+0000","last_undegraded":"2023-12-19T16:07:41.531219+0000","last_fullsized":"2023-12-19T16:07:41.531219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:36.918227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.543129+0000","last_change":"2023-12-19T16:07:41.540982+0000","last_active":"2023-12-19T16:07:41.543129+0000","last_peered":"2023-12-19T16:07:41.543129+0000","last_clean":"2023-12-19T16:07:41.543129+0000","last_became_active":"2023-12-19T16:07:41.540654+0000","last_became_peered":"2023-12-19T16:07:41.540654+0000","last_unstale":"2023-12-19T16:07:41.543129+0000","last_undegraded":"2023-12-19T16:07:41.543129+0000","last_fullsized":"2023-12-19T16:07:41.543129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:48.955394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531185+0000","last_change":"2023-12-19T16:07:41.531185+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531185+0000","last_undegraded":"2023-12-19T16:07:41.531185+0000","last_fullsized":"2023-12-19T16:07:41.531185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:42.891596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.543765+0000","last_change":"2023-12-19T16:07:41.543300+0000","last_active":"2023-12-19T16:07:41.543765+0000","last_peered":"2023-12-19T16:07:41.543765+0000","last_clean":"2023-12-19T16:07:41.543765+0000","last_became_active":"2023-12-19T16:07:41.543098+0000","last_became_peered":"2023-12-19T16:07:41.543098+0000","last_unstale":"2023-12-19T16:07:41.543765+0000","last_undegraded":"2023-12-19T16:07:41.543765+0000","last_fullsized":"2023-12-19T16:07:41.543765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:16:33.732599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530754+0000","last_change":"2023-12-19T16:07:41.530754+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530754+0000","last_undegraded":"2023-12-19T16:07:41.530754+0000","last_fullsized":"2023-12-19T16:07:41.530754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:22.382499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538409+0000","last_change":"2023-12-19T16:07:41.536582+0000","last_active":"2023-12-19T16:07:41.538409+0000","last_peered":"2023-12-19T16:07:41.538409+0000","last_clean":"2023-12-19T16:07:41.538409+0000","last_became_active":"2023-12-19T16:07:41.536322+0000","last_became_peered":"2023-12-19T16:07:41.536322+0000","last_unstale":"2023-12-19T16:07:41.538409+0000","last_undegraded":"2023-12-19T16:07:41.538409+0000","last_fullsized":"2023-12-19T16:07:41.538409+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:40:35.184260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.526708+0000","last_change":"2023-12-19T16:07:41.526708+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.526708+0000","last_undegraded":"2023-12-19T16:07:41.526708+0000","last_fullsized":"2023-12-19T16:07:41.526708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:03:01.998993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.540447+0000","last_change":"2023-12-19T16:07:41.537907+0000","last_active":"2023-12-19T16:07:41.540447+0000","last_peered":"2023-12-19T16:07:41.540447+0000","last_clean":"2023-12-19T16:07:41.540447+0000","last_became_active":"2023-12-19T16:07:41.537096+0000","last_became_peered":"2023-12-19T16:07:41.537096+0000","last_unstale":"2023-12-19T16:07:41.540447+0000","last_undegraded":"2023-12-19T16:07:41.540447+0000","last_fullsized":"2023-12-19T16:07:41.540447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:04:24.120557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530063+0000","last_change":"2023-12-19T16:07:41.530063+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530063+0000","last_undegraded":"2023-12-19T16:07:41.530063+0000","last_fullsized":"2023-12-19T16:07:41.530063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:58.080454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.540808+0000","last_change":"2023-12-19T16:07:41.535728+0000","last_active":"2023-12-19T16:07:41.540808+0000","last_peered":"2023-12-19T16:07:41.540808+0000","last_clean":"2023-12-19T16:07:41.540808+0000","last_became_active":"2023-12-19T16:07:41.535425+0000","last_became_peered":"2023-12-19T16:07:41.535425+0000","last_unstale":"2023-12-19T16:07:41.540808+0000","last_undegraded":"2023-12-19T16:07:41.540808+0000","last_fullsized":"2023-12-19T16:07:41.540808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:42.914223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530466+0000","last_change":"2023-12-19T16:07:41.530466+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530466+0000","last_undegraded":"2023-12-19T16:07:41.530466+0000","last_fullsized":"2023-12-19T16:07:41.530466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:14:36.093257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.544582+0000","last_change":"2023-12-19T16:07:41.541840+0000","last_active":"2023-12-19T16:07:41.544582+0000","last_peered":"2023-12-19T16:07:41.544582+0000","last_clean":"2023-12-19T16:07:41.544582+0000","last_became_active":"2023-12-19T16:07:41.541418+0000","last_became_peered":"2023-12-19T16:07:41.541418+0000","last_unstale":"2023-12-19T16:07:41.544582+0000","last_undegraded":"2023-12-19T16:07:41.544582+0000","last_fullsized":"2023-12-19T16:07:41.544582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:04.614913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531700+0000","last_change":"2023-12-19T16:07:41.531700+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531700+0000","last_undegraded":"2023-12-19T16:07:41.531700+0000","last_fullsized":"2023-12-19T16:07:41.531700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:54.332659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545380+0000","last_change":"2023-12-19T16:07:41.543692+0000","last_active":"2023-12-19T16:07:41.545380+0000","last_peered":"2023-12-19T16:07:41.545380+0000","last_clean":"2023-12-19T16:07:41.545380+0000","last_became_active":"2023-12-19T16:07:41.543404+0000","last_became_peered":"2023-12-19T16:07:41.543404+0000","last_unstale":"2023-12-19T16:07:41.545380+0000","last_undegraded":"2023-12-19T16:07:41.545380+0000","last_fullsized":"2023-12-19T16:07:41.545380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:56.749124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530470+0000","last_change":"2023-12-19T16:07:41.530470+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530470+0000","last_undegraded":"2023-12-19T16:07:41.530470+0000","last_fullsized":"2023-12-19T16:07:41.530470+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:40:14.146826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.543106+0000","last_change":"2023-12-19T16:07:41.540450+0000","last_active":"2023-12-19T16:07:41.543106+0000","last_peered":"2023-12-19T16:07:41.543106+0000","last_clean":"2023-12-19T16:07:41.543106+0000","last_became_active":"2023-12-19T16:07:41.540084+0000","last_became_peered":"2023-12-19T16:07:41.540084+0000","last_unstale":"2023-12-19T16:07:41.543106+0000","last_undegraded":"2023-12-19T16:07:41.543106+0000","last_fullsized":"2023-12-19T16:07:41.543106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:42.914223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532505+0000","last_change":"2023-12-19T16:07:41.532505+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532505+0000","last_undegraded":"2023-12-19T16:07:41.532505+0000","last_fullsized":"2023-12-19T16:07:41.532505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:40:14.146826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.540767+0000","last_change":"2023-12-19T16:07:41.535019+0000","last_active":"2023-12-19T16:07:41.540767+0000","last_peered":"2023-12-19T16:07:41.540767+0000","last_clean":"2023-12-19T16:07:41.540767+0000","last_became_active":"2023-12-19T16:07:41.534739+0000","last_became_peered":"2023-12-19T16:07:41.534739+0000","last_unstale":"2023-12-19T16:07:41.540767+0000","last_undegraded":"2023-12-19T16:07:41.540767+0000","last_fullsized":"2023-12-19T16:07:41.540767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:26:48.870501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529252+0000","last_change":"2023-12-19T16:07:41.529252+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529252+0000","last_undegraded":"2023-12-19T16:07:41.529252+0000","last_fullsized":"2023-12-19T16:07:41.529252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:03:01.998993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538389+0000","last_change":"2023-12-19T16:07:41.535225+0000","last_active":"2023-12-19T16:07:41.538389+0000","last_peered":"2023-12-19T16:07:41.538389+0000","last_clean":"2023-12-19T16:07:41.538389+0000","last_became_active":"2023-12-19T16:07:41.534968+0000","last_became_peered":"2023-12-19T16:07:41.534968+0000","last_unstale":"2023-12-19T16:07:41.538389+0000","last_undegraded":"2023-12-19T16:07:41.538389+0000","last_fullsized":"2023-12-19T16:07:41.538389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:21.375178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527409+0000","last_change":"2023-12-19T16:07:41.527409+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527409+0000","last_undegraded":"2023-12-19T16:07:41.527409+0000","last_fullsized":"2023-12-19T16:07:41.527409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:15.031639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.544867+0000","last_change":"2023-12-19T16:07:41.539795+0000","last_active":"2023-12-19T16:07:41.544867+0000","last_peered":"2023-12-19T16:07:41.544867+0000","last_clean":"2023-12-19T16:07:41.544867+0000","last_became_active":"2023-12-19T16:07:41.539479+0000","last_became_peered":"2023-12-19T16:07:41.539479+0000","last_unstale":"2023-12-19T16:07:41.544867+0000","last_undegraded":"2023-12-19T16:07:41.544867+0000","last_fullsized":"2023-12-19T16:07:41.544867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:06:54.795957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525642+0000","last_change":"2023-12-19T16:07:41.525642+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525642+0000","last_undegraded":"2023-12-19T16:07:41.525642+0000","last_fullsized":"2023-12-19T16:07:41.525642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:15.031639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.539048+0000","last_change":"2023-12-19T16:07:41.537380+0000","last_active":"2023-12-19T16:07:41.539048+0000","last_peered":"2023-12-19T16:07:41.539048+0000","last_clean":"2023-12-19T16:07:41.539048+0000","last_became_active":"2023-12-19T16:07:41.537122+0000","last_became_peered":"2023-12-19T16:07:41.537122+0000","last_unstale":"2023-12-19T16:07:41.539048+0000","last_undegraded":"2023-12-19T16:07:41.539048+0000","last_fullsized":"2023-12-19T16:07:41.539048+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:35.910905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-19T16:07:40.520774+0000","last_change":"2023-12-19T16:06:47.761389+0000","last_active":"2023-12-19T16:07:40.520774+0000","last_peered":"2023-12-19T16:07:40.520774+0000","last_clean":"2023-12-19T16:07:40.520774+0000","last_became_active":"2023-12-19T16:06:47.760252+0000","last_became_peered":"2023-12-19T16:06:47.760252+0000","last_unstale":"2023-12-19T16:07:40.520774+0000","last_undegraded":"2023-12-19T16:07:40.520774+0000","last_fullsized":"2023-12-19T16:07:40.520774+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_clean_scrub_stamp":"2023-12-19T16:06:46.706871+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:09.167979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":905216,"data_stored":705288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":905216,"data_stored":705288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:07:45.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-12-19T16:07:45.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.530870+0000', 'last_change': '2023-12-19T16:07:41.530870+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.530870+0000', 'last_undegraded': '2023-12-19T16:07:41.530870+0000', 'last_fullsized': '2023-12-19T16:07:41.530870+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T03:04:25.127879+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T16:07:45.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-12-19T16:07:45.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.534432+0000', 'last_change': '2023-12-19T16:07:41.534432+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.534432+0000', 'last_undegraded': '2023-12-19T16:07:41.534432+0000', 'last_fullsized': '2023-12-19T16:07:41.534432+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:07:52.335635+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:07:45.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-12-19T16:07:45.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.529877+0000', 'last_change': '2023-12-19T16:07:41.529877+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.529877+0000', 'last_undegraded': '2023-12-19T16:07:41.529877+0000', 'last_fullsized': '2023-12-19T16:07:41.529877+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:05:34.739335+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:07:45.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-12-19T16:07:45.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.530124+0000', 'last_change': '2023-12-19T16:07:41.530124+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.530124+0000', 'last_undegraded': '2023-12-19T16:07:41.530124+0000', 'last_fullsized': '2023-12-19T16:07:41.530124+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:45:40.959769+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T16:07:45.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-12-19T16:07:45.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.537184+0000', 'last_change': '2023-12-19T16:07:41.537184+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.537184+0000', 'last_undegraded': '2023-12-19T16:07:41.537184+0000', 'last_fullsized': '2023-12-19T16:07:41.537184+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:26:49.877822+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T16:07:45.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-12-19T16:07:45.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.533601+0000', 'last_change': '2023-12-19T16:07:41.533601+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.533601+0000', 'last_undegraded': '2023-12-19T16:07:41.533601+0000', 'last_fullsized': '2023-12-19T16:07:41.533601+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:43:18.172948+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:07:45.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-12-19T16:07:45.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.525873+0000', 'last_change': '2023-12-19T16:07:41.525873+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.525873+0000', 'last_undegraded': '2023-12-19T16:07:41.525873+0000', 'last_fullsized': '2023-12-19T16:07:41.525873+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T22:15:19.041369+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:07:45.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-12-19T16:07:45.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.527524+0000', 'last_change': '2023-12-19T16:07:41.527524+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.527524+0000', 'last_undegraded': '2023-12-19T16:07:41.527524+0000', 'last_fullsized': '2023-12-19T16:07:41.527524+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:05:42.867424+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:07:45.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-12-19T16:07:45.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.525066+0000', 'last_change': '2023-12-19T16:07:41.525066+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.525066+0000', 'last_undegraded': '2023-12-19T16:07:41.525066+0000', 'last_fullsized': '2023-12-19T16:07:41.525066+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T20:07:54.635072+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:07:45.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-12-19T16:07:45.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.529841+0000', 'last_change': '2023-12-19T16:07:41.529841+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.529841+0000', 'last_undegraded': '2023-12-19T16:07:41.529841+0000', 'last_fullsized': '2023-12-19T16:07:41.529841+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T22:15:19.041369+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T16:07:45.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-12-19T16:07:45.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.524671+0000', 'last_change': '2023-12-19T16:07:41.524671+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.524671+0000', 'last_undegraded': '2023-12-19T16:07:41.524671+0000', 'last_fullsized': '2023-12-19T16:07:41.524671+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:57:32.203742+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:07:45.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-12-19T16:07:45.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.531252+0000', 'last_change': '2023-12-19T16:07:41.531252+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.531252+0000', 'last_undegraded': '2023-12-19T16:07:41.531252+0000', 'last_fullsized': '2023-12-19T16:07:41.531252+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:57:32.203742+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:07:45.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-12-19T16:07:45.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.536620+0000', 'last_change': '2023-12-19T16:07:41.536620+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.536620+0000', 'last_undegraded': '2023-12-19T16:07:41.536620+0000', 'last_fullsized': '2023-12-19T16:07:41.536620+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:28:43.921544+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T16:07:45.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-12-19T16:07:45.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.532874+0000', 'last_change': '2023-12-19T16:07:41.532874+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.532874+0000', 'last_undegraded': '2023-12-19T16:07:41.532874+0000', 'last_fullsized': '2023-12-19T16:07:41.532874+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T21:25:30.826214+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:07:45.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-12-19T16:07:45.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.529784+0000', 'last_change': '2023-12-19T16:07:41.529784+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.529784+0000', 'last_undegraded': '2023-12-19T16:07:41.529784+0000', 'last_fullsized': '2023-12-19T16:07:41.529784+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T19:03:01.998993+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:07:45.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-12-19T16:07:45.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.525126+0000', 'last_change': '2023-12-19T16:07:41.525126+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.525126+0000', 'last_undegraded': '2023-12-19T16:07:41.525126+0000', 'last_fullsized': '2023-12-19T16:07:41.525126+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:43:18.172948+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:07:45.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-12-19T16:07:45.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.524684+0000', 'last_change': '2023-12-19T16:07:41.524684+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.524684+0000', 'last_undegraded': '2023-12-19T16:07:41.524684+0000', 'last_fullsized': '2023-12-19T16:07:41.524684+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T21:25:30.826214+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:07:45.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-12-19T16:07:45.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.529238+0000', 'last_change': '2023-12-19T16:07:41.529238+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.529238+0000', 'last_undegraded': '2023-12-19T16:07:41.529238+0000', 'last_fullsized': '2023-12-19T16:07:41.529238+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T21:46:51.385493+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:07:45.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-12-19T16:07:45.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.531471+0000', 'last_change': '2023-12-19T16:07:41.531471+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.531471+0000', 'last_undegraded': '2023-12-19T16:07:41.531471+0000', 'last_fullsized': '2023-12-19T16:07:41.531471+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T23:31:27.607901+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:07:45.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-12-19T16:07:45.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.532210+0000', 'last_change': '2023-12-19T16:07:41.532210+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.532210+0000', 'last_undegraded': '2023-12-19T16:07:41.532210+0000', 'last_fullsized': '2023-12-19T16:07:41.532210+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T01:00:57.756446+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T16:07:45.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-12-19T16:07:45.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.528412+0000', 'last_change': '2023-12-19T16:07:41.528412+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.528412+0000', 'last_undegraded': '2023-12-19T16:07:41.528412+0000', 'last_fullsized': '2023-12-19T16:07:41.528412+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T20:56:22.467159+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:07:45.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-12-19T16:07:45.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.525781+0000', 'last_change': '2023-12-19T16:07:41.525781+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.525781+0000', 'last_undegraded': '2023-12-19T16:07:41.525781+0000', 'last_fullsized': '2023-12-19T16:07:41.525781+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T01:30:03.606200+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:07:45.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-12-19T16:07:45.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.531959+0000', 'last_change': '2023-12-19T16:07:41.531959+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.531959+0000', 'last_undegraded': '2023-12-19T16:07:41.531959+0000', 'last_fullsized': '2023-12-19T16:07:41.531959+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:03:49.018092+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T16:07:45.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-12-19T16:07:45.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.529594+0000', 'last_change': '2023-12-19T16:07:41.529594+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.529594+0000', 'last_undegraded': '2023-12-19T16:07:41.529594+0000', 'last_fullsized': '2023-12-19T16:07:41.529594+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:05:42.867424+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:07:45.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-12-19T16:07:45.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.528676+0000', 'last_change': '2023-12-19T16:07:41.528676+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.528676+0000', 'last_undegraded': '2023-12-19T16:07:41.528676+0000', 'last_fullsized': '2023-12-19T16:07:41.528676+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T21:46:51.385493+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T16:07:45.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-12-19T16:07:45.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.528656+0000', 'last_change': '2023-12-19T16:07:41.528656+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.528656+0000', 'last_undegraded': '2023-12-19T16:07:41.528656+0000', 'last_fullsized': '2023-12-19T16:07:41.528656+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:05:42.867424+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:07:45.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-12-19T16:07:45.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.530116+0000', 'last_change': '2023-12-19T16:07:41.530116+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.530116+0000', 'last_undegraded': '2023-12-19T16:07:41.530116+0000', 'last_fullsized': '2023-12-19T16:07:41.530116+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T02:35:09.783023+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T16:07:45.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-12-19T16:07:45.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.530639+0000', 'last_change': '2023-12-19T16:07:41.530639+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.530639+0000', 'last_undegraded': '2023-12-19T16:07:41.530639+0000', 'last_fullsized': '2023-12-19T16:07:41.530639+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T21:25:30.826214+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:07:45.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-12-19T16:07:45.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.527975+0000', 'last_change': '2023-12-19T16:07:41.527975+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.527975+0000', 'last_undegraded': '2023-12-19T16:07:41.527975+0000', 'last_fullsized': '2023-12-19T16:07:41.527975+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T02:35:09.783023+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:07:45.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-12-19T16:07:45.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.525699+0000', 'last_change': '2023-12-19T16:07:41.525699+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.525699+0000', 'last_undegraded': '2023-12-19T16:07:41.525699+0000', 'last_fullsized': '2023-12-19T16:07:41.525699+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:10:23.495455+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:07:45.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-12-19T16:07:45.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.529951+0000', 'last_change': '2023-12-19T16:07:41.529951+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.529951+0000', 'last_undegraded': '2023-12-19T16:07:41.529951+0000', 'last_fullsized': '2023-12-19T16:07:41.529951+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:06:55.803278+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T16:07:45.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-12-19T16:07:45.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.527111+0000', 'last_change': '2023-12-19T16:07:41.527111+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.527111+0000', 'last_undegraded': '2023-12-19T16:07:41.527111+0000', 'last_fullsized': '2023-12-19T16:07:41.527111+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T21:46:51.385493+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:07:45.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-12-19T16:07:45.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.531569+0000', 'last_change': '2023-12-19T16:07:41.531569+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.531569+0000', 'last_undegraded': '2023-12-19T16:07:41.531569+0000', 'last_fullsized': '2023-12-19T16:07:41.531569+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T20:07:54.635072+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T16:07:45.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-12-19T16:07:45.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.530465+0000', 'last_change': '2023-12-19T16:07:41.530465+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.530465+0000', 'last_undegraded': '2023-12-19T16:07:41.530465+0000', 'last_fullsized': '2023-12-19T16:07:41.530465+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:25:19.019112+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T16:07:45.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-12-19T16:07:45.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.527427+0000', 'last_change': '2023-12-19T16:07:41.527427+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.527427+0000', 'last_undegraded': '2023-12-19T16:07:41.527427+0000', 'last_fullsized': '2023-12-19T16:07:41.527427+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:45:40.959769+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:07:45.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-12-19T16:07:45.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.528051+0000', 'last_change': '2023-12-19T16:07:41.528051+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.528051+0000', 'last_undegraded': '2023-12-19T16:07:41.528051+0000', 'last_fullsized': '2023-12-19T16:07:41.528051+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T22:29:54.332659+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T16:07:45.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-12-19T16:07:45.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.525160+0000', 'last_change': '2023-12-19T16:07:41.525160+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.525160+0000', 'last_undegraded': '2023-12-19T16:07:41.525160+0000', 'last_fullsized': '2023-12-19T16:07:41.525160+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T01:30:03.606200+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:07:45.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-12-19T16:07:45.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.531408+0000', 'last_change': '2023-12-19T16:07:41.531408+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.531408+0000', 'last_undegraded': '2023-12-19T16:07:41.531408+0000', 'last_fullsized': '2023-12-19T16:07:41.531408+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:10:23.495455+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:07:45.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-12-19T16:07:45.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.525861+0000', 'last_change': '2023-12-19T16:07:41.525861+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.525861+0000', 'last_undegraded': '2023-12-19T16:07:41.525861+0000', 'last_fullsized': '2023-12-19T16:07:41.525861+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T22:29:54.332659+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:07:45.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-12-19T16:07:45.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.530232+0000', 'last_change': '2023-12-19T16:07:41.530232+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.530232+0000', 'last_undegraded': '2023-12-19T16:07:41.530232+0000', 'last_fullsized': '2023-12-19T16:07:41.530232+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T20:56:22.467159+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T16:07:45.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-12-19T16:07:45.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.529250+0000', 'last_change': '2023-12-19T16:07:41.529250+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.529250+0000', 'last_undegraded': '2023-12-19T16:07:41.529250+0000', 'last_fullsized': '2023-12-19T16:07:41.529250+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:43:18.172948+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:07:45.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-12-19T16:07:45.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.530117+0000', 'last_change': '2023-12-19T16:07:41.530117+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.530117+0000', 'last_undegraded': '2023-12-19T16:07:41.530117+0000', 'last_fullsized': '2023-12-19T16:07:41.530117+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:05:34.739335+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:07:45.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-12-19T16:07:45.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.532322+0000', 'last_change': '2023-12-19T16:07:41.532322+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.532322+0000', 'last_undegraded': '2023-12-19T16:07:41.532322+0000', 'last_fullsized': '2023-12-19T16:07:41.532322+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:57:32.203742+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:07:45.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-12-19T16:07:45.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.530322+0000', 'last_change': '2023-12-19T16:07:41.530322+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.530322+0000', 'last_undegraded': '2023-12-19T16:07:41.530322+0000', 'last_fullsized': '2023-12-19T16:07:41.530322+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T23:31:27.607901+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:07:45.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-12-19T16:07:45.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.530356+0000', 'last_change': '2023-12-19T16:07:41.530356+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.530356+0000', 'last_undegraded': '2023-12-19T16:07:41.530356+0000', 'last_fullsized': '2023-12-19T16:07:41.530356+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T02:40:15.031639+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T16:07:45.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-12-19T16:07:45.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.531449+0000', 'last_change': '2023-12-19T16:07:41.531449+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.531449+0000', 'last_undegraded': '2023-12-19T16:07:41.531449+0000', 'last_fullsized': '2023-12-19T16:07:41.531449+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T19:14:36.093257+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:07:45.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-12-19T16:07:45.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.526664+0000', 'last_change': '2023-12-19T16:07:41.526664+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.526664+0000', 'last_undegraded': '2023-12-19T16:07:41.526664+0000', 'last_fullsized': '2023-12-19T16:07:41.526664+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T02:35:09.783023+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:07:45.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-12-19T16:07:45.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.529369+0000', 'last_change': '2023-12-19T16:07:41.529369+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.529369+0000', 'last_undegraded': '2023-12-19T16:07:41.529369+0000', 'last_fullsized': '2023-12-19T16:07:41.529369+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T23:10:44.002133+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T16:07:45.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-12-19T16:07:45.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.526582+0000', 'last_change': '2023-12-19T16:07:41.526582+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.526582+0000', 'last_undegraded': '2023-12-19T16:07:41.526582+0000', 'last_fullsized': '2023-12-19T16:07:41.526582+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:03:49.018092+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:07:45.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-12-19T16:07:45.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.530904+0000', 'last_change': '2023-12-19T16:07:41.530904+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.530904+0000', 'last_undegraded': '2023-12-19T16:07:41.530904+0000', 'last_fullsized': '2023-12-19T16:07:41.530904+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T22:15:19.041369+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:07:45.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-12-19T16:07:45.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.529391+0000', 'last_change': '2023-12-19T16:07:41.529391+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.529391+0000', 'last_undegraded': '2023-12-19T16:07:41.529391+0000', 'last_fullsized': '2023-12-19T16:07:41.529391+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T01:30:03.606200+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T16:07:45.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-12-19T16:07:45.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.532089+0000', 'last_change': '2023-12-19T16:07:41.532089+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.532089+0000', 'last_undegraded': '2023-12-19T16:07:41.532089+0000', 'last_fullsized': '2023-12-19T16:07:41.532089+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T03:17:53.298933+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T16:07:45.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-12-19T16:07:45.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.531219+0000', 'last_change': '2023-12-19T16:07:41.531219+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.531219+0000', 'last_undegraded': '2023-12-19T16:07:41.531219+0000', 'last_fullsized': '2023-12-19T16:07:41.531219+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T22:41:36.918227+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T16:07:45.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-12-19T16:07:45.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.531185+0000', 'last_change': '2023-12-19T16:07:41.531185+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.531185+0000', 'last_undegraded': '2023-12-19T16:07:41.531185+0000', 'last_fullsized': '2023-12-19T16:07:41.531185+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T23:39:42.891596+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T16:07:45.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-12-19T16:07:45.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.530754+0000', 'last_change': '2023-12-19T16:07:41.530754+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.530754+0000', 'last_undegraded': '2023-12-19T16:07:41.530754+0000', 'last_fullsized': '2023-12-19T16:07:41.530754+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T21:10:22.382499+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T16:07:45.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-12-19T16:07:45.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.526708+0000', 'last_change': '2023-12-19T16:07:41.526708+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.526708+0000', 'last_undegraded': '2023-12-19T16:07:41.526708+0000', 'last_fullsized': '2023-12-19T16:07:41.526708+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T19:03:01.998993+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:07:45.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-12-19T16:07:45.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.530063+0000', 'last_change': '2023-12-19T16:07:41.530063+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.530063+0000', 'last_undegraded': '2023-12-19T16:07:41.530063+0000', 'last_fullsized': '2023-12-19T16:07:41.530063+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:29:58.080454+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T16:07:45.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-12-19T16:07:45.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.530466+0000', 'last_change': '2023-12-19T16:07:41.530466+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.530466+0000', 'last_undegraded': '2023-12-19T16:07:41.530466+0000', 'last_fullsized': '2023-12-19T16:07:41.530466+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T19:14:36.093257+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T16:07:45.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-12-19T16:07:45.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.531700+0000', 'last_change': '2023-12-19T16:07:41.531700+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.531700+0000', 'last_undegraded': '2023-12-19T16:07:41.531700+0000', 'last_fullsized': '2023-12-19T16:07:41.531700+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T22:29:54.332659+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T16:07:45.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-12-19T16:07:45.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.530470+0000', 'last_change': '2023-12-19T16:07:41.530470+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.530470+0000', 'last_undegraded': '2023-12-19T16:07:41.530470+0000', 'last_fullsized': '2023-12-19T16:07:41.530470+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:40:14.146826+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T16:07:45.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-12-19T16:07:45.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.532505+0000', 'last_change': '2023-12-19T16:07:41.532505+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.532505+0000', 'last_undegraded': '2023-12-19T16:07:41.532505+0000', 'last_fullsized': '2023-12-19T16:07:41.532505+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:40:14.146826+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T16:07:45.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-12-19T16:07:45.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.529252+0000', 'last_change': '2023-12-19T16:07:41.529252+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.529252+0000', 'last_undegraded': '2023-12-19T16:07:41.529252+0000', 'last_fullsized': '2023-12-19T16:07:41.529252+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T19:03:01.998993+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T16:07:45.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-12-19T16:07:45.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.527409+0000', 'last_change': '2023-12-19T16:07:41.527409+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.527409+0000', 'last_undegraded': '2023-12-19T16:07:41.527409+0000', 'last_fullsized': '2023-12-19T16:07:41.527409+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T02:40:15.031639+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:07:45.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-12-19T16:07:45.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:07:41.525642+0000', 'last_change': '2023-12-19T16:07:41.525642+0000', 'last_active': '2023-12-19T16:07:41.514068+0000', 'last_peered': '2023-12-19T16:07:41.514068+0000', 'last_clean': '2023-12-19T16:07:41.514068+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:07:41.525642+0000', 'last_undegraded': '2023-12-19T16:07:41.525642+0000', 'last_fullsized': '2023-12-19T16:07:41.525642+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'last_clean_scrub_stamp': '2023-12-19T16:07:41.514068+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T02:40:15.031639+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T16:07:45.614 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-19T16:07:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.740+0000 7fe0d03bb640 1 Processor -- start 2023-12-19T16:07:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.740+0000 7fe0d03bb640 1 -- start start 2023-12-19T16:07:45.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.741+0000 7fe0d03bb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0c80bab80 0x7fe0c814b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:45.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.741+0000 7fe0d03bb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe0c80b8b40 0x7fe0c8155320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:45.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.741+0000 7fe0d03bb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c80b6da0 con 0x7fe0c8144e30 2023-12-19T16:07:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.741+0000 7fe0d03bb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c80b8090 con 0x7fe0c80bab80 2023-12-19T16:07:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.741+0000 7fe0d03bb640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c814afe0 con 0x7fe0c80b8b40 2023-12-19T16:07:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.741+0000 7fe0cd956640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0c80bab80 0x7fe0c814b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.741+0000 7fe0cd956640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0c80bab80 0x7fe0c814b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37826/0 (socket says 172.21.15.37:37826) 2023-12-19T16:07:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.741+0000 7fe0cd956640 1 -- 172.21.15.37:0/2004648959 learned_addr learned my addr 172.21.15.37:0/2004648959 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.741+0000 7fe0ce958640 1 --2- 172.21.15.37:0/2004648959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe0c80b8b40 0x7fe0c8155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.741+0000 7fe0cd956640 1 -- 172.21.15.37:0/2004648959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe0c80b8b40 msgr2=0x7fe0c8155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.741+0000 7fe0cd956640 1 --2- 172.21.15.37:0/2004648959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe0c80b8b40 0x7fe0c8155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.741+0000 7fe0cd956640 1 -- 172.21.15.37:0/2004648959 >> v1:172.21.15.78:6789/0 conn(0x7fe0c8144e30 legacy=0x7fe0c80b7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.741+0000 7fe0cd956640 1 -- 172.21.15.37:0/2004648959 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c8145210 con 0x7fe0c80bab80 2023-12-19T16:07:45.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.742+0000 7fe0cd956640 1 --2- 172.21.15.37:0/2004648959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c80bab80 0x7fe0c814b470 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8009850 tx=0x7fe0b802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95496ac0b8dc0377 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:45.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.742+0000 7fe0cd155640 1 -- 172.21.15.37:0/2004648959 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8004230 con 0x7fe0c80bab80 2023-12-19T16:07:45.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.742+0000 7fe0cd155640 1 -- 172.21.15.37:0/2004648959 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b8004390 con 0x7fe0c80bab80 2023-12-19T16:07:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.742+0000 7fe0cd155640 1 -- 172.21.15.37:0/2004648959 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8003810 con 0x7fe0c80bab80 2023-12-19T16:07:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.743+0000 7fe0d03bb640 1 -- 172.21.15.37:0/2004648959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c80bab80 msgr2=0x7fe0c814b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.743+0000 7fe0d03bb640 1 --2- 172.21.15.37:0/2004648959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c80bab80 0x7fe0c814b470 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8009850 tx=0x7fe0b802b9f0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.743+0000 7fe0d03bb640 1 -- 172.21.15.37:0/2004648959 shutdown_connections 2023-12-19T16:07:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.743+0000 7fe0d03bb640 1 --2- 172.21.15.37:0/2004648959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe0c80b8b40 0x7fe0c8155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.743+0000 7fe0d03bb640 1 --2- 172.21.15.37:0/2004648959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c80bab80 0x7fe0c814b470 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.743+0000 7fe0d03bb640 1 -- 172.21.15.37:0/2004648959 >> 172.21.15.37:0/2004648959 conn(0x7fe0c80c0200 msgr2=0x7fe0c80c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.743+0000 7fe0d03bb640 1 -- 172.21.15.37:0/2004648959 shutdown_connections 2023-12-19T16:07:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.743+0000 7fe0d03bb640 1 -- 172.21.15.37:0/2004648959 wait complete. 2023-12-19T16:07:45.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.744+0000 7fe0d03bb640 1 Processor -- start 2023-12-19T16:07:45.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.744+0000 7fe0d03bb640 1 -- start start 2023-12-19T16:07:45.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.744+0000 7fe0d03bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0c80b8b40 0x7fe0c80b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:45.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.744+0000 7fe0d03bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c80bab80 0x7fe0c8145990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:45.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.744+0000 7fe0d03bb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe0c8144e30 0x7fe0c80adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.744+0000 7fe0d03bb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c8145ed0 con 0x7fe0c80bab80 2023-12-19T16:07:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.744+0000 7fe0d03bb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c80ae040 con 0x7fe0c80b8b40 2023-12-19T16:07:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.744+0000 7fe0d03bb640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c81477b0 con 0x7fe0c8144e30 2023-12-19T16:07:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.744+0000 7fe0cd956640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c80bab80 0x7fe0c8145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.744+0000 7fe0cd956640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c80bab80 0x7fe0c8145990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37838/0 (socket says 172.21.15.37:37838) 2023-12-19T16:07:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.745+0000 7fe0cd956640 1 -- 172.21.15.37:0/470413001 learned_addr learned my addr 172.21.15.37:0/470413001 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.745+0000 7fe0ce157640 1 --2- 172.21.15.37:0/470413001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0c80b8b40 0x7fe0c80b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.745+0000 7fe0ce958640 1 --2- 172.21.15.37:0/470413001 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe0c8144e30 0x7fe0c80adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.745+0000 7fe0cd956640 1 -- 172.21.15.37:0/470413001 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe0c8144e30 msgr2=0x7fe0c80adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.745+0000 7fe0cd956640 1 --2- 172.21.15.37:0/470413001 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe0c8144e30 0x7fe0c80adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.745+0000 7fe0cd956640 1 -- 172.21.15.37:0/470413001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0c80b8b40 msgr2=0x7fe0c80b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.745+0000 7fe0cd956640 1 --2- 172.21.15.37:0/470413001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0c80b8b40 0x7fe0c80b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.745+0000 7fe0cd956640 1 -- 172.21.15.37:0/470413001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b8009460 con 0x7fe0c80bab80 2023-12-19T16:07:45.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.745+0000 7fe0cd956640 1 --2- 172.21.15.37:0/470413001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c80bab80 0x7fe0c8145990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe0b802ba30 tx=0x7fe0b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:45.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.745+0000 7fe0beffd640 1 -- 172.21.15.37:0/470413001 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b803d070 con 0x7fe0c80bab80 2023-12-19T16:07:45.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.745+0000 7fe0beffd640 1 -- 172.21.15.37:0/470413001 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b8003610 con 0x7fe0c80bab80 2023-12-19T16:07:45.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.745+0000 7fe0d03bb640 1 -- 172.21.15.37:0/470413001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c8147a90 con 0x7fe0c80bab80 2023-12-19T16:07:45.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.745+0000 7fe0beffd640 1 -- 172.21.15.37:0/470413001 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b80039a0 con 0x7fe0c80bab80 2023-12-19T16:07:45.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.745+0000 7fe0d03bb640 1 -- 172.21.15.37:0/470413001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c8145470 con 0x7fe0c80bab80 2023-12-19T16:07:45.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.746+0000 7fe0d03bb640 1 -- 172.21.15.37:0/470413001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c804e840 con 0x7fe0c80bab80 2023-12-19T16:07:45.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.747+0000 7fe0beffd640 1 -- 172.21.15.37:0/470413001 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe0b8003b00 con 0x7fe0c80bab80 2023-12-19T16:07:45.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.747+0000 7fe0beffd640 1 --2- 172.21.15.37:0/470413001 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe0ac06a430 0x7fe0ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:45.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.747+0000 7fe0beffd640 1 -- 172.21.15.37:0/470413001 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0b80aa470 con 0x7fe0c80bab80 2023-12-19T16:07:45.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.747+0000 7fe0ce157640 1 --2- 172.21.15.37:0/470413001 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe0ac06a430 0x7fe0ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:45.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.748+0000 7fe0ce157640 1 --2- 172.21.15.37:0/470413001 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe0ac06a430 0x7fe0ac06c8f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe0c81e4250 tx=0x7fe0c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.751+0000 7fe0beffd640 1 -- 172.21.15.37:0/470413001 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe0b8075af0 con 0x7fe0c80bab80 2023-12-19T16:07:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.994+0000 7fe0d03bb640 1 -- 172.21.15.37:0/470413001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe0c814a820 con 0x7fe0c80bab80 2023-12-19T16:07:45.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.994+0000 7fe0beffd640 1 -- 172.21.15.37:0/470413001 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2516 (secure 0 0 0) 0x7fe0b8079110 con 0x7fe0c80bab80 2023-12-19T16:07:45.997 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:45.997 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":71,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":31,"num_osds":8,"num_up_osds":8,"osd_up_since":1703002005,"num_in_osds":8,"osd_in_since":1703001996,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":224468992,"bytes_avail":772869644288,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":13,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4977}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2023-12-19T16:07:40.641381+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-19T16:07:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.996+0000 7fe0d03bb640 1 -- 172.21.15.37:0/470413001 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe0ac06a430 msgr2=0x7fe0ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.996+0000 7fe0d03bb640 1 --2- 172.21.15.37:0/470413001 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe0ac06a430 0x7fe0ac06c8f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe0c81e4250 tx=0x7fe0c0009040 comp rx=0 tx=0).stop 2023-12-19T16:07:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.996+0000 7fe0d03bb640 1 -- 172.21.15.37:0/470413001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c80bab80 msgr2=0x7fe0c8145990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.996+0000 7fe0d03bb640 1 --2- 172.21.15.37:0/470413001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c80bab80 0x7fe0c8145990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe0b802ba30 tx=0x7fe0b80046c0 comp rx=0 tx=0).stop 2023-12-19T16:07:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.996+0000 7fe0d03bb640 1 -- 172.21.15.37:0/470413001 shutdown_connections 2023-12-19T16:07:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.996+0000 7fe0d03bb640 1 --2- 172.21.15.37:0/470413001 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe0ac06a430 0x7fe0ac06c8f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:46.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.996+0000 7fe0d03bb640 1 --2- 172.21.15.37:0/470413001 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe0c8144e30 0x7fe0c80adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:46.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.996+0000 7fe0d03bb640 1 --2- 172.21.15.37:0/470413001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c80bab80 0x7fe0c8145990 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:46.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.996+0000 7fe0d03bb640 1 --2- 172.21.15.37:0/470413001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0c80b8b40 0x7fe0c80b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:46.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.996+0000 7fe0d03bb640 1 -- 172.21.15.37:0/470413001 >> 172.21.15.37:0/470413001 conn(0x7fe0c80c0200 msgr2=0x7fe0c80bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:46.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.996+0000 7fe0d03bb640 1 -- 172.21.15.37:0/470413001 shutdown_connections 2023-12-19T16:07:46.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:45.996+0000 7fe0d03bb640 1 -- 172.21.15.37:0/470413001 wait complete. 2023-12-19T16:07:46.009 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-19T16:07:46.009 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:07:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.112+0000 7f7a3702c640 1 Processor -- start 2023-12-19T16:07:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.112+0000 7f7a3702c640 1 -- start start 2023-12-19T16:07:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.113+0000 7f7a3702c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7a30144ea0 0x7f7a30156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.113+0000 7f7a3702c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a300bc6b0 con 0x7f7a300bcdd0 2023-12-19T16:07:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.113+0000 7f7a3702c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a300a59f0 con 0x7f7a300b6690 2023-12-19T16:07:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.113+0000 7f7a3702c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a300bc0a0 con 0x7f7a30144ea0 2023-12-19T16:07:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.113+0000 7f7a34dc8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7a300bcdd0 0x7f7a300b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43392/0 (socket says 172.21.15.37:43392) 2023-12-19T16:07:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.113+0000 7f7a34dc8640 1 -- 172.21.15.37:0/848610416 learned_addr learned my addr 172.21.15.37:0/848610416 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.113+0000 7f7a355c9640 1 --2- 172.21.15.37:0/848610416 >> v2:172.21.15.78:3300/0 conn(0x7f7a30144ea0 0x7f7a30156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.114+0000 7f7a2f7fe640 1 -- 172.21.15.37:0/848610416 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809168191 0 0) 0x7f7a300bc6b0 con 0x7f7a300bcdd0 2023-12-19T16:07:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.114+0000 7f7a2f7fe640 1 -- 172.21.15.37:0/848610416 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a1c003520 con 0x7f7a300bcdd0 2023-12-19T16:07:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.114+0000 7f7a355c9640 1 -- 172.21.15.37:0/848610416 >> v1:172.21.15.78:6789/0 conn(0x7f7a300b6690 legacy=0x7f7a30144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.114+0000 7f7a355c9640 1 -- 172.21.15.37:0/848610416 >> v1:172.21.15.37:6789/0 conn(0x7f7a300bcdd0 legacy=0x7f7a300b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.114+0000 7f7a2f7fe640 1 -- 172.21.15.37:0/848610416 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1432084299 0 0) 0x7f7a1c003520 con 0x7f7a300bcdd0 2023-12-19T16:07:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.114+0000 7f7a355c9640 1 -- 172.21.15.37:0/848610416 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a300bc340 con 0x7f7a30144ea0 2023-12-19T16:07:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.115+0000 7f7a355c9640 1 --2- 172.21.15.37:0/848610416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a30144ea0 0x7f7a30156350 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7a300a5b80 tx=0x7f7a1802b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cb1d6b50c487778 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.115+0000 7f7a2f7fe640 1 -- 172.21.15.37:0/848610416 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a280019f0 con 0x7f7a30144ea0 2023-12-19T16:07:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.115+0000 7f7a2f7fe640 1 -- 172.21.15.37:0/848610416 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a18031580 con 0x7f7a30144ea0 2023-12-19T16:07:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.115+0000 7f7a2f7fe640 1 -- 172.21.15.37:0/848610416 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a180318f0 con 0x7f7a30144ea0 2023-12-19T16:07:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.115+0000 7f7a3702c640 1 -- 172.21.15.37:0/848610416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a30144ea0 msgr2=0x7f7a30156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.115+0000 7f7a3702c640 1 --2- 172.21.15.37:0/848610416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a30144ea0 0x7f7a30156350 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7a300a5b80 tx=0x7f7a1802b8a0 comp rx=0 tx=0).stop 2023-12-19T16:07:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.115+0000 7f7a3702c640 1 -- 172.21.15.37:0/848610416 shutdown_connections 2023-12-19T16:07:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.115+0000 7f7a3702c640 1 --2- 172.21.15.37:0/848610416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a30144ea0 0x7f7a30156350 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.115+0000 7f7a3702c640 1 -- 172.21.15.37:0/848610416 >> 172.21.15.37:0/848610416 conn(0x7f7a30071e60 msgr2=0x7f7a300c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:46.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.115+0000 7f7a3702c640 1 -- 172.21.15.37:0/848610416 shutdown_connections 2023-12-19T16:07:46.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.115+0000 7f7a3702c640 1 -- 172.21.15.37:0/848610416 wait complete. 2023-12-19T16:07:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.116+0000 7f7a3702c640 1 Processor -- start 2023-12-19T16:07:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.116+0000 7f7a3702c640 1 -- start start 2023-12-19T16:07:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.117+0000 7f7a3702c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a300b6690 0x7f7a30140770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.117+0000 7f7a3702c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a300bcdd0 0x7f7a301492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.117+0000 7f7a3702c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a30144ea0 0x7f7a301e2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.117+0000 7f7a3702c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a30140cb0 con 0x7f7a30144ea0 2023-12-19T16:07:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.117+0000 7f7a3702c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a300bf360 con 0x7f7a300bcdd0 2023-12-19T16:07:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.117+0000 7f7a3702c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a301d4df0 con 0x7f7a300b6690 2023-12-19T16:07:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.117+0000 7f7a355c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a30144ea0 0x7f7a301e2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.117+0000 7f7a355c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a30144ea0 0x7f7a301e2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37842/0 (socket says 172.21.15.37:37842) 2023-12-19T16:07:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.117+0000 7f7a355c9640 1 -- 172.21.15.37:0/2622650211 learned_addr learned my addr 172.21.15.37:0/2622650211 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.117+0000 7f7a2ffff640 1 --2- 172.21.15.37:0/2622650211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a300bcdd0 0x7f7a301492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.117+0000 7f7a34dc8640 1 --2- 172.21.15.37:0/2622650211 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a300b6690 0x7f7a30140770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.117+0000 7f7a355c9640 1 -- 172.21.15.37:0/2622650211 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a300b6690 msgr2=0x7f7a30140770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.117+0000 7f7a355c9640 1 --2- 172.21.15.37:0/2622650211 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a300b6690 0x7f7a30140770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.117+0000 7f7a355c9640 1 -- 172.21.15.37:0/2622650211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a300bcdd0 msgr2=0x7f7a301492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:46.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.118+0000 7f7a355c9640 1 --2- 172.21.15.37:0/2622650211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a300bcdd0 0x7f7a301492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:46.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.118+0000 7f7a355c9640 1 -- 172.21.15.37:0/2622650211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a18009400 con 0x7f7a30144ea0 2023-12-19T16:07:46.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.118+0000 7f7a355c9640 1 --2- 172.21.15.37:0/2622650211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a30144ea0 0x7f7a301e2ee0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7a1802b8e0 tx=0x7f7a180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:46.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.118+0000 7f7a2d7fa640 1 -- 172.21.15.37:0/2622650211 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a18032820 con 0x7f7a30144ea0 2023-12-19T16:07:46.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.118+0000 7f7a2d7fa640 1 -- 172.21.15.37:0/2622650211 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a18032980 con 0x7f7a30144ea0 2023-12-19T16:07:46.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.118+0000 7f7a3702c640 1 -- 172.21.15.37:0/2622650211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a30149830 con 0x7f7a30144ea0 2023-12-19T16:07:46.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.118+0000 7f7a2d7fa640 1 -- 172.21.15.37:0/2622650211 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a18032d30 con 0x7f7a30144ea0 2023-12-19T16:07:46.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.118+0000 7f7a3702c640 1 -- 172.21.15.37:0/2622650211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a301d47a0 con 0x7f7a30144ea0 2023-12-19T16:07:46.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.119+0000 7f7a3702c640 1 -- 172.21.15.37:0/2622650211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a301d4600 con 0x7f7a30144ea0 2023-12-19T16:07:46.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.119+0000 7f7a2d7fa640 1 -- 172.21.15.37:0/2622650211 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7a180453f0 con 0x7f7a30144ea0 2023-12-19T16:07:46.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.120+0000 7f7a2d7fa640 1 --2- 172.21.15.37:0/2622650211 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7a1006a430 0x7f7a1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:46.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.120+0000 7f7a2d7fa640 1 -- 172.21.15.37:0/2622650211 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a180aab60 con 0x7f7a30144ea0 2023-12-19T16:07:46.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.120+0000 7f7a34dc8640 1 --2- 172.21.15.37:0/2622650211 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7a1006a430 0x7f7a1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:46.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.120+0000 7f7a34dc8640 1 --2- 172.21.15.37:0/2622650211 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7a1006a430 0x7f7a1006c8f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7a28005c00 tx=0x7f7a28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:46.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.124+0000 7f7a2d7fa640 1 -- 172.21.15.37:0/2622650211 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7a301d4600 con 0x7f7a30144ea0 2023-12-19T16:07:46.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.295+0000 7f7a3702c640 1 -- 172.21.15.37:0/2622650211 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a300b5500 con 0x7f7a1006a430 2023-12-19T16:07:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.302+0000 7f7a2d7fa640 1 -- 172.21.15.37:0/2622650211 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+261740 (secure 0 0 0) 0x7f7a2800eec0 con 0x7f7a1006a430 2023-12-19T16:07:46.307 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:46.308 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-19T16:07:46.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.305+0000 7f7a3702c640 1 -- 172.21.15.37:0/2622650211 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7a1006a430 msgr2=0x7f7a1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:46.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.305+0000 7f7a3702c640 1 --2- 172.21.15.37:0/2622650211 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7a1006a430 0x7f7a1006c8f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7a28005c00 tx=0x7f7a28009040 comp rx=0 tx=0).stop 2023-12-19T16:07:46.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.305+0000 7f7a3702c640 1 -- 172.21.15.37:0/2622650211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a30144ea0 msgr2=0x7f7a301e2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:46.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.305+0000 7f7a3702c640 1 --2- 172.21.15.37:0/2622650211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a30144ea0 0x7f7a301e2ee0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7a1802b8e0 tx=0x7f7a180046c0 comp rx=0 tx=0).stop 2023-12-19T16:07:46.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.305+0000 7f7a3702c640 1 -- 172.21.15.37:0/2622650211 shutdown_connections 2023-12-19T16:07:46.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.305+0000 7f7a3702c640 1 --2- 172.21.15.37:0/2622650211 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7a1006a430 0x7f7a1006c8f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:46.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.305+0000 7f7a3702c640 1 --2- 172.21.15.37:0/2622650211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a30144ea0 0x7f7a301e2ee0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:46.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.305+0000 7f7a3702c640 1 --2- 172.21.15.37:0/2622650211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a300bcdd0 0x7f7a301492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:46.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.305+0000 7f7a3702c640 1 --2- 172.21.15.37:0/2622650211 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7a300b6690 0x7f7a30140770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:46.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.305+0000 7f7a3702c640 1 -- 172.21.15.37:0/2622650211 >> 172.21.15.37:0/2622650211 conn(0x7f7a30071e60 msgr2=0x7f7a300b8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:46.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.305+0000 7f7a3702c640 1 -- 172.21.15.37:0/2622650211 shutdown_connections 2023-12-19T16:07:46.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:46.305+0000 7f7a3702c640 1 -- 172.21.15.37:0/2622650211 wait complete. 2023-12-19T16:07:46.318 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-12-19T16:07:44.642123+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":3678208,"data_stored":2100096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.123105"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530870+0000","last_change":"2023-12-19T16:07:41.530870+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530870+0000","last_undegraded":"2023-12-19T16:07:41.530870+0000","last_fullsized":"2023-12-19T16:07:41.530870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:04:25.127879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.534432+0000","last_change":"2023-12-19T16:07:41.534432+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.534432+0000","last_undegraded":"2023-12-19T16:07:41.534432+0000","last_fullsized":"2023-12-19T16:07:41.534432+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:07:52.335635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529877+0000","last_change":"2023-12-19T16:07:41.529877+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529877+0000","last_undegraded":"2023-12-19T16:07:41.529877+0000","last_fullsized":"2023-12-19T16:07:41.529877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:05:34.739335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530124+0000","last_change":"2023-12-19T16:07:41.530124+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530124+0000","last_undegraded":"2023-12-19T16:07:41.530124+0000","last_fullsized":"2023-12-19T16:07:41.530124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:45:40.959769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.537184+0000","last_change":"2023-12-19T16:07:41.537184+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.537184+0000","last_undegraded":"2023-12-19T16:07:41.537184+0000","last_fullsized":"2023-12-19T16:07:41.537184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:26:49.877822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.533601+0000","last_change":"2023-12-19T16:07:41.533601+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.533601+0000","last_undegraded":"2023-12-19T16:07:41.533601+0000","last_fullsized":"2023-12-19T16:07:41.533601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:18.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525873+0000","last_change":"2023-12-19T16:07:41.525873+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525873+0000","last_undegraded":"2023-12-19T16:07:41.525873+0000","last_fullsized":"2023-12-19T16:07:41.525873+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:15:19.041369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527524+0000","last_change":"2023-12-19T16:07:41.527524+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527524+0000","last_undegraded":"2023-12-19T16:07:41.527524+0000","last_fullsized":"2023-12-19T16:07:41.527524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:42.867424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525066+0000","last_change":"2023-12-19T16:07:41.525066+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525066+0000","last_undegraded":"2023-12-19T16:07:41.525066+0000","last_fullsized":"2023-12-19T16:07:41.525066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:07:54.635072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529841+0000","last_change":"2023-12-19T16:07:41.529841+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529841+0000","last_undegraded":"2023-12-19T16:07:41.529841+0000","last_fullsized":"2023-12-19T16:07:41.529841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:15:19.041369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.524671+0000","last_change":"2023-12-19T16:07:41.524671+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.524671+0000","last_undegraded":"2023-12-19T16:07:41.524671+0000","last_fullsized":"2023-12-19T16:07:41.524671+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:32.203742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531252+0000","last_change":"2023-12-19T16:07:41.531252+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531252+0000","last_undegraded":"2023-12-19T16:07:41.531252+0000","last_fullsized":"2023-12-19T16:07:41.531252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:32.203742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.536620+0000","last_change":"2023-12-19T16:07:41.536620+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.536620+0000","last_undegraded":"2023-12-19T16:07:41.536620+0000","last_fullsized":"2023-12-19T16:07:41.536620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:43.921544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532874+0000","last_change":"2023-12-19T16:07:41.532874+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532874+0000","last_undegraded":"2023-12-19T16:07:41.532874+0000","last_fullsized":"2023-12-19T16:07:41.532874+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:25:30.826214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529784+0000","last_change":"2023-12-19T16:07:41.529784+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529784+0000","last_undegraded":"2023-12-19T16:07:41.529784+0000","last_fullsized":"2023-12-19T16:07:41.529784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:03:01.998993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525126+0000","last_change":"2023-12-19T16:07:41.525126+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525126+0000","last_undegraded":"2023-12-19T16:07:41.525126+0000","last_fullsized":"2023-12-19T16:07:41.525126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:18.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.524684+0000","last_change":"2023-12-19T16:07:41.524684+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.524684+0000","last_undegraded":"2023-12-19T16:07:41.524684+0000","last_fullsized":"2023-12-19T16:07:41.524684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:25:30.826214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529238+0000","last_change":"2023-12-19T16:07:41.529238+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529238+0000","last_undegraded":"2023-12-19T16:07:41.529238+0000","last_fullsized":"2023-12-19T16:07:41.529238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:51.385493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531471+0000","last_change":"2023-12-19T16:07:41.531471+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531471+0000","last_undegraded":"2023-12-19T16:07:41.531471+0000","last_fullsized":"2023-12-19T16:07:41.531471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:27.607901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532210+0000","last_change":"2023-12-19T16:07:41.532210+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532210+0000","last_undegraded":"2023-12-19T16:07:41.532210+0000","last_fullsized":"2023-12-19T16:07:41.532210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:57.756446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.528412+0000","last_change":"2023-12-19T16:07:41.528412+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.528412+0000","last_undegraded":"2023-12-19T16:07:41.528412+0000","last_fullsized":"2023-12-19T16:07:41.528412+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:22.467159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525781+0000","last_change":"2023-12-19T16:07:41.525781+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525781+0000","last_undegraded":"2023-12-19T16:07:41.525781+0000","last_fullsized":"2023-12-19T16:07:41.525781+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:30:03.606200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531959+0000","last_change":"2023-12-19T16:07:41.531959+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531959+0000","last_undegraded":"2023-12-19T16:07:41.531959+0000","last_fullsized":"2023-12-19T16:07:41.531959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:49.018092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529594+0000","last_change":"2023-12-19T16:07:41.529594+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529594+0000","last_undegraded":"2023-12-19T16:07:41.529594+0000","last_fullsized":"2023-12-19T16:07:41.529594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:42.867424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.528676+0000","last_change":"2023-12-19T16:07:41.528676+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.528676+0000","last_undegraded":"2023-12-19T16:07:41.528676+0000","last_fullsized":"2023-12-19T16:07:41.528676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:51.385493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.528656+0000","last_change":"2023-12-19T16:07:41.528656+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.528656+0000","last_undegraded":"2023-12-19T16:07:41.528656+0000","last_fullsized":"2023-12-19T16:07:41.528656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:42.867424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530116+0000","last_change":"2023-12-19T16:07:41.530116+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530116+0000","last_undegraded":"2023-12-19T16:07:41.530116+0000","last_fullsized":"2023-12-19T16:07:41.530116+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:09.783023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530639+0000","last_change":"2023-12-19T16:07:41.530639+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530639+0000","last_undegraded":"2023-12-19T16:07:41.530639+0000","last_fullsized":"2023-12-19T16:07:41.530639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:25:30.826214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527975+0000","last_change":"2023-12-19T16:07:41.527975+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527975+0000","last_undegraded":"2023-12-19T16:07:41.527975+0000","last_fullsized":"2023-12-19T16:07:41.527975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:09.783023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525699+0000","last_change":"2023-12-19T16:07:41.525699+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525699+0000","last_undegraded":"2023-12-19T16:07:41.525699+0000","last_fullsized":"2023-12-19T16:07:41.525699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:23.495455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529951+0000","last_change":"2023-12-19T16:07:41.529951+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529951+0000","last_undegraded":"2023-12-19T16:07:41.529951+0000","last_fullsized":"2023-12-19T16:07:41.529951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:06:55.803278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527111+0000","last_change":"2023-12-19T16:07:41.527111+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527111+0000","last_undegraded":"2023-12-19T16:07:41.527111+0000","last_fullsized":"2023-12-19T16:07:41.527111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:51.385493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531569+0000","last_change":"2023-12-19T16:07:41.531569+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531569+0000","last_undegraded":"2023-12-19T16:07:41.531569+0000","last_fullsized":"2023-12-19T16:07:41.531569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:07:54.635072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.540818+0000","last_change":"2023-12-19T16:07:41.539770+0000","last_active":"2023-12-19T16:07:41.540818+0000","last_peered":"2023-12-19T16:07:41.540818+0000","last_clean":"2023-12-19T16:07:41.540818+0000","last_became_active":"2023-12-19T16:07:41.539351+0000","last_became_peered":"2023-12-19T16:07:41.539351+0000","last_unstale":"2023-12-19T16:07:41.540818+0000","last_undegraded":"2023-12-19T16:07:41.540818+0000","last_fullsized":"2023-12-19T16:07:41.540818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:57.073133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530465+0000","last_change":"2023-12-19T16:07:41.530465+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530465+0000","last_undegraded":"2023-12-19T16:07:41.530465+0000","last_fullsized":"2023-12-19T16:07:41.530465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:25:19.019112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.541611+0000","last_change":"2023-12-19T16:07:41.539319+0000","last_active":"2023-12-19T16:07:41.541611+0000","last_peered":"2023-12-19T16:07:41.541611+0000","last_clean":"2023-12-19T16:07:41.541611+0000","last_became_active":"2023-12-19T16:07:41.539008+0000","last_became_peered":"2023-12-19T16:07:41.539008+0000","last_unstale":"2023-12-19T16:07:41.541611+0000","last_undegraded":"2023-12-19T16:07:41.541611+0000","last_fullsized":"2023-12-19T16:07:41.541611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:33.056284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527427+0000","last_change":"2023-12-19T16:07:41.527427+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527427+0000","last_undegraded":"2023-12-19T16:07:41.527427+0000","last_fullsized":"2023-12-19T16:07:41.527427+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:45:40.959769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545626+0000","last_change":"2023-12-19T16:07:41.544330+0000","last_active":"2023-12-19T16:07:41.545626+0000","last_peered":"2023-12-19T16:07:41.545626+0000","last_clean":"2023-12-19T16:07:41.545626+0000","last_became_active":"2023-12-19T16:07:41.544039+0000","last_became_peered":"2023-12-19T16:07:41.544039+0000","last_unstale":"2023-12-19T16:07:41.545626+0000","last_undegraded":"2023-12-19T16:07:41.545626+0000","last_fullsized":"2023-12-19T16:07:41.545626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:04.614913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.528051+0000","last_change":"2023-12-19T16:07:41.528051+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.528051+0000","last_undegraded":"2023-12-19T16:07:41.528051+0000","last_fullsized":"2023-12-19T16:07:41.528051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:54.332659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.544840+0000","last_change":"2023-12-19T16:07:41.538998+0000","last_active":"2023-12-19T16:07:41.544840+0000","last_peered":"2023-12-19T16:07:41.544840+0000","last_clean":"2023-12-19T16:07:41.544840+0000","last_became_active":"2023-12-19T16:07:41.538718+0000","last_became_peered":"2023-12-19T16:07:41.538718+0000","last_unstale":"2023-12-19T16:07:41.544840+0000","last_undegraded":"2023-12-19T16:07:41.544840+0000","last_fullsized":"2023-12-19T16:07:41.544840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:56:08.338813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525160+0000","last_change":"2023-12-19T16:07:41.525160+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525160+0000","last_undegraded":"2023-12-19T16:07:41.525160+0000","last_fullsized":"2023-12-19T16:07:41.525160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:30:03.606200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.542347+0000","last_change":"2023-12-19T16:07:41.540990+0000","last_active":"2023-12-19T16:07:41.542347+0000","last_peered":"2023-12-19T16:07:41.542347+0000","last_clean":"2023-12-19T16:07:41.542347+0000","last_became_active":"2023-12-19T16:07:41.540782+0000","last_became_peered":"2023-12-19T16:07:41.540782+0000","last_unstale":"2023-12-19T16:07:41.542347+0000","last_undegraded":"2023-12-19T16:07:41.542347+0000","last_fullsized":"2023-12-19T16:07:41.542347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:56.749124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531408+0000","last_change":"2023-12-19T16:07:41.531408+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531408+0000","last_undegraded":"2023-12-19T16:07:41.531408+0000","last_fullsized":"2023-12-19T16:07:41.531408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:23.495455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.541485+0000","last_change":"2023-12-19T16:07:41.540194+0000","last_active":"2023-12-19T16:07:41.541485+0000","last_peered":"2023-12-19T16:07:41.541485+0000","last_clean":"2023-12-19T16:07:41.541485+0000","last_became_active":"2023-12-19T16:07:41.539841+0000","last_became_peered":"2023-12-19T16:07:41.539841+0000","last_unstale":"2023-12-19T16:07:41.541485+0000","last_undegraded":"2023-12-19T16:07:41.541485+0000","last_fullsized":"2023-12-19T16:07:41.541485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:35.910905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525861+0000","last_change":"2023-12-19T16:07:41.525861+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525861+0000","last_undegraded":"2023-12-19T16:07:41.525861+0000","last_fullsized":"2023-12-19T16:07:41.525861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:54.332659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545362+0000","last_change":"2023-12-19T16:07:41.543547+0000","last_active":"2023-12-19T16:07:41.545362+0000","last_peered":"2023-12-19T16:07:41.545362+0000","last_clean":"2023-12-19T16:07:41.545362+0000","last_became_active":"2023-12-19T16:07:41.543289+0000","last_became_peered":"2023-12-19T16:07:41.543289+0000","last_unstale":"2023-12-19T16:07:41.545362+0000","last_undegraded":"2023-12-19T16:07:41.545362+0000","last_fullsized":"2023-12-19T16:07:41.545362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:48.955394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530232+0000","last_change":"2023-12-19T16:07:41.530232+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530232+0000","last_undegraded":"2023-12-19T16:07:41.530232+0000","last_fullsized":"2023-12-19T16:07:41.530232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:22.467159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.537161+0000","last_change":"2023-12-19T16:07:41.534939+0000","last_active":"2023-12-19T16:07:41.537161+0000","last_peered":"2023-12-19T16:07:41.537161+0000","last_clean":"2023-12-19T16:07:41.537161+0000","last_became_active":"2023-12-19T16:07:41.534662+0000","last_became_peered":"2023-12-19T16:07:41.534662+0000","last_unstale":"2023-12-19T16:07:41.537161+0000","last_undegraded":"2023-12-19T16:07:41.537161+0000","last_fullsized":"2023-12-19T16:07:41.537161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:41.884274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529250+0000","last_change":"2023-12-19T16:07:41.529250+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529250+0000","last_undegraded":"2023-12-19T16:07:41.529250+0000","last_fullsized":"2023-12-19T16:07:41.529250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:18.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.542172+0000","last_change":"2023-12-19T16:07:41.539076+0000","last_active":"2023-12-19T16:07:41.542172+0000","last_peered":"2023-12-19T16:07:41.542172+0000","last_clean":"2023-12-19T16:07:41.542172+0000","last_became_active":"2023-12-19T16:07:41.538793+0000","last_became_peered":"2023-12-19T16:07:41.538793+0000","last_unstale":"2023-12-19T16:07:41.542172+0000","last_undegraded":"2023-12-19T16:07:41.542172+0000","last_fullsized":"2023-12-19T16:07:41.542172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:42:25.311467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530117+0000","last_change":"2023-12-19T16:07:41.530117+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530117+0000","last_undegraded":"2023-12-19T16:07:41.530117+0000","last_fullsized":"2023-12-19T16:07:41.530117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:05:34.739335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.544976+0000","last_change":"2023-12-19T16:07:41.543028+0000","last_active":"2023-12-19T16:07:41.544976+0000","last_peered":"2023-12-19T16:07:41.544976+0000","last_clean":"2023-12-19T16:07:41.544976+0000","last_became_active":"2023-12-19T16:07:41.542523+0000","last_became_peered":"2023-12-19T16:07:41.542523+0000","last_unstale":"2023-12-19T16:07:41.544976+0000","last_undegraded":"2023-12-19T16:07:41.544976+0000","last_fullsized":"2023-12-19T16:07:41.544976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:26:48.870501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532322+0000","last_change":"2023-12-19T16:07:41.532322+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532322+0000","last_undegraded":"2023-12-19T16:07:41.532322+0000","last_fullsized":"2023-12-19T16:07:41.532322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:32.203742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538529+0000","last_change":"2023-12-19T16:07:41.534899+0000","last_active":"2023-12-19T16:07:41.538529+0000","last_peered":"2023-12-19T16:07:41.538529+0000","last_clean":"2023-12-19T16:07:41.538529+0000","last_became_active":"2023-12-19T16:07:41.534601+0000","last_became_peered":"2023-12-19T16:07:41.534601+0000","last_unstale":"2023-12-19T16:07:41.538529+0000","last_undegraded":"2023-12-19T16:07:41.538529+0000","last_fullsized":"2023-12-19T16:07:41.538529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:42.994812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530322+0000","last_change":"2023-12-19T16:07:41.530322+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530322+0000","last_undegraded":"2023-12-19T16:07:41.530322+0000","last_fullsized":"2023-12-19T16:07:41.530322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:27.607901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545470+0000","last_change":"2023-12-19T16:07:41.543958+0000","last_active":"2023-12-19T16:07:41.545470+0000","last_peered":"2023-12-19T16:07:41.545470+0000","last_clean":"2023-12-19T16:07:41.545470+0000","last_became_active":"2023-12-19T16:07:41.543503+0000","last_became_peered":"2023-12-19T16:07:41.543503+0000","last_unstale":"2023-12-19T16:07:41.545470+0000","last_undegraded":"2023-12-19T16:07:41.545470+0000","last_fullsized":"2023-12-19T16:07:41.545470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:25:18.011790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530356+0000","last_change":"2023-12-19T16:07:41.530356+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530356+0000","last_undegraded":"2023-12-19T16:07:41.530356+0000","last_fullsized":"2023-12-19T16:07:41.530356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:15.031639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.537202+0000","last_change":"2023-12-19T16:07:41.534556+0000","last_active":"2023-12-19T16:07:41.537202+0000","last_peered":"2023-12-19T16:07:41.537202+0000","last_clean":"2023-12-19T16:07:41.537202+0000","last_became_active":"2023-12-19T16:07:41.534265+0000","last_became_peered":"2023-12-19T16:07:41.534265+0000","last_unstale":"2023-12-19T16:07:41.537202+0000","last_undegraded":"2023-12-19T16:07:41.537202+0000","last_fullsized":"2023-12-19T16:07:41.537202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:16:33.732599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531449+0000","last_change":"2023-12-19T16:07:41.531449+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531449+0000","last_undegraded":"2023-12-19T16:07:41.531449+0000","last_fullsized":"2023-12-19T16:07:41.531449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:14:36.093257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.543193+0000","last_change":"2023-12-19T16:07:41.541301+0000","last_active":"2023-12-19T16:07:41.543193+0000","last_peered":"2023-12-19T16:07:41.543193+0000","last_clean":"2023-12-19T16:07:41.543193+0000","last_became_active":"2023-12-19T16:07:41.540995+0000","last_became_peered":"2023-12-19T16:07:41.540995+0000","last_unstale":"2023-12-19T16:07:41.543193+0000","last_undegraded":"2023-12-19T16:07:41.543193+0000","last_fullsized":"2023-12-19T16:07:41.543193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:04.614913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.526664+0000","last_change":"2023-12-19T16:07:41.526664+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.526664+0000","last_undegraded":"2023-12-19T16:07:41.526664+0000","last_fullsized":"2023-12-19T16:07:41.526664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:09.783023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545015+0000","last_change":"2023-12-19T16:07:41.540432+0000","last_active":"2023-12-19T16:07:41.545015+0000","last_peered":"2023-12-19T16:07:41.545015+0000","last_clean":"2023-12-19T16:07:41.545015+0000","last_became_active":"2023-12-19T16:07:41.540087+0000","last_became_peered":"2023-12-19T16:07:41.540087+0000","last_unstale":"2023-12-19T16:07:41.545015+0000","last_undegraded":"2023-12-19T16:07:41.545015+0000","last_fullsized":"2023-12-19T16:07:41.545015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:04:24.120557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529369+0000","last_change":"2023-12-19T16:07:41.529369+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529369+0000","last_undegraded":"2023-12-19T16:07:41.529369+0000","last_fullsized":"2023-12-19T16:07:41.529369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:44.002133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538459+0000","last_change":"2023-12-19T16:07:41.534179+0000","last_active":"2023-12-19T16:07:41.538459+0000","last_peered":"2023-12-19T16:07:41.538459+0000","last_clean":"2023-12-19T16:07:41.538459+0000","last_became_active":"2023-12-19T16:07:41.533903+0000","last_became_peered":"2023-12-19T16:07:41.533903+0000","last_unstale":"2023-12-19T16:07:41.538459+0000","last_undegraded":"2023-12-19T16:07:41.538459+0000","last_fullsized":"2023-12-19T16:07:41.538459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:42.994812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.526582+0000","last_change":"2023-12-19T16:07:41.526582+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.526582+0000","last_undegraded":"2023-12-19T16:07:41.526582+0000","last_fullsized":"2023-12-19T16:07:41.526582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:49.018092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.542338+0000","last_change":"2023-12-19T16:07:41.539027+0000","last_active":"2023-12-19T16:07:41.542338+0000","last_peered":"2023-12-19T16:07:41.542338+0000","last_clean":"2023-12-19T16:07:41.542338+0000","last_became_active":"2023-12-19T16:07:41.538640+0000","last_became_peered":"2023-12-19T16:07:41.538640+0000","last_unstale":"2023-12-19T16:07:41.542338+0000","last_undegraded":"2023-12-19T16:07:41.542338+0000","last_fullsized":"2023-12-19T16:07:41.542338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:33.056284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530904+0000","last_change":"2023-12-19T16:07:41.530904+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530904+0000","last_undegraded":"2023-12-19T16:07:41.530904+0000","last_fullsized":"2023-12-19T16:07:41.530904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:15:19.041369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538397+0000","last_change":"2023-12-19T16:07:41.535833+0000","last_active":"2023-12-19T16:07:41.538397+0000","last_peered":"2023-12-19T16:07:41.538397+0000","last_clean":"2023-12-19T16:07:41.538397+0000","last_became_active":"2023-12-19T16:07:41.535489+0000","last_became_peered":"2023-12-19T16:07:41.535489+0000","last_unstale":"2023-12-19T16:07:41.538397+0000","last_undegraded":"2023-12-19T16:07:41.538397+0000","last_fullsized":"2023-12-19T16:07:41.538397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:57.073133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529391+0000","last_change":"2023-12-19T16:07:41.529391+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529391+0000","last_undegraded":"2023-12-19T16:07:41.529391+0000","last_fullsized":"2023-12-19T16:07:41.529391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:30:03.606200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.537077+0000","last_change":"2023-12-19T16:07:41.534514+0000","last_active":"2023-12-19T16:07:41.537077+0000","last_peered":"2023-12-19T16:07:41.537077+0000","last_clean":"2023-12-19T16:07:41.537077+0000","last_became_active":"2023-12-19T16:07:41.532360+0000","last_became_peered":"2023-12-19T16:07:41.532360+0000","last_unstale":"2023-12-19T16:07:41.537077+0000","last_undegraded":"2023-12-19T16:07:41.537077+0000","last_fullsized":"2023-12-19T16:07:41.537077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:52.291611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532089+0000","last_change":"2023-12-19T16:07:41.532089+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532089+0000","last_undegraded":"2023-12-19T16:07:41.532089+0000","last_fullsized":"2023-12-19T16:07:41.532089+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:53.298933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.542372+0000","last_change":"2023-12-19T16:07:41.541032+0000","last_active":"2023-12-19T16:07:41.542372+0000","last_peered":"2023-12-19T16:07:41.542372+0000","last_clean":"2023-12-19T16:07:41.542372+0000","last_became_active":"2023-12-19T16:07:41.540678+0000","last_became_peered":"2023-12-19T16:07:41.540678+0000","last_unstale":"2023-12-19T16:07:41.542372+0000","last_undegraded":"2023-12-19T16:07:41.542372+0000","last_fullsized":"2023-12-19T16:07:41.542372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:42.914223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531219+0000","last_change":"2023-12-19T16:07:41.531219+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531219+0000","last_undegraded":"2023-12-19T16:07:41.531219+0000","last_fullsized":"2023-12-19T16:07:41.531219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:36.918227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.543129+0000","last_change":"2023-12-19T16:07:41.540982+0000","last_active":"2023-12-19T16:07:41.543129+0000","last_peered":"2023-12-19T16:07:41.543129+0000","last_clean":"2023-12-19T16:07:41.543129+0000","last_became_active":"2023-12-19T16:07:41.540654+0000","last_became_peered":"2023-12-19T16:07:41.540654+0000","last_unstale":"2023-12-19T16:07:41.543129+0000","last_undegraded":"2023-12-19T16:07:41.543129+0000","last_fullsized":"2023-12-19T16:07:41.543129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:48.955394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531185+0000","last_change":"2023-12-19T16:07:41.531185+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531185+0000","last_undegraded":"2023-12-19T16:07:41.531185+0000","last_fullsized":"2023-12-19T16:07:41.531185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:42.891596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.543765+0000","last_change":"2023-12-19T16:07:41.543300+0000","last_active":"2023-12-19T16:07:41.543765+0000","last_peered":"2023-12-19T16:07:41.543765+0000","last_clean":"2023-12-19T16:07:41.543765+0000","last_became_active":"2023-12-19T16:07:41.543098+0000","last_became_peered":"2023-12-19T16:07:41.543098+0000","last_unstale":"2023-12-19T16:07:41.543765+0000","last_undegraded":"2023-12-19T16:07:41.543765+0000","last_fullsized":"2023-12-19T16:07:41.543765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:16:33.732599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530754+0000","last_change":"2023-12-19T16:07:41.530754+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530754+0000","last_undegraded":"2023-12-19T16:07:41.530754+0000","last_fullsized":"2023-12-19T16:07:41.530754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:22.382499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538409+0000","last_change":"2023-12-19T16:07:41.536582+0000","last_active":"2023-12-19T16:07:41.538409+0000","last_peered":"2023-12-19T16:07:41.538409+0000","last_clean":"2023-12-19T16:07:41.538409+0000","last_became_active":"2023-12-19T16:07:41.536322+0000","last_became_peered":"2023-12-19T16:07:41.536322+0000","last_unstale":"2023-12-19T16:07:41.538409+0000","last_undegraded":"2023-12-19T16:07:41.538409+0000","last_fullsized":"2023-12-19T16:07:41.538409+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:40:35.184260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.526708+0000","last_change":"2023-12-19T16:07:41.526708+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.526708+0000","last_undegraded":"2023-12-19T16:07:41.526708+0000","last_fullsized":"2023-12-19T16:07:41.526708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:03:01.998993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.540447+0000","last_change":"2023-12-19T16:07:41.537907+0000","last_active":"2023-12-19T16:07:41.540447+0000","last_peered":"2023-12-19T16:07:41.540447+0000","last_clean":"2023-12-19T16:07:41.540447+0000","last_became_active":"2023-12-19T16:07:41.537096+0000","last_became_peered":"2023-12-19T16:07:41.537096+0000","last_unstale":"2023-12-19T16:07:41.540447+0000","last_undegraded":"2023-12-19T16:07:41.540447+0000","last_fullsized":"2023-12-19T16:07:41.540447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:04:24.120557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530063+0000","last_change":"2023-12-19T16:07:41.530063+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530063+0000","last_undegraded":"2023-12-19T16:07:41.530063+0000","last_fullsized":"2023-12-19T16:07:41.530063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:58.080454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.540808+0000","last_change":"2023-12-19T16:07:41.535728+0000","last_active":"2023-12-19T16:07:41.540808+0000","last_peered":"2023-12-19T16:07:41.540808+0000","last_clean":"2023-12-19T16:07:41.540808+0000","last_became_active":"2023-12-19T16:07:41.535425+0000","last_became_peered":"2023-12-19T16:07:41.535425+0000","last_unstale":"2023-12-19T16:07:41.540808+0000","last_undegraded":"2023-12-19T16:07:41.540808+0000","last_fullsized":"2023-12-19T16:07:41.540808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:42.914223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530466+0000","last_change":"2023-12-19T16:07:41.530466+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530466+0000","last_undegraded":"2023-12-19T16:07:41.530466+0000","last_fullsized":"2023-12-19T16:07:41.530466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:14:36.093257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.544582+0000","last_change":"2023-12-19T16:07:41.541840+0000","last_active":"2023-12-19T16:07:41.544582+0000","last_peered":"2023-12-19T16:07:41.544582+0000","last_clean":"2023-12-19T16:07:41.544582+0000","last_became_active":"2023-12-19T16:07:41.541418+0000","last_became_peered":"2023-12-19T16:07:41.541418+0000","last_unstale":"2023-12-19T16:07:41.544582+0000","last_undegraded":"2023-12-19T16:07:41.544582+0000","last_fullsized":"2023-12-19T16:07:41.544582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:04.614913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.531700+0000","last_change":"2023-12-19T16:07:41.531700+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.531700+0000","last_undegraded":"2023-12-19T16:07:41.531700+0000","last_fullsized":"2023-12-19T16:07:41.531700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:54.332659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.545380+0000","last_change":"2023-12-19T16:07:41.543692+0000","last_active":"2023-12-19T16:07:41.545380+0000","last_peered":"2023-12-19T16:07:41.545380+0000","last_clean":"2023-12-19T16:07:41.545380+0000","last_became_active":"2023-12-19T16:07:41.543404+0000","last_became_peered":"2023-12-19T16:07:41.543404+0000","last_unstale":"2023-12-19T16:07:41.545380+0000","last_undegraded":"2023-12-19T16:07:41.545380+0000","last_fullsized":"2023-12-19T16:07:41.545380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:56.749124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.530470+0000","last_change":"2023-12-19T16:07:41.530470+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.530470+0000","last_undegraded":"2023-12-19T16:07:41.530470+0000","last_fullsized":"2023-12-19T16:07:41.530470+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:40:14.146826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.543106+0000","last_change":"2023-12-19T16:07:41.540450+0000","last_active":"2023-12-19T16:07:41.543106+0000","last_peered":"2023-12-19T16:07:41.543106+0000","last_clean":"2023-12-19T16:07:41.543106+0000","last_became_active":"2023-12-19T16:07:41.540084+0000","last_became_peered":"2023-12-19T16:07:41.540084+0000","last_unstale":"2023-12-19T16:07:41.543106+0000","last_undegraded":"2023-12-19T16:07:41.543106+0000","last_fullsized":"2023-12-19T16:07:41.543106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:42.914223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.532505+0000","last_change":"2023-12-19T16:07:41.532505+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.532505+0000","last_undegraded":"2023-12-19T16:07:41.532505+0000","last_fullsized":"2023-12-19T16:07:41.532505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:40:14.146826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.540767+0000","last_change":"2023-12-19T16:07:41.535019+0000","last_active":"2023-12-19T16:07:41.540767+0000","last_peered":"2023-12-19T16:07:41.540767+0000","last_clean":"2023-12-19T16:07:41.540767+0000","last_became_active":"2023-12-19T16:07:41.534739+0000","last_became_peered":"2023-12-19T16:07:41.534739+0000","last_unstale":"2023-12-19T16:07:41.540767+0000","last_undegraded":"2023-12-19T16:07:41.540767+0000","last_fullsized":"2023-12-19T16:07:41.540767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:26:48.870501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.529252+0000","last_change":"2023-12-19T16:07:41.529252+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.529252+0000","last_undegraded":"2023-12-19T16:07:41.529252+0000","last_fullsized":"2023-12-19T16:07:41.529252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:03:01.998993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.538389+0000","last_change":"2023-12-19T16:07:41.535225+0000","last_active":"2023-12-19T16:07:41.538389+0000","last_peered":"2023-12-19T16:07:41.538389+0000","last_clean":"2023-12-19T16:07:41.538389+0000","last_became_active":"2023-12-19T16:07:41.534968+0000","last_became_peered":"2023-12-19T16:07:41.534968+0000","last_unstale":"2023-12-19T16:07:41.538389+0000","last_undegraded":"2023-12-19T16:07:41.538389+0000","last_fullsized":"2023-12-19T16:07:41.538389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:21.375178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.527409+0000","last_change":"2023-12-19T16:07:41.527409+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.527409+0000","last_undegraded":"2023-12-19T16:07:41.527409+0000","last_fullsized":"2023-12-19T16:07:41.527409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:15.031639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.544867+0000","last_change":"2023-12-19T16:07:41.539795+0000","last_active":"2023-12-19T16:07:41.544867+0000","last_peered":"2023-12-19T16:07:41.544867+0000","last_clean":"2023-12-19T16:07:41.544867+0000","last_became_active":"2023-12-19T16:07:41.539479+0000","last_became_peered":"2023-12-19T16:07:41.539479+0000","last_unstale":"2023-12-19T16:07:41.544867+0000","last_undegraded":"2023-12-19T16:07:41.544867+0000","last_fullsized":"2023-12-19T16:07:41.544867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:06:54.795957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-12-19T16:07:41.525642+0000","last_change":"2023-12-19T16:07:41.525642+0000","last_active":"2023-12-19T16:07:41.514068+0000","last_peered":"2023-12-19T16:07:41.514068+0000","last_clean":"2023-12-19T16:07:41.514068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:07:41.525642+0000","last_undegraded":"2023-12-19T16:07:41.525642+0000","last_fullsized":"2023-12-19T16:07:41.525642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:15.031639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.539048+0000","last_change":"2023-12-19T16:07:41.537380+0000","last_active":"2023-12-19T16:07:41.539048+0000","last_peered":"2023-12-19T16:07:41.539048+0000","last_clean":"2023-12-19T16:07:41.539048+0000","last_became_active":"2023-12-19T16:07:41.537122+0000","last_became_peered":"2023-12-19T16:07:41.537122+0000","last_unstale":"2023-12-19T16:07:41.539048+0000","last_undegraded":"2023-12-19T16:07:41.539048+0000","last_fullsized":"2023-12-19T16:07:41.539048+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:35.910905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-19T16:07:40.520774+0000","last_change":"2023-12-19T16:06:47.761389+0000","last_active":"2023-12-19T16:07:40.520774+0000","last_peered":"2023-12-19T16:07:40.520774+0000","last_clean":"2023-12-19T16:07:40.520774+0000","last_became_active":"2023-12-19T16:06:47.760252+0000","last_became_peered":"2023-12-19T16:06:47.760252+0000","last_unstale":"2023-12-19T16:07:40.520774+0000","last_undegraded":"2023-12-19T16:07:40.520774+0000","last_fullsized":"2023-12-19T16:07:40.520774+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_clean_scrub_stamp":"2023-12-19T16:06:46.706871+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:09.167979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":905216,"data_stored":705288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":114920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":905216,"data_stored":705288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:07:49.323 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:07:49.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.439+0000 7f5626373640 1 Processor -- start 2023-12-19T16:07:49.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.439+0000 7f5626373640 1 -- start start 2023-12-19T16:07:49.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.439+0000 7f5626373640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5620144ea0 0x7f5620156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:49.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.439+0000 7f5626373640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56200bc6b0 con 0x7f56200bcdd0 2023-12-19T16:07:49.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.439+0000 7f5626373640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56200a59f0 con 0x7f56200b6690 2023-12-19T16:07:49.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.439+0000 7f5626373640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56200bc0a0 con 0x7f5620144ea0 2023-12-19T16:07:49.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.439+0000 7f5624910640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5620144ea0 0x7f5620156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:49.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.439+0000 7f561ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f56200bcdd0 0x7f56200b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43396/0 (socket says 172.21.15.37:43396) 2023-12-19T16:07:49.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.439+0000 7f561ffff640 1 -- 172.21.15.37:0/1518287757 learned_addr learned my addr 172.21.15.37:0/1518287757 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:49.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.440+0000 7f5624910640 1 -- 172.21.15.37:0/1518287757 >> v1:172.21.15.78:6789/0 conn(0x7f56200b6690 legacy=0x7f5620144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:49.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.440+0000 7f561effd640 1 -- 172.21.15.37:0/1518287757 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278952545 0 0) 0x7f56200bc6b0 con 0x7f56200bcdd0 2023-12-19T16:07:49.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.440+0000 7f5624910640 1 -- 172.21.15.37:0/1518287757 >> v1:172.21.15.37:6789/0 conn(0x7f56200bcdd0 legacy=0x7f56200b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:49.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.440+0000 7f5624910640 1 -- 172.21.15.37:0/1518287757 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56200bc340 con 0x7f5620144ea0 2023-12-19T16:07:49.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.441+0000 7f5624910640 1 --2- 172.21.15.37:0/1518287757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5620144ea0 0x7f5620156350 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f56200a5b80 tx=0x7f561802bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ddd13d4c310280b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:49.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.441+0000 7f561effd640 1 -- 172.21.15.37:0/1518287757 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561802cd80 con 0x7f5620144ea0 2023-12-19T16:07:49.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.441+0000 7f561effd640 1 -- 172.21.15.37:0/1518287757 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5618034440 con 0x7f5620144ea0 2023-12-19T16:07:49.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.441+0000 7f561effd640 1 -- 172.21.15.37:0/1518287757 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56180347d0 con 0x7f5620144ea0 2023-12-19T16:07:49.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.441+0000 7f5626373640 1 -- 172.21.15.37:0/1518287757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5620144ea0 msgr2=0x7f5620156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:49.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.441+0000 7f5626373640 1 --2- 172.21.15.37:0/1518287757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5620144ea0 0x7f5620156350 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f56200a5b80 tx=0x7f561802bfd0 comp rx=0 tx=0).stop 2023-12-19T16:07:49.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.441+0000 7f5626373640 1 -- 172.21.15.37:0/1518287757 shutdown_connections 2023-12-19T16:07:49.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.441+0000 7f5626373640 1 --2- 172.21.15.37:0/1518287757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5620144ea0 0x7f5620156350 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:49.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.441+0000 7f5626373640 1 -- 172.21.15.37:0/1518287757 >> 172.21.15.37:0/1518287757 conn(0x7f5620071e60 msgr2=0x7f56200c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:49.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.441+0000 7f5626373640 1 -- 172.21.15.37:0/1518287757 shutdown_connections 2023-12-19T16:07:49.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.441+0000 7f5626373640 1 -- 172.21.15.37:0/1518287757 wait complete. 2023-12-19T16:07:49.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.442+0000 7f5626373640 1 Processor -- start 2023-12-19T16:07:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.443+0000 7f5626373640 1 -- start start 2023-12-19T16:07:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.443+0000 7f5626373640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56200b6690 0x7f5620149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.443+0000 7f5626373640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56200bcdd0 0x7f5620148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.443+0000 7f5626373640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5620144ea0 0x7f56200ba6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.443+0000 7f5626373640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5620149210 con 0x7f56200b6690 2023-12-19T16:07:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.443+0000 7f5626373640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5620149400 con 0x7f56200bcdd0 2023-12-19T16:07:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.443+0000 7f5626373640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56201d26b0 con 0x7f5620144ea0 2023-12-19T16:07:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.443+0000 7f561ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56200b6690 0x7f5620149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.443+0000 7f561ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56200b6690 0x7f5620149ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37866/0 (socket says 172.21.15.37:37866) 2023-12-19T16:07:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.443+0000 7f561ffff640 1 -- 172.21.15.37:0/1172404424 learned_addr learned my addr 172.21.15.37:0/1172404424 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.444+0000 7f561f7fe640 1 --2- 172.21.15.37:0/1172404424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56200bcdd0 0x7f5620148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.444+0000 7f5624910640 1 --2- 172.21.15.37:0/1172404424 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5620144ea0 0x7f56200ba6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.444+0000 7f561ffff640 1 -- 172.21.15.37:0/1172404424 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5620144ea0 msgr2=0x7f56200ba6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.444+0000 7f561ffff640 1 --2- 172.21.15.37:0/1172404424 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5620144ea0 0x7f56200ba6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.444+0000 7f561ffff640 1 -- 172.21.15.37:0/1172404424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56200bcdd0 msgr2=0x7f5620148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.444+0000 7f561ffff640 1 --2- 172.21.15.37:0/1172404424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56200bcdd0 0x7f5620148cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.444+0000 7f561ffff640 1 -- 172.21.15.37:0/1172404424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5618009a70 con 0x7f56200b6690 2023-12-19T16:07:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.444+0000 7f561f7fe640 1 --2- 172.21.15.37:0/1172404424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56200bcdd0 0x7f5620148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:07:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.444+0000 7f561ffff640 1 --2- 172.21.15.37:0/1172404424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56200b6690 0x7f5620149ce0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f561000c4a0 tx=0x7f561000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.444+0000 7f561cff9640 1 -- 172.21.15.37:0/1172404424 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56100074e0 con 0x7f56200b6690 2023-12-19T16:07:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.444+0000 7f561cff9640 1 -- 172.21.15.37:0/1172404424 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5610007640 con 0x7f56200b6690 2023-12-19T16:07:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.444+0000 7f561cff9640 1 -- 172.21.15.37:0/1172404424 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5610004a00 con 0x7f56200b6690 2023-12-19T16:07:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.444+0000 7f5626373640 1 -- 172.21.15.37:0/1172404424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f562013ee50 con 0x7f56200b6690 2023-12-19T16:07:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.444+0000 7f5626373640 1 -- 172.21.15.37:0/1172404424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f562014b110 con 0x7f56200b6690 2023-12-19T16:07:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.445+0000 7f5626373640 1 -- 172.21.15.37:0/1172404424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56200ba4b0 con 0x7f56200b6690 2023-12-19T16:07:49.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.446+0000 7f561cff9640 1 -- 172.21.15.37:0/1172404424 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5610004b60 con 0x7f56200b6690 2023-12-19T16:07:49.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.446+0000 7f561cff9640 1 --2- 172.21.15.37:0/1172404424 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f560c06a460 0x7f560c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:49.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.446+0000 7f561cff9640 1 -- 172.21.15.37:0/1172404424 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5610087a40 con 0x7f56200b6690 2023-12-19T16:07:49.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.446+0000 7f561f7fe640 1 --2- 172.21.15.37:0/1172404424 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f560c06a460 0x7f560c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:49.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.447+0000 7f561f7fe640 1 --2- 172.21.15.37:0/1172404424 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f560c06a460 0x7f560c06c920 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5614007fd0 tx=0x7f5614009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:49.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.450+0000 7f561cff9640 1 -- 172.21.15.37:0/1172404424 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5610089e60 con 0x7f56200b6690 2023-12-19T16:07:49.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.624+0000 7f5626373640 1 -- 172.21.15.37:0/1172404424 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f56200bd1b0 con 0x7f560c06a460 2023-12-19T16:07:49.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.632+0000 7f561cff9640 1 -- 172.21.15.37:0/1172404424 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+267771 (secure 0 0 0) 0x7f56140013e0 con 0x7f560c06a460 2023-12-19T16:07:49.636 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-19T16:07:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.634+0000 7f5626373640 1 -- 172.21.15.37:0/1172404424 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f560c06a460 msgr2=0x7f560c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.634+0000 7f5626373640 1 --2- 172.21.15.37:0/1172404424 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f560c06a460 0x7f560c06c920 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5614007fd0 tx=0x7f5614009040 comp rx=0 tx=0).stop 2023-12-19T16:07:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.634+0000 7f5626373640 1 -- 172.21.15.37:0/1172404424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56200b6690 msgr2=0x7f5620149ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.634+0000 7f5626373640 1 --2- 172.21.15.37:0/1172404424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56200b6690 0x7f5620149ce0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f561000c4a0 tx=0x7f561000c960 comp rx=0 tx=0).stop 2023-12-19T16:07:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.634+0000 7f5626373640 1 -- 172.21.15.37:0/1172404424 shutdown_connections 2023-12-19T16:07:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.634+0000 7f5626373640 1 --2- 172.21.15.37:0/1172404424 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f560c06a460 0x7f560c06c920 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.634+0000 7f5626373640 1 --2- 172.21.15.37:0/1172404424 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5620144ea0 0x7f56200ba6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.634+0000 7f5626373640 1 --2- 172.21.15.37:0/1172404424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56200bcdd0 0x7f5620148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.634+0000 7f5626373640 1 --2- 172.21.15.37:0/1172404424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56200b6690 0x7f5620149ce0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.634+0000 7f5626373640 1 -- 172.21.15.37:0/1172404424 >> 172.21.15.37:0/1172404424 conn(0x7f5620071e60 msgr2=0x7f5620140850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.635+0000 7f5626373640 1 -- 172.21.15.37:0/1172404424 shutdown_connections 2023-12-19T16:07:49.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.635+0000 7f5626373640 1 -- 172.21.15.37:0/1172404424 wait complete. 2023-12-19T16:07:49.647 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-12-19T16:07:48.642980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3944,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":4038656,"data_stored":2259556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.120585"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.923563+0000","last_change":"2023-12-19T16:07:41.918118+0000","last_active":"2023-12-19T16:07:41.923563+0000","last_peered":"2023-12-19T16:07:41.923563+0000","last_clean":"2023-12-19T16:07:41.923563+0000","last_became_active":"2023-12-19T16:07:41.917859+0000","last_became_peered":"2023-12-19T16:07:41.917859+0000","last_unstale":"2023-12-19T16:07:41.923563+0000","last_undegraded":"2023-12-19T16:07:41.923563+0000","last_fullsized":"2023-12-19T16:07:41.923563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:04:25.127879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.919142+0000","last_change":"2023-12-19T16:07:41.916767+0000","last_active":"2023-12-19T16:07:41.919142+0000","last_peered":"2023-12-19T16:07:41.919142+0000","last_clean":"2023-12-19T16:07:41.919142+0000","last_became_active":"2023-12-19T16:07:41.916505+0000","last_became_peered":"2023-12-19T16:07:41.916505+0000","last_unstale":"2023-12-19T16:07:41.919142+0000","last_undegraded":"2023-12-19T16:07:41.919142+0000","last_fullsized":"2023-12-19T16:07:41.919142+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:07:52.335635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.926834+0000","last_change":"2023-12-19T16:07:41.924987+0000","last_active":"2023-12-19T16:07:41.926834+0000","last_peered":"2023-12-19T16:07:41.926834+0000","last_clean":"2023-12-19T16:07:41.926834+0000","last_became_active":"2023-12-19T16:07:41.924639+0000","last_became_peered":"2023-12-19T16:07:41.924639+0000","last_unstale":"2023-12-19T16:07:41.926834+0000","last_undegraded":"2023-12-19T16:07:41.926834+0000","last_fullsized":"2023-12-19T16:07:41.926834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:05:34.739335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.926608+0000","last_change":"2023-12-19T16:07:41.925109+0000","last_active":"2023-12-19T16:07:41.926608+0000","last_peered":"2023-12-19T16:07:41.926608+0000","last_clean":"2023-12-19T16:07:41.926608+0000","last_became_active":"2023-12-19T16:07:41.924664+0000","last_became_peered":"2023-12-19T16:07:41.924664+0000","last_unstale":"2023-12-19T16:07:41.926608+0000","last_undegraded":"2023-12-19T16:07:41.926608+0000","last_fullsized":"2023-12-19T16:07:41.926608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:45:40.959769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.919361+0000","last_change":"2023-12-19T16:07:41.917353+0000","last_active":"2023-12-19T16:07:41.919361+0000","last_peered":"2023-12-19T16:07:41.919361+0000","last_clean":"2023-12-19T16:07:41.919361+0000","last_became_active":"2023-12-19T16:07:41.917100+0000","last_became_peered":"2023-12-19T16:07:41.917100+0000","last_unstale":"2023-12-19T16:07:41.919361+0000","last_undegraded":"2023-12-19T16:07:41.919361+0000","last_fullsized":"2023-12-19T16:07:41.919361+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:26:49.877822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.918863+0000","last_change":"2023-12-19T16:07:41.914728+0000","last_active":"2023-12-19T16:07:41.918863+0000","last_peered":"2023-12-19T16:07:41.918863+0000","last_clean":"2023-12-19T16:07:41.918863+0000","last_became_active":"2023-12-19T16:07:41.914269+0000","last_became_peered":"2023-12-19T16:07:41.914269+0000","last_unstale":"2023-12-19T16:07:41.918863+0000","last_undegraded":"2023-12-19T16:07:41.918863+0000","last_fullsized":"2023-12-19T16:07:41.918863+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:18.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.919740+0000","last_change":"2023-12-19T16:07:41.917985+0000","last_active":"2023-12-19T16:07:41.919740+0000","last_peered":"2023-12-19T16:07:41.919740+0000","last_clean":"2023-12-19T16:07:41.919740+0000","last_became_active":"2023-12-19T16:07:41.917725+0000","last_became_peered":"2023-12-19T16:07:41.917725+0000","last_unstale":"2023-12-19T16:07:41.919740+0000","last_undegraded":"2023-12-19T16:07:41.919740+0000","last_fullsized":"2023-12-19T16:07:41.919740+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:15:19.041369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.913266+0000","last_change":"2023-12-19T16:07:41.906496+0000","last_active":"2023-12-19T16:07:41.913266+0000","last_peered":"2023-12-19T16:07:41.913266+0000","last_clean":"2023-12-19T16:07:41.913266+0000","last_became_active":"2023-12-19T16:07:41.906190+0000","last_became_peered":"2023-12-19T16:07:41.906190+0000","last_unstale":"2023-12-19T16:07:41.913266+0000","last_undegraded":"2023-12-19T16:07:41.913266+0000","last_fullsized":"2023-12-19T16:07:41.913266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:42.867424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.923767+0000","last_change":"2023-12-19T16:07:41.921929+0000","last_active":"2023-12-19T16:07:41.923767+0000","last_peered":"2023-12-19T16:07:41.923767+0000","last_clean":"2023-12-19T16:07:41.923767+0000","last_became_active":"2023-12-19T16:07:41.921638+0000","last_became_peered":"2023-12-19T16:07:41.921638+0000","last_unstale":"2023-12-19T16:07:41.923767+0000","last_undegraded":"2023-12-19T16:07:41.923767+0000","last_fullsized":"2023-12-19T16:07:41.923767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:07:54.635072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.926125+0000","last_change":"2023-12-19T16:07:41.922695+0000","last_active":"2023-12-19T16:07:41.926125+0000","last_peered":"2023-12-19T16:07:41.926125+0000","last_clean":"2023-12-19T16:07:41.926125+0000","last_became_active":"2023-12-19T16:07:41.922457+0000","last_became_peered":"2023-12-19T16:07:41.922457+0000","last_unstale":"2023-12-19T16:07:41.926125+0000","last_undegraded":"2023-12-19T16:07:41.926125+0000","last_fullsized":"2023-12-19T16:07:41.926125+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:15:19.041369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.924706+0000","last_change":"2023-12-19T16:07:41.923012+0000","last_active":"2023-12-19T16:07:41.924706+0000","last_peered":"2023-12-19T16:07:41.924706+0000","last_clean":"2023-12-19T16:07:41.924706+0000","last_became_active":"2023-12-19T16:07:41.922736+0000","last_became_peered":"2023-12-19T16:07:41.922736+0000","last_unstale":"2023-12-19T16:07:41.924706+0000","last_undegraded":"2023-12-19T16:07:41.924706+0000","last_fullsized":"2023-12-19T16:07:41.924706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:32.203742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.919825+0000","last_change":"2023-12-19T16:07:41.916371+0000","last_active":"2023-12-19T16:07:41.919825+0000","last_peered":"2023-12-19T16:07:41.919825+0000","last_clean":"2023-12-19T16:07:41.919825+0000","last_became_active":"2023-12-19T16:07:41.916115+0000","last_became_peered":"2023-12-19T16:07:41.916115+0000","last_unstale":"2023-12-19T16:07:41.919825+0000","last_undegraded":"2023-12-19T16:07:41.919825+0000","last_fullsized":"2023-12-19T16:07:41.919825+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:32.203742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.915042+0000","last_change":"2023-12-19T16:07:41.913131+0000","last_active":"2023-12-19T16:07:41.915042+0000","last_peered":"2023-12-19T16:07:41.915042+0000","last_clean":"2023-12-19T16:07:41.915042+0000","last_became_active":"2023-12-19T16:07:41.912877+0000","last_became_peered":"2023-12-19T16:07:41.912877+0000","last_unstale":"2023-12-19T16:07:41.915042+0000","last_undegraded":"2023-12-19T16:07:41.915042+0000","last_fullsized":"2023-12-19T16:07:41.915042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:43.921544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.921958+0000","last_change":"2023-12-19T16:07:41.920436+0000","last_active":"2023-12-19T16:07:41.921958+0000","last_peered":"2023-12-19T16:07:41.921958+0000","last_clean":"2023-12-19T16:07:41.921958+0000","last_became_active":"2023-12-19T16:07:41.920192+0000","last_became_peered":"2023-12-19T16:07:41.920192+0000","last_unstale":"2023-12-19T16:07:41.921958+0000","last_undegraded":"2023-12-19T16:07:41.921958+0000","last_fullsized":"2023-12-19T16:07:41.921958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:25:30.826214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.919730+0000","last_change":"2023-12-19T16:07:41.917939+0000","last_active":"2023-12-19T16:07:41.919730+0000","last_peered":"2023-12-19T16:07:41.919730+0000","last_clean":"2023-12-19T16:07:41.919730+0000","last_became_active":"2023-12-19T16:07:41.917667+0000","last_became_peered":"2023-12-19T16:07:41.917667+0000","last_unstale":"2023-12-19T16:07:41.919730+0000","last_undegraded":"2023-12-19T16:07:41.919730+0000","last_fullsized":"2023-12-19T16:07:41.919730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:03:01.998993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.919438+0000","last_change":"2023-12-19T16:07:41.913178+0000","last_active":"2023-12-19T16:07:41.919438+0000","last_peered":"2023-12-19T16:07:41.919438+0000","last_clean":"2023-12-19T16:07:41.919438+0000","last_became_active":"2023-12-19T16:07:41.912917+0000","last_became_peered":"2023-12-19T16:07:41.912917+0000","last_unstale":"2023-12-19T16:07:41.919438+0000","last_undegraded":"2023-12-19T16:07:41.919438+0000","last_fullsized":"2023-12-19T16:07:41.919438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:18.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.919545+0000","last_change":"2023-12-19T16:07:41.915268+0000","last_active":"2023-12-19T16:07:41.919545+0000","last_peered":"2023-12-19T16:07:41.919545+0000","last_clean":"2023-12-19T16:07:41.919545+0000","last_became_active":"2023-12-19T16:07:41.915024+0000","last_became_peered":"2023-12-19T16:07:41.915024+0000","last_unstale":"2023-12-19T16:07:41.919545+0000","last_undegraded":"2023-12-19T16:07:41.919545+0000","last_fullsized":"2023-12-19T16:07:41.919545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:25:30.826214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.927205+0000","last_change":"2023-12-19T16:07:41.925690+0000","last_active":"2023-12-19T16:07:41.927205+0000","last_peered":"2023-12-19T16:07:41.927205+0000","last_clean":"2023-12-19T16:07:41.927205+0000","last_became_active":"2023-12-19T16:07:41.925149+0000","last_became_peered":"2023-12-19T16:07:41.925149+0000","last_unstale":"2023-12-19T16:07:41.927205+0000","last_undegraded":"2023-12-19T16:07:41.927205+0000","last_fullsized":"2023-12-19T16:07:41.927205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:51.385493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.926675+0000","last_change":"2023-12-19T16:07:41.925687+0000","last_active":"2023-12-19T16:07:41.926675+0000","last_peered":"2023-12-19T16:07:41.926675+0000","last_clean":"2023-12-19T16:07:41.926675+0000","last_became_active":"2023-12-19T16:07:41.925447+0000","last_became_peered":"2023-12-19T16:07:41.925447+0000","last_unstale":"2023-12-19T16:07:41.926675+0000","last_undegraded":"2023-12-19T16:07:41.926675+0000","last_fullsized":"2023-12-19T16:07:41.926675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:27.607901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.920990+0000","last_change":"2023-12-19T16:07:41.919898+0000","last_active":"2023-12-19T16:07:41.920990+0000","last_peered":"2023-12-19T16:07:41.920990+0000","last_clean":"2023-12-19T16:07:41.920990+0000","last_became_active":"2023-12-19T16:07:41.917552+0000","last_became_peered":"2023-12-19T16:07:41.917552+0000","last_unstale":"2023-12-19T16:07:41.920990+0000","last_undegraded":"2023-12-19T16:07:41.920990+0000","last_fullsized":"2023-12-19T16:07:41.920990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:57.756446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.913210+0000","last_change":"2023-12-19T16:07:41.911187+0000","last_active":"2023-12-19T16:07:41.913210+0000","last_peered":"2023-12-19T16:07:41.913210+0000","last_clean":"2023-12-19T16:07:41.913210+0000","last_became_active":"2023-12-19T16:07:41.910728+0000","last_became_peered":"2023-12-19T16:07:41.910728+0000","last_unstale":"2023-12-19T16:07:41.913210+0000","last_undegraded":"2023-12-19T16:07:41.913210+0000","last_fullsized":"2023-12-19T16:07:41.913210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:22.467159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.918440+0000","last_change":"2023-12-19T16:07:41.913098+0000","last_active":"2023-12-19T16:07:41.918440+0000","last_peered":"2023-12-19T16:07:41.918440+0000","last_clean":"2023-12-19T16:07:41.918440+0000","last_became_active":"2023-12-19T16:07:41.912850+0000","last_became_peered":"2023-12-19T16:07:41.912850+0000","last_unstale":"2023-12-19T16:07:41.918440+0000","last_undegraded":"2023-12-19T16:07:41.918440+0000","last_fullsized":"2023-12-19T16:07:41.918440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:30:03.606200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.923644+0000","last_change":"2023-12-19T16:07:41.918625+0000","last_active":"2023-12-19T16:07:41.923644+0000","last_peered":"2023-12-19T16:07:41.923644+0000","last_clean":"2023-12-19T16:07:41.923644+0000","last_became_active":"2023-12-19T16:07:41.918374+0000","last_became_peered":"2023-12-19T16:07:41.918374+0000","last_unstale":"2023-12-19T16:07:41.923644+0000","last_undegraded":"2023-12-19T16:07:41.923644+0000","last_fullsized":"2023-12-19T16:07:41.923644+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:49.018092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.915440+0000","last_change":"2023-12-19T16:07:41.909063+0000","last_active":"2023-12-19T16:07:41.915440+0000","last_peered":"2023-12-19T16:07:41.915440+0000","last_clean":"2023-12-19T16:07:41.915440+0000","last_became_active":"2023-12-19T16:07:41.908766+0000","last_became_peered":"2023-12-19T16:07:41.908766+0000","last_unstale":"2023-12-19T16:07:41.915440+0000","last_undegraded":"2023-12-19T16:07:41.915440+0000","last_fullsized":"2023-12-19T16:07:41.915440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:42.867424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.923077+0000","last_change":"2023-12-19T16:07:41.922114+0000","last_active":"2023-12-19T16:07:41.923077+0000","last_peered":"2023-12-19T16:07:41.923077+0000","last_clean":"2023-12-19T16:07:41.923077+0000","last_became_active":"2023-12-19T16:07:41.921844+0000","last_became_peered":"2023-12-19T16:07:41.921844+0000","last_unstale":"2023-12-19T16:07:41.923077+0000","last_undegraded":"2023-12-19T16:07:41.923077+0000","last_fullsized":"2023-12-19T16:07:41.923077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:51.385493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.919126+0000","last_change":"2023-12-19T16:07:41.916132+0000","last_active":"2023-12-19T16:07:41.919126+0000","last_peered":"2023-12-19T16:07:41.919126+0000","last_clean":"2023-12-19T16:07:41.919126+0000","last_became_active":"2023-12-19T16:07:41.915896+0000","last_became_peered":"2023-12-19T16:07:41.915896+0000","last_unstale":"2023-12-19T16:07:41.919126+0000","last_undegraded":"2023-12-19T16:07:41.919126+0000","last_fullsized":"2023-12-19T16:07:41.919126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:42.867424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.925790+0000","last_change":"2023-12-19T16:07:41.922530+0000","last_active":"2023-12-19T16:07:41.925790+0000","last_peered":"2023-12-19T16:07:41.925790+0000","last_clean":"2023-12-19T16:07:41.925790+0000","last_became_active":"2023-12-19T16:07:41.922002+0000","last_became_peered":"2023-12-19T16:07:41.922002+0000","last_unstale":"2023-12-19T16:07:41.925790+0000","last_undegraded":"2023-12-19T16:07:41.925790+0000","last_fullsized":"2023-12-19T16:07:41.925790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:09.783023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.919807+0000","last_change":"2023-12-19T16:07:41.916197+0000","last_active":"2023-12-19T16:07:41.919807+0000","last_peered":"2023-12-19T16:07:41.919807+0000","last_clean":"2023-12-19T16:07:41.919807+0000","last_became_active":"2023-12-19T16:07:41.915946+0000","last_became_peered":"2023-12-19T16:07:41.915946+0000","last_unstale":"2023-12-19T16:07:41.919807+0000","last_undegraded":"2023-12-19T16:07:41.919807+0000","last_fullsized":"2023-12-19T16:07:41.919807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:25:30.826214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.918321+0000","last_change":"2023-12-19T16:07:41.916773+0000","last_active":"2023-12-19T16:07:41.918321+0000","last_peered":"2023-12-19T16:07:41.918321+0000","last_clean":"2023-12-19T16:07:41.918321+0000","last_became_active":"2023-12-19T16:07:41.916441+0000","last_became_peered":"2023-12-19T16:07:41.916441+0000","last_unstale":"2023-12-19T16:07:41.918321+0000","last_undegraded":"2023-12-19T16:07:41.918321+0000","last_fullsized":"2023-12-19T16:07:41.918321+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:09.783023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.919512+0000","last_change":"2023-12-19T16:07:41.916089+0000","last_active":"2023-12-19T16:07:41.919512+0000","last_peered":"2023-12-19T16:07:41.919512+0000","last_clean":"2023-12-19T16:07:41.919512+0000","last_became_active":"2023-12-19T16:07:41.915801+0000","last_became_peered":"2023-12-19T16:07:41.915801+0000","last_unstale":"2023-12-19T16:07:41.919512+0000","last_undegraded":"2023-12-19T16:07:41.919512+0000","last_fullsized":"2023-12-19T16:07:41.919512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:23.495455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.923276+0000","last_change":"2023-12-19T16:07:41.914886+0000","last_active":"2023-12-19T16:07:41.923276+0000","last_peered":"2023-12-19T16:07:41.923276+0000","last_clean":"2023-12-19T16:07:41.923276+0000","last_became_active":"2023-12-19T16:07:41.914628+0000","last_became_peered":"2023-12-19T16:07:41.914628+0000","last_unstale":"2023-12-19T16:07:41.923276+0000","last_undegraded":"2023-12-19T16:07:41.923276+0000","last_fullsized":"2023-12-19T16:07:41.923276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:06:55.803278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.915269+0000","last_change":"2023-12-19T16:07:41.910234+0000","last_active":"2023-12-19T16:07:41.915269+0000","last_peered":"2023-12-19T16:07:41.915269+0000","last_clean":"2023-12-19T16:07:41.915269+0000","last_became_active":"2023-12-19T16:07:41.909933+0000","last_became_peered":"2023-12-19T16:07:41.909933+0000","last_unstale":"2023-12-19T16:07:41.915269+0000","last_undegraded":"2023-12-19T16:07:41.915269+0000","last_fullsized":"2023-12-19T16:07:41.915269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:51.385493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.920171+0000","last_change":"2023-12-19T16:07:41.916539+0000","last_active":"2023-12-19T16:07:41.920171+0000","last_peered":"2023-12-19T16:07:41.920171+0000","last_clean":"2023-12-19T16:07:41.920171+0000","last_became_active":"2023-12-19T16:07:41.916259+0000","last_became_peered":"2023-12-19T16:07:41.916259+0000","last_unstale":"2023-12-19T16:07:41.920171+0000","last_undegraded":"2023-12-19T16:07:41.920171+0000","last_fullsized":"2023-12-19T16:07:41.920171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:07:54.635072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.926027+0000","last_change":"2023-12-19T16:07:41.539770+0000","last_active":"2023-12-19T16:07:41.926027+0000","last_peered":"2023-12-19T16:07:41.926027+0000","last_clean":"2023-12-19T16:07:41.926027+0000","last_became_active":"2023-12-19T16:07:41.539351+0000","last_became_peered":"2023-12-19T16:07:41.539351+0000","last_unstale":"2023-12-19T16:07:41.926027+0000","last_undegraded":"2023-12-19T16:07:41.926027+0000","last_fullsized":"2023-12-19T16:07:41.926027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:57.073133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.919707+0000","last_change":"2023-12-19T16:07:41.913415+0000","last_active":"2023-12-19T16:07:41.919707+0000","last_peered":"2023-12-19T16:07:41.919707+0000","last_clean":"2023-12-19T16:07:41.919707+0000","last_became_active":"2023-12-19T16:07:41.912486+0000","last_became_peered":"2023-12-19T16:07:41.912486+0000","last_unstale":"2023-12-19T16:07:41.919707+0000","last_undegraded":"2023-12-19T16:07:41.919707+0000","last_fullsized":"2023-12-19T16:07:41.919707+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:25:19.019112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.915802+0000","last_change":"2023-12-19T16:07:41.539319+0000","last_active":"2023-12-19T16:07:41.915802+0000","last_peered":"2023-12-19T16:07:41.915802+0000","last_clean":"2023-12-19T16:07:41.915802+0000","last_became_active":"2023-12-19T16:07:41.539008+0000","last_became_peered":"2023-12-19T16:07:41.539008+0000","last_unstale":"2023-12-19T16:07:41.915802+0000","last_undegraded":"2023-12-19T16:07:41.915802+0000","last_fullsized":"2023-12-19T16:07:41.915802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:33.056284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.918413+0000","last_change":"2023-12-19T16:07:41.916219+0000","last_active":"2023-12-19T16:07:41.918413+0000","last_peered":"2023-12-19T16:07:41.918413+0000","last_clean":"2023-12-19T16:07:41.918413+0000","last_became_active":"2023-12-19T16:07:41.915858+0000","last_became_peered":"2023-12-19T16:07:41.915858+0000","last_unstale":"2023-12-19T16:07:41.918413+0000","last_undegraded":"2023-12-19T16:07:41.918413+0000","last_fullsized":"2023-12-19T16:07:41.918413+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:45:40.959769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.925020+0000","last_change":"2023-12-19T16:07:41.544330+0000","last_active":"2023-12-19T16:07:41.925020+0000","last_peered":"2023-12-19T16:07:41.925020+0000","last_clean":"2023-12-19T16:07:41.925020+0000","last_became_active":"2023-12-19T16:07:41.544039+0000","last_became_peered":"2023-12-19T16:07:41.544039+0000","last_unstale":"2023-12-19T16:07:41.925020+0000","last_undegraded":"2023-12-19T16:07:41.925020+0000","last_fullsized":"2023-12-19T16:07:41.925020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:04.614913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.926478+0000","last_change":"2023-12-19T16:07:41.922884+0000","last_active":"2023-12-19T16:07:41.926478+0000","last_peered":"2023-12-19T16:07:41.926478+0000","last_clean":"2023-12-19T16:07:41.926478+0000","last_became_active":"2023-12-19T16:07:41.921549+0000","last_became_peered":"2023-12-19T16:07:41.921549+0000","last_unstale":"2023-12-19T16:07:41.926478+0000","last_undegraded":"2023-12-19T16:07:41.926478+0000","last_fullsized":"2023-12-19T16:07:41.926478+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:54.332659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.922482+0000","last_change":"2023-12-19T16:07:41.538998+0000","last_active":"2023-12-19T16:07:41.922482+0000","last_peered":"2023-12-19T16:07:41.922482+0000","last_clean":"2023-12-19T16:07:41.922482+0000","last_became_active":"2023-12-19T16:07:41.538718+0000","last_became_peered":"2023-12-19T16:07:41.538718+0000","last_unstale":"2023-12-19T16:07:41.922482+0000","last_undegraded":"2023-12-19T16:07:41.922482+0000","last_fullsized":"2023-12-19T16:07:41.922482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:56:08.338813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.916177+0000","last_change":"2023-12-19T16:07:41.910924+0000","last_active":"2023-12-19T16:07:41.916177+0000","last_peered":"2023-12-19T16:07:41.916177+0000","last_clean":"2023-12-19T16:07:41.916177+0000","last_became_active":"2023-12-19T16:07:41.910486+0000","last_became_peered":"2023-12-19T16:07:41.910486+0000","last_unstale":"2023-12-19T16:07:41.916177+0000","last_undegraded":"2023-12-19T16:07:41.916177+0000","last_fullsized":"2023-12-19T16:07:41.916177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:30:03.606200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.925027+0000","last_change":"2023-12-19T16:07:41.540990+0000","last_active":"2023-12-19T16:07:41.925027+0000","last_peered":"2023-12-19T16:07:41.925027+0000","last_clean":"2023-12-19T16:07:41.925027+0000","last_became_active":"2023-12-19T16:07:41.540782+0000","last_became_peered":"2023-12-19T16:07:41.540782+0000","last_unstale":"2023-12-19T16:07:41.925027+0000","last_undegraded":"2023-12-19T16:07:41.925027+0000","last_fullsized":"2023-12-19T16:07:41.925027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:56.749124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.916044+0000","last_change":"2023-12-19T16:07:41.912836+0000","last_active":"2023-12-19T16:07:41.916044+0000","last_peered":"2023-12-19T16:07:41.916044+0000","last_clean":"2023-12-19T16:07:41.916044+0000","last_became_active":"2023-12-19T16:07:41.912393+0000","last_became_peered":"2023-12-19T16:07:41.912393+0000","last_unstale":"2023-12-19T16:07:41.916044+0000","last_undegraded":"2023-12-19T16:07:41.916044+0000","last_fullsized":"2023-12-19T16:07:41.916044+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:23.495455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.923862+0000","last_change":"2023-12-19T16:07:41.540194+0000","last_active":"2023-12-19T16:07:41.923862+0000","last_peered":"2023-12-19T16:07:41.923862+0000","last_clean":"2023-12-19T16:07:41.923862+0000","last_became_active":"2023-12-19T16:07:41.539841+0000","last_became_peered":"2023-12-19T16:07:41.539841+0000","last_unstale":"2023-12-19T16:07:41.923862+0000","last_undegraded":"2023-12-19T16:07:41.923862+0000","last_fullsized":"2023-12-19T16:07:41.923862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:35.910905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.917960+0000","last_change":"2023-12-19T16:07:41.915478+0000","last_active":"2023-12-19T16:07:41.917960+0000","last_peered":"2023-12-19T16:07:41.917960+0000","last_clean":"2023-12-19T16:07:41.917960+0000","last_became_active":"2023-12-19T16:07:41.915224+0000","last_became_peered":"2023-12-19T16:07:41.915224+0000","last_unstale":"2023-12-19T16:07:41.917960+0000","last_undegraded":"2023-12-19T16:07:41.917960+0000","last_fullsized":"2023-12-19T16:07:41.917960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:54.332659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.912274+0000","last_change":"2023-12-19T16:07:41.543547+0000","last_active":"2023-12-19T16:07:41.912274+0000","last_peered":"2023-12-19T16:07:41.912274+0000","last_clean":"2023-12-19T16:07:41.912274+0000","last_became_active":"2023-12-19T16:07:41.543289+0000","last_became_peered":"2023-12-19T16:07:41.543289+0000","last_unstale":"2023-12-19T16:07:41.912274+0000","last_undegraded":"2023-12-19T16:07:41.912274+0000","last_fullsized":"2023-12-19T16:07:41.912274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:48.955394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.923060+0000","last_change":"2023-12-19T16:07:41.922015+0000","last_active":"2023-12-19T16:07:41.923060+0000","last_peered":"2023-12-19T16:07:41.923060+0000","last_clean":"2023-12-19T16:07:41.923060+0000","last_became_active":"2023-12-19T16:07:41.921740+0000","last_became_peered":"2023-12-19T16:07:41.921740+0000","last_unstale":"2023-12-19T16:07:41.923060+0000","last_undegraded":"2023-12-19T16:07:41.923060+0000","last_fullsized":"2023-12-19T16:07:41.923060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:56:22.467159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.903314+0000","last_change":"2023-12-19T16:07:41.534939+0000","last_active":"2023-12-19T16:07:41.903314+0000","last_peered":"2023-12-19T16:07:41.903314+0000","last_clean":"2023-12-19T16:07:41.903314+0000","last_became_active":"2023-12-19T16:07:41.534662+0000","last_became_peered":"2023-12-19T16:07:41.534662+0000","last_unstale":"2023-12-19T16:07:41.903314+0000","last_undegraded":"2023-12-19T16:07:41.903314+0000","last_fullsized":"2023-12-19T16:07:41.903314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:41.884274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.918977+0000","last_change":"2023-12-19T16:07:41.914324+0000","last_active":"2023-12-19T16:07:41.918977+0000","last_peered":"2023-12-19T16:07:41.918977+0000","last_clean":"2023-12-19T16:07:41.918977+0000","last_became_active":"2023-12-19T16:07:41.914072+0000","last_became_peered":"2023-12-19T16:07:41.914072+0000","last_unstale":"2023-12-19T16:07:41.918977+0000","last_undegraded":"2023-12-19T16:07:41.918977+0000","last_fullsized":"2023-12-19T16:07:41.918977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:18.172948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.915154+0000","last_change":"2023-12-19T16:07:41.539076+0000","last_active":"2023-12-19T16:07:41.915154+0000","last_peered":"2023-12-19T16:07:41.915154+0000","last_clean":"2023-12-19T16:07:41.915154+0000","last_became_active":"2023-12-19T16:07:41.538793+0000","last_became_peered":"2023-12-19T16:07:41.538793+0000","last_unstale":"2023-12-19T16:07:41.915154+0000","last_undegraded":"2023-12-19T16:07:41.915154+0000","last_fullsized":"2023-12-19T16:07:41.915154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:42:25.311467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.925177+0000","last_change":"2023-12-19T16:07:41.923964+0000","last_active":"2023-12-19T16:07:41.925177+0000","last_peered":"2023-12-19T16:07:41.925177+0000","last_clean":"2023-12-19T16:07:41.925177+0000","last_became_active":"2023-12-19T16:07:41.923743+0000","last_became_peered":"2023-12-19T16:07:41.923743+0000","last_unstale":"2023-12-19T16:07:41.925177+0000","last_undegraded":"2023-12-19T16:07:41.925177+0000","last_fullsized":"2023-12-19T16:07:41.925177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:05:34.739335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.907910+0000","last_change":"2023-12-19T16:07:41.543028+0000","last_active":"2023-12-19T16:07:41.907910+0000","last_peered":"2023-12-19T16:07:41.907910+0000","last_clean":"2023-12-19T16:07:41.907910+0000","last_became_active":"2023-12-19T16:07:41.542523+0000","last_became_peered":"2023-12-19T16:07:41.542523+0000","last_unstale":"2023-12-19T16:07:41.907910+0000","last_undegraded":"2023-12-19T16:07:41.907910+0000","last_fullsized":"2023-12-19T16:07:41.907910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:26:48.870501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.918879+0000","last_change":"2023-12-19T16:07:41.916089+0000","last_active":"2023-12-19T16:07:41.918879+0000","last_peered":"2023-12-19T16:07:41.918879+0000","last_clean":"2023-12-19T16:07:41.918879+0000","last_became_active":"2023-12-19T16:07:41.915821+0000","last_became_peered":"2023-12-19T16:07:41.915821+0000","last_unstale":"2023-12-19T16:07:41.918879+0000","last_undegraded":"2023-12-19T16:07:41.918879+0000","last_fullsized":"2023-12-19T16:07:41.918879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:57:32.203742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.926484+0000","last_change":"2023-12-19T16:07:41.534899+0000","last_active":"2023-12-19T16:07:41.926484+0000","last_peered":"2023-12-19T16:07:41.926484+0000","last_clean":"2023-12-19T16:07:41.926484+0000","last_became_active":"2023-12-19T16:07:41.534601+0000","last_became_peered":"2023-12-19T16:07:41.534601+0000","last_unstale":"2023-12-19T16:07:41.926484+0000","last_undegraded":"2023-12-19T16:07:41.926484+0000","last_fullsized":"2023-12-19T16:07:41.926484+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:42.994812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.926854+0000","last_change":"2023-12-19T16:07:41.925224+0000","last_active":"2023-12-19T16:07:41.926854+0000","last_peered":"2023-12-19T16:07:41.926854+0000","last_clean":"2023-12-19T16:07:41.926854+0000","last_became_active":"2023-12-19T16:07:41.924966+0000","last_became_peered":"2023-12-19T16:07:41.924966+0000","last_unstale":"2023-12-19T16:07:41.926854+0000","last_undegraded":"2023-12-19T16:07:41.926854+0000","last_fullsized":"2023-12-19T16:07:41.926854+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:27.607901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.933964+0000","last_change":"2023-12-19T16:07:41.543958+0000","last_active":"2023-12-19T16:07:41.933964+0000","last_peered":"2023-12-19T16:07:41.933964+0000","last_clean":"2023-12-19T16:07:41.933964+0000","last_became_active":"2023-12-19T16:07:41.543503+0000","last_became_peered":"2023-12-19T16:07:41.543503+0000","last_unstale":"2023-12-19T16:07:41.933964+0000","last_undegraded":"2023-12-19T16:07:41.933964+0000","last_fullsized":"2023-12-19T16:07:41.933964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:25:18.011790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.933559+0000","last_change":"2023-12-19T16:07:41.927899+0000","last_active":"2023-12-19T16:07:41.933559+0000","last_peered":"2023-12-19T16:07:41.933559+0000","last_clean":"2023-12-19T16:07:41.933559+0000","last_became_active":"2023-12-19T16:07:41.927576+0000","last_became_peered":"2023-12-19T16:07:41.927576+0000","last_unstale":"2023-12-19T16:07:41.933559+0000","last_undegraded":"2023-12-19T16:07:41.933559+0000","last_fullsized":"2023-12-19T16:07:41.933559+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:15.031639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.927025+0000","last_change":"2023-12-19T16:07:41.534556+0000","last_active":"2023-12-19T16:07:41.927025+0000","last_peered":"2023-12-19T16:07:41.927025+0000","last_clean":"2023-12-19T16:07:41.927025+0000","last_became_active":"2023-12-19T16:07:41.534265+0000","last_became_peered":"2023-12-19T16:07:41.534265+0000","last_unstale":"2023-12-19T16:07:41.927025+0000","last_undegraded":"2023-12-19T16:07:41.927025+0000","last_fullsized":"2023-12-19T16:07:41.927025+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:16:33.732599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.918951+0000","last_change":"2023-12-19T16:07:41.916660+0000","last_active":"2023-12-19T16:07:41.918951+0000","last_peered":"2023-12-19T16:07:41.918951+0000","last_clean":"2023-12-19T16:07:41.918951+0000","last_became_active":"2023-12-19T16:07:41.916446+0000","last_became_peered":"2023-12-19T16:07:41.916446+0000","last_unstale":"2023-12-19T16:07:41.918951+0000","last_undegraded":"2023-12-19T16:07:41.918951+0000","last_fullsized":"2023-12-19T16:07:41.918951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:14:36.093257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.921190+0000","last_change":"2023-12-19T16:07:41.541301+0000","last_active":"2023-12-19T16:07:41.921190+0000","last_peered":"2023-12-19T16:07:41.921190+0000","last_clean":"2023-12-19T16:07:41.921190+0000","last_became_active":"2023-12-19T16:07:41.540995+0000","last_became_peered":"2023-12-19T16:07:41.540995+0000","last_unstale":"2023-12-19T16:07:41.921190+0000","last_undegraded":"2023-12-19T16:07:41.921190+0000","last_fullsized":"2023-12-19T16:07:41.921190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:04.614913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.915252+0000","last_change":"2023-12-19T16:07:41.910562+0000","last_active":"2023-12-19T16:07:41.915252+0000","last_peered":"2023-12-19T16:07:41.915252+0000","last_clean":"2023-12-19T16:07:41.915252+0000","last_became_active":"2023-12-19T16:07:41.910280+0000","last_became_peered":"2023-12-19T16:07:41.910280+0000","last_unstale":"2023-12-19T16:07:41.915252+0000","last_undegraded":"2023-12-19T16:07:41.915252+0000","last_fullsized":"2023-12-19T16:07:41.915252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:09.783023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.912164+0000","last_change":"2023-12-19T16:07:41.540432+0000","last_active":"2023-12-19T16:07:41.912164+0000","last_peered":"2023-12-19T16:07:41.912164+0000","last_clean":"2023-12-19T16:07:41.912164+0000","last_became_active":"2023-12-19T16:07:41.540087+0000","last_became_peered":"2023-12-19T16:07:41.540087+0000","last_unstale":"2023-12-19T16:07:41.912164+0000","last_undegraded":"2023-12-19T16:07:41.912164+0000","last_fullsized":"2023-12-19T16:07:41.912164+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:04:24.120557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.919620+0000","last_change":"2023-12-19T16:07:41.913523+0000","last_active":"2023-12-19T16:07:41.919620+0000","last_peered":"2023-12-19T16:07:41.919620+0000","last_clean":"2023-12-19T16:07:41.919620+0000","last_became_active":"2023-12-19T16:07:41.912675+0000","last_became_peered":"2023-12-19T16:07:41.912675+0000","last_unstale":"2023-12-19T16:07:41.919620+0000","last_undegraded":"2023-12-19T16:07:41.919620+0000","last_fullsized":"2023-12-19T16:07:41.919620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:44.002133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.927137+0000","last_change":"2023-12-19T16:07:41.534179+0000","last_active":"2023-12-19T16:07:41.927137+0000","last_peered":"2023-12-19T16:07:41.927137+0000","last_clean":"2023-12-19T16:07:41.927137+0000","last_became_active":"2023-12-19T16:07:41.533903+0000","last_became_peered":"2023-12-19T16:07:41.533903+0000","last_unstale":"2023-12-19T16:07:41.927137+0000","last_undegraded":"2023-12-19T16:07:41.927137+0000","last_fullsized":"2023-12-19T16:07:41.927137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:42.994812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.918015+0000","last_change":"2023-12-19T16:07:41.914040+0000","last_active":"2023-12-19T16:07:41.918015+0000","last_peered":"2023-12-19T16:07:41.918015+0000","last_clean":"2023-12-19T16:07:41.918015+0000","last_became_active":"2023-12-19T16:07:41.913749+0000","last_became_peered":"2023-12-19T16:07:41.913749+0000","last_unstale":"2023-12-19T16:07:41.918015+0000","last_undegraded":"2023-12-19T16:07:41.918015+0000","last_fullsized":"2023-12-19T16:07:41.918015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:03:49.018092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.928749+0000","last_change":"2023-12-19T16:07:41.539027+0000","last_active":"2023-12-19T16:07:41.928749+0000","last_peered":"2023-12-19T16:07:41.928749+0000","last_clean":"2023-12-19T16:07:41.928749+0000","last_became_active":"2023-12-19T16:07:41.538640+0000","last_became_peered":"2023-12-19T16:07:41.538640+0000","last_unstale":"2023-12-19T16:07:41.928749+0000","last_undegraded":"2023-12-19T16:07:41.928749+0000","last_fullsized":"2023-12-19T16:07:41.928749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:33.056284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.919027+0000","last_change":"2023-12-19T16:07:41.913745+0000","last_active":"2023-12-19T16:07:41.919027+0000","last_peered":"2023-12-19T16:07:41.919027+0000","last_clean":"2023-12-19T16:07:41.919027+0000","last_became_active":"2023-12-19T16:07:41.913416+0000","last_became_peered":"2023-12-19T16:07:41.913416+0000","last_unstale":"2023-12-19T16:07:41.919027+0000","last_undegraded":"2023-12-19T16:07:41.919027+0000","last_fullsized":"2023-12-19T16:07:41.919027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:15:19.041369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.926978+0000","last_change":"2023-12-19T16:07:41.535833+0000","last_active":"2023-12-19T16:07:41.926978+0000","last_peered":"2023-12-19T16:07:41.926978+0000","last_clean":"2023-12-19T16:07:41.926978+0000","last_became_active":"2023-12-19T16:07:41.535489+0000","last_became_peered":"2023-12-19T16:07:41.535489+0000","last_unstale":"2023-12-19T16:07:41.926978+0000","last_undegraded":"2023-12-19T16:07:41.926978+0000","last_fullsized":"2023-12-19T16:07:41.926978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:57.073133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.926582+0000","last_change":"2023-12-19T16:07:41.924922+0000","last_active":"2023-12-19T16:07:41.926582+0000","last_peered":"2023-12-19T16:07:41.926582+0000","last_clean":"2023-12-19T16:07:41.926582+0000","last_became_active":"2023-12-19T16:07:41.924333+0000","last_became_peered":"2023-12-19T16:07:41.924333+0000","last_unstale":"2023-12-19T16:07:41.926582+0000","last_undegraded":"2023-12-19T16:07:41.926582+0000","last_fullsized":"2023-12-19T16:07:41.926582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:30:03.606200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.925028+0000","last_change":"2023-12-19T16:07:41.534514+0000","last_active":"2023-12-19T16:07:41.925028+0000","last_peered":"2023-12-19T16:07:41.925028+0000","last_clean":"2023-12-19T16:07:41.925028+0000","last_became_active":"2023-12-19T16:07:41.532360+0000","last_became_peered":"2023-12-19T16:07:41.532360+0000","last_unstale":"2023-12-19T16:07:41.925028+0000","last_undegraded":"2023-12-19T16:07:41.925028+0000","last_fullsized":"2023-12-19T16:07:41.925028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:52.291611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.912123+0000","last_change":"2023-12-19T16:07:41.907395+0000","last_active":"2023-12-19T16:07:41.912123+0000","last_peered":"2023-12-19T16:07:41.912123+0000","last_clean":"2023-12-19T16:07:41.912123+0000","last_became_active":"2023-12-19T16:07:41.907145+0000","last_became_peered":"2023-12-19T16:07:41.907145+0000","last_unstale":"2023-12-19T16:07:41.912123+0000","last_undegraded":"2023-12-19T16:07:41.912123+0000","last_fullsized":"2023-12-19T16:07:41.912123+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:53.298933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.902722+0000","last_change":"2023-12-19T16:07:41.541032+0000","last_active":"2023-12-19T16:07:41.902722+0000","last_peered":"2023-12-19T16:07:41.902722+0000","last_clean":"2023-12-19T16:07:41.902722+0000","last_became_active":"2023-12-19T16:07:41.540678+0000","last_became_peered":"2023-12-19T16:07:41.540678+0000","last_unstale":"2023-12-19T16:07:41.902722+0000","last_undegraded":"2023-12-19T16:07:41.902722+0000","last_fullsized":"2023-12-19T16:07:41.902722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:42.914223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.911876+0000","last_change":"2023-12-19T16:07:41.907382+0000","last_active":"2023-12-19T16:07:41.911876+0000","last_peered":"2023-12-19T16:07:41.911876+0000","last_clean":"2023-12-19T16:07:41.911876+0000","last_became_active":"2023-12-19T16:07:41.907101+0000","last_became_peered":"2023-12-19T16:07:41.907101+0000","last_unstale":"2023-12-19T16:07:41.911876+0000","last_undegraded":"2023-12-19T16:07:41.911876+0000","last_fullsized":"2023-12-19T16:07:41.911876+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:36.918227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.923809+0000","last_change":"2023-12-19T16:07:41.540982+0000","last_active":"2023-12-19T16:07:41.923809+0000","last_peered":"2023-12-19T16:07:41.923809+0000","last_clean":"2023-12-19T16:07:41.923809+0000","last_became_active":"2023-12-19T16:07:41.540654+0000","last_became_peered":"2023-12-19T16:07:41.540654+0000","last_unstale":"2023-12-19T16:07:41.923809+0000","last_undegraded":"2023-12-19T16:07:41.923809+0000","last_fullsized":"2023-12-19T16:07:41.923809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:48.955394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.915023+0000","last_change":"2023-12-19T16:07:41.912386+0000","last_active":"2023-12-19T16:07:41.915023+0000","last_peered":"2023-12-19T16:07:41.915023+0000","last_clean":"2023-12-19T16:07:41.915023+0000","last_became_active":"2023-12-19T16:07:41.912125+0000","last_became_peered":"2023-12-19T16:07:41.912125+0000","last_unstale":"2023-12-19T16:07:41.915023+0000","last_undegraded":"2023-12-19T16:07:41.915023+0000","last_fullsized":"2023-12-19T16:07:41.915023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:42.891596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.909955+0000","last_change":"2023-12-19T16:07:41.543300+0000","last_active":"2023-12-19T16:07:41.909955+0000","last_peered":"2023-12-19T16:07:41.909955+0000","last_clean":"2023-12-19T16:07:41.909955+0000","last_became_active":"2023-12-19T16:07:41.543098+0000","last_became_peered":"2023-12-19T16:07:41.543098+0000","last_unstale":"2023-12-19T16:07:41.909955+0000","last_undegraded":"2023-12-19T16:07:41.909955+0000","last_fullsized":"2023-12-19T16:07:41.909955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:16:33.732599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.914731+0000","last_change":"2023-12-19T16:07:41.912375+0000","last_active":"2023-12-19T16:07:41.914731+0000","last_peered":"2023-12-19T16:07:41.914731+0000","last_clean":"2023-12-19T16:07:41.914731+0000","last_became_active":"2023-12-19T16:07:41.912110+0000","last_became_peered":"2023-12-19T16:07:41.912110+0000","last_unstale":"2023-12-19T16:07:41.914731+0000","last_undegraded":"2023-12-19T16:07:41.914731+0000","last_fullsized":"2023-12-19T16:07:41.914731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:22.382499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.902202+0000","last_change":"2023-12-19T16:07:41.536582+0000","last_active":"2023-12-19T16:07:41.902202+0000","last_peered":"2023-12-19T16:07:41.902202+0000","last_clean":"2023-12-19T16:07:41.902202+0000","last_became_active":"2023-12-19T16:07:41.536322+0000","last_became_peered":"2023-12-19T16:07:41.536322+0000","last_unstale":"2023-12-19T16:07:41.902202+0000","last_undegraded":"2023-12-19T16:07:41.902202+0000","last_fullsized":"2023-12-19T16:07:41.902202+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:40:35.184260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.919719+0000","last_change":"2023-12-19T16:07:41.917450+0000","last_active":"2023-12-19T16:07:41.919719+0000","last_peered":"2023-12-19T16:07:41.919719+0000","last_clean":"2023-12-19T16:07:41.919719+0000","last_became_active":"2023-12-19T16:07:41.917123+0000","last_became_peered":"2023-12-19T16:07:41.917123+0000","last_unstale":"2023-12-19T16:07:41.919719+0000","last_undegraded":"2023-12-19T16:07:41.919719+0000","last_fullsized":"2023-12-19T16:07:41.919719+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:03:01.998993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.905328+0000","last_change":"2023-12-19T16:07:41.537907+0000","last_active":"2023-12-19T16:07:41.905328+0000","last_peered":"2023-12-19T16:07:41.905328+0000","last_clean":"2023-12-19T16:07:41.905328+0000","last_became_active":"2023-12-19T16:07:41.537096+0000","last_became_peered":"2023-12-19T16:07:41.537096+0000","last_unstale":"2023-12-19T16:07:41.905328+0000","last_undegraded":"2023-12-19T16:07:41.905328+0000","last_fullsized":"2023-12-19T16:07:41.905328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:04:24.120557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.918256+0000","last_change":"2023-12-19T16:07:41.915483+0000","last_active":"2023-12-19T16:07:41.918256+0000","last_peered":"2023-12-19T16:07:41.918256+0000","last_clean":"2023-12-19T16:07:41.918256+0000","last_became_active":"2023-12-19T16:07:41.915226+0000","last_became_peered":"2023-12-19T16:07:41.915226+0000","last_unstale":"2023-12-19T16:07:41.918256+0000","last_undegraded":"2023-12-19T16:07:41.918256+0000","last_fullsized":"2023-12-19T16:07:41.918256+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:29:58.080454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.926985+0000","last_change":"2023-12-19T16:07:41.535728+0000","last_active":"2023-12-19T16:07:41.926985+0000","last_peered":"2023-12-19T16:07:41.926985+0000","last_clean":"2023-12-19T16:07:41.926985+0000","last_became_active":"2023-12-19T16:07:41.535425+0000","last_became_peered":"2023-12-19T16:07:41.535425+0000","last_unstale":"2023-12-19T16:07:41.926985+0000","last_undegraded":"2023-12-19T16:07:41.926985+0000","last_fullsized":"2023-12-19T16:07:41.926985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:42.914223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.926156+0000","last_change":"2023-12-19T16:07:41.922610+0000","last_active":"2023-12-19T16:07:41.926156+0000","last_peered":"2023-12-19T16:07:41.926156+0000","last_clean":"2023-12-19T16:07:41.926156+0000","last_became_active":"2023-12-19T16:07:41.922248+0000","last_became_peered":"2023-12-19T16:07:41.922248+0000","last_unstale":"2023-12-19T16:07:41.926156+0000","last_undegraded":"2023-12-19T16:07:41.926156+0000","last_fullsized":"2023-12-19T16:07:41.926156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:14:36.093257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T16:07:42.915394+0000","last_change":"2023-12-19T16:07:41.541840+0000","last_active":"2023-12-19T16:07:42.915394+0000","last_peered":"2023-12-19T16:07:42.915394+0000","last_clean":"2023-12-19T16:07:42.915394+0000","last_became_active":"2023-12-19T16:07:41.541418+0000","last_became_peered":"2023-12-19T16:07:41.541418+0000","last_unstale":"2023-12-19T16:07:42.915394+0000","last_undegraded":"2023-12-19T16:07:42.915394+0000","last_fullsized":"2023-12-19T16:07:42.915394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:47:04.614913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.925455+0000","last_change":"2023-12-19T16:07:41.924246+0000","last_active":"2023-12-19T16:07:41.925455+0000","last_peered":"2023-12-19T16:07:41.925455+0000","last_clean":"2023-12-19T16:07:41.925455+0000","last_became_active":"2023-12-19T16:07:41.923973+0000","last_became_peered":"2023-12-19T16:07:41.923973+0000","last_unstale":"2023-12-19T16:07:41.925455+0000","last_undegraded":"2023-12-19T16:07:41.925455+0000","last_fullsized":"2023-12-19T16:07:41.925455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:54.332659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.919852+0000","last_change":"2023-12-19T16:07:41.543692+0000","last_active":"2023-12-19T16:07:41.919852+0000","last_peered":"2023-12-19T16:07:41.919852+0000","last_clean":"2023-12-19T16:07:41.919852+0000","last_became_active":"2023-12-19T16:07:41.543404+0000","last_became_peered":"2023-12-19T16:07:41.543404+0000","last_unstale":"2023-12-19T16:07:41.919852+0000","last_undegraded":"2023-12-19T16:07:41.919852+0000","last_fullsized":"2023-12-19T16:07:41.919852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:00:56.749124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.923316+0000","last_change":"2023-12-19T16:07:41.915600+0000","last_active":"2023-12-19T16:07:41.923316+0000","last_peered":"2023-12-19T16:07:41.923316+0000","last_clean":"2023-12-19T16:07:41.923316+0000","last_became_active":"2023-12-19T16:07:41.915286+0000","last_became_peered":"2023-12-19T16:07:41.915286+0000","last_unstale":"2023-12-19T16:07:41.923316+0000","last_undegraded":"2023-12-19T16:07:41.923316+0000","last_fullsized":"2023-12-19T16:07:41.923316+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:40:14.146826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.909179+0000","last_change":"2023-12-19T16:07:41.540450+0000","last_active":"2023-12-19T16:07:41.909179+0000","last_peered":"2023-12-19T16:07:41.909179+0000","last_clean":"2023-12-19T16:07:41.909179+0000","last_became_active":"2023-12-19T16:07:41.540084+0000","last_became_peered":"2023-12-19T16:07:41.540084+0000","last_unstale":"2023-12-19T16:07:41.909179+0000","last_undegraded":"2023-12-19T16:07:41.909179+0000","last_fullsized":"2023-12-19T16:07:41.909179+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:28:42.914223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.916593+0000","last_change":"2023-12-19T16:07:41.915241+0000","last_active":"2023-12-19T16:07:41.916593+0000","last_peered":"2023-12-19T16:07:41.916593+0000","last_clean":"2023-12-19T16:07:41.916593+0000","last_became_active":"2023-12-19T16:07:41.914978+0000","last_became_peered":"2023-12-19T16:07:41.914978+0000","last_unstale":"2023-12-19T16:07:41.916593+0000","last_undegraded":"2023-12-19T16:07:41.916593+0000","last_fullsized":"2023-12-19T16:07:41.916593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:40:14.146826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.921319+0000","last_change":"2023-12-19T16:07:41.535019+0000","last_active":"2023-12-19T16:07:41.921319+0000","last_peered":"2023-12-19T16:07:41.921319+0000","last_clean":"2023-12-19T16:07:41.921319+0000","last_became_active":"2023-12-19T16:07:41.534739+0000","last_became_peered":"2023-12-19T16:07:41.534739+0000","last_unstale":"2023-12-19T16:07:41.921319+0000","last_undegraded":"2023-12-19T16:07:41.921319+0000","last_fullsized":"2023-12-19T16:07:41.921319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:26:48.870501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.925941+0000","last_change":"2023-12-19T16:07:41.924599+0000","last_active":"2023-12-19T16:07:41.925941+0000","last_peered":"2023-12-19T16:07:41.925941+0000","last_clean":"2023-12-19T16:07:41.925941+0000","last_became_active":"2023-12-19T16:07:41.924381+0000","last_became_peered":"2023-12-19T16:07:41.924381+0000","last_unstale":"2023-12-19T16:07:41.925941+0000","last_undegraded":"2023-12-19T16:07:41.925941+0000","last_fullsized":"2023-12-19T16:07:41.925941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:03:01.998993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.902297+0000","last_change":"2023-12-19T16:07:41.535225+0000","last_active":"2023-12-19T16:07:41.902297+0000","last_peered":"2023-12-19T16:07:41.902297+0000","last_clean":"2023-12-19T16:07:41.902297+0000","last_became_active":"2023-12-19T16:07:41.534968+0000","last_became_peered":"2023-12-19T16:07:41.534968+0000","last_unstale":"2023-12-19T16:07:41.902297+0000","last_undegraded":"2023-12-19T16:07:41.902297+0000","last_fullsized":"2023-12-19T16:07:41.902297+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:21.375178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.918195+0000","last_change":"2023-12-19T16:07:41.913811+0000","last_active":"2023-12-19T16:07:41.918195+0000","last_peered":"2023-12-19T16:07:41.918195+0000","last_clean":"2023-12-19T16:07:41.918195+0000","last_became_active":"2023-12-19T16:07:41.913426+0000","last_became_peered":"2023-12-19T16:07:41.913426+0000","last_unstale":"2023-12-19T16:07:41.918195+0000","last_undegraded":"2023-12-19T16:07:41.918195+0000","last_fullsized":"2023-12-19T16:07:41.918195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:15.031639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.908222+0000","last_change":"2023-12-19T16:07:41.539795+0000","last_active":"2023-12-19T16:07:41.908222+0000","last_peered":"2023-12-19T16:07:41.908222+0000","last_clean":"2023-12-19T16:07:41.908222+0000","last_became_active":"2023-12-19T16:07:41.539479+0000","last_became_peered":"2023-12-19T16:07:41.539479+0000","last_unstale":"2023-12-19T16:07:41.908222+0000","last_undegraded":"2023-12-19T16:07:41.908222+0000","last_fullsized":"2023-12-19T16:07:41.908222+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:06:54.795957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.915238+0000","last_change":"2023-12-19T16:07:41.911449+0000","last_active":"2023-12-19T16:07:41.915238+0000","last_peered":"2023-12-19T16:07:41.915238+0000","last_clean":"2023-12-19T16:07:41.915238+0000","last_became_active":"2023-12-19T16:07:41.911146+0000","last_became_peered":"2023-12-19T16:07:41.911146+0000","last_unstale":"2023-12-19T16:07:41.915238+0000","last_undegraded":"2023-12-19T16:07:41.915238+0000","last_fullsized":"2023-12-19T16:07:41.915238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:41.514068+0000","last_clean_scrub_stamp":"2023-12-19T16:07:41.514068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:15.031639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.909900+0000","last_change":"2023-12-19T16:07:41.537380+0000","last_active":"2023-12-19T16:07:41.909900+0000","last_peered":"2023-12-19T16:07:41.909900+0000","last_clean":"2023-12-19T16:07:41.909900+0000","last_became_active":"2023-12-19T16:07:41.537122+0000","last_became_peered":"2023-12-19T16:07:41.537122+0000","last_unstale":"2023-12-19T16:07:41.909900+0000","last_undegraded":"2023-12-19T16:07:41.909900+0000","last_fullsized":"2023-12-19T16:07:41.909900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:07:40.506746+0000","last_clean_scrub_stamp":"2023-12-19T16:07:40.506746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:41:35.910905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T16:07:41.903299+0000","last_change":"2023-12-19T16:06:47.761389+0000","last_active":"2023-12-19T16:07:41.903299+0000","last_peered":"2023-12-19T16:07:41.903299+0000","last_clean":"2023-12-19T16:07:41.903299+0000","last_became_active":"2023-12-19T16:06:47.760252+0000","last_became_peered":"2023-12-19T16:06:47.760252+0000","last_unstale":"2023-12-19T16:07:41.903299+0000","last_undegraded":"2023-12-19T16:07:41.903299+0000","last_fullsized":"2023-12-19T16:07:41.903299+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_clean_scrub_stamp":"2023-12-19T16:06:46.706871+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:09.167979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":946176,"data_stored":724720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":135848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:07:46 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.247},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.377}]},{"osd":1,"last update":"Tue Dec 19 16:07:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.29299999999999998}]},{"osd":2,"last update":"Tue Dec 19 16:07:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35299999999999998}]},{"osd":4,"last update":"Tue Dec 19 16:07:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.621}]},{"osd":5,"last update":"Tue Dec 19 16:07:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.63400000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:07:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.59399999999999997}]},{"osd":7,"last update":"Tue Dec 19 16:07:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54700000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":352256,"data_stored":134332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":135848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":942080,"data_stored":724630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:07:49.652 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T16:07:49.652 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T16:07:49.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.798+0000 7faa33051640 1 Processor -- start 2023-12-19T16:07:49.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.798+0000 7faa33051640 1 -- start start 2023-12-19T16:07:49.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.799+0000 7faa33051640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa2c0b8550 0x7faa2c0b8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.799+0000 7faa33051640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2c14a9e0 con 0x7faa2c14b5b0 2023-12-19T16:07:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.799+0000 7faa33051640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2c0bac70 con 0x7faa2c14b150 2023-12-19T16:07:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.799+0000 7faa33051640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c14b9e0 con 0x7faa2c0b8550 2023-12-19T16:07:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.799+0000 7faa315ee640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faa2c14b5b0 0x7faa2c1552f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33226/0 (socket says 172.21.15.37:33226) 2023-12-19T16:07:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.799+0000 7faa315ee640 1 -- 172.21.15.37:0/1597230506 learned_addr learned my addr 172.21.15.37:0/1597230506 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:49.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.799+0000 7faa30ded640 1 --2- 172.21.15.37:0/1597230506 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa2c0b8550 0x7faa2c0b8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:49.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.799+0000 7faa2b7fe640 1 -- 172.21.15.37:0/1597230506 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474265574 0 0) 0x7faa2c14a9e0 con 0x7faa2c14b5b0 2023-12-19T16:07:49.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.799+0000 7faa2b7fe640 1 -- 172.21.15.37:0/1597230506 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa14003520 con 0x7faa2c14b5b0 2023-12-19T16:07:49.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.799+0000 7faa2b7fe640 1 -- 172.21.15.37:0/1597230506 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651043698 0 0) 0x7faa2c0bac70 con 0x7faa2c14b150 2023-12-19T16:07:49.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.799+0000 7faa30ded640 1 -- 172.21.15.37:0/1597230506 >> v1:172.21.15.78:6789/0 conn(0x7faa2c14b150 legacy=0x7faa2c144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:49.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.799+0000 7faa30ded640 1 -- 172.21.15.37:0/1597230506 >> v1:172.21.15.37:6789/0 conn(0x7faa2c14b5b0 legacy=0x7faa2c1552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:49.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.800+0000 7faa30ded640 1 -- 172.21.15.37:0/1597230506 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2c0ba2e0 con 0x7faa2c0b8550 2023-12-19T16:07:49.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.800+0000 7faa30ded640 1 --2- 172.21.15.37:0/1597230506 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa2c0b8550 0x7faa2c0b8930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa24009dc0 tx=0x7faa2402bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec72c2dd92e77133 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.800+0000 7faa2b7fe640 1 -- 172.21.15.37:0/1597230506 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c001670 con 0x7faa2c0b8550 2023-12-19T16:07:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.801+0000 7faa2b7fe640 1 -- 172.21.15.37:0/1597230506 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2402c7b0 con 0x7faa2c0b8550 2023-12-19T16:07:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.801+0000 7faa2b7fe640 1 -- 172.21.15.37:0/1597230506 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2402cb20 con 0x7faa2c0b8550 2023-12-19T16:07:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.801+0000 7faa33051640 1 -- 172.21.15.37:0/1597230506 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa2c0b8550 msgr2=0x7faa2c0b8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.801+0000 7faa33051640 1 --2- 172.21.15.37:0/1597230506 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa2c0b8550 0x7faa2c0b8930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa24009dc0 tx=0x7faa2402bc80 comp rx=0 tx=0).stop 2023-12-19T16:07:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.801+0000 7faa33051640 1 -- 172.21.15.37:0/1597230506 shutdown_connections 2023-12-19T16:07:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.801+0000 7faa33051640 1 --2- 172.21.15.37:0/1597230506 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa2c0b8550 0x7faa2c0b8930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.801+0000 7faa33051640 1 -- 172.21.15.37:0/1597230506 >> 172.21.15.37:0/1597230506 conn(0x7faa2c06b4f0 msgr2=0x7faa2c06b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.801+0000 7faa33051640 1 -- 172.21.15.37:0/1597230506 shutdown_connections 2023-12-19T16:07:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.801+0000 7faa33051640 1 -- 172.21.15.37:0/1597230506 wait complete. 2023-12-19T16:07:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.802+0000 7faa33051640 1 Processor -- start 2023-12-19T16:07:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.802+0000 7faa33051640 1 -- start start 2023-12-19T16:07:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.803+0000 7faa33051640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa2c0b8550 0x7faa2c146d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.803+0000 7faa33051640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa2c14b150 0x7faa2c147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.803+0000 7faa33051640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa2c14b5b0 0x7faa2c1e0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.803+0000 7faa33051640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c1e4050 con 0x7faa2c14b150 2023-12-19T16:07:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.803+0000 7faa33051640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c147250 con 0x7faa2c14b5b0 2023-12-19T16:07:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.803+0000 7faa33051640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c13f8f0 con 0x7faa2c0b8550 2023-12-19T16:07:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.803+0000 7faa2bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa2c14b150 0x7faa2c147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.803+0000 7faa2bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa2c14b150 0x7faa2c147c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60548/0 (socket says 172.21.15.37:60548) 2023-12-19T16:07:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.803+0000 7faa2bfff640 1 -- 172.21.15.37:0/993620324 learned_addr learned my addr 172.21.15.37:0/993620324 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.803+0000 7faa315ee640 1 --2- 172.21.15.37:0/993620324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa2c14b5b0 0x7faa2c1e0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.803+0000 7faa30ded640 1 --2- 172.21.15.37:0/993620324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa2c0b8550 0x7faa2c146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.803+0000 7faa2bfff640 1 -- 172.21.15.37:0/993620324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa2c0b8550 msgr2=0x7faa2c146d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.803+0000 7faa2bfff640 1 --2- 172.21.15.37:0/993620324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa2c0b8550 0x7faa2c146d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.803+0000 7faa2bfff640 1 -- 172.21.15.37:0/993620324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa2c14b5b0 msgr2=0x7faa2c1e0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.803+0000 7faa2bfff640 1 --2- 172.21.15.37:0/993620324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa2c14b5b0 0x7faa2c1e0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.803+0000 7faa2bfff640 1 -- 172.21.15.37:0/993620324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa24009a70 con 0x7faa2c14b150 2023-12-19T16:07:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.803+0000 7faa315ee640 1 --2- 172.21.15.37:0/993620324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa2c14b5b0 0x7faa2c1e0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.803+0000 7faa30ded640 1 --2- 172.21.15.37:0/993620324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa2c0b8550 0x7faa2c146d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.803+0000 7faa2bfff640 1 --2- 172.21.15.37:0/993620324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa2c14b150 0x7faa2c147c80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faa2000c4b0 tx=0x7faa2000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.804+0000 7faa297fa640 1 -- 172.21.15.37:0/993620324 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa20005480 con 0x7faa2c14b150 2023-12-19T16:07:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.804+0000 7faa297fa640 1 -- 172.21.15.37:0/993620324 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa200035f0 con 0x7faa2c14b150 2023-12-19T16:07:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.804+0000 7faa33051640 1 -- 172.21.15.37:0/993620324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2c1e3a90 con 0x7faa2c14b150 2023-12-19T16:07:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.804+0000 7faa297fa640 1 -- 172.21.15.37:0/993620324 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa200039e0 con 0x7faa2c14b150 2023-12-19T16:07:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.804+0000 7faa33051640 1 -- 172.21.15.37:0/993620324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa2c1dfd10 con 0x7faa2c14b150 2023-12-19T16:07:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.805+0000 7faa33051640 1 -- 172.21.15.37:0/993620324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa2c1dfb70 con 0x7faa2c14b150 2023-12-19T16:07:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.805+0000 7faa297fa640 1 -- 172.21.15.37:0/993620324 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faa20003b40 con 0x7faa2c14b150 2023-12-19T16:07:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.806+0000 7faa297fa640 1 --2- 172.21.15.37:0/993620324 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7faa1806a460 0x7faa1806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.806+0000 7faa297fa640 1 -- 172.21.15.37:0/993620324 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa20087f00 con 0x7faa2c14b150 2023-12-19T16:07:49.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.806+0000 7faa30ded640 1 --2- 172.21.15.37:0/993620324 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7faa1806a460 0x7faa1806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:49.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.806+0000 7faa30ded640 1 --2- 172.21.15.37:0/993620324 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7faa1806a460 0x7faa1806c920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7faa24036000 tx=0x7faa24030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:49.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:49.810+0000 7faa297fa640 1 -- 172.21.15.37:0/993620324 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7faa2c1dfb70 con 0x7faa2c14b150 2023-12-19T16:07:50.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.056+0000 7faa33051640 1 -- 172.21.15.37:0/993620324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7faa2c1dfb70 con 0x7faa2c14b150 2023-12-19T16:07:50.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.060+0000 7faa297fa640 1 -- 172.21.15.37:0/993620324 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7faa2c1dfb70 con 0x7faa2c14b150 2023-12-19T16:07:50.062 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-12-19T16:07:50.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.061+0000 7faa33051640 1 -- 172.21.15.37:0/993620324 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7faa1806a460 msgr2=0x7faa1806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.061+0000 7faa33051640 1 --2- 172.21.15.37:0/993620324 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7faa1806a460 0x7faa1806c920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7faa24036000 tx=0x7faa24030000 comp rx=0 tx=0).stop 2023-12-19T16:07:50.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.061+0000 7faa33051640 1 -- 172.21.15.37:0/993620324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa2c14b150 msgr2=0x7faa2c147c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.061+0000 7faa33051640 1 --2- 172.21.15.37:0/993620324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa2c14b150 0x7faa2c147c80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faa2000c4b0 tx=0x7faa2000c970 comp rx=0 tx=0).stop 2023-12-19T16:07:50.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.061+0000 7faa33051640 1 -- 172.21.15.37:0/993620324 shutdown_connections 2023-12-19T16:07:50.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.061+0000 7faa33051640 1 --2- 172.21.15.37:0/993620324 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7faa1806a460 0x7faa1806c920 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.061+0000 7faa33051640 1 --2- 172.21.15.37:0/993620324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa2c14b5b0 0x7faa2c1e0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.061+0000 7faa33051640 1 --2- 172.21.15.37:0/993620324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa2c14b150 0x7faa2c147c80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.061+0000 7faa33051640 1 --2- 172.21.15.37:0/993620324 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faa2c0b8550 0x7faa2c146d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.062+0000 7faa33051640 1 -- 172.21.15.37:0/993620324 >> 172.21.15.37:0/993620324 conn(0x7faa2c06b4f0 msgr2=0x7faa2c144640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:50.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.062+0000 7faa33051640 1 -- 172.21.15.37:0/993620324 shutdown_connections 2023-12-19T16:07:50.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.062+0000 7faa33051640 1 -- 172.21.15.37:0/993620324 wait complete. 2023-12-19T16:07:50.074 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:07:50.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.177+0000 7fedc6c41640 1 Processor -- start 2023-12-19T16:07:50.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.177+0000 7fedc6c41640 1 -- start start 2023-12-19T16:07:50.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.178+0000 7fedc6c41640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fedc00b6690 0x7fedc0144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.178+0000 7fedc6c41640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc00bc6b0 con 0x7fedc0144cd0 2023-12-19T16:07:50.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.178+0000 7fedc6c41640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc00a59f0 con 0x7fedc00bcdd0 2023-12-19T16:07:50.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.178+0000 7fedc6c41640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc00bc0a0 con 0x7fedc00b6690 2023-12-19T16:07:50.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.178+0000 7fedbffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fedc00b6690 0x7fedc0144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.178+0000 7fedc51de640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fedc0144cd0 0x7fedc0155340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33238/0 (socket says 172.21.15.37:33238) 2023-12-19T16:07:50.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.178+0000 7fedbffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fedc00b6690 0x7fedc0144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60556/0 (socket says 172.21.15.37:60556) 2023-12-19T16:07:50.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.178+0000 7fedc51de640 1 -- 172.21.15.37:0/1118061201 learned_addr learned my addr 172.21.15.37:0/1118061201 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:50.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.178+0000 7fedbffff640 1 -- 172.21.15.37:0/1118061201 >> v1:172.21.15.78:6789/0 conn(0x7fedc00bcdd0 legacy=0x7fedc00b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.178+0000 7fedbffff640 1 -- 172.21.15.37:0/1118061201 >> v1:172.21.15.37:6789/0 conn(0x7fedc0144cd0 legacy=0x7fedc0155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.178+0000 7fedbffff640 1 -- 172.21.15.37:0/1118061201 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc00bc340 con 0x7fedc00b6690 2023-12-19T16:07:50.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.179+0000 7fedbffff640 1 --2- 172.21.15.37:0/1118061201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedc00b6690 0x7fedc0144790 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fedc00a5b80 tx=0x7fedb402b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f417674888a7e89 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:50.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.179+0000 7fedbf7fe640 1 -- 172.21.15.37:0/1118061201 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb4030890 con 0x7fedc00b6690 2023-12-19T16:07:50.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.179+0000 7fedbf7fe640 1 -- 172.21.15.37:0/1118061201 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb40309f0 con 0x7fedc00b6690 2023-12-19T16:07:50.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.179+0000 7fedbf7fe640 1 -- 172.21.15.37:0/1118061201 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb4030d80 con 0x7fedc00b6690 2023-12-19T16:07:50.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.180+0000 7fedc6c41640 1 -- 172.21.15.37:0/1118061201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedc00b6690 msgr2=0x7fedc0144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.180+0000 7fedc6c41640 1 --2- 172.21.15.37:0/1118061201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedc00b6690 0x7fedc0144790 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fedc00a5b80 tx=0x7fedb402b9d0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.180+0000 7fedc6c41640 1 -- 172.21.15.37:0/1118061201 shutdown_connections 2023-12-19T16:07:50.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.180+0000 7fedc6c41640 1 --2- 172.21.15.37:0/1118061201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedc00b6690 0x7fedc0144790 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.180+0000 7fedc6c41640 1 -- 172.21.15.37:0/1118061201 >> 172.21.15.37:0/1118061201 conn(0x7fedc0071e60 msgr2=0x7fedc00c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:50.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.180+0000 7fedc6c41640 1 -- 172.21.15.37:0/1118061201 shutdown_connections 2023-12-19T16:07:50.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.180+0000 7fedc6c41640 1 -- 172.21.15.37:0/1118061201 wait complete. 2023-12-19T16:07:50.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.181+0000 7fedc6c41640 1 Processor -- start 2023-12-19T16:07:50.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.181+0000 7fedc6c41640 1 -- start start 2023-12-19T16:07:50.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.181+0000 7fedc6c41640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc00b6690 0x7fedc01490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedc6c41640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedc00bcdd0 0x7fedc014b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedc6c41640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedc0144cd0 0x7fedc0149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedc6c41640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc01e1090 con 0x7fedc0144cd0 2023-12-19T16:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedc6c41640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc0149610 con 0x7fedc00b6690 2023-12-19T16:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedc6c41640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc0148410 con 0x7fedc00bcdd0 2023-12-19T16:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedc51de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedc0144cd0 0x7fedc0149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedc51de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedc0144cd0 0x7fedc0149fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60564/0 (socket says 172.21.15.37:60564) 2023-12-19T16:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedc51de640 1 -- 172.21.15.37:0/461543429 learned_addr learned my addr 172.21.15.37:0/461543429 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedbffff640 1 --2- 172.21.15.37:0/461543429 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedc00bcdd0 0x7fedc014b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedc49dd640 1 --2- 172.21.15.37:0/461543429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc00b6690 0x7fedc01490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedc51de640 1 -- 172.21.15.37:0/461543429 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedc00bcdd0 msgr2=0x7fedc014b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedc51de640 1 --2- 172.21.15.37:0/461543429 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedc00bcdd0 0x7fedc014b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedc51de640 1 -- 172.21.15.37:0/461543429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc00b6690 msgr2=0x7fedc01490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedc51de640 1 --2- 172.21.15.37:0/461543429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc00b6690 0x7fedc01490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedc51de640 1 -- 172.21.15.37:0/461543429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb4009400 con 0x7fedc0144cd0 2023-12-19T16:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedc49dd640 1 --2- 172.21.15.37:0/461543429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc00b6690 0x7fedc01490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedbffff640 1 --2- 172.21.15.37:0/461543429 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedc00bcdd0 0x7fedc014b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedc51de640 1 --2- 172.21.15.37:0/461543429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedc0144cd0 0x7fedc0149fd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fedb000c3a0 tx=0x7fedb000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedbd7fa640 1 -- 172.21.15.37:0/461543429 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0005ce0 con 0x7fedc0144cd0 2023-12-19T16:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedbd7fa640 1 -- 172.21.15.37:0/461543429 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb0005e40 con 0x7fedc0144cd0 2023-12-19T16:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedbd7fa640 1 -- 172.21.15.37:0/461543429 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb00072d0 con 0x7fedc0144cd0 2023-12-19T16:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedc6c41640 1 -- 172.21.15.37:0/461543429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc0148910 con 0x7fedc0144cd0 2023-12-19T16:07:50.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.182+0000 7fedc6c41640 1 -- 172.21.15.37:0/461543429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc014a510 con 0x7fedc0144cd0 2023-12-19T16:07:50.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.183+0000 7fedc6c41640 1 -- 172.21.15.37:0/461543429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc0148df0 con 0x7fedc0144cd0 2023-12-19T16:07:50.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.184+0000 7fedbd7fa640 1 -- 172.21.15.37:0/461543429 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fedb0007430 con 0x7fedc0144cd0 2023-12-19T16:07:50.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.184+0000 7fedbd7fa640 1 --2- 172.21.15.37:0/461543429 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fedac06a460 0x7fedac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.184+0000 7fedbd7fa640 1 -- 172.21.15.37:0/461543429 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fedb0087c80 con 0x7fedc0144cd0 2023-12-19T16:07:50.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.184+0000 7fedc49dd640 1 --2- 172.21.15.37:0/461543429 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fedac06a460 0x7fedac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.185+0000 7fedc49dd640 1 --2- 172.21.15.37:0/461543429 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fedac06a460 0x7fedac06c920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fedb80012e0 tx=0x7fedb8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:50.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.188+0000 7fedbd7fa640 1 -- 172.21.15.37:0/461543429 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fedc0148df0 con 0x7fedc0144cd0 2023-12-19T16:07:50.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.399+0000 7fedc6c41640 1 -- 172.21.15.37:0/461543429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedc0148df0 con 0x7fedc0144cd0 2023-12-19T16:07:50.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.400+0000 7fedbd7fa640 1 -- 172.21.15.37:0/461543429 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3946 (secure 0 0 0) 0x7fedc0148df0 con 0x7fedc0144cd0 2023-12-19T16:07:50.402 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:07:50.402 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/19970234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":19970234},{"type":"v1","addr":"172.21.15.37:6834","nonce":19970234}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2974397450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2974397450},{"type":"v1","addr":"172.21.15.78:6835","nonce":2974397450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:07:41.897266+0000","modified":"2023-12-19T16:07:43.904067+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1604445250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1604445250},{"type":"v1","addr":"172.21.15.37:6835","nonce":1604445250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T16:07:50.403 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 13 2023-12-19T16:07:50.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.401+0000 7fedc6c41640 1 -- 172.21.15.37:0/461543429 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fedac06a460 msgr2=0x7fedac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.401+0000 7fedc6c41640 1 --2- 172.21.15.37:0/461543429 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fedac06a460 0x7fedac06c920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fedb80012e0 tx=0x7fedb8009040 comp rx=0 tx=0).stop 2023-12-19T16:07:50.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.401+0000 7fedc6c41640 1 -- 172.21.15.37:0/461543429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedc0144cd0 msgr2=0x7fedc0149fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.401+0000 7fedc6c41640 1 --2- 172.21.15.37:0/461543429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedc0144cd0 0x7fedc0149fd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fedb000c3a0 tx=0x7fedb000c860 comp rx=0 tx=0).stop 2023-12-19T16:07:50.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.401+0000 7fedc6c41640 1 -- 172.21.15.37:0/461543429 shutdown_connections 2023-12-19T16:07:50.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.401+0000 7fedc6c41640 1 --2- 172.21.15.37:0/461543429 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fedac06a460 0x7fedac06c920 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.401+0000 7fedc6c41640 1 --2- 172.21.15.37:0/461543429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedc0144cd0 0x7fedc0149fd0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.401+0000 7fedc6c41640 1 --2- 172.21.15.37:0/461543429 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fedc00bcdd0 0x7fedc014b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.401+0000 7fedc6c41640 1 --2- 172.21.15.37:0/461543429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedc00b6690 0x7fedc01490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.402+0000 7fedc6c41640 1 -- 172.21.15.37:0/461543429 >> 172.21.15.37:0/461543429 conn(0x7fedc0071e60 msgr2=0x7fedc00b86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:50.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.402+0000 7fedc6c41640 1 -- 172.21.15.37:0/461543429 shutdown_connections 2023-12-19T16:07:50.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.402+0000 7fedc6c41640 1 -- 172.21.15.37:0/461543429 wait complete. 2023-12-19T16:07:50.717 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T16:07:41.897266+0000', 'modified': '2023-12-19T16:07:43.904067+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4977}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4977': {'gid': 4977, 'name': 'c', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/1604445250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 1604445250}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 1604445250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T16:07:50.717 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T16:07:50.717 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-19T16:07:50.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.824+0000 7f7ddd6a1640 1 Processor -- start 2023-12-19T16:07:50.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.824+0000 7f7ddd6a1640 1 -- start start 2023-12-19T16:07:50.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.824+0000 7f7ddd6a1640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7dd8144e30 0x7f7dd80b7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.824+0000 7f7ddd6a1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7dd80bab80 0x7f7dd814b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.824+0000 7f7ddd6a1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd80b6da0 con 0x7f7dd80b8b40 2023-12-19T16:07:50.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.824+0000 7f7ddd6a1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd80b8090 con 0x7f7dd80bab80 2023-12-19T16:07:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.824+0000 7f7ddd6a1640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd814afe0 con 0x7f7dd8144e30 2023-12-19T16:07:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.824+0000 7f7dd77fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7dd80b8b40 0x7f7dd814dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33252/0 (socket says 172.21.15.37:33252) 2023-12-19T16:07:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.824+0000 7f7dd77fe640 1 -- 172.21.15.37:0/323522427 learned_addr learned my addr 172.21.15.37:0/323522427 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:07:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.825+0000 7f7dd6ffd640 1 --2- 172.21.15.37:0/323522427 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7dd8144e30 0x7f7dd80b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.825+0000 7f7dd67fc640 1 --2- 172.21.15.37:0/323522427 >> v2:172.21.15.78:3300/0 conn(0x7f7dd80bab80 0x7f7dd814b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.825+0000 7f7dd5ffb640 1 -- 172.21.15.37:0/323522427 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 560667344 0 0) 0x7f7dd0001490 con 0x7f7dd80b8b40 2023-12-19T16:07:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.825+0000 7f7dd5ffb640 1 -- 172.21.15.37:0/323522427 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dc0003520 con 0x7f7dd80b8b40 2023-12-19T16:07:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.825+0000 7f7dd6ffd640 1 -- 172.21.15.37:0/323522427 >> v2:172.21.15.78:3300/0 conn(0x7f7dd80bab80 msgr2=0x7f7dd814b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.825+0000 7f7dd6ffd640 1 --2- 172.21.15.37:0/323522427 >> v2:172.21.15.78:3300/0 conn(0x7f7dd80bab80 0x7f7dd814b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.825+0000 7f7dd6ffd640 1 -- 172.21.15.37:0/323522427 >> v1:172.21.15.37:6789/0 conn(0x7f7dd80b8b40 legacy=0x7f7dd814dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.825+0000 7f7dd6ffd640 1 -- 172.21.15.37:0/323522427 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd8145210 con 0x7f7dd8144e30 2023-12-19T16:07:50.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.826+0000 7f7dd6ffd640 1 --2- 172.21.15.37:0/323522427 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7dd8144e30 0x7f7dd80b7600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80097a0 tx=0x7f7dc802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc95f7c7c128cd0a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:50.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.826+0000 7f7dd5ffb640 1 -- 172.21.15.37:0/323522427 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8030610 con 0x7f7dd8144e30 2023-12-19T16:07:50.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.826+0000 7f7dd5ffb640 1 -- 172.21.15.37:0/323522427 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc8030770 con 0x7f7dd8144e30 2023-12-19T16:07:50.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.826+0000 7f7dd5ffb640 1 -- 172.21.15.37:0/323522427 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8030b00 con 0x7f7dd8144e30 2023-12-19T16:07:50.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.826+0000 7f7ddd6a1640 1 -- 172.21.15.37:0/323522427 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7dd8144e30 msgr2=0x7f7dd80b7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.826+0000 7f7ddd6a1640 1 --2- 172.21.15.37:0/323522427 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7dd8144e30 0x7f7dd80b7600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80097a0 tx=0x7f7dc802b960 comp rx=0 tx=0).stop 2023-12-19T16:07:50.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.827+0000 7f7ddd6a1640 1 -- 172.21.15.37:0/323522427 shutdown_connections 2023-12-19T16:07:50.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.827+0000 7f7ddd6a1640 1 --2- 172.21.15.37:0/323522427 >> v2:172.21.15.78:3300/0 conn(0x7f7dd80bab80 0x7f7dd814b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.827+0000 7f7ddd6a1640 1 --2- 172.21.15.37:0/323522427 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7dd8144e30 0x7f7dd80b7600 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.827+0000 7f7ddd6a1640 1 -- 172.21.15.37:0/323522427 >> 172.21.15.37:0/323522427 conn(0x7f7dd80c0200 msgr2=0x7f7dd80c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:50.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.827+0000 7f7ddd6a1640 1 -- 172.21.15.37:0/323522427 shutdown_connections 2023-12-19T16:07:50.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.827+0000 7f7ddd6a1640 1 -- 172.21.15.37:0/323522427 wait complete. 2023-12-19T16:07:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.828+0000 7f7ddd6a1640 1 Processor -- start 2023-12-19T16:07:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.828+0000 7f7ddd6a1640 1 -- start start 2023-12-19T16:07:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.828+0000 7f7ddd6a1640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7dd80b8b40 0x7f7dd80af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.828+0000 7f7ddd6a1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dd80bab80 0x7f7dd8148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.828+0000 7f7ddd6a1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dd8144e30 0x7f7dd81d73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.828+0000 7f7ddd6a1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd81d78f0 con 0x7f7dd8144e30 2023-12-19T16:07:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.828+0000 7f7ddd6a1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd81d1bc0 con 0x7f7dd80bab80 2023-12-19T16:07:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.828+0000 7f7ddd6a1640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80ae280 con 0x7f7dd80b8b40 2023-12-19T16:07:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.829+0000 7f7dd77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dd8144e30 0x7f7dd81d73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.829+0000 7f7dd77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dd8144e30 0x7f7dd81d73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60572/0 (socket says 172.21.15.37:60572) 2023-12-19T16:07:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.829+0000 7f7dd77fe640 1 -- 172.21.15.37:0/1863553954 learned_addr learned my addr 172.21.15.37:0/1863553954 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.829+0000 7f7dd77fe640 1 -- 172.21.15.37:0/1863553954 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7dd80b8b40 msgr2=0x7f7dd80af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.829+0000 7f7dd77fe640 1 --2- 172.21.15.37:0/1863553954 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7dd80b8b40 0x7f7dd80af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.829+0000 7f7dd77fe640 1 -- 172.21.15.37:0/1863553954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dd80bab80 msgr2=0x7f7dd8148d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.829+0000 7f7dd77fe640 1 --2- 172.21.15.37:0/1863553954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dd80bab80 0x7f7dd8148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.829+0000 7f7dd77fe640 1 -- 172.21.15.37:0/1863553954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc8009400 con 0x7f7dd8144e30 2023-12-19T16:07:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.829+0000 7f7dd77fe640 1 --2- 172.21.15.37:0/1863553954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dd8144e30 0x7f7dd81d73b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000cb70 tx=0x7f7dd000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.829+0000 7f7dbf7fe640 1 -- 172.21.15.37:0/1863553954 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000ad40 con 0x7f7dd8144e30 2023-12-19T16:07:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.829+0000 7f7dbf7fe640 1 -- 172.21.15.37:0/1863553954 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd0012400 con 0x7f7dd8144e30 2023-12-19T16:07:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.829+0000 7f7ddd6a1640 1 -- 172.21.15.37:0/1863553954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd80ae560 con 0x7f7dd8144e30 2023-12-19T16:07:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.829+0000 7f7dbf7fe640 1 -- 172.21.15.37:0/1863553954 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000aea0 con 0x7f7dd8144e30 2023-12-19T16:07:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.829+0000 7f7ddd6a1640 1 -- 172.21.15.37:0/1863553954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd80aeb20 con 0x7f7dd8144e30 2023-12-19T16:07:50.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.831+0000 7f7dbf7fe640 1 -- 172.21.15.37:0/1863553954 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7dd0007070 con 0x7f7dd8144e30 2023-12-19T16:07:50.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.831+0000 7f7dbf7fe640 1 --2- 172.21.15.37:0/1863553954 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7dc406a430 0x7f7dc406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.831+0000 7f7dbf7fe640 1 -- 172.21.15.37:0/1863553954 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dd0088790 con 0x7f7dd8144e30 2023-12-19T16:07:50.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.831+0000 7f7dd6ffd640 1 --2- 172.21.15.37:0/1863553954 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7dc406a430 0x7f7dc406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.832+0000 7f7de020d740 1 Processor -- start 2023-12-19T16:07:50.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.832+0000 7f7dd6ffd640 1 --2- 172.21.15.37:0/1863553954 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7dc406a430 0x7f7dc406c8f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8036000 tx=0x7f7dc8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:50.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.832+0000 7f7de020d740 1 -- start start 2023-12-19T16:07:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.833+0000 7f7de020d740 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x561f4cd44800 0x561f4cd08bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.833+0000 7f7de020d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd09100 0x561f4cd39ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.833+0000 7f7de020d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd3a0e0 0x561f4cd3a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.833+0000 7f7de020d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f4cc780b0 con 0x561f4cd3a0e0 2023-12-19T16:07:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.833+0000 7f7de020d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f4cc75840 con 0x561f4cd09100 2023-12-19T16:07:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.833+0000 7f7de020d740 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f4cc71130 con 0x561f4cd44800 2023-12-19T16:07:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.833+0000 7f7dd77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd3a0e0 0x561f4cd3a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.833+0000 7f7dd77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd3a0e0 0x561f4cd3a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60586/0 (socket says 172.21.15.37:60586) 2023-12-19T16:07:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.833+0000 7f7dd77fe640 1 -- 172.21.15.37:0/718254311 learned_addr learned my addr 172.21.15.37:0/718254311 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.833+0000 7f7dd67fc640 1 --2- 172.21.15.37:0/718254311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd09100 0x561f4cd39ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.833+0000 7f7dd6ffd640 1 --2- 172.21.15.37:0/718254311 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x561f4cd44800 0x561f4cd08bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.833+0000 7f7dd77fe640 1 -- 172.21.15.37:0/718254311 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x561f4cd44800 msgr2=0x561f4cd08bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.833+0000 7f7dd77fe640 1 --2- 172.21.15.37:0/718254311 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x561f4cd44800 0x561f4cd08bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.833+0000 7f7dd77fe640 1 -- 172.21.15.37:0/718254311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd09100 msgr2=0x561f4cd39ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.833+0000 7f7dd77fe640 1 --2- 172.21.15.37:0/718254311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd09100 0x561f4cd39ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.833+0000 7f7dd77fe640 1 -- 172.21.15.37:0/718254311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f4cc2bc40 con 0x561f4cd3a0e0 2023-12-19T16:07:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.833+0000 7f7dd77fe640 1 --2- 172.21.15.37:0/718254311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd3a0e0 0x561f4cd3a560 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7dd005f4e0 tx=0x7f7dd0057a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770c527537c3b8d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.834+0000 7f7dbcff9640 1 -- 172.21.15.37:0/718254311 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0055dd0 con 0x561f4cd3a0e0 2023-12-19T16:07:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.834+0000 7f7dbcff9640 1 -- 172.21.15.37:0/718254311 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd0054140 con 0x561f4cd3a0e0 2023-12-19T16:07:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.834+0000 7f7dbcff9640 1 -- 172.21.15.37:0/718254311 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0057160 con 0x561f4cd3a0e0 2023-12-19T16:07:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.834+0000 7f7de020d740 1 -- 172.21.15.37:0/718254311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd3a0e0 msgr2=0x561f4cd3a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.834+0000 7f7de020d740 1 --2- 172.21.15.37:0/718254311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd3a0e0 0x561f4cd3a560 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7dd005f4e0 tx=0x7f7dd0057a30 comp rx=0 tx=0).stop 2023-12-19T16:07:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.834+0000 7f7de020d740 1 -- 172.21.15.37:0/718254311 shutdown_connections 2023-12-19T16:07:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.834+0000 7f7de020d740 1 --2- 172.21.15.37:0/718254311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd3a0e0 0x561f4cd3a560 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.834+0000 7f7de020d740 1 --2- 172.21.15.37:0/718254311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd09100 0x561f4cd39ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.834+0000 7f7de020d740 1 --2- 172.21.15.37:0/718254311 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x561f4cd44800 0x561f4cd08bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.834+0000 7f7de020d740 1 -- 172.21.15.37:0/718254311 >> 172.21.15.37:0/718254311 conn(0x561f4cd0a5f0 msgr2=0x561f4cd43f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.834+0000 7f7de020d740 1 -- 172.21.15.37:0/718254311 shutdown_connections 2023-12-19T16:07:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.834+0000 7f7de020d740 1 -- 172.21.15.37:0/718254311 wait complete. 2023-12-19T16:07:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.835+0000 7f7de020d740 1 -- start start 2023-12-19T16:07:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.835+0000 7f7de020d740 1 Processor -- start 2023-12-19T16:07:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7de020d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd3a0e0 0x561f4cd50f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7de020d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd44800 0x561f4cd33e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7de020d740 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x561f4cd34890 0x561f4cd30b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7de020d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f4cc2f840 con 0x561f4cd3a0e0 2023-12-19T16:07:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7de020d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f4cc2f4e0 con 0x561f4cd44800 2023-12-19T16:07:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7de020d740 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f4cbf5230 con 0x561f4cd34890 2023-12-19T16:07:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7de020d740 10 client.0 _ll_register_callbacks cb 0x561f4cc466d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:07:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7dd6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd3a0e0 0x561f4cd50f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7dd6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd3a0e0 0x561f4cd50f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60600/0 (socket says 172.21.15.37:60600) 2023-12-19T16:07:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7dd6ffd640 1 -- 172.21.15.37:0/554603577 learned_addr learned my addr 172.21.15.37:0/554603577 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7dd6ffd640 1 -- 172.21.15.37:0/554603577 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x561f4cd34890 msgr2=0x561f4cd30b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7dd67fc640 1 --2- 172.21.15.37:0/554603577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd44800 0x561f4cd33e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7dd6ffd640 1 --2- 172.21.15.37:0/554603577 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x561f4cd34890 0x561f4cd30b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7dd6ffd640 1 -- 172.21.15.37:0/554603577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd44800 msgr2=0x561f4cd33e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7dd6ffd640 1 --2- 172.21.15.37:0/554603577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd44800 0x561f4cd33e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7dd6ffd640 1 -- 172.21.15.37:0/554603577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd80aeb20 con 0x561f4cd3a0e0 2023-12-19T16:07:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7dd67fc640 1 --2- 172.21.15.37:0/554603577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd44800 0x561f4cd33e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7dd6ffd640 1 --2- 172.21.15.37:0/554603577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd3a0e0 0x561f4cd50f60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009890 tx=0x7f7dc8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1063b9bec4e0c0ad server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7db5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-12-19T16:07:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7db5ffb640 1 -- 172.21.15.37:0/554603577 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc804a070 con 0x561f4cd3a0e0 2023-12-19T16:07:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7de020d740 1 -- 172.21.15.37:0/554603577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f4cc9a970 con 0x561f4cd3a0e0 2023-12-19T16:07:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7db5ffb640 1 -- 172.21.15.37:0/554603577 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dc8044910 con 0x561f4cd3a0e0 2023-12-19T16:07:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7db5ffb640 1 -- 172.21.15.37:0/554603577 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7dc803e070 con 0x561f4cd3a0e0 2023-12-19T16:07:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7de020d740 10 client.5187 fetch_fsmap learned FSMap version 13 2023-12-19T16:07:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.836+0000 7f7de020d740 1 -- 172.21.15.37:0/554603577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x561f4cc6f7b0 con 0x561f4cd3a0e0 2023-12-19T16:07:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.837+0000 7f7db5ffb640 1 -- 172.21.15.37:0/554603577 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561f4cc9a970 con 0x561f4cd3a0e0 2023-12-19T16:07:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.837+0000 7f7db5ffb640 1 -- 172.21.15.37:0/554603577 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 13) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f7dc8044ce0 con 0x561f4cd3a0e0 2023-12-19T16:07:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.837+0000 7f7de020d740 10 client.5187 fetch_fsmap finished waiting for FSMap version 13 2023-12-19T16:07:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.837+0000 7f7de020d740 10 client.5187 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T16:07:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.837+0000 7f7de020d740 20 client.5187 populate_metadata read hostname 'smithi037' 2023-12-19T16:07:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.837+0000 7f7de020d740 1 --2- 172.21.15.37:0/554603577 >> [v2:172.21.15.37:6833/1604445250,v1:172.21.15.37:6835/1604445250] conn(0x561f4cd53d60 0x561f4cd54140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.837+0000 7f7de020d740 4 client.5187 mds_command: new command op to 4977 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T16:07:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.837+0000 7f7de020d740 1 -- 172.21.15.37:0/554603577 --> [v2:172.21.15.37:6833/1604445250,v1:172.21.15.37:6835/1604445250] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561f4cc62f00 con 0x561f4cd53d60 2023-12-19T16:07:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.837+0000 7f7dd67fc640 1 --2- 172.21.15.37:0/554603577 >> [v2:172.21.15.37:6833/1604445250,v1:172.21.15.37:6835/1604445250] conn(0x561f4cd53d60 0x561f4cd54140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.837+0000 7f7dd67fc640 1 --2- 172.21.15.37:0/554603577 >> [v2:172.21.15.37:6833/1604445250,v1:172.21.15.37:6835/1604445250] conn(0x561f4cd53d60 0x561f4cd54140 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f22edf5dfddd75ba server_cookie=bd213d43adf850d9 in_seq=0 out_seq=0 2023-12-19T16:07:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.837+0000 7f7db5ffb640 10 client.5187 ms_handle_connect on v2:172.21.15.37:6833/1604445250 2023-12-19T16:07:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.838+0000 7f7db5ffb640 1 -- 172.21.15.37:0/554603577 <== mds.0 v2:172.21.15.37:6833/1604445250 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x561f4cc62f00 con 0x561f4cd53d60 2023-12-19T16:07:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.838+0000 7f7db5ffb640 10 client.5187 handle_command_reply: tid=0 2023-12-19T16:07:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.838+0000 7f7de020d740 1 client.5187 shutdown 2023-12-19T16:07:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.838+0000 7f7de020d740 1 -- 172.21.15.37:0/554603577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd3a0e0 msgr2=0x561f4cd50f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.838+0000 7f7de020d740 1 --2- 172.21.15.37:0/554603577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd3a0e0 0x561f4cd50f60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009890 tx=0x7f7dc8004730 comp rx=0 tx=0).stop 2023-12-19T16:07:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.838+0000 7f7de020d740 1 -- 172.21.15.37:0/554603577 shutdown_connections 2023-12-19T16:07:50.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.838+0000 7f7de020d740 1 --2- 172.21.15.37:0/554603577 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x561f4cd34890 0x561f4cd30b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.838+0000 7f7de020d740 1 --2- 172.21.15.37:0/554603577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd44800 0x561f4cd33e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.838+0000 7f7de020d740 1 --2- 172.21.15.37:0/554603577 >> [v2:172.21.15.37:6833/1604445250,v1:172.21.15.37:6835/1604445250] conn(0x561f4cd53d60 0x561f4cd54140 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.838+0000 7f7de020d740 1 --2- 172.21.15.37:0/554603577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd3a0e0 0x561f4cd50f60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.838+0000 7f7db5ffb640 0 client.5187 ms_handle_reset on v2:172.21.15.37:6833/1604445250 2023-12-19T16:07:50.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.838+0000 7f7de020d740 1 -- 172.21.15.37:0/554603577 >> 172.21.15.37:0/554603577 conn(0x561f4cd09100 msgr2=0x561f4cd359c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:50.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.838+0000 7f7de020d740 1 -- 172.21.15.37:0/554603577 shutdown_connections 2023-12-19T16:07:50.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.838+0000 7f7de020d740 1 -- 172.21.15.37:0/554603577 wait complete. 2023-12-19T16:07:50.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.838+0000 7f7de020d740 20 client.5187 trim_cache size 0 max 16384 2023-12-19T16:07:50.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.853+0000 7f7de020d740 1 Processor -- start 2023-12-19T16:07:50.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.853+0000 7f7de020d740 1 -- start start 2023-12-19T16:07:50.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.854+0000 7f7de020d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd34890 0x561f4cd41330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.854+0000 7f7de020d740 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x561f4cd3a0e0 0x561f4cd5a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.854+0000 7f7de020d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd44800 0x561f4cd5a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.854+0000 7f7de020d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f4cd33330 con 0x561f4cd44800 2023-12-19T16:07:50.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.854+0000 7f7de020d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f4cd0dd20 con 0x561f4cd34890 2023-12-19T16:07:50.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.854+0000 7f7de020d740 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f4cd4e220 con 0x561f4cd3a0e0 2023-12-19T16:07:50.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.854+0000 7f7dd77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd44800 0x561f4cd5a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.854+0000 7f7dd77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd44800 0x561f4cd5a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60606/0 (socket says 172.21.15.37:60606) 2023-12-19T16:07:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.854+0000 7f7dd77fe640 1 -- 172.21.15.37:0/1431799786 learned_addr learned my addr 172.21.15.37:0/1431799786 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.854+0000 7f7dd77fe640 1 -- 172.21.15.37:0/1431799786 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x561f4cd3a0e0 msgr2=0x561f4cd5a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.854+0000 7f7dd77fe640 1 --2- 172.21.15.37:0/1431799786 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x561f4cd3a0e0 0x561f4cd5a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.854+0000 7f7dd77fe640 1 -- 172.21.15.37:0/1431799786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd34890 msgr2=0x561f4cd41330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.854+0000 7f7dd6ffd640 1 --2- 172.21.15.37:0/1431799786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd34890 0x561f4cd41330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.854+0000 7f7dd77fe640 1 --2- 172.21.15.37:0/1431799786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd34890 0x561f4cd41330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.854+0000 7f7dd77fe640 1 -- 172.21.15.37:0/1431799786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f4cc11be0 con 0x561f4cd44800 2023-12-19T16:07:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.854+0000 7f7dd77fe640 1 --2- 172.21.15.37:0/1431799786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd44800 0x561f4cd5a6b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00582e0 tx=0x7f7dd0014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bbafd2513d0990 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.854+0000 7f7dbd7fa640 1 -- 172.21.15.37:0/1431799786 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0057800 con 0x561f4cd44800 2023-12-19T16:07:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.854+0000 7f7dbd7fa640 1 -- 172.21.15.37:0/1431799786 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd00542b0 con 0x561f4cd44800 2023-12-19T16:07:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.854+0000 7f7dbd7fa640 1 -- 172.21.15.37:0/1431799786 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0056f20 con 0x561f4cd44800 2023-12-19T16:07:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.855+0000 7f7de020d740 1 -- 172.21.15.37:0/1431799786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd44800 msgr2=0x561f4cd5a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.855+0000 7f7de020d740 1 --2- 172.21.15.37:0/1431799786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd44800 0x561f4cd5a6b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00582e0 tx=0x7f7dd0014040 comp rx=0 tx=0).stop 2023-12-19T16:07:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.855+0000 7f7de020d740 1 -- 172.21.15.37:0/1431799786 shutdown_connections 2023-12-19T16:07:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.855+0000 7f7de020d740 1 --2- 172.21.15.37:0/1431799786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd44800 0x561f4cd5a6b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.855+0000 7f7de020d740 1 --2- 172.21.15.37:0/1431799786 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x561f4cd3a0e0 0x561f4cd5a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.855+0000 7f7de020d740 1 --2- 172.21.15.37:0/1431799786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd34890 0x561f4cd41330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.855+0000 7f7de020d740 1 -- 172.21.15.37:0/1431799786 >> 172.21.15.37:0/1431799786 conn(0x561f4cd09100 msgr2=0x561f4cd33a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.855+0000 7f7de020d740 1 -- 172.21.15.37:0/1431799786 shutdown_connections 2023-12-19T16:07:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.855+0000 7f7de020d740 1 -- 172.21.15.37:0/1431799786 wait complete. 2023-12-19T16:07:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.855+0000 7f7de020d740 1 -- start start 2023-12-19T16:07:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.855+0000 7f7de020d740 1 Processor -- start 2023-12-19T16:07:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.856+0000 7f7de020d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd34890 0x561f4cd354a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.856+0000 7f7de020d740 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x561f4cd3a0e0 0x561f4cda9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.856+0000 7f7de020d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd44800 0x561f4cd3fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.856+0000 7f7de020d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f4cd35ea0 con 0x561f4cd34890 2023-12-19T16:07:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.856+0000 7f7de020d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f4cd3ddb0 con 0x561f4cd44800 2023-12-19T16:07:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.856+0000 7f7de020d740 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f4cdaa740 con 0x561f4cd3a0e0 2023-12-19T16:07:50.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.856+0000 7f7de020d740 10 client.0 _ll_register_callbacks cb 0x7f7dd0088040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:07:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.856+0000 7f7dd6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd34890 0x561f4cd354a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.856+0000 7f7dd6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd34890 0x561f4cd354a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60622/0 (socket says 172.21.15.37:60622) 2023-12-19T16:07:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.856+0000 7f7dd6ffd640 1 -- 172.21.15.37:0/2379624451 learned_addr learned my addr 172.21.15.37:0/2379624451 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.856+0000 7f7dd6ffd640 1 -- 172.21.15.37:0/2379624451 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x561f4cd3a0e0 msgr2=0x561f4cda9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.856+0000 7f7dd6ffd640 1 --2- 172.21.15.37:0/2379624451 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x561f4cd3a0e0 0x561f4cda9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.856+0000 7f7dd6ffd640 1 -- 172.21.15.37:0/2379624451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd44800 msgr2=0x561f4cd3fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.856+0000 7f7dd6ffd640 1 --2- 172.21.15.37:0/2379624451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd44800 0x561f4cd3fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.856+0000 7f7dd6ffd640 1 -- 172.21.15.37:0/2379624451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561f4cc2bc40 con 0x561f4cd34890 2023-12-19T16:07:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.856+0000 7f7dd6ffd640 1 --2- 172.21.15.37:0/2379624451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd34890 0x561f4cd354a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7dc802bf70 tx=0x7f7dc803e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a29e1eb5eb8233f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.856+0000 7f7db5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-12-19T16:07:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.857+0000 7f7db5ffb640 1 -- 172.21.15.37:0/2379624451 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8066070 con 0x561f4cd34890 2023-12-19T16:07:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.857+0000 7f7db5ffb640 1 -- 172.21.15.37:0/2379624451 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dc804f5c0 con 0x561f4cd34890 2023-12-19T16:07:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.857+0000 7f7de020d740 1 -- 172.21.15.37:0/2379624451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7dd0054140 con 0x561f4cd34890 2023-12-19T16:07:50.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.857+0000 7f7db5ffb640 1 -- 172.21.15.37:0/2379624451 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7dc804f780 con 0x561f4cd34890 2023-12-19T16:07:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.857+0000 7f7de020d740 10 client.5193 fetch_fsmap learned FSMap version 13 2023-12-19T16:07:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.857+0000 7f7de020d740 1 -- 172.21.15.37:0/2379624451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x561f4cc372f0 con 0x561f4cd34890 2023-12-19T16:07:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.857+0000 7f7db5ffb640 1 -- 172.21.15.37:0/2379624451 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd0054140 con 0x561f4cd34890 2023-12-19T16:07:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.857+0000 7f7db5ffb640 1 -- 172.21.15.37:0/2379624451 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 13) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f7dc8069020 con 0x561f4cd34890 2023-12-19T16:07:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.857+0000 7f7de020d740 10 client.5193 fetch_fsmap finished waiting for FSMap version 13 2023-12-19T16:07:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.857+0000 7f7de020d740 10 client.5193 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T16:07:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.857+0000 7f7de020d740 20 client.5193 populate_metadata read hostname 'smithi037' 2023-12-19T16:07:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.857+0000 7f7de020d740 1 --2- 172.21.15.37:0/2379624451 >> [v2:172.21.15.37:6833/1604445250,v1:172.21.15.37:6835/1604445250] conn(0x561f4cd404a0 0x561f4cda30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.857+0000 7f7de020d740 4 client.5193 mds_command: new command op to 4977 tid=0[{"prefix": "status"}] 2023-12-19T16:07:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.857+0000 7f7de020d740 1 -- 172.21.15.37:0/2379624451 --> [v2:172.21.15.37:6833/1604445250,v1:172.21.15.37:6835/1604445250] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561f4cc6a1b0 con 0x561f4cd404a0 2023-12-19T16:07:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.857+0000 7f7dd67fc640 1 --2- 172.21.15.37:0/2379624451 >> [v2:172.21.15.37:6833/1604445250,v1:172.21.15.37:6835/1604445250] conn(0x561f4cd404a0 0x561f4cda30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.857+0000 7f7dd67fc640 1 --2- 172.21.15.37:0/2379624451 >> [v2:172.21.15.37:6833/1604445250,v1:172.21.15.37:6835/1604445250] conn(0x561f4cd404a0 0x561f4cda30e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fef162e8b767a9ff server_cookie=c3b9a4e3930d6d84 in_seq=0 out_seq=0 2023-12-19T16:07:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.857+0000 7f7db5ffb640 10 client.5193 ms_handle_connect on v2:172.21.15.37:6833/1604445250 2023-12-19T16:07:50.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7db5ffb640 1 -- 172.21.15.37:0/2379624451 <== mds.0 v2:172.21.15.37:6833/1604445250 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x561f4cc6a1b0 con 0x561f4cd404a0 2023-12-19T16:07:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7db5ffb640 10 client.5193 handle_command_reply: tid=0 2023-12-19T16:07:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7de020d740 1 client.5193 shutdown 2023-12-19T16:07:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7de020d740 1 -- 172.21.15.37:0/2379624451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd34890 msgr2=0x561f4cd354a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7de020d740 1 --2- 172.21.15.37:0/2379624451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd34890 0x561f4cd354a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7dc802bf70 tx=0x7f7dc803e000 comp rx=0 tx=0).stop 2023-12-19T16:07:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7de020d740 1 -- 172.21.15.37:0/2379624451 shutdown_connections 2023-12-19T16:07:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7de020d740 1 --2- 172.21.15.37:0/2379624451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561f4cd44800 0x561f4cd3fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7de020d740 1 --2- 172.21.15.37:0/2379624451 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x561f4cd3a0e0 0x561f4cda9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7de020d740 1 --2- 172.21.15.37:0/2379624451 >> [v2:172.21.15.37:6833/1604445250,v1:172.21.15.37:6835/1604445250] conn(0x561f4cd404a0 0x561f4cda30e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7de020d740 1 --2- 172.21.15.37:0/2379624451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f4cd34890 0x561f4cd354a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7db5ffb640 0 client.5193 ms_handle_reset on v2:172.21.15.37:6833/1604445250 2023-12-19T16:07:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7de020d740 1 -- 172.21.15.37:0/2379624451 >> 172.21.15.37:0/2379624451 conn(0x561f4cd09100 msgr2=0x561f4cd33a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7de020d740 1 -- 172.21.15.37:0/2379624451 shutdown_connections 2023-12-19T16:07:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7de020d740 1 -- 172.21.15.37:0/2379624451 wait complete. 2023-12-19T16:07:50.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7de020d740 20 client.5193 trim_cache size 0 max 16384 2023-12-19T16:07:50.867 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-12-19T16:07:50.867 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2", 2023-12-19T16:07:50.867 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-12-19T16:07:50.867 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4977, 2023-12-19T16:07:50.867 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-12-19T16:07:50.867 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-12-19T16:07:50.867 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-12-19T16:07:50.867 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 8.9597496270000008, 2023-12-19T16:07:50.867 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 13, 2023-12-19T16:07:50.867 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 31, 2023-12-19T16:07:50.867 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 31, 2023-12-19T16:07:50.868 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 16.201951214000001 2023-12-19T16:07:50.868 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-12-19T16:07:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7ddd6a1640 1 -- 172.21.15.37:0/1863553954 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7dc406a430 msgr2=0x7f7dc406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7ddd6a1640 1 --2- 172.21.15.37:0/1863553954 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7dc406a430 0x7f7dc406c8f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8036000 tx=0x7f7dc8030000 comp rx=0 tx=0).stop 2023-12-19T16:07:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7ddd6a1640 1 -- 172.21.15.37:0/1863553954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dd8144e30 msgr2=0x7f7dd81d73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7ddd6a1640 1 --2- 172.21.15.37:0/1863553954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dd8144e30 0x7f7dd81d73b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000cb70 tx=0x7f7dd000a430 comp rx=0 tx=0).stop 2023-12-19T16:07:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7ddd6a1640 1 -- 172.21.15.37:0/1863553954 shutdown_connections 2023-12-19T16:07:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7ddd6a1640 1 --2- 172.21.15.37:0/1863553954 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7dc406a430 0x7f7dc406c8f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7ddd6a1640 1 --2- 172.21.15.37:0/1863553954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dd8144e30 0x7f7dd81d73b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7ddd6a1640 1 --2- 172.21.15.37:0/1863553954 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dd80bab80 0x7f7dd8148d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7ddd6a1640 1 --2- 172.21.15.37:0/1863553954 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7dd80b8b40 0x7f7dd80af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.858+0000 7f7ddd6a1640 1 -- 172.21.15.37:0/1863553954 >> 172.21.15.37:0/1863553954 conn(0x7f7dd80c0200 msgr2=0x7f7dd80be380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.859+0000 7f7ddd6a1640 1 -- 172.21.15.37:0/1863553954 shutdown_connections 2023-12-19T16:07:50.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.859+0000 7f7ddd6a1640 1 -- 172.21.15.37:0/1863553954 wait complete. 2023-12-19T16:07:50.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T16:07:50.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.974+0000 7f897e3f0640 1 Processor -- start 2023-12-19T16:07:50.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.974+0000 7f897e3f0640 1 -- start start 2023-12-19T16:07:50.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.975+0000 7f897e3f0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8978070ff0 0x7f897814aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.975+0000 7f897e3f0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89780ba700 0x7f8978155390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.975+0000 7f897e3f0640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f897814af90 con 0x7f89780ba0e0 2023-12-19T16:07:50.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.975+0000 7f897e3f0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89780b8630 con 0x7f8978070ff0 2023-12-19T16:07:50.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.975+0000 7f897e3f0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897806b090 con 0x7f89780ba700 2023-12-19T16:07:50.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.975+0000 7f8977fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8978070ff0 0x7f897814aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.975+0000 7f8977fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8978070ff0 0x7f897814aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60634/0 (socket says 172.21.15.37:60634) 2023-12-19T16:07:50.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.975+0000 7f8977fff640 1 -- 172.21.15.37:0/4231144345 learned_addr learned my addr 172.21.15.37:0/4231144345 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:50.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.976+0000 7f897c98d640 1 --2- 172.21.15.37:0/4231144345 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89780ba700 0x7f8978155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.976+0000 7f8977fff640 1 -- 172.21.15.37:0/4231144345 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89780ba700 msgr2=0x7f8978155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:07:50.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.976+0000 7f8977fff640 1 --2- 172.21.15.37:0/4231144345 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89780ba700 0x7f8978155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.976+0000 7f8977fff640 1 -- 172.21.15.37:0/4231144345 >> v1:172.21.15.78:6789/0 conn(0x7f89780ba0e0 legacy=0x7f89780b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.976+0000 7f8977fff640 1 -- 172.21.15.37:0/4231144345 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8978071d10 con 0x7f8978070ff0 2023-12-19T16:07:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.976+0000 7f8977fff640 1 --2- 172.21.15.37:0/4231144345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8978070ff0 0x7f897814aa50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f896c009870 tx=0x7f896c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb98bca602cbfce server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.976+0000 7f8976ffd640 1 -- 172.21.15.37:0/4231144345 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c030840 con 0x7f8978070ff0 2023-12-19T16:07:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.977+0000 7f8976ffd640 1 -- 172.21.15.37:0/4231144345 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896c0309a0 con 0x7f8978070ff0 2023-12-19T16:07:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.977+0000 7f8976ffd640 1 -- 172.21.15.37:0/4231144345 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c030d30 con 0x7f8978070ff0 2023-12-19T16:07:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.977+0000 7f897e3f0640 1 -- 172.21.15.37:0/4231144345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8978070ff0 msgr2=0x7f897814aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.977+0000 7f897e3f0640 1 --2- 172.21.15.37:0/4231144345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8978070ff0 0x7f897814aa50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f896c009870 tx=0x7f896c02b980 comp rx=0 tx=0).stop 2023-12-19T16:07:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.977+0000 7f897e3f0640 1 -- 172.21.15.37:0/4231144345 shutdown_connections 2023-12-19T16:07:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.977+0000 7f897e3f0640 1 --2- 172.21.15.37:0/4231144345 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89780ba700 0x7f8978155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.977+0000 7f897e3f0640 1 --2- 172.21.15.37:0/4231144345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8978070ff0 0x7f897814aa50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.977+0000 7f897e3f0640 1 -- 172.21.15.37:0/4231144345 >> 172.21.15.37:0/4231144345 conn(0x7f89780be120 msgr2=0x7f89780be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:50.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.977+0000 7f897e3f0640 1 -- 172.21.15.37:0/4231144345 shutdown_connections 2023-12-19T16:07:50.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.977+0000 7f897e3f0640 1 -- 172.21.15.37:0/4231144345 wait complete. 2023-12-19T16:07:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.978+0000 7f897e3f0640 1 Processor -- start 2023-12-19T16:07:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.978+0000 7f897e3f0640 1 -- start start 2023-12-19T16:07:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.979+0000 7f897e3f0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8978070ff0 0x7f897814d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.979+0000 7f897e3f0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89780ba0e0 0x7f897814bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.979+0000 7f897e3f0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89780ba700 0x7f897814c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.979+0000 7f897e3f0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897814d8f0 con 0x7f8978070ff0 2023-12-19T16:07:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.979+0000 7f897e3f0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897814e0d0 con 0x7f89780ba700 2023-12-19T16:07:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.979+0000 7f897e3f0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897814e700 con 0x7f89780ba0e0 2023-12-19T16:07:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.979+0000 7f8977fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8978070ff0 0x7f897814d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.979+0000 7f8977fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8978070ff0 0x7f897814d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60638/0 (socket says 172.21.15.37:60638) 2023-12-19T16:07:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.979+0000 7f8977fff640 1 -- 172.21.15.37:0/2251425241 learned_addr learned my addr 172.21.15.37:0/2251425241 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:07:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.979+0000 7f897c98d640 1 --2- 172.21.15.37:0/2251425241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89780ba700 0x7f897814c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.979+0000 7f89777fe640 1 --2- 172.21.15.37:0/2251425241 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89780ba0e0 0x7f897814bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.979+0000 7f8977fff640 1 -- 172.21.15.37:0/2251425241 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89780ba0e0 msgr2=0x7f897814bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.979+0000 7f8977fff640 1 --2- 172.21.15.37:0/2251425241 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89780ba0e0 0x7f897814bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.979+0000 7f8977fff640 1 -- 172.21.15.37:0/2251425241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89780ba700 msgr2=0x7f897814c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.979+0000 7f8977fff640 1 --2- 172.21.15.37:0/2251425241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89780ba700 0x7f897814c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.979+0000 7f8977fff640 1 -- 172.21.15.37:0/2251425241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c0094d0 con 0x7f8978070ff0 2023-12-19T16:07:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.979+0000 7f897c98d640 1 --2- 172.21.15.37:0/2251425241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89780ba700 0x7f897814c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.979+0000 7f89777fe640 1 --2- 172.21.15.37:0/2251425241 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89780ba0e0 0x7f897814bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:07:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.980+0000 7f8977fff640 1 --2- 172.21.15.37:0/2251425241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8978070ff0 0x7f897814d3b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f896c000c00 tx=0x7f896c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.980+0000 7f8974ff9640 1 -- 172.21.15.37:0/2251425241 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c039c90 con 0x7f8978070ff0 2023-12-19T16:07:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.980+0000 7f8974ff9640 1 -- 172.21.15.37:0/2251425241 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896c039df0 con 0x7f8978070ff0 2023-12-19T16:07:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.980+0000 7f8974ff9640 1 -- 172.21.15.37:0/2251425241 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c043640 con 0x7f8978070ff0 2023-12-19T16:07:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.980+0000 7f897e3f0640 1 -- 172.21.15.37:0/2251425241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89781e34d0 con 0x7f8978070ff0 2023-12-19T16:07:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.980+0000 7f897e3f0640 1 -- 172.21.15.37:0/2251425241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89781e3a90 con 0x7f8978070ff0 2023-12-19T16:07:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.981+0000 7f897e3f0640 1 -- 172.21.15.37:0/2251425241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f897804e840 con 0x7f8978070ff0 2023-12-19T16:07:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.981+0000 7f8974ff9640 1 -- 172.21.15.37:0/2251425241 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f896c0437a0 con 0x7f8978070ff0 2023-12-19T16:07:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.982+0000 7f8974ff9640 1 --2- 172.21.15.37:0/2251425241 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f896406a460 0x7f896406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:07:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.982+0000 7f8974ff9640 1 -- 172.21.15.37:0/2251425241 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f896c03e070 con 0x7f8978070ff0 2023-12-19T16:07:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.982+0000 7f89777fe640 1 --2- 172.21.15.37:0/2251425241 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f896406a460 0x7f896406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:07:50.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.982+0000 7f89777fe640 1 --2- 172.21.15.37:0/2251425241 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f896406a460 0x7f896406c920 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f897814efb0 tx=0x7f8968009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:07:50.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:50.986+0000 7f8974ff9640 1 -- 172.21.15.37:0/2251425241 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f896c076fc0 con 0x7f8978070ff0 2023-12-19T16:07:51.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:51.197+0000 7f897e3f0640 1 -- 172.21.15.37:0/2251425241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8978144da0 con 0x7f8978070ff0 2023-12-19T16:07:51.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:51.198+0000 7f8974ff9640 1 -- 172.21.15.37:0/2251425241 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7f896c034070 con 0x7f8978070ff0 2023-12-19T16:07:51.200 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T16:07:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:51.199+0000 7f897e3f0640 1 -- 172.21.15.37:0/2251425241 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f896406a460 msgr2=0x7f896406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:51.199+0000 7f897e3f0640 1 --2- 172.21.15.37:0/2251425241 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f896406a460 0x7f896406c920 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f897814efb0 tx=0x7f8968009040 comp rx=0 tx=0).stop 2023-12-19T16:07:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:51.199+0000 7f897e3f0640 1 -- 172.21.15.37:0/2251425241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8978070ff0 msgr2=0x7f897814d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:07:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:51.199+0000 7f897e3f0640 1 --2- 172.21.15.37:0/2251425241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8978070ff0 0x7f897814d3b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f896c000c00 tx=0x7f896c004730 comp rx=0 tx=0).stop 2023-12-19T16:07:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:51.199+0000 7f897e3f0640 1 -- 172.21.15.37:0/2251425241 shutdown_connections 2023-12-19T16:07:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:51.199+0000 7f897e3f0640 1 --2- 172.21.15.37:0/2251425241 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f896406a460 0x7f896406c920 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:51.199+0000 7f897e3f0640 1 --2- 172.21.15.37:0/2251425241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89780ba700 0x7f897814c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:51.199+0000 7f897e3f0640 1 --2- 172.21.15.37:0/2251425241 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f89780ba0e0 0x7f897814bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:51.199+0000 7f897e3f0640 1 --2- 172.21.15.37:0/2251425241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8978070ff0 0x7f897814d3b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:07:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:51.199+0000 7f897e3f0640 1 -- 172.21.15.37:0/2251425241 >> 172.21.15.37:0/2251425241 conn(0x7f89780be120 msgr2=0x7f8978148a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:07:51.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:51.200+0000 7f897e3f0640 1 -- 172.21.15.37:0/2251425241 shutdown_connections 2023-12-19T16:07:51.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:07:51.200+0000 7f897e3f0640 1 -- 172.21.15.37:0/2251425241 wait complete. 2023-12-19T16:07:51.212 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T16:07:51.212 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T16:07:51.212 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-12-19T16:07:51.212 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T16:07:51.212 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T16:07:51.213 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T16:07:51.213 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T16:07:51.213 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T16:07:51.213 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:07:51.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:51.213 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-12-19T16:07:51.273 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:07:51.274 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:07:51.274 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:07:51.274 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:07:51.274 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-19T16:07:51.274 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:07:51.274 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T16:07:51.274 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-19T16:07:51.274 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-12-19T16:07:51.274 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T16:07:51.274 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-19T16:07:51.274 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-12-19T16:07:51.274 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T16:07:51.275 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:07:51.275 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T16:07:51.275 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:07:51.275 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T16:07:51.275 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42312sec preferred_lft 42312sec 2023-12-19T16:07:51.275 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-12-19T16:07:51.275 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:07:51.275 INFO:teuthology.orchestra.run.smithi151.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:07:51.275 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 76:29:7e:3b:25:e2 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:07:51.275 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T16:07:51.275 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:07:51.275 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::303e:89ff:fea5:6d7b/64 scope link 2023-12-19T16:07:51.275 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:07:51.275 INFO:teuthology.orchestra.run.smithi151.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:07:51.275 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 76:29:7e:3b:25:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T16:07:51.276 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::7429:7eff:fe3b:25e2/64 scope link 2023-12-19T16:07:51.276 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:07:51.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:51.277 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T16:07:51.373 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-12-19T16:07:51.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:51.378 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-12-19T16:07:51.426 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-12-19T16:07:51.426 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T16:07:51.427 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T16:07:51.427 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T16:07:51.427 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T16:07:51.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:51.427 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-19T16:07:51.427 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-19T16:07:51.427 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T16:07:51.427 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T16:07:51.427 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T16:07:51.427 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-19T16:07:51.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:51.599 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T16:07:51.649 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T16:07:51.649 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:07:51.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:51.649 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-12-19T16:07:51.746 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:07:51.746 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T16:07:51.799 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:07:51.800 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:07:51.800 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:07:51.849 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-19T16:07:51.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:51.849 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:07:51.987 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:07:51.987 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T16:07:51.988 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2023-12-19T16:07:52.011 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:07:52.011 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T16:07:52.011 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2023-12-19T16:07:52.011 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.78:3300,172.21.15.78:3301" 2023-12-19T16:07:52.011 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T16:07:52.035 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:07:52.035 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T16:07:52.035 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2023-12-19T16:07:52.035 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.78:3300,172.21.15.78:3301" 2023-12-19T16:07:52.035 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T16:07:52.036 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.78:6789,172.21.15.78:6790" 2023-12-19T16:07:52.036 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.78:6789,172.21.15.78:6790:/ 2023-12-19T16:07:52.036 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2" will pass to kernel 2023-12-19T16:07:52.038 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T16:07:52.038 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2023-12-19T16:07:52.038 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T16:07:52.038 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T16:07:52.038 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T16:07:52.042 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T16:07:52.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:52.042 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:07:52.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:52.123 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T16:07:52.179 INFO:teuthology.orchestra.run.smithi151.stdout:client4948 2023-12-19T16:07:52.179 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T16:07:52.179 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:07:52.226 DEBUG:teuthology.orchestra.run.smithi151:> mktemp -d --suffix=xfstests-dev 2023-12-19T16:07:52.325 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.t6fx4IVDVzxfstests-dev 2023-12-19T16:07:52.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:52.326 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.t6fx4IVDVzxfstests-dev) 2023-12-19T16:07:52.387 INFO:teuthology.orchestra.run.smithi151.stderr:Cloning into '/tmp/tmp.t6fx4IVDVzxfstests-dev'... 2023-12-19T16:07:53.526 DEBUG:teuthology.orchestra.run.smithi151:> mktemp -d --suffix=xfsprogs-dev 2023-12-19T16:07:53.579 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.LLmHOUESMaxfsprogs-dev 2023-12-19T16:07:53.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:53.580 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.LLmHOUESMaxfsprogs-dev) 2023-12-19T16:07:53.638 INFO:teuthology.orchestra.run.smithi151.stderr:Cloning into '/tmp/tmp.LLmHOUESMaxfsprogs-dev'... 2023-12-19T16:07:54.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:54.273 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-12-19T16:07:54.336 DEBUG:teuthology.orchestra.run.smithi151:> mktemp -d --suffix=test 2023-12-19T16:07:54.387 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.VQWFH9MHpotest 2023-12-19T16:07:54.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:07:54.387 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-12-19T16:07:54.443 DEBUG:teuthology.orchestra.run.smithi151:> mktemp -d --suffix=scratch 2023-12-19T16:07:54.496 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.QHjjk1hzmdscratch 2023-12-19T16:07:54.497 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2023-12-19T16:07:54.497 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel xfsprogs-qa-devel 2023-12-19T16:07:55.343 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:03:32 ago on Tue 19 Dec 2023 04:04:23 PM UTC. 2023-12-19T16:07:55.443 INFO:teuthology.orchestra.run.smithi151.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2023-12-19T16:07:55.443 INFO:teuthology.orchestra.run.smithi151.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2023-12-19T16:07:55.445 INFO:teuthology.orchestra.run.smithi151.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2023-12-19T16:07:55.445 INFO:teuthology.orchestra.run.smithi151.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2023-12-19T16:07:55.447 INFO:teuthology.orchestra.run.smithi151.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2023-12-19T16:07:55.449 INFO:teuthology.orchestra.run.smithi151.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2023-12-19T16:07:55.451 INFO:teuthology.orchestra.run.smithi151.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2023-12-19T16:07:55.452 INFO:teuthology.orchestra.run.smithi151.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2023-12-19T16:07:55.454 INFO:teuthology.orchestra.run.smithi151.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2023-12-19T16:07:55.455 INFO:teuthology.orchestra.run.smithi151.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2023-12-19T16:07:55.456 INFO:teuthology.orchestra.run.smithi151.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2023-12-19T16:07:55.457 INFO:teuthology.orchestra.run.smithi151.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2023-12-19T16:07:55.458 INFO:teuthology.orchestra.run.smithi151.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2023-12-19T16:07:55.459 INFO:teuthology.orchestra.run.smithi151.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2023-12-19T16:07:55.460 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2023-12-19T16:07:55.461 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T16:07:55.462 INFO:teuthology.orchestra.run.smithi151.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2023-12-19T16:07:55.463 INFO:teuthology.orchestra.run.smithi151.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-19T16:07:55.464 INFO:teuthology.orchestra.run.smithi151.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2023-12-19T16:07:55.465 INFO:teuthology.orchestra.run.smithi151.stdout:Package libuuid-devel-2.37.4-15.el9.x86_64 is already installed. 2023-12-19T16:07:55.466 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsprogs-devel-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T16:07:55.467 INFO:teuthology.orchestra.run.smithi151.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2023-12-19T16:07:55.472 INFO:teuthology.orchestra.run.smithi151.stdout:Package gettext-0.21-8.el9.x86_64 is already installed. 2023-12-19T16:07:55.480 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T16:07:55.539 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-12-19T16:07:55.542 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-12-19T16:07:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-12-19T16:07:55.543 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-12-19T16:07:55.543 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-12-19T16:07:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: device-mapper-devel x86_64 9:1.02.195-3.el9 crb 43 k 2023-12-19T16:07:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2023-12-19T16:07:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2023-12-19T16:07:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: indent x86_64 2.2.13-4.el9 epel 179 k 2023-12-19T16:07:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: inih-devel x86_64 49-6.el9 crb 11 k 2023-12-19T16:07:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: libblkid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 17 k 2023-12-19T16:07:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: libedit-devel x86_64 3.1-38.20210216cvs.el9 CentOS-AppStream 39 k 2023-12-19T16:07:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: libicu-devel x86_64 67.1-9.el9 CentOS-AppStream 830 k 2023-12-19T16:07:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: sqlite x86_64 3.34.1-6.el9 CentOS-AppStream 747 k 2023-12-19T16:07:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: userspace-rcu-devel x86_64 0.12.1-6.el9 crb 120 k 2023-12-19T16:07:55.543 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2023-12-19T16:07:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: cpp x86_64 11.4.1-2.3.el9 CentOS-AppStream 11 M 2023-12-19T16:07:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: e2fsprogs x86_64 1.46.5-4.el9 CentOS-BaseOS 1.0 M 2023-12-19T16:07:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: e2fsprogs-libs x86_64 1.46.5-4.el9 CentOS-BaseOS 221 k 2023-12-19T16:07:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: gcc x86_64 11.4.1-2.3.el9 CentOS-AppStream 32 M 2023-12-19T16:07:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: gcc-c++ x86_64 11.4.1-2.3.el9 CentOS-AppStream 13 M 2023-12-19T16:07:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: gcc-plugin-annobin x86_64 11.4.1-2.3.el9 CentOS-AppStream 47 k 2023-12-19T16:07:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: libcom_err x86_64 1.46.5-4.el9 CentOS-BaseOS 25 k 2023-12-19T16:07:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: libgcc x86_64 11.4.1-2.3.el9 CentOS-BaseOS 92 k 2023-12-19T16:07:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: libgomp x86_64 11.4.1-2.3.el9 CentOS-BaseOS 268 k 2023-12-19T16:07:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: libss x86_64 1.46.5-4.el9 CentOS-BaseOS 31 k 2023-12-19T16:07:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: libstdc++ x86_64 11.4.1-2.3.el9 CentOS-BaseOS 735 k 2023-12-19T16:07:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: libstdc++-devel x86_64 11.4.1-2.3.el9 CentOS-AppStream 2.2 M 2023-12-19T16:07:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: python-unversioned-command 2023-12-19T16:07:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: noarch 3.9.18-1.el9 CentOS-AppStream 8.8 k 2023-12-19T16:07:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3 x86_64 3.9.18-1.el9 CentOS-BaseOS 26 k 2023-12-19T16:07:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel x86_64 3.9.18-1.el9 CentOS-AppStream 204 k 2023-12-19T16:07:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-libs x86_64 3.9.18-1.el9 CentOS-BaseOS 7.3 M 2023-12-19T16:07:55.545 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-12-19T16:07:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2023-12-19T16:07:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: libselinux-devel x86_64 3.5-1.el9 CentOS-AppStream 114 k 2023-12-19T16:07:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: libsepol-devel x86_64 3.5-1.el9 CentOS-AppStream 40 k 2023-12-19T16:07:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-devel x86_64 10.40-2.el9 appstream 515 k 2023-12-19T16:07:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf16 x86_64 10.40-2.el9 appstream 217 k 2023-12-19T16:07:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf32 x86_64 10.40-2.el9 appstream 206 k 2023-12-19T16:07:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2023-12-19T16:07:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: systemd-devel x86_64 252-18.el9 CentOS-AppStream 482 k 2023-12-19T16:07:55.545 INFO:teuthology.orchestra.run.smithi151.stdout:Installing weak dependencies: 2023-12-19T16:07:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2023-12-19T16:07:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2023-12-19T16:07:55.546 INFO:teuthology.orchestra.run.smithi151.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2023-12-19T16:07:55.546 INFO:teuthology.orchestra.run.smithi151.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-12-19T16:07:55.546 INFO:teuthology.orchestra.run.smithi151.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-12-19T16:07:55.546 INFO:teuthology.orchestra.run.smithi151.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2023-12-19T16:07:55.546 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:07:55.546 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-12-19T16:07:55.546 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-12-19T16:07:55.546 INFO:teuthology.orchestra.run.smithi151.stdout:Install 24 Packages 2023-12-19T16:07:55.546 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 16 Packages 2023-12-19T16:07:55.546 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:07:55.547 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 78 M 2023-12-19T16:07:55.547 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-12-19T16:07:56.530 INFO:teuthology.orchestra.run.smithi151.stdout:(1/40): fio-engine-http-3.35-1.el9.x86_64.rpm 57 kB/s | 17 kB 00:00 2023-12-19T16:07:56.556 INFO:teuthology.orchestra.run.smithi151.stdout:(2/40): fio-engine-libaio-3.35-1.el9.x86_64.rpm 45 kB/s | 14 kB 00:00 2023-12-19T16:07:56.815 INFO:teuthology.orchestra.run.smithi151.stdout:(3/40): fio-engine-nbd-3.35-1.el9.x86_64.rpm 48 kB/s | 13 kB 00:00 2023-12-19T16:07:56.839 INFO:teuthology.orchestra.run.smithi151.stdout:(4/40): fio-engine-rados-3.35-1.el9.x86_64.rpm 52 kB/s | 15 kB 00:00 2023-12-19T16:07:57.057 INFO:teuthology.orchestra.run.smithi151.stdout:(5/40): fio-3.35-1.el9.x86_64.rpm 7.6 MB/s | 6.2 MB 00:00 2023-12-19T16:07:57.082 INFO:teuthology.orchestra.run.smithi151.stdout:(6/40): fio-engine-rbd-3.35-1.el9.x86_64.rpm 63 kB/s | 15 kB 00:00 2023-12-19T16:07:57.107 INFO:teuthology.orchestra.run.smithi151.stdout:(7/40): fio-engine-rdma-3.35-1.el9.x86_64.rpm 73 kB/s | 20 kB 00:00 2023-12-19T16:07:57.149 INFO:teuthology.orchestra.run.smithi151.stdout:(8/40): libblkid-devel-2.37.4-15.el9.x86_64.rpm 416 kB/s | 17 kB 00:00 2023-12-19T16:07:57.175 INFO:teuthology.orchestra.run.smithi151.stdout:(9/40): libedit-devel-3.1-38.20210216cvs.el9.x8 594 kB/s | 39 kB 00:00 2023-12-19T16:07:57.216 INFO:teuthology.orchestra.run.smithi151.stdout:(10/40): libicu-devel-67.1-9.el9.x86_64.rpm 7.6 MB/s | 830 kB 00:00 2023-12-19T16:07:57.242 INFO:teuthology.orchestra.run.smithi151.stdout:(11/40): libselinux-devel-3.5-1.el9.x86_64.rpm 1.9 MB/s | 114 kB 00:00 2023-12-19T16:07:57.267 INFO:teuthology.orchestra.run.smithi151.stdout:(12/40): libsepol-devel-3.5-1.el9.x86_64.rpm 468 kB/s | 40 kB 00:00 2023-12-19T16:07:57.309 INFO:teuthology.orchestra.run.smithi151.stdout:(13/40): sqlite-3.34.1-6.el9.x86_64.rpm 8.1 MB/s | 747 kB 00:00 2023-12-19T16:07:57.334 INFO:teuthology.orchestra.run.smithi151.stdout:(14/40): rmt-1.6-6.el9.x86_64.rpm 763 kB/s | 45 kB 00:00 2023-12-19T16:07:57.368 INFO:teuthology.orchestra.run.smithi151.stdout:(15/40): systemd-devel-252-18.el9.x86_64.rpm 5.1 MB/s | 482 kB 00:00 2023-12-19T16:07:57.560 INFO:teuthology.orchestra.run.smithi151.stdout:(16/40): libnbd-1.18.1-3.el9.x86_64.rpm 671 kB/s | 166 kB 00:00 2023-12-19T16:07:57.594 INFO:teuthology.orchestra.run.smithi151.stdout:(17/40): pcre2-utf16-10.40-2.el9.x86_64.rpm 964 kB/s | 217 kB 00:00 2023-12-19T16:07:57.627 INFO:teuthology.orchestra.run.smithi151.stdout:(18/40): pcre2-devel-10.40-2.el9.x86_64.rpm 1.7 MB/s | 515 kB 00:00 2023-12-19T16:07:57.653 INFO:teuthology.orchestra.run.smithi151.stdout:(19/40): pcre2-utf32-10.40-2.el9.x86_64.rpm 2.2 MB/s | 206 kB 00:00 2023-12-19T16:07:57.694 INFO:teuthology.orchestra.run.smithi151.stdout:(20/40): inih-devel-49-6.el9.x86_64.rpm 164 kB/s | 11 kB 00:00 2023-12-19T16:07:57.720 INFO:teuthology.orchestra.run.smithi151.stdout:(21/40): device-mapper-devel-1.02.195-3.el9.x86 347 kB/s | 43 kB 00:00 2023-12-19T16:07:57.804 INFO:teuthology.orchestra.run.smithi151.stdout:(22/40): userspace-rcu-devel-0.12.1-6.el9.x86_6 804 kB/s | 120 kB 00:00 2023-12-19T16:07:58.096 INFO:teuthology.orchestra.run.smithi151.stdout:(23/40): cpp-11.4.1-2.3.el9.x86_64.rpm 36 MB/s | 11 MB 00:00 2023-12-19T16:07:58.554 INFO:teuthology.orchestra.run.smithi151.stdout:(24/40): dump-0.4-0.51.b47.el9.x86_64.rpm 102 kB/s | 88 kB 00:00 2023-12-19T16:07:58.564 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:07:58.567 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:07:58.569 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:07:58.947 INFO:teuthology.orchestra.run.smithi151.stdout:(25/40): gcc-11.4.1-2.3.el9.x86_64.rpm 38 MB/s | 32 MB 00:00 2023-12-19T16:07:59.047 INFO:teuthology.orchestra.run.smithi151.stdout:(26/40): indent-2.2.13-4.el9.x86_64.rpm 135 kB/s | 179 kB 00:01 2023-12-19T16:07:59.348 INFO:teuthology.orchestra.run.smithi151.stdout:(27/40): gcc-c++-11.4.1-2.3.el9.x86_64.rpm 16 MB/s | 13 MB 00:00 2023-12-19T16:07:59.381 INFO:teuthology.orchestra.run.smithi151.stdout:(28/40): gcc-plugin-annobin-11.4.1-2.3.el9.x86_ 110 kB/s | 47 kB 00:00 2023-12-19T16:07:59.465 INFO:teuthology.orchestra.run.smithi151.stdout:(29/40): libstdc++-devel-11.4.1-2.3.el9.x86_64. 5.4 MB/s | 2.2 MB 00:00 2023-12-19T16:07:59.482 INFO:teuthology.orchestra.run.smithi151.stdout:(30/40): python-unversioned-command-3.9.18-1.el 101 kB/s | 8.8 kB 00:00 2023-12-19T16:07:59.507 INFO:teuthology.orchestra.run.smithi151.stdout:(31/40): python3-devel-3.9.18-1.el9.x86_64.rpm 1.8 MB/s | 204 kB 00:00 2023-12-19T16:07:59.558 INFO:teuthology.orchestra.run.smithi151.stdout:(32/40): e2fsprogs-1.46.5-4.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2023-12-19T16:07:59.591 INFO:teuthology.orchestra.run.smithi151.stdout:(33/40): e2fsprogs-libs-1.46.5-4.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2023-12-19T16:07:59.626 INFO:teuthology.orchestra.run.smithi151.stdout:(34/40): libcom_err-1.46.5-4.el9.x86_64.rpm 229 kB/s | 25 kB 00:00 2023-12-19T16:07:59.659 INFO:teuthology.orchestra.run.smithi151.stdout:(35/40): libgcc-11.4.1-2.3.el9.x86_64.rpm 945 kB/s | 92 kB 00:00 2023-12-19T16:07:59.692 INFO:teuthology.orchestra.run.smithi151.stdout:(36/40): libgomp-11.4.1-2.3.el9.x86_64.rpm 4.1 MB/s | 268 kB 00:00 2023-12-19T16:07:59.726 INFO:teuthology.orchestra.run.smithi151.stdout:(37/40): libss-1.46.5-4.el9.x86_64.rpm 315 kB/s | 31 kB 00:00 2023-12-19T16:07:59.776 INFO:teuthology.orchestra.run.smithi151.stdout:(38/40): libstdc++-11.4.1-2.3.el9.x86_64.rpm 6.2 MB/s | 735 kB 00:00 2023-12-19T16:07:59.826 INFO:teuthology.orchestra.run.smithi151.stdout:(39/40): python3-3.9.18-1.el9.x86_64.rpm 276 kB/s | 26 kB 00:00 2023-12-19T16:08:00.077 INFO:teuthology.orchestra.run.smithi151.stdout:(40/40): python3-libs-3.9.18-1.el9.x86_64.rpm 21 MB/s | 7.3 MB 00:00 2023-12-19T16:08:00.083 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-12-19T16:08:00.083 INFO:teuthology.orchestra.run.smithi151.stdout:Total 17 MB/s | 78 MB 00:04 2023-12-19T16:08:00.361 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-12-19T16:08:00.695 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-12-19T16:08:00.696 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-12-19T16:08:01.536 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-12-19T16:08:01.537 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-12-19T16:08:03.735 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-12-19T16:08:03.804 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libcom_err-1.46.5-4.el9.x86_64 1/56 2023-12-19T16:08:03.845 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libgcc-11.4.1-2.3.el9.x86_64 2/56 2023-12-19T16:08:03.957 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libgcc-11.4.1-2.3.el9.x86_64 2/56 2023-12-19T16:08:04.045 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libstdc++-11.4.1-2.3.el9.x86_64 3/56 2023-12-19T16:08:04.794 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : e2fsprogs-libs-1.46.5-4.el9.x86_64 4/56 2023-12-19T16:08:04.873 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libstdc++-devel-11.4.1-2.3.el9.x86_64 5/56 2023-12-19T16:08:06.460 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libss-1.46.5-4.el9.x86_64 6/56 2023-12-19T16:08:06.623 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : python3-libs-3.9.18-1.el9.x86_64 7/56 2023-12-19T16:08:06.650 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : python3-3.9.18-1.el9.x86_64 8/56 2023-12-19T16:08:06.688 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : python-unversioned-command-3.9.18-1.el9.noarch 9/56 2023-12-19T16:08:07.022 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libgomp-11.4.1-2.3.el9.x86_64 10/56 2023-12-19T16:08:08.110 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : cpp-11.4.1-2.3.el9.x86_64 11/56 2023-12-19T16:08:08.366 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : gcc-11.4.1-2.3.el9.x86_64 12/56 2023-12-19T16:08:08.447 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: gcc-11.4.1-2.3.el9.x86_64 12/56 2023-12-19T16:08:08.484 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-utf32-10.40-2.el9.x86_64 13/56 2023-12-19T16:08:08.661 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-utf16-10.40-2.el9.x86_64 14/56 2023-12-19T16:08:08.729 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-devel-10.40-2.el9.x86_64 15/56 2023-12-19T16:08:08.756 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 16/56 2023-12-19T16:08:08.816 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 17/56 2023-12-19T16:08:08.850 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 18/56 2023-12-19T16:08:08.885 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 19/56 2023-12-19T16:08:08.918 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 20/56 2023-12-19T16:08:08.946 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 21/56 2023-12-19T16:08:09.205 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 22/56 2023-12-19T16:08:09.250 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fio-3.35-1.el9.x86_64 23/56 2023-12-19T16:08:09.718 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rmt-2:1.6-6.el9.x86_64 24/56 2023-12-19T16:08:09.782 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : systemd-devel-252-18.el9.x86_64 25/56 2023-12-19T16:08:09.930 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libsepol-devel-3.5-1.el9.x86_64 26/56 2023-12-19T16:08:09.963 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libselinux-devel-3.5-1.el9.x86_64 27/56 2023-12-19T16:08:09.994 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : device-mapper-devel-9:1.02.195-3.el9.x86_64 28/56 2023-12-19T16:08:10.453 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 29/56 2023-12-19T16:08:10.531 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : gcc-c++-11.4.1-2.3.el9.x86_64 30/56 2023-12-19T16:08:10.571 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 31/56 2023-12-19T16:08:10.760 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 31/56 2023-12-19T16:08:10.899 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : python3-devel-3.9.18-1.el9.x86_64 32/56 2023-12-19T16:08:11.096 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : e2fsprogs-1.46.5-4.el9.x86_64 33/56 2023-12-19T16:08:11.231 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : indent-2.2.13-4.el9.x86_64 34/56 2023-12-19T16:08:11.263 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : userspace-rcu-devel-0.12.1-6.el9.x86_64 35/56 2023-12-19T16:08:11.300 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : inih-devel-49-6.el9.x86_64 36/56 2023-12-19T16:08:11.636 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : sqlite-3.34.1-6.el9.x86_64 37/56 2023-12-19T16:08:11.687 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libicu-devel-67.1-9.el9.x86_64 38/56 2023-12-19T16:08:11.718 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libedit-devel-3.1-38.20210216cvs.el9.x86_64 39/56 2023-12-19T16:08:11.745 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libblkid-devel-2.37.4-15.el9.x86_64 40/56 2023-12-19T16:08:11.787 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 41/56 2023-12-19T16:08:11.825 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 42/56 2023-12-19T16:08:11.861 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 43/56 2023-12-19T16:08:11.894 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 44/56 2023-12-19T16:08:11.920 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 45/56 2023-12-19T16:08:11.921 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 46/56 2023-12-19T16:08:12.028 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 46/56 2023-12-19T16:08:12.071 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 47/56 2023-12-19T16:08:12.104 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 48/56 2023-12-19T16:08:12.179 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 49/56 2023-12-19T16:08:12.231 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 50/56 2023-12-19T16:08:12.264 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 51/56 2023-12-19T16:08:12.264 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 52/56 2023-12-19T16:08:12.375 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 52/56 2023-12-19T16:08:12.400 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 53/56 2023-12-19T16:08:12.441 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 54/56 2023-12-19T16:08:12.582 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 55/56 2023-12-19T16:08:12.711 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 56/56 2023-12-19T16:08:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: python3-libs-3.9.17-2.el9.x86_64 56/56 2023-12-19T16:08:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fio-3.35-1.el9.x86_64 1/56 2023-12-19T16:08:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/56 2023-12-19T16:08:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/56 2023-12-19T16:08:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/56 2023-12-19T16:08:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/56 2023-12-19T16:08:14.820 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/56 2023-12-19T16:08:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/56 2023-12-19T16:08:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libblkid-devel-2.37.4-15.el9.x86_64 8/56 2023-12-19T16:08:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libedit-devel-3.1-38.20210216cvs.el9.x86_64 9/56 2023-12-19T16:08:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libicu-devel-67.1-9.el9.x86_64 10/56 2023-12-19T16:08:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libselinux-devel-3.5-1.el9.x86_64 11/56 2023-12-19T16:08:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libsepol-devel-3.5-1.el9.x86_64 12/56 2023-12-19T16:08:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : sqlite-3.34.1-6.el9.x86_64 13/56 2023-12-19T16:08:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : systemd-devel-252-18.el9.x86_64 14/56 2023-12-19T16:08:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 15/56 2023-12-19T16:08:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 16/56 2023-12-19T16:08:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-devel-10.40-2.el9.x86_64 17/56 2023-12-19T16:08:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-utf16-10.40-2.el9.x86_64 18/56 2023-12-19T16:08:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-utf32-10.40-2.el9.x86_64 19/56 2023-12-19T16:08:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : device-mapper-devel-9:1.02.195-3.el9.x86_64 20/56 2023-12-19T16:08:14.821 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : inih-devel-49-6.el9.x86_64 21/56 2023-12-19T16:08:14.822 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : userspace-rcu-devel-0.12.1-6.el9.x86_64 22/56 2023-12-19T16:08:14.822 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 23/56 2023-12-19T16:08:14.822 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : indent-2.2.13-4.el9.x86_64 24/56 2023-12-19T16:08:14.822 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cpp-11.4.1-2.3.el9.x86_64 25/56 2023-12-19T16:08:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 26/56 2023-12-19T16:08:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gcc-11.4.1-2.3.el9.x86_64 27/56 2023-12-19T16:08:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 28/56 2023-12-19T16:08:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gcc-c++-11.4.1-2.3.el9.x86_64 29/56 2023-12-19T16:08:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 30/56 2023-12-19T16:08:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 31/56 2023-12-19T16:08:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 32/56 2023-12-19T16:08:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libstdc++-devel-11.4.1-2.3.el9.x86_64 33/56 2023-12-19T16:08:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 34/56 2023-12-19T16:08:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python-unversioned-command-3.9.18-1.el9.noarch 35/56 2023-12-19T16:08:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 36/56 2023-12-19T16:08:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-devel-3.9.18-1.el9.x86_64 37/56 2023-12-19T16:08:14.825 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 38/56 2023-12-19T16:08:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : e2fsprogs-1.46.5-4.el9.x86_64 39/56 2023-12-19T16:08:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 40/56 2023-12-19T16:08:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : e2fsprogs-libs-1.46.5-4.el9.x86_64 41/56 2023-12-19T16:08:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 42/56 2023-12-19T16:08:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcom_err-1.46.5-4.el9.x86_64 43/56 2023-12-19T16:08:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 44/56 2023-12-19T16:08:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgcc-11.4.1-2.3.el9.x86_64 45/56 2023-12-19T16:08:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 46/56 2023-12-19T16:08:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgomp-11.4.1-2.3.el9.x86_64 47/56 2023-12-19T16:08:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 48/56 2023-12-19T16:08:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libss-1.46.5-4.el9.x86_64 49/56 2023-12-19T16:08:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libss-1.46.5-3.el9.x86_64 50/56 2023-12-19T16:08:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libstdc++-11.4.1-2.3.el9.x86_64 51/56 2023-12-19T16:08:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 52/56 2023-12-19T16:08:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-3.9.18-1.el9.x86_64 53/56 2023-12-19T16:08:14.827 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-3.9.17-2.el9.x86_64 54/56 2023-12-19T16:08:14.827 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-libs-3.9.18-1.el9.x86_64 55/56 2023-12-19T16:08:15.659 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 56/56 2023-12-19T16:08:15.660 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:08:15.660 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2023-12-19T16:08:15.660 INFO:teuthology.orchestra.run.smithi151.stdout: cpp-11.4.1-2.3.el9.x86_64 2023-12-19T16:08:15.660 INFO:teuthology.orchestra.run.smithi151.stdout: e2fsprogs-1.46.5-4.el9.x86_64 2023-12-19T16:08:15.660 INFO:teuthology.orchestra.run.smithi151.stdout: e2fsprogs-libs-1.46.5-4.el9.x86_64 2023-12-19T16:08:15.660 INFO:teuthology.orchestra.run.smithi151.stdout: gcc-11.4.1-2.3.el9.x86_64 2023-12-19T16:08:15.660 INFO:teuthology.orchestra.run.smithi151.stdout: gcc-c++-11.4.1-2.3.el9.x86_64 2023-12-19T16:08:15.660 INFO:teuthology.orchestra.run.smithi151.stdout: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 2023-12-19T16:08:15.660 INFO:teuthology.orchestra.run.smithi151.stdout: libcom_err-1.46.5-4.el9.x86_64 2023-12-19T16:08:15.660 INFO:teuthology.orchestra.run.smithi151.stdout: libgcc-11.4.1-2.3.el9.x86_64 2023-12-19T16:08:15.660 INFO:teuthology.orchestra.run.smithi151.stdout: libgomp-11.4.1-2.3.el9.x86_64 2023-12-19T16:08:15.660 INFO:teuthology.orchestra.run.smithi151.stdout: libss-1.46.5-4.el9.x86_64 2023-12-19T16:08:15.661 INFO:teuthology.orchestra.run.smithi151.stdout: libstdc++-11.4.1-2.3.el9.x86_64 2023-12-19T16:08:15.661 INFO:teuthology.orchestra.run.smithi151.stdout: libstdc++-devel-11.4.1-2.3.el9.x86_64 2023-12-19T16:08:15.661 INFO:teuthology.orchestra.run.smithi151.stdout: python-unversioned-command-3.9.18-1.el9.noarch 2023-12-19T16:08:15.661 INFO:teuthology.orchestra.run.smithi151.stdout: python3-3.9.18-1.el9.x86_64 2023-12-19T16:08:15.661 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel-3.9.18-1.el9.x86_64 2023-12-19T16:08:15.661 INFO:teuthology.orchestra.run.smithi151.stdout: python3-libs-3.9.18-1.el9.x86_64 2023-12-19T16:08:15.661 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-12-19T16:08:15.661 INFO:teuthology.orchestra.run.smithi151.stdout: device-mapper-devel-9:1.02.195-3.el9.x86_64 2023-12-19T16:08:15.661 INFO:teuthology.orchestra.run.smithi151.stdout: dump-1:0.4-0.51.b47.el9.x86_64 2023-12-19T16:08:15.661 INFO:teuthology.orchestra.run.smithi151.stdout: fio-3.35-1.el9.x86_64 2023-12-19T16:08:15.661 INFO:teuthology.orchestra.run.smithi151.stdout: fio-engine-http-3.35-1.el9.x86_64 2023-12-19T16:08:15.661 INFO:teuthology.orchestra.run.smithi151.stdout: fio-engine-libaio-3.35-1.el9.x86_64 2023-12-19T16:08:15.661 INFO:teuthology.orchestra.run.smithi151.stdout: fio-engine-nbd-3.35-1.el9.x86_64 2023-12-19T16:08:15.661 INFO:teuthology.orchestra.run.smithi151.stdout: fio-engine-rados-3.35-1.el9.x86_64 2023-12-19T16:08:15.662 INFO:teuthology.orchestra.run.smithi151.stdout: fio-engine-rbd-3.35-1.el9.x86_64 2023-12-19T16:08:15.662 INFO:teuthology.orchestra.run.smithi151.stdout: fio-engine-rdma-3.35-1.el9.x86_64 2023-12-19T16:08:15.662 INFO:teuthology.orchestra.run.smithi151.stdout: indent-2.2.13-4.el9.x86_64 2023-12-19T16:08:15.662 INFO:teuthology.orchestra.run.smithi151.stdout: inih-devel-49-6.el9.x86_64 2023-12-19T16:08:15.662 INFO:teuthology.orchestra.run.smithi151.stdout: libblkid-devel-2.37.4-15.el9.x86_64 2023-12-19T16:08:15.662 INFO:teuthology.orchestra.run.smithi151.stdout: libedit-devel-3.1-38.20210216cvs.el9.x86_64 2023-12-19T16:08:15.662 INFO:teuthology.orchestra.run.smithi151.stdout: libicu-devel-67.1-9.el9.x86_64 2023-12-19T16:08:15.662 INFO:teuthology.orchestra.run.smithi151.stdout: libnbd-1.18.1-3.el9.x86_64 2023-12-19T16:08:15.662 INFO:teuthology.orchestra.run.smithi151.stdout: libselinux-devel-3.5-1.el9.x86_64 2023-12-19T16:08:15.662 INFO:teuthology.orchestra.run.smithi151.stdout: libsepol-devel-3.5-1.el9.x86_64 2023-12-19T16:08:15.662 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-devel-10.40-2.el9.x86_64 2023-12-19T16:08:15.662 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf16-10.40-2.el9.x86_64 2023-12-19T16:08:15.662 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf32-10.40-2.el9.x86_64 2023-12-19T16:08:15.662 INFO:teuthology.orchestra.run.smithi151.stdout: rmt-2:1.6-6.el9.x86_64 2023-12-19T16:08:15.663 INFO:teuthology.orchestra.run.smithi151.stdout: sqlite-3.34.1-6.el9.x86_64 2023-12-19T16:08:15.663 INFO:teuthology.orchestra.run.smithi151.stdout: systemd-devel-252-18.el9.x86_64 2023-12-19T16:08:15.663 INFO:teuthology.orchestra.run.smithi151.stdout: userspace-rcu-devel-0.12.1-6.el9.x86_64 2023-12-19T16:08:15.663 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:08:15.663 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-12-19T16:08:16.243 DEBUG:teuthology.orchestra.run.smithi151:> sudo useradd -m fsgqa 2023-12-19T16:08:16.316 INFO:teuthology.orchestra.run.smithi151.stderr:useradd: user 'fsgqa' already exists 2023-12-19T16:08:16.319 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-19T16:08:16.319 DEBUG:teuthology.orchestra.run.smithi151:> sudo groupadd fsgqa 2023-12-19T16:08:16.392 INFO:teuthology.orchestra.run.smithi151.stderr:groupadd: group 'fsgqa' already exists 2023-12-19T16:08:16.395 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-19T16:08:16.395 DEBUG:teuthology.orchestra.run.smithi151:> sudo useradd fsgqa2 2023-12-19T16:08:17.058 DEBUG:teuthology.orchestra.run.smithi151:> sudo useradd 123456-fsgqa 2023-12-19T16:08:17.696 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-12-19T16:08:17.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.812+0000 7f96f0555640 1 Processor -- start 2023-12-19T16:08:17.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.812+0000 7f96f0555640 1 -- start start 2023-12-19T16:08:17.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.812+0000 7f96f0555640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96e80bcdd0 0x7f96e80b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:08:17.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.813+0000 7f96f0555640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96e80b64c0 0x7f96e8144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:08:17.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.813+0000 7f96f0555640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e80bc6b0 con 0x7f96e8144cd0 2023-12-19T16:08:17.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.813+0000 7f96f0555640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e80b6900 con 0x7f96e80b64c0 2023-12-19T16:08:17.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.813+0000 7f96f0555640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80a59f0 con 0x7f96e80bcdd0 2023-12-19T16:08:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.813+0000 7f96edaf0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96e80b64c0 0x7f96e8144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:08:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.813+0000 7f96eeaf2640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f96e8144cd0 0x7f96e814e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39650/0 (socket says 172.21.15.37:39650) 2023-12-19T16:08:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.813+0000 7f96eeaf2640 1 -- 172.21.15.37:0/1123368917 learned_addr learned my addr 172.21.15.37:0/1123368917 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T16:08:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.813+0000 7f96ee2f1640 1 --2- 172.21.15.37:0/1123368917 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96e80bcdd0 0x7f96e80b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:08:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.813+0000 7f96edaf0640 1 -- 172.21.15.37:0/1123368917 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96e80bcdd0 msgr2=0x7f96e80b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:08:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.813+0000 7f96edaf0640 1 --2- 172.21.15.37:0/1123368917 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96e80bcdd0 0x7f96e80b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:08:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.813+0000 7f96edaf0640 1 -- 172.21.15.37:0/1123368917 >> v1:172.21.15.37:6789/0 conn(0x7f96e8144cd0 legacy=0x7f96e814e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:08:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.813+0000 7f96edaf0640 1 -- 172.21.15.37:0/1123368917 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e80bc0a0 con 0x7f96e80b64c0 2023-12-19T16:08:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.813+0000 7f96ed2ef640 1 -- 172.21.15.37:0/1123368917 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521580492 0 0) 0x7f96e80bc6b0 con 0x7f96e8144cd0 2023-12-19T16:08:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.814+0000 7f96edaf0640 1 --2- 172.21.15.37:0/1123368917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96e80b64c0 0x7f96e8144790 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f96d80097a0 tx=0x7f96d802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b1f7e41f4c01f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:08:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.814+0000 7f96ed2ef640 1 -- 172.21.15.37:0/1123368917 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8030610 con 0x7f96e80b64c0 2023-12-19T16:08:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.814+0000 7f96ed2ef640 1 -- 172.21.15.37:0/1123368917 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d8030770 con 0x7f96e80b64c0 2023-12-19T16:08:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.814+0000 7f96ed2ef640 1 -- 172.21.15.37:0/1123368917 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8030b00 con 0x7f96e80b64c0 2023-12-19T16:08:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.814+0000 7f96f0555640 1 -- 172.21.15.37:0/1123368917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96e80b64c0 msgr2=0x7f96e8144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:08:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.814+0000 7f96f0555640 1 --2- 172.21.15.37:0/1123368917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96e80b64c0 0x7f96e8144790 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f96d80097a0 tx=0x7f96d802b960 comp rx=0 tx=0).stop 2023-12-19T16:08:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.815+0000 7f96f0555640 1 -- 172.21.15.37:0/1123368917 shutdown_connections 2023-12-19T16:08:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.815+0000 7f96f0555640 1 --2- 172.21.15.37:0/1123368917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96e80b64c0 0x7f96e8144790 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:08:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.815+0000 7f96f0555640 1 --2- 172.21.15.37:0/1123368917 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96e80bcdd0 0x7f96e80b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:08:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.815+0000 7f96f0555640 1 -- 172.21.15.37:0/1123368917 >> 172.21.15.37:0/1123368917 conn(0x7f96e8071e60 msgr2=0x7f96e80c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:08:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.815+0000 7f96f0555640 1 -- 172.21.15.37:0/1123368917 shutdown_connections 2023-12-19T16:08:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.815+0000 7f96f0555640 1 -- 172.21.15.37:0/1123368917 wait complete. 2023-12-19T16:08:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.816+0000 7f96f0555640 1 Processor -- start 2023-12-19T16:08:17.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.816+0000 7f96f0555640 1 -- start start 2023-12-19T16:08:17.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.816+0000 7f96f0555640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96e80b64c0 0x7f96e80bec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:08:17.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.816+0000 7f96f0555640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e80bcdd0 0x7f96e81dfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:08:17.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.816+0000 7f96f0555640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96e8144cd0 0x7f96e814ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:08:17.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.816+0000 7f96f0555640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e8147c60 con 0x7f96e80b64c0 2023-12-19T16:08:17.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.816+0000 7f96f0555640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e81e3f90 con 0x7f96e80bcdd0 2023-12-19T16:08:17.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.816+0000 7f96f0555640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e81d4440 con 0x7f96e8144cd0 2023-12-19T16:08:17.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.817+0000 7f96ee2f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96e80b64c0 0x7f96e80bec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:08:17.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.817+0000 7f96ee2f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96e80b64c0 0x7f96e80bec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45244/0 (socket says 172.21.15.37:45244) 2023-12-19T16:08:17.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.817+0000 7f96ee2f1640 1 -- 172.21.15.37:0/2018717548 learned_addr learned my addr 172.21.15.37:0/2018717548 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:08:17.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.817+0000 7f96eeaf2640 1 --2- 172.21.15.37:0/2018717548 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96e8144cd0 0x7f96e814ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:08:17.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.817+0000 7f96ee2f1640 1 -- 172.21.15.37:0/2018717548 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96e8144cd0 msgr2=0x7f96e814ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:08:17.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.817+0000 7f96edaf0640 1 --2- 172.21.15.37:0/2018717548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e80bcdd0 0x7f96e81dfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:08:17.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.817+0000 7f96ee2f1640 1 --2- 172.21.15.37:0/2018717548 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96e8144cd0 0x7f96e814ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:08:17.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.817+0000 7f96ee2f1640 1 -- 172.21.15.37:0/2018717548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e80bcdd0 msgr2=0x7f96e81dfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:08:17.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.817+0000 7f96ee2f1640 1 --2- 172.21.15.37:0/2018717548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e80bcdd0 0x7f96e81dfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:08:17.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.817+0000 7f96ee2f1640 1 -- 172.21.15.37:0/2018717548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d8009400 con 0x7f96e80b64c0 2023-12-19T16:08:17.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.817+0000 7f96edaf0640 1 --2- 172.21.15.37:0/2018717548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e80bcdd0 0x7f96e81dfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:08:17.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.817+0000 7f96eeaf2640 1 --2- 172.21.15.37:0/2018717548 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96e8144cd0 0x7f96e814ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:08:17.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.817+0000 7f96ee2f1640 1 --2- 172.21.15.37:0/2018717548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96e80b64c0 0x7f96e80bec70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f96e400d800 tx=0x7f96e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:08:17.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.817+0000 7f96deffd640 1 -- 172.21.15.37:0/2018717548 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e400b6c0 con 0x7f96e80b64c0 2023-12-19T16:08:17.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.817+0000 7f96deffd640 1 -- 172.21.15.37:0/2018717548 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e400b820 con 0x7f96e80b64c0 2023-12-19T16:08:17.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.817+0000 7f96f0555640 1 -- 172.21.15.37:0/2018717548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e80bfed0 con 0x7f96e80b64c0 2023-12-19T16:08:17.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.817+0000 7f96deffd640 1 -- 172.21.15.37:0/2018717548 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e400bbb0 con 0x7f96e80b64c0 2023-12-19T16:08:17.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.817+0000 7f96f0555640 1 -- 172.21.15.37:0/2018717548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e81e34b0 con 0x7f96e80b64c0 2023-12-19T16:08:17.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.818+0000 7f96f0555640 1 -- 172.21.15.37:0/2018717548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e804e840 con 0x7f96e80b64c0 2023-12-19T16:08:17.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.819+0000 7f96deffd640 1 -- 172.21.15.37:0/2018717548 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f96e400bd10 con 0x7f96e80b64c0 2023-12-19T16:08:17.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.819+0000 7f96deffd640 1 --2- 172.21.15.37:0/2018717548 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f96cc06a430 0x7f96cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:08:17.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.819+0000 7f96deffd640 1 -- 172.21.15.37:0/2018717548 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96e4088ed0 con 0x7f96e80b64c0 2023-12-19T16:08:17.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.819+0000 7f96edaf0640 1 --2- 172.21.15.37:0/2018717548 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f96cc06a430 0x7f96cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:08:17.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.820+0000 7f96edaf0640 1 --2- 172.21.15.37:0/2018717548 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f96cc06a430 0x7f96cc06c8f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f96d8036000 tx=0x7f96d803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:08:17.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:17.824+0000 7f96deffd640 1 -- 172.21.15.37:0/2018717548 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f96e4054430 con 0x7f96e80b64c0 2023-12-19T16:08:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.071+0000 7f96f0555640 1 -- 172.21.15.37:0/2018717548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f96e80b7430 con 0x7f96e80b64c0 2023-12-19T16:08:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.071+0000 7f96deffd640 1 -- 172.21.15.37:0/2018717548 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7f96e4057a50 con 0x7f96e80b64c0 2023-12-19T16:08:18.074 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:08:18.075 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","modified":"2023-12-19T16:06:00.058907Z","created":"2023-12-19T16:06:00.058907Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3301","nonce":0},{"type":"v1","addr":"172.21.15.78:6790","nonce":0}]},"addr":"172.21.15.78:6790/0","public_addr":"172.21.15.78:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-12-19T16:08:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:dumped monmap epoch 1 2023-12-19T16:08:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.073+0000 7f96f0555640 1 -- 172.21.15.37:0/2018717548 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f96cc06a430 msgr2=0x7f96cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:08:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.073+0000 7f96f0555640 1 --2- 172.21.15.37:0/2018717548 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f96cc06a430 0x7f96cc06c8f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f96d8036000 tx=0x7f96d803b040 comp rx=0 tx=0).stop 2023-12-19T16:08:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.073+0000 7f96f0555640 1 -- 172.21.15.37:0/2018717548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96e80b64c0 msgr2=0x7f96e80bec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:08:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.073+0000 7f96f0555640 1 --2- 172.21.15.37:0/2018717548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96e80b64c0 0x7f96e80bec70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f96e400d800 tx=0x7f96e400dcc0 comp rx=0 tx=0).stop 2023-12-19T16:08:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.073+0000 7f96f0555640 1 -- 172.21.15.37:0/2018717548 shutdown_connections 2023-12-19T16:08:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.073+0000 7f96f0555640 1 --2- 172.21.15.37:0/2018717548 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f96cc06a430 0x7f96cc06c8f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:08:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.073+0000 7f96f0555640 1 --2- 172.21.15.37:0/2018717548 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96e8144cd0 0x7f96e814ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:08:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.073+0000 7f96f0555640 1 --2- 172.21.15.37:0/2018717548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96e80bcdd0 0x7f96e81dfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:08:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.073+0000 7f96f0555640 1 --2- 172.21.15.37:0/2018717548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96e80b64c0 0x7f96e80bec70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:08:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.073+0000 7f96f0555640 1 -- 172.21.15.37:0/2018717548 >> 172.21.15.37:0/2018717548 conn(0x7f96e8071e60 msgr2=0x7f96e8141860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:08:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.073+0000 7f96f0555640 1 -- 172.21.15.37:0/2018717548 shutdown_connections 2023-12-19T16:08:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.073+0000 7f96f0555640 1 -- 172.21.15.37:0/2018717548 wait complete. 2023-12-19T16:08:18.087 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-12-19T16:08:18.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.190+0000 7f9fb659f640 1 Processor -- start 2023-12-19T16:08:18.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.190+0000 7f9fb659f640 1 -- start start 2023-12-19T16:08:18.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.191+0000 7f9fb659f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9fb0141cb0 0x7f9fb014ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:08:18.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.191+0000 7f9fb659f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9fb006fc10 0x7f9fb00b9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:08:18.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.191+0000 7f9fb659f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb0070480 con 0x7f9fb006af20 2023-12-19T16:08:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.191+0000 7f9fb659f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb0071080 con 0x7f9fb0141cb0 2023-12-19T16:08:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.191+0000 7f9fb659f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb00701a0 con 0x7f9fb006fc10 2023-12-19T16:08:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.191+0000 7f9faf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9fb0141cb0 0x7f9fb014ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:08:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.191+0000 7f9faf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9fb0141cb0 0x7f9fb014ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45248/0 (socket says 172.21.15.37:45248) 2023-12-19T16:08:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.191+0000 7f9faf7fe640 1 -- 172.21.15.37:0/337434150 learned_addr learned my addr 172.21.15.37:0/337434150 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:08:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.191+0000 7f9fb4b3c640 1 --2- 172.21.15.37:0/337434150 >> v2:172.21.15.78:3300/0 conn(0x7f9fb006fc10 0x7f9fb00b9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:08:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.191+0000 7f9faf7fe640 1 -- 172.21.15.37:0/337434150 >> v2:172.21.15.78:3300/0 conn(0x7f9fb006fc10 msgr2=0x7f9fb00b9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:08:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.191+0000 7f9faf7fe640 1 --2- 172.21.15.37:0/337434150 >> v2:172.21.15.78:3300/0 conn(0x7f9fb006fc10 0x7f9fb00b9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:08:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.191+0000 7f9faf7fe640 1 -- 172.21.15.37:0/337434150 >> v1:172.21.15.37:6789/0 conn(0x7f9fb006af20 legacy=0x7f9fb01415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:08:18.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.192+0000 7f9faf7fe640 1 -- 172.21.15.37:0/337434150 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb0070ca0 con 0x7f9fb0141cb0 2023-12-19T16:08:18.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.192+0000 7f9faeffd640 1 -- 172.21.15.37:0/337434150 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073575405 0 0) 0x7f9fb0070480 con 0x7f9fb006af20 2023-12-19T16:08:18.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.192+0000 7f9fb4b3c640 1 --2- 172.21.15.37:0/337434150 >> v2:172.21.15.78:3300/0 conn(0x7f9fb006fc10 0x7f9fb00b9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:08:18.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.192+0000 7f9faf7fe640 1 --2- 172.21.15.37:0/337434150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fb0141cb0 0x7f9fb014ad00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9fb01487c0 tx=0x7f9fa402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea5cc35d36e635a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:08:18.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.192+0000 7f9faeffd640 1 -- 172.21.15.37:0/337434150 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4031870 con 0x7f9fb0141cb0 2023-12-19T16:08:18.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.192+0000 7f9faeffd640 1 -- 172.21.15.37:0/337434150 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa40319d0 con 0x7f9fb0141cb0 2023-12-19T16:08:18.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.192+0000 7f9faeffd640 1 -- 172.21.15.37:0/337434150 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4031d60 con 0x7f9fb0141cb0 2023-12-19T16:08:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.193+0000 7f9fb659f640 1 -- 172.21.15.37:0/337434150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fb0141cb0 msgr2=0x7f9fb014ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:08:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.193+0000 7f9fb659f640 1 --2- 172.21.15.37:0/337434150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fb0141cb0 0x7f9fb014ad00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9fb01487c0 tx=0x7f9fa402b910 comp rx=0 tx=0).stop 2023-12-19T16:08:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.193+0000 7f9fb659f640 1 -- 172.21.15.37:0/337434150 shutdown_connections 2023-12-19T16:08:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.193+0000 7f9fb659f640 1 --2- 172.21.15.37:0/337434150 >> v2:172.21.15.78:3300/0 conn(0x7f9fb006fc10 0x7f9fb00b9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:08:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.193+0000 7f9fb659f640 1 --2- 172.21.15.37:0/337434150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fb0141cb0 0x7f9fb014ad00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:08:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.193+0000 7f9fb659f640 1 -- 172.21.15.37:0/337434150 >> 172.21.15.37:0/337434150 conn(0x7f9fb00b9c30 msgr2=0x7f9fb00ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:08:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.193+0000 7f9fb659f640 1 -- 172.21.15.37:0/337434150 shutdown_connections 2023-12-19T16:08:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.193+0000 7f9fb659f640 1 -- 172.21.15.37:0/337434150 wait complete. 2023-12-19T16:08:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.194+0000 7f9fb659f640 1 Processor -- start 2023-12-19T16:08:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.194+0000 7f9fb659f640 1 -- start start 2023-12-19T16:08:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.195+0000 7f9fb659f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fb006af20 0x7f9fb0142270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:08:18.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.195+0000 7f9fb659f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fb006fc10 0x7f9fb0142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:08:18.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.195+0000 7f9fb659f640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fb0141cb0 0x7f9fb01e14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:08:18.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.195+0000 7f9fb659f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb01d31b0 con 0x7f9fb006af20 2023-12-19T16:08:18.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.195+0000 7f9fb659f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb01434f0 con 0x7f9fb006fc10 2023-12-19T16:08:18.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.195+0000 7f9fb659f640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb013cf60 con 0x7f9fb0141cb0 2023-12-19T16:08:18.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.195+0000 7f9faffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fb006af20 0x7f9fb0142270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:08:18.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.195+0000 7f9faffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fb006af20 0x7f9fb0142270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45264/0 (socket says 172.21.15.37:45264) 2023-12-19T16:08:18.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.195+0000 7f9faffff640 1 -- 172.21.15.37:0/3364936298 learned_addr learned my addr 172.21.15.37:0/3364936298 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:08:18.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.195+0000 7f9faf7fe640 1 --2- 172.21.15.37:0/3364936298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fb006fc10 0x7f9fb0142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:08:18.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.195+0000 7f9fb4b3c640 1 --2- 172.21.15.37:0/3364936298 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fb0141cb0 0x7f9fb01e14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:08:18.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.195+0000 7f9faffff640 1 -- 172.21.15.37:0/3364936298 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fb0141cb0 msgr2=0x7f9fb01e14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:08:18.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.195+0000 7f9faffff640 1 --2- 172.21.15.37:0/3364936298 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fb0141cb0 0x7f9fb01e14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:08:18.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.195+0000 7f9faffff640 1 -- 172.21.15.37:0/3364936298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fb006fc10 msgr2=0x7f9fb0142fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:08:18.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.195+0000 7f9faffff640 1 --2- 172.21.15.37:0/3364936298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fb006fc10 0x7f9fb0142fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:08:18.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.195+0000 7f9faffff640 1 -- 172.21.15.37:0/3364936298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa40094d0 con 0x7f9fb006af20 2023-12-19T16:08:18.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.195+0000 7f9faffff640 1 --2- 172.21.15.37:0/3364936298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fb006af20 0x7f9fb0142270 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000c4b0 tx=0x7f9fa000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:08:18.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.196+0000 7f9facff9640 1 -- 172.21.15.37:0/3364936298 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0005480 con 0x7f9fb006af20 2023-12-19T16:08:18.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.196+0000 7f9facff9640 1 -- 172.21.15.37:0/3364936298 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa00035f0 con 0x7f9fb006af20 2023-12-19T16:08:18.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.196+0000 7f9fb659f640 1 -- 172.21.15.37:0/3364936298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb01d3f20 con 0x7f9fb006af20 2023-12-19T16:08:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.196+0000 7f9facff9640 1 -- 172.21.15.37:0/3364936298 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa00039e0 con 0x7f9fb006af20 2023-12-19T16:08:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.196+0000 7f9fb659f640 1 -- 172.21.15.37:0/3364936298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb0143770 con 0x7f9fb006af20 2023-12-19T16:08:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.197+0000 7f9fb659f640 1 -- 172.21.15.37:0/3364936298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb00b8b90 con 0x7f9fb006af20 2023-12-19T16:08:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.197+0000 7f9facff9640 1 -- 172.21.15.37:0/3364936298 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9fa0003b40 con 0x7f9fb006af20 2023-12-19T16:08:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.197+0000 7f9facff9640 1 --2- 172.21.15.37:0/3364936298 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f9f9c06a460 0x7f9f9c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:08:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.198+0000 7f9facff9640 1 -- 172.21.15.37:0/3364936298 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fa0087dc0 con 0x7f9fb006af20 2023-12-19T16:08:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.198+0000 7f9faf7fe640 1 --2- 172.21.15.37:0/3364936298 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f9f9c06a460 0x7f9f9c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:08:18.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.198+0000 7f9faf7fe640 1 --2- 172.21.15.37:0/3364936298 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f9f9c06a460 0x7f9f9c06c920 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4036000 tx=0x7f9fa403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:08:18.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.202+0000 7f9facff9640 1 -- 172.21.15.37:0/3364936298 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9fa00534f0 con 0x7f9fb006af20 2023-12-19T16:08:18.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.444+0000 7f9fb659f640 1 -- 172.21.15.37:0/3364936298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f9fb004e840 con 0x7f9fb006af20 2023-12-19T16:08:18.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.445+0000 7f9facff9640 1 -- 172.21.15.37:0/3364936298 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7f9fa0017020 con 0x7f9fb006af20 2023-12-19T16:08:18.448 INFO:teuthology.orchestra.run.smithi037.stdout:[client.admin] 2023-12-19T16:08:18.448 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBov4FlDqP1FxAAgmeUG5CfJbsHOkLlF2UByQ== 2023-12-19T16:08:18.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.447+0000 7f9fb659f640 1 -- 172.21.15.37:0/3364936298 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f9f9c06a460 msgr2=0x7f9f9c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:08:18.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.447+0000 7f9fb659f640 1 --2- 172.21.15.37:0/3364936298 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f9f9c06a460 0x7f9f9c06c920 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4036000 tx=0x7f9fa403c040 comp rx=0 tx=0).stop 2023-12-19T16:08:18.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.447+0000 7f9fb659f640 1 -- 172.21.15.37:0/3364936298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fb006af20 msgr2=0x7f9fb0142270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:08:18.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.447+0000 7f9fb659f640 1 --2- 172.21.15.37:0/3364936298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fb006af20 0x7f9fb0142270 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000c4b0 tx=0x7f9fa000c970 comp rx=0 tx=0).stop 2023-12-19T16:08:18.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.447+0000 7f9fb659f640 1 -- 172.21.15.37:0/3364936298 shutdown_connections 2023-12-19T16:08:18.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.447+0000 7f9fb659f640 1 --2- 172.21.15.37:0/3364936298 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f9f9c06a460 0x7f9f9c06c920 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:08:18.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.447+0000 7f9fb659f640 1 --2- 172.21.15.37:0/3364936298 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9fb0141cb0 0x7f9fb01e14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:08:18.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.447+0000 7f9fb659f640 1 --2- 172.21.15.37:0/3364936298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fb006fc10 0x7f9fb0142fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:08:18.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.447+0000 7f9fb659f640 1 --2- 172.21.15.37:0/3364936298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fb006af20 0x7f9fb0142270 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:08:18.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.447+0000 7f9fb659f640 1 -- 172.21.15.37:0/3364936298 >> 172.21.15.37:0/3364936298 conn(0x7f9fb00b9c30 msgr2=0x7f9fb0140900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:08:18.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.447+0000 7f9fb659f640 1 -- 172.21.15.37:0/3364936298 shutdown_connections 2023-12-19T16:08:18.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:08:18.447+0000 7f9fb659f640 1 -- 172.21.15.37:0/3364936298 wait complete. 2023-12-19T16:08:18.461 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T16:08:18.461 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/tmp/tmp.t6fx4IVDVzxfstests-dev/local.config 2023-12-19T16:08:18.537 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.37:6789:/test export TEST_DIR=/tmp/tmp.VQWFH9MHpotest export SCRATCH_DEV=172.21.15.37:6789:/scratch export SCRATCH_MNT=/tmp/tmp.QHjjk1hzmdscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBov4FlDqP1FxAAgmeUG5CfJbsHOkLlF2UByQ==" 2023-12-19T16:08:18.537 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T16:08:18.537 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/tmp/tmp.t6fx4IVDVzxfstests-dev/ceph.exclude 2023-12-19T16:08:18.651 DEBUG:teuthology.orchestra.run.smithi151:> (cd /tmp/tmp.t6fx4IVDVzxfstests-dev && exec sudo make) 2023-12-19T16:08:18.782 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize -cfi 2023-12-19T16:08:19.427 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: putting auxiliary files in '.'. 2023-12-19T16:08:19.427 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: copying file './config.guess' 2023-12-19T16:08:19.438 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: copying file './config.sub' 2023-12-19T16:08:19.450 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: copying file './install-sh' 2023-12-19T16:08:19.461 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: copying file './ltmain.sh' 2023-12-19T16:08:19.533 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-12-19T16:08:19.533 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-12-19T16:08:19.546 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-12-19T16:08:19.560 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-12-19T16:08:19.574 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-12-19T16:08:19.591 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-12-19T16:08:19.612 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-12-19T16:08:19.617 INFO:teuthology.orchestra.run.smithi151.stdout:cp include/install-sh . 2023-12-19T16:08:19.620 INFO:teuthology.orchestra.run.smithi151.stdout:aclocal -I m4 2023-12-19T16:08:20.849 INFO:teuthology.orchestra.run.smithi151.stdout:autoheader 2023-12-19T16:08:21.228 INFO:teuthology.orchestra.run.smithi151.stdout:autoconf 2023-12-19T16:08:21.453 INFO:teuthology.orchestra.run.smithi151.stdout:./configure \ 2023-12-19T16:08:21.454 INFO:teuthology.orchestra.run.smithi151.stdout: --libexecdir=/usr/lib \ 2023-12-19T16:08:21.454 INFO:teuthology.orchestra.run.smithi151.stdout: --exec_prefix=/var/lib 2023-12-19T16:08:21.822 INFO:teuthology.orchestra.run.smithi151.stdout:checking build system type... x86_64-pc-linux-gnu 2023-12-19T16:08:21.822 INFO:teuthology.orchestra.run.smithi151.stdout:checking host system type... x86_64-pc-linux-gnu 2023-12-19T16:08:21.825 INFO:teuthology.orchestra.run.smithi151.stdout:checking how to print strings... printf 2023-12-19T16:08:21.825 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gcc... gcc 2023-12-19T16:08:21.973 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether the C compiler works... yes 2023-12-19T16:08:21.973 INFO:teuthology.orchestra.run.smithi151.stdout:checking for C compiler default output file name... a.out 2023-12-19T16:08:22.028 INFO:teuthology.orchestra.run.smithi151.stdout:checking for suffix of executables... 2023-12-19T16:08:22.110 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether we are cross compiling... no 2023-12-19T16:08:22.148 INFO:teuthology.orchestra.run.smithi151.stdout:checking for suffix of object files... o 2023-12-19T16:08:22.181 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether we are using the GNU C compiler... yes 2023-12-19T16:08:22.216 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether gcc accepts -g... yes 2023-12-19T16:08:22.266 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gcc option to accept ISO C89... none needed 2023-12-19T16:08:22.274 INFO:teuthology.orchestra.run.smithi151.stdout:checking for a sed that does not truncate output... /bin/sed 2023-12-19T16:08:22.280 INFO:teuthology.orchestra.run.smithi151.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-12-19T16:08:22.283 INFO:teuthology.orchestra.run.smithi151.stdout:checking for egrep... /bin/grep -E 2023-12-19T16:08:22.286 INFO:teuthology.orchestra.run.smithi151.stdout:checking for fgrep... /bin/grep -F 2023-12-19T16:08:22.295 INFO:teuthology.orchestra.run.smithi151.stdout:checking for ld used by gcc... /bin/ld 2023-12-19T16:08:22.299 INFO:teuthology.orchestra.run.smithi151.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-12-19T16:08:22.305 INFO:teuthology.orchestra.run.smithi151.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-12-19T16:08:23.371 INFO:teuthology.orchestra.run.smithi151.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-12-19T16:08:23.371 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether ln -s works... yes 2023-12-19T16:08:23.382 INFO:teuthology.orchestra.run.smithi151.stdout:checking the maximum length of command line arguments... 1572864 2023-12-19T16:08:23.390 INFO:teuthology.orchestra.run.smithi151.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-12-19T16:08:23.390 INFO:teuthology.orchestra.run.smithi151.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-12-19T16:08:23.390 INFO:teuthology.orchestra.run.smithi151.stdout:checking for /bin/ld option to reload object files... -r 2023-12-19T16:08:23.390 INFO:teuthology.orchestra.run.smithi151.stdout:checking for objdump... objdump 2023-12-19T16:08:23.391 INFO:teuthology.orchestra.run.smithi151.stdout:checking how to recognize dependent libraries... pass_all 2023-12-19T16:08:23.392 INFO:teuthology.orchestra.run.smithi151.stdout:checking for dlltool... no 2023-12-19T16:08:23.392 INFO:teuthology.orchestra.run.smithi151.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-12-19T16:08:23.392 INFO:teuthology.orchestra.run.smithi151.stdout:checking for ar... ar 2023-12-19T16:08:23.480 INFO:teuthology.orchestra.run.smithi151.stdout:checking for archiver @FILE support... @ 2023-12-19T16:08:23.481 INFO:teuthology.orchestra.run.smithi151.stdout:checking for strip... strip 2023-12-19T16:08:23.481 INFO:teuthology.orchestra.run.smithi151.stdout:checking for ranlib... ranlib 2023-12-19T16:08:23.481 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gawk... gawk 2023-12-19T16:08:23.628 INFO:teuthology.orchestra.run.smithi151.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-12-19T16:08:23.631 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sysroot... no 2023-12-19T16:08:23.639 INFO:teuthology.orchestra.run.smithi151.stdout:checking for a working dd... /bin/dd 2023-12-19T16:08:23.647 INFO:teuthology.orchestra.run.smithi151.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-12-19T16:08:23.678 INFO:teuthology.orchestra.run.smithi151.stdout:checking for mt... no 2023-12-19T16:08:23.685 INFO:teuthology.orchestra.run.smithi151.stdout:checking if : is a manifest tool... no 2023-12-19T16:08:23.802 INFO:teuthology.orchestra.run.smithi151.stdout:checking how to run the C preprocessor... gcc -E 2023-12-19T16:08:24.100 INFO:teuthology.orchestra.run.smithi151.stdout:checking for ANSI C header files... yes 2023-12-19T16:08:24.148 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/types.h... yes 2023-12-19T16:08:24.236 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/stat.h... yes 2023-12-19T16:08:24.292 INFO:teuthology.orchestra.run.smithi151.stdout:checking for stdlib.h... yes 2023-12-19T16:08:24.352 INFO:teuthology.orchestra.run.smithi151.stdout:checking for string.h... yes 2023-12-19T16:08:24.411 INFO:teuthology.orchestra.run.smithi151.stdout:checking for memory.h... yes 2023-12-19T16:08:24.467 INFO:teuthology.orchestra.run.smithi151.stdout:checking for strings.h... yes 2023-12-19T16:08:24.531 INFO:teuthology.orchestra.run.smithi151.stdout:checking for inttypes.h... yes 2023-12-19T16:08:24.588 INFO:teuthology.orchestra.run.smithi151.stdout:checking for stdint.h... yes 2023-12-19T16:08:24.688 INFO:teuthology.orchestra.run.smithi151.stdout:checking for unistd.h... yes 2023-12-19T16:08:24.765 INFO:teuthology.orchestra.run.smithi151.stdout:checking for dlfcn.h... yes 2023-12-19T16:08:24.778 INFO:teuthology.orchestra.run.smithi151.stdout:checking for objdir... .libs 2023-12-19T16:08:24.957 INFO:teuthology.orchestra.run.smithi151.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-12-19T16:08:24.957 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-12-19T16:08:25.011 INFO:teuthology.orchestra.run.smithi151.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-12-19T16:08:25.059 INFO:teuthology.orchestra.run.smithi151.stdout:checking if gcc static flag -static works... no 2023-12-19T16:08:25.127 INFO:teuthology.orchestra.run.smithi151.stdout:checking if gcc supports -c -o file.o... yes 2023-12-19T16:08:25.127 INFO:teuthology.orchestra.run.smithi151.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-12-19T16:08:25.150 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-12-19T16:08:25.217 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether -lc should be explicitly linked in... no 2023-12-19T16:08:25.383 INFO:teuthology.orchestra.run.smithi151.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-12-19T16:08:25.384 INFO:teuthology.orchestra.run.smithi151.stdout:checking how to hardcode library paths into programs... immediate 2023-12-19T16:08:25.388 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether stripping libraries is possible... yes 2023-12-19T16:08:25.388 INFO:teuthology.orchestra.run.smithi151.stdout:checking if libtool supports shared libraries... yes 2023-12-19T16:08:25.388 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether to build shared libraries... yes 2023-12-19T16:08:25.389 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether to build static libraries... yes 2023-12-19T16:08:25.408 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gcc... (cached) gcc 2023-12-19T16:08:25.462 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-19T16:08:25.463 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-19T16:08:25.463 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-19T16:08:25.463 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gmake... /usr/bin/gmake 2023-12-19T16:08:25.463 INFO:teuthology.orchestra.run.smithi151.stderr:./configure: line 12083: test: $(SHELL): binary operator expected 2023-12-19T16:08:25.464 INFO:teuthology.orchestra.run.smithi151.stdout:checking for tar... /bin/tar 2023-12-19T16:08:25.464 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gzip... /bin/gzip 2023-12-19T16:08:25.490 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether gcc -MM is supported... yes 2023-12-19T16:08:25.490 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sort... /bin/sort 2023-12-19T16:08:25.490 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether ln -s works... yes 2023-12-19T16:08:25.491 INFO:teuthology.orchestra.run.smithi151.stdout:checking for rpm... /bin/rpm 2023-12-19T16:08:25.501 INFO:teuthology.orchestra.run.smithi151.stdout:checking for rpmbuild... no 2023-12-19T16:08:25.577 INFO:teuthology.orchestra.run.smithi151.stdout:checking assert.h usability... yes 2023-12-19T16:08:25.603 INFO:teuthology.orchestra.run.smithi151.stdout:checking assert.h presence... yes 2023-12-19T16:08:25.603 INFO:teuthology.orchestra.run.smithi151.stdout:checking for assert.h... yes 2023-12-19T16:08:25.682 INFO:teuthology.orchestra.run.smithi151.stdout:checking bstring.h usability... no 2023-12-19T16:08:25.723 INFO:teuthology.orchestra.run.smithi151.stdout:checking bstring.h presence... no 2023-12-19T16:08:25.723 INFO:teuthology.orchestra.run.smithi151.stdout:checking for bstring.h... no 2023-12-19T16:08:25.789 INFO:teuthology.orchestra.run.smithi151.stdout:checking libgen.h usability... yes 2023-12-19T16:08:25.816 INFO:teuthology.orchestra.run.smithi151.stdout:checking libgen.h presence... yes 2023-12-19T16:08:25.816 INFO:teuthology.orchestra.run.smithi151.stdout:checking for libgen.h... yes 2023-12-19T16:08:25.907 INFO:teuthology.orchestra.run.smithi151.stdout:checking dirent.h usability... yes 2023-12-19T16:08:25.934 INFO:teuthology.orchestra.run.smithi151.stdout:checking dirent.h presence... yes 2023-12-19T16:08:25.934 INFO:teuthology.orchestra.run.smithi151.stdout:checking for dirent.h... yes 2023-12-19T16:08:26.073 INFO:teuthology.orchestra.run.smithi151.stdout:checking errno.h usability... yes 2023-12-19T16:08:26.103 INFO:teuthology.orchestra.run.smithi151.stdout:checking errno.h presence... yes 2023-12-19T16:08:26.103 INFO:teuthology.orchestra.run.smithi151.stdout:checking for errno.h... yes 2023-12-19T16:08:26.200 INFO:teuthology.orchestra.run.smithi151.stdout:checking malloc.h usability... yes 2023-12-19T16:08:26.232 INFO:teuthology.orchestra.run.smithi151.stdout:checking malloc.h presence... yes 2023-12-19T16:08:26.233 INFO:teuthology.orchestra.run.smithi151.stdout:checking for malloc.h... yes 2023-12-19T16:08:26.308 INFO:teuthology.orchestra.run.smithi151.stdout:checking uuid.h usability... no 2023-12-19T16:08:26.341 INFO:teuthology.orchestra.run.smithi151.stdout:checking uuid.h presence... no 2023-12-19T16:08:26.341 INFO:teuthology.orchestra.run.smithi151.stdout:checking for uuid.h... no 2023-12-19T16:08:26.431 INFO:teuthology.orchestra.run.smithi151.stdout:checking uuid/uuid.h usability... yes 2023-12-19T16:08:26.461 INFO:teuthology.orchestra.run.smithi151.stdout:checking uuid/uuid.h presence... yes 2023-12-19T16:08:26.461 INFO:teuthology.orchestra.run.smithi151.stdout:checking for uuid/uuid.h... yes 2023-12-19T16:08:26.540 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/uuid.h usability... no 2023-12-19T16:08:26.583 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/uuid.h presence... no 2023-12-19T16:08:26.583 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/uuid.h... no 2023-12-19T16:08:26.671 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/file.h usability... yes 2023-12-19T16:08:26.699 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/file.h presence... yes 2023-12-19T16:08:26.699 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/file.h... yes 2023-12-19T16:08:26.789 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/fcntl.h usability... yes 2023-12-19T16:08:26.814 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/fcntl.h presence... yes 2023-12-19T16:08:26.814 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/fcntl.h... yes 2023-12-19T16:08:26.896 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/syssgi.h usability... no 2023-12-19T16:08:26.934 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/syssgi.h presence... no 2023-12-19T16:08:26.934 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/syssgi.h... no 2023-12-19T16:08:27.042 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/param.h usability... yes 2023-12-19T16:08:27.074 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/param.h presence... yes 2023-12-19T16:08:27.075 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/param.h... yes 2023-12-19T16:08:27.095 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/stat.h... (cached) yes 2023-12-19T16:08:27.184 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/statvfs.h usability... yes 2023-12-19T16:08:27.210 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/statvfs.h presence... yes 2023-12-19T16:08:27.211 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/statvfs.h... yes 2023-12-19T16:08:27.288 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/time.h usability... yes 2023-12-19T16:08:27.317 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/time.h presence... yes 2023-12-19T16:08:27.317 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/time.h... yes 2023-12-19T16:08:27.404 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/ioctl.h usability... yes 2023-12-19T16:08:27.429 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/ioctl.h presence... yes 2023-12-19T16:08:27.429 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/ioctl.h... yes 2023-12-19T16:08:27.513 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/wait.h usability... yes 2023-12-19T16:08:27.544 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/wait.h presence... yes 2023-12-19T16:08:27.544 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/wait.h... yes 2023-12-19T16:08:27.564 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/types.h... (cached) yes 2023-12-19T16:08:27.582 INFO:teuthology.orchestra.run.smithi151.stdout:checking for strings.h... (cached) yes 2023-12-19T16:08:27.656 INFO:teuthology.orchestra.run.smithi151.stdout:checking err.h usability... yes 2023-12-19T16:08:27.683 INFO:teuthology.orchestra.run.smithi151.stdout:checking err.h presence... yes 2023-12-19T16:08:27.683 INFO:teuthology.orchestra.run.smithi151.stdout:checking for err.h... yes 2023-12-19T16:08:27.764 INFO:teuthology.orchestra.run.smithi151.stdout:checking linux/falloc.h usability... yes 2023-12-19T16:08:27.789 INFO:teuthology.orchestra.run.smithi151.stdout:checking linux/falloc.h presence... yes 2023-12-19T16:08:27.789 INFO:teuthology.orchestra.run.smithi151.stdout:checking for linux/falloc.h... yes 2023-12-19T16:08:27.870 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-12-19T16:08:27.911 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-12-19T16:08:27.911 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/fs/xfs_fsops.h... no 2023-12-19T16:08:27.981 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/fs/xfs_itable.h usability... no 2023-12-19T16:08:28.020 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/fs/xfs_itable.h presence... no 2023-12-19T16:08:28.020 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/fs/xfs_itable.h... no 2023-12-19T16:08:28.090 INFO:teuthology.orchestra.run.smithi151.stdout:checking xfs/platform_defs.h usability... no 2023-12-19T16:08:28.131 INFO:teuthology.orchestra.run.smithi151.stdout:checking xfs/platform_defs.h presence... no 2023-12-19T16:08:28.131 INFO:teuthology.orchestra.run.smithi151.stdout:checking for xfs/platform_defs.h... no 2023-12-19T16:08:28.199 INFO:teuthology.orchestra.run.smithi151.stdout:checking btrfs/ioctl.h usability... no 2023-12-19T16:08:28.238 INFO:teuthology.orchestra.run.smithi151.stdout:checking btrfs/ioctl.h presence... no 2023-12-19T16:08:28.239 INFO:teuthology.orchestra.run.smithi151.stdout:checking for btrfs/ioctl.h... no 2023-12-19T16:08:28.307 INFO:teuthology.orchestra.run.smithi151.stdout:checking cifs/ioctl.h usability... no 2023-12-19T16:08:28.351 INFO:teuthology.orchestra.run.smithi151.stdout:checking cifs/ioctl.h presence... no 2023-12-19T16:08:28.351 INFO:teuthology.orchestra.run.smithi151.stdout:checking for cifs/ioctl.h... no 2023-12-19T16:08:28.424 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/mman.h usability... yes 2023-12-19T16:08:28.452 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/mman.h presence... yes 2023-12-19T16:08:28.452 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/mman.h... yes 2023-12-19T16:08:28.508 INFO:teuthology.orchestra.run.smithi151.stdout:checking for xfs/xfs_log_format.h... no 2023-12-19T16:08:28.606 INFO:teuthology.orchestra.run.smithi151.stdout:checking for uuid_compare... no 2023-12-19T16:08:28.688 INFO:teuthology.orchestra.run.smithi151.stdout:checking for uuid_compare in -luuid... yes 2023-12-19T16:08:28.702 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:08:28.705 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:08:28.708 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:08:28.815 INFO:teuthology.orchestra.run.smithi151.stdout:checking for xfs/xfs.h... yes 2023-12-19T16:08:28.861 INFO:teuthology.orchestra.run.smithi151.stdout:checking for xfs/libxfs.h... no 2023-12-19T16:08:28.918 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether xlog_assign_lsn is declared... no 2023-12-19T16:08:28.990 INFO:teuthology.orchestra.run.smithi151.stdout:checking for xfs/xqm.h... yes 2023-12-19T16:08:29.103 INFO:teuthology.orchestra.run.smithi151.stdout:checking xfsctl from xfs/xfs.h... ok 2023-12-19T16:08:29.161 INFO:teuthology.orchestra.run.smithi151.stdout:checking xfs/handle.h usability... yes 2023-12-19T16:08:29.185 INFO:teuthology.orchestra.run.smithi151.stdout:checking xfs/handle.h presence... yes 2023-12-19T16:08:29.186 INFO:teuthology.orchestra.run.smithi151.stdout:checking for xfs/handle.h... yes 2023-12-19T16:08:29.272 INFO:teuthology.orchestra.run.smithi151.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-12-19T16:08:29.326 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/acl.h usability... yes 2023-12-19T16:08:29.350 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/acl.h presence... yes 2023-12-19T16:08:29.350 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/acl.h... yes 2023-12-19T16:08:29.405 INFO:teuthology.orchestra.run.smithi151.stdout:checking acl/libacl.h usability... yes 2023-12-19T16:08:29.436 INFO:teuthology.orchestra.run.smithi151.stdout:checking acl/libacl.h presence... yes 2023-12-19T16:08:29.436 INFO:teuthology.orchestra.run.smithi151.stdout:checking for acl/libacl.h... yes 2023-12-19T16:08:29.510 INFO:teuthology.orchestra.run.smithi151.stdout:checking for acl_init in -lacl... yes 2023-12-19T16:08:29.568 INFO:teuthology.orchestra.run.smithi151.stdout:checking gdbm-ndbm.h usability... no 2023-12-19T16:08:29.599 INFO:teuthology.orchestra.run.smithi151.stdout:checking gdbm-ndbm.h presence... no 2023-12-19T16:08:29.599 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gdbm-ndbm.h... no 2023-12-19T16:08:29.650 INFO:teuthology.orchestra.run.smithi151.stdout:checking gdbm/ndbm.h usability... no 2023-12-19T16:08:29.679 INFO:teuthology.orchestra.run.smithi151.stdout:checking gdbm/ndbm.h presence... no 2023-12-19T16:08:29.679 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gdbm/ndbm.h... no 2023-12-19T16:08:29.729 INFO:teuthology.orchestra.run.smithi151.stdout:checking ndbm.h usability... no 2023-12-19T16:08:29.766 INFO:teuthology.orchestra.run.smithi151.stdout:checking ndbm.h presence... no 2023-12-19T16:08:29.766 INFO:teuthology.orchestra.run.smithi151.stdout:checking for ndbm.h... no 2023-12-19T16:08:29.821 INFO:teuthology.orchestra.run.smithi151.stdout:checking libaio.h usability... yes 2023-12-19T16:08:29.848 INFO:teuthology.orchestra.run.smithi151.stdout:checking libaio.h presence... yes 2023-12-19T16:08:29.848 INFO:teuthology.orchestra.run.smithi151.stdout:checking for libaio.h... yes 2023-12-19T16:08:29.904 INFO:teuthology.orchestra.run.smithi151.stdout:checking liburing.h usability... no 2023-12-19T16:08:29.939 INFO:teuthology.orchestra.run.smithi151.stdout:checking liburing.h presence... no 2023-12-19T16:08:29.939 INFO:teuthology.orchestra.run.smithi151.stdout:checking for liburing.h... no 2023-12-19T16:08:29.999 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/capability.h usability... no 2023-12-19T16:08:30.037 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/capability.h presence... no 2023-12-19T16:08:30.037 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/capability.h... no 2023-12-19T16:08:30.095 INFO:teuthology.orchestra.run.smithi151.stdout:checking linux/fiemap.h usability... yes 2023-12-19T16:08:30.117 INFO:teuthology.orchestra.run.smithi151.stdout:checking linux/fiemap.h presence... yes 2023-12-19T16:08:30.117 INFO:teuthology.orchestra.run.smithi151.stdout:checking for linux/fiemap.h... yes 2023-12-19T16:08:30.190 INFO:teuthology.orchestra.run.smithi151.stdout:checking for fallocate... yes 2023-12-19T16:08:30.268 INFO:teuthology.orchestra.run.smithi151.stdout:checking for open_by_handle_at... yes 2023-12-19T16:08:30.338 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/prctl.h usability... yes 2023-12-19T16:08:30.365 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/prctl.h presence... yes 2023-12-19T16:08:30.365 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/prctl.h... yes 2023-12-19T16:08:30.424 INFO:teuthology.orchestra.run.smithi151.stdout:checking linux/fs.h usability... yes 2023-12-19T16:08:30.447 INFO:teuthology.orchestra.run.smithi151.stdout:checking linux/fs.h presence... yes 2023-12-19T16:08:30.447 INFO:teuthology.orchestra.run.smithi151.stdout:checking for linux/fs.h... yes 2023-12-19T16:08:30.500 INFO:teuthology.orchestra.run.smithi151.stdout:checking btrfsutil.h usability... no 2023-12-19T16:08:30.538 INFO:teuthology.orchestra.run.smithi151.stdout:checking btrfsutil.h presence... no 2023-12-19T16:08:30.539 INFO:teuthology.orchestra.run.smithi151.stdout:checking for btrfsutil.h... no 2023-12-19T16:08:30.622 INFO:teuthology.orchestra.run.smithi151.stdout:checking for copy_file_range... yes 2023-12-19T16:08:30.701 INFO:teuthology.orchestra.run.smithi151.stdout:checking for SEEK_DATA... yes 2023-12-19T16:08:30.804 INFO:teuthology.orchestra.run.smithi151.stdout:checking for BMV_OF_SHARED... yes 2023-12-19T16:08:30.889 INFO:teuthology.orchestra.run.smithi151.stdout:checking for nftw... yes 2023-12-19T16:08:30.976 INFO:teuthology.orchestra.run.smithi151.stdout:checking for RLIMIT_NOFILE... yes 2023-12-19T16:08:31.059 INFO:teuthology.orchestra.run.smithi151.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2023-12-19T16:08:31.140 INFO:teuthology.orchestra.run.smithi151.stdout:checking for FICLONE... yes 2023-12-19T16:08:31.222 INFO:teuthology.orchestra.run.smithi151.stdout:checking for renameat2... yes 2023-12-19T16:08:31.310 INFO:teuthology.orchestra.run.smithi151.stdout:checking for reallocarray... yes 2023-12-19T16:08:31.410 INFO:teuthology.orchestra.run.smithi151.stdout:checking for struct mount_attr... yes 2023-12-19T16:08:31.514 INFO:teuthology.orchestra.run.smithi151.stdout:checking for struct btrfs_qgroup_limit... yes 2023-12-19T16:08:31.618 INFO:teuthology.orchestra.run.smithi151.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-12-19T16:08:31.725 INFO:teuthology.orchestra.run.smithi151.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-12-19T16:08:31.831 INFO:teuthology.orchestra.run.smithi151.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-12-19T16:08:31.941 INFO:teuthology.orchestra.run.smithi151.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-12-19T16:08:32.046 INFO:teuthology.orchestra.run.smithi151.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-12-19T16:08:32.153 INFO:teuthology.orchestra.run.smithi151.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-12-19T16:08:32.232 INFO:teuthology.orchestra.run.smithi151.stdout:checking linux/btrfs.h usability... yes 2023-12-19T16:08:32.256 INFO:teuthology.orchestra.run.smithi151.stdout:checking linux/btrfs.h presence... yes 2023-12-19T16:08:32.256 INFO:teuthology.orchestra.run.smithi151.stdout:checking for linux/btrfs.h... yes 2023-12-19T16:08:32.348 INFO:teuthology.orchestra.run.smithi151.stdout:checking linux/btrfs_tree.h usability... yes 2023-12-19T16:08:32.374 INFO:teuthology.orchestra.run.smithi151.stdout:checking linux/btrfs_tree.h presence... yes 2023-12-19T16:08:32.374 INFO:teuthology.orchestra.run.smithi151.stdout:checking for linux/btrfs_tree.h... yes 2023-12-19T16:08:32.430 INFO:teuthology.orchestra.run.smithi151.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-12-19T16:08:32.472 INFO:teuthology.orchestra.run.smithi151.stdout:configure: creating ./config.status 2023-12-19T16:08:33.826 INFO:teuthology.orchestra.run.smithi151.stdout:config.status: creating include/builddefs 2023-12-19T16:08:33.869 INFO:teuthology.orchestra.run.smithi151.stdout:config.status: creating include/config.h 2023-12-19T16:08:33.902 INFO:teuthology.orchestra.run.smithi151.stdout:config.status: executing libtool commands 2023-12-19T16:08:34.005 INFO:teuthology.orchestra.run.smithi151.stdout:Building include 2023-12-19T16:08:34.016 INFO:teuthology.orchestra.run.smithi151.stdout:Building lib 2023-12-19T16:08:34.025 INFO:teuthology.orchestra.run.smithi151.stdout: [LTDEP] 2023-12-19T16:08:34.330 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] dataascii.lo 2023-12-19T16:08:34.609 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] databin.lo 2023-12-19T16:08:34.921 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] datapid.lo 2023-12-19T16:08:35.164 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] file_lock.lo 2023-12-19T16:08:35.466 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] forker.lo 2023-12-19T16:08:35.756 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] pattern.lo 2023-12-19T16:08:36.017 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] open_flags.lo 2023-12-19T16:08:36.311 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] random_range.lo 2023-12-19T16:08:36.694 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] string_to_tokens.lo 2023-12-19T16:08:36.932 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] str_to_bytes.lo 2023-12-19T16:08:37.226 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] tlibio.lo 2023-12-19T16:08:37.641 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] write_log.lo 2023-12-19T16:08:38.048 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] random.lo 2023-12-19T16:08:38.299 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] 2023-12-19T16:08:38.541 INFO:teuthology.orchestra.run.smithi151.stdout:Building ltp 2023-12-19T16:08:38.552 INFO:teuthology.orchestra.run.smithi151.stdout: [DEP] 2023-12-19T16:08:38.845 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] doio 2023-12-19T16:08:39.710 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fsstress 2023-12-19T16:08:41.389 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fsx 2023-12-19T16:08:42.341 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] growfiles 2023-12-19T16:08:43.027 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] iogen 2023-12-19T16:08:43.614 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] aio-stress 2023-12-19T16:08:44.241 INFO:teuthology.orchestra.run.smithi151.stdout:Building src 2023-12-19T16:08:44.255 INFO:teuthology.orchestra.run.smithi151.stdout: [DEP] 2023-12-19T16:08:48.073 INFO:teuthology.orchestra.run.smithi151.stdout: [DEP] 2023-12-19T16:08:48.145 INFO:teuthology.orchestra.run.smithi151.stdout: [DEP] 2023-12-19T16:08:48.168 INFO:teuthology.orchestra.run.smithi151.stdout: [DEP] 2023-12-19T16:08:48.620 INFO:teuthology.orchestra.run.smithi151.stdout: [DEP] 2023-12-19T16:08:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] dirstress 2023-12-19T16:08:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fill 2023-12-19T16:08:49.424 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fill2 2023-12-19T16:08:49.865 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] getpagesize 2023-12-19T16:08:50.181 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] holes 2023-12-19T16:08:50.555 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] lstat64 2023-12-19T16:08:50.955 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] nametest 2023-12-19T16:08:51.402 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] permname 2023-12-19T16:08:51.823 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] randholes 2023-12-19T16:08:52.271 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] runas 2023-12-19T16:08:52.637 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] truncfile 2023-12-19T16:08:53.038 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] usemem 2023-12-19T16:08:53.358 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] mmapcat 2023-12-19T16:08:53.683 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] append_reader 2023-12-19T16:08:54.019 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] append_writer 2023-12-19T16:08:54.346 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] dirperf 2023-12-19T16:08:54.771 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] metaperf 2023-12-19T16:08:55.260 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] devzero 2023-12-19T16:08:55.664 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] feature 2023-12-19T16:08:56.050 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] alloc 2023-12-19T16:08:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fault 2023-12-19T16:08:56.816 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fstest 2023-12-19T16:08:57.273 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_access_root 2023-12-19T16:08:57.635 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] godown 2023-12-19T16:08:58.022 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] resvtest 2023-12-19T16:08:58.391 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] writemod 2023-12-19T16:08:58.720 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] writev_on_pagefault 2023-12-19T16:08:58.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:08:58.832 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:08:58.835 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:08:59.036 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] makeextents 2023-12-19T16:08:59.377 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] itrash 2023-12-19T16:08:59.681 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] rename 2023-12-19T16:08:59.994 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] multi_open_unlink 2023-12-19T16:09:00.318 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] unwritten_sync 2023-12-19T16:09:00.686 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] genhashnames 2023-12-19T16:09:01.064 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_holes 2023-12-19T16:09:01.398 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_mmap_writev 2023-12-19T16:09:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_truncate_cmtime 2023-12-19T16:09:02.073 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] dirhash_collide 2023-12-19T16:09:02.406 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_rename_overwrite 2023-12-19T16:09:02.745 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] holetest 2023-12-19T16:09:03.156 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_truncate_self 2023-12-19T16:09:03.482 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] af_unix 2023-12-19T16:09:03.814 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_mmap_stale_pmd 2023-12-19T16:09:04.165 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_mmap_cow_race 2023-12-19T16:09:04.510 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_mmap_fallocate 2023-12-19T16:09:04.855 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fsync-err 2023-12-19T16:09:05.225 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_mmap_write_ro 2023-12-19T16:09:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_ext4_dax_journal_corruption 2023-12-19T16:09:05.924 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_ext4_dax_inline_corruption 2023-12-19T16:09:06.244 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_ofd_locks 2023-12-19T16:09:06.632 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_mmap_collision 2023-12-19T16:09:07.031 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] mmap-write-concurrent 2023-12-19T16:09:07.387 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_get_file_time 2023-12-19T16:09:07.727 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_create_short_dirs 2023-12-19T16:09:08.100 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_create_long_dirs 2023-12-19T16:09:08.427 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_enospc 2023-12-19T16:09:08.823 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_mmap_writev_overlap 2023-12-19T16:09:09.177 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] checkpoint_journal 2023-12-19T16:09:09.501 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] mmap-rw-fault 2023-12-19T16:09:09.853 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] allocstale 2023-12-19T16:09:10.198 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_mmap_cow_memory_failure 2023-12-19T16:09:10.525 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fake-dump-rootino 2023-12-19T16:09:10.834 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] dio-buf-fault 2023-12-19T16:09:11.163 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] rewinddir-test 2023-12-19T16:09:11.545 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfsctl 2023-12-19T16:09:11.926 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] bstat 2023-12-19T16:09:12.312 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_mtab 2023-12-19T16:09:12.711 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] getdevicesize 2023-12-19T16:09:13.024 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] preallo_rw_pattern_reader 2023-12-19T16:09:13.348 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] preallo_rw_pattern_writer 2023-12-19T16:09:13.691 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] ftrunc 2023-12-19T16:09:13.997 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] trunc 2023-12-19T16:09:14.365 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fs_perms 2023-12-19T16:09:14.713 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] testx 2023-12-19T16:09:15.029 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] looptest 2023-12-19T16:09:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] locktest 2023-12-19T16:09:15.888 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] unwritten_mmap 2023-12-19T16:09:16.256 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] bulkstat_unlink_test 2023-12-19T16:09:16.627 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] deduperace 2023-12-19T16:09:17.028 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] bulkstat_unlink_test_modified 2023-12-19T16:09:17.421 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_dir_offset 2023-12-19T16:09:17.781 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_futimens 2023-12-19T16:09:18.103 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_immutable 2023-12-19T16:09:18.948 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] stale_handle 2023-12-19T16:09:19.314 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] pwrite_mmap_blocked 2023-12-19T16:09:19.629 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_dir_offset2 2023-12-19T16:09:20.007 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] seek_sanity_test 2023-12-19T16:09:20.658 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] seek_copy_test 2023-12-19T16:09:20.971 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_readdir_1 2023-12-19T16:09:21.334 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_readdir_2 2023-12-19T16:09:21.677 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fsync-tester 2023-12-19T16:09:22.134 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] nsexec 2023-12-19T16:09:22.495 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] cloner 2023-12-19T16:09:22.826 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] renameat2 2023-12-19T16:09:23.185 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_getcwd 2023-12-19T16:09:23.510 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] e4compact 2023-12-19T16:09:23.905 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] test-nextquota 2023-12-19T16:09:24.262 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] punch-alternating 2023-12-19T16:09:24.615 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] attr-list-by-handle-cursor-test 2023-12-19T16:09:24.971 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] listxattr 2023-12-19T16:09:25.301 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] dio-interleaved 2023-12-19T16:09:25.631 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_dir_type 2023-12-19T16:09:25.977 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] dio-invalidate-cache 2023-12-19T16:09:26.379 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] stat_test 2023-12-19T16:09:26.858 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_encrypted_d_revalidate 2023-12-19T16:09:27.191 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] attr_replace_test 2023-12-19T16:09:27.524 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] swapon 2023-12-19T16:09:27.859 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] mkswap 2023-12-19T16:09:28.228 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_attr_corruption 2023-12-19T16:09:28.586 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_open_tmpfiles 2023-12-19T16:09:28.959 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fscrypt-crypt-util 2023-12-19T16:09:28.967 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:09:28.970 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:09:28.973 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:09:29.793 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] bulkstat_null_ocount 2023-12-19T16:09:30.137 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] splice-test 2023-12-19T16:09:30.463 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] chprojid_fail 2023-12-19T16:09:30.794 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] detached_mounts_propagation 2023-12-19T16:09:31.190 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] ext4_resize 2023-12-19T16:09:31.522 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_readdir_3 2023-12-19T16:09:31.901 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] splice2pipe 2023-12-19T16:09:32.242 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] uuid_ioctl 2023-12-19T16:09:32.572 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fiemap-tester 2023-12-19T16:09:33.050 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_stripealign 2023-12-19T16:09:33.363 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] open_by_handle 2023-12-19T16:09:33.789 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_mmap_dio 2023-12-19T16:09:34.111 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfsfind 2023-12-19T16:09:34.485 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] t_reflink_read_race 2023-12-19T16:09:34.875 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fssum 2023-12-19T16:09:35.562 INFO:teuthology.orchestra.run.smithi151.stdout:Building log-writes 2023-12-19T16:09:35.575 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] replay-log 2023-12-19T16:09:36.100 INFO:teuthology.orchestra.run.smithi151.stdout:Building perf 2023-12-19T16:09:36.110 INFO:teuthology.orchestra.run.smithi151.stdout:Building aio-dio-regress 2023-12-19T16:09:36.125 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] aiocp 2023-12-19T16:09:36.548 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] aio-dio-append-write-fallocate-race 2023-12-19T16:09:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] aio-dio-append-write-read-race 2023-12-19T16:09:37.292 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] aio-dio-cow-race 2023-12-19T16:09:37.628 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] aio-dio-cycle-write 2023-12-19T16:09:37.979 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] aio-dio-eof-race 2023-12-19T16:09:38.335 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] aio-dio-extend-stat 2023-12-19T16:09:38.686 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] aio-dio-fcntl-race 2023-12-19T16:09:39.037 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] aio-dio-hole-filling-race 2023-12-19T16:09:39.352 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] aio-dio-invalidate-failure 2023-12-19T16:09:39.719 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] aio-dio-invalidate-readahead 2023-12-19T16:09:40.060 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] aiodio_sparse2 2023-12-19T16:09:40.462 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] aio-dio-subblock-eof-read 2023-12-19T16:09:40.772 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] aio-dio-write-verify 2023-12-19T16:09:41.168 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-12-19T16:09:41.477 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-12-19T16:09:41.793 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] aio-last-ref-held-by-io 2023-12-19T16:09:42.151 INFO:teuthology.orchestra.run.smithi151.stdout:Building vfs 2023-12-19T16:09:42.167 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] vfstest 2023-12-19T16:09:44.538 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] mount-idmapped 2023-12-19T16:09:45.173 INFO:teuthology.orchestra.run.smithi151.stdout:Building m4 2023-12-19T16:09:45.184 INFO:teuthology.orchestra.run.smithi151.stdout:Building common 2023-12-19T16:09:45.194 INFO:teuthology.orchestra.run.smithi151.stdout:Building tests 2023-12-19T16:09:45.209 INFO:teuthology.orchestra.run.smithi151.stdout:Building btrfs 2023-12-19T16:09:45.224 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/btrfs/group.list 2023-12-19T16:09:45.437 INFO:teuthology.orchestra.run.smithi151.stdout:Building ceph 2023-12-19T16:09:45.452 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/ceph/group.list 2023-12-19T16:09:45.506 INFO:teuthology.orchestra.run.smithi151.stdout:Building cifs 2023-12-19T16:09:45.519 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/cifs/group.list 2023-12-19T16:09:45.566 INFO:teuthology.orchestra.run.smithi151.stdout:Building ext4 2023-12-19T16:09:45.579 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/ext4/group.list 2023-12-19T16:09:45.728 INFO:teuthology.orchestra.run.smithi151.stdout:Building f2fs 2023-12-19T16:09:45.743 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/f2fs/group.list 2023-12-19T16:09:45.806 INFO:teuthology.orchestra.run.smithi151.stdout:Building generic 2023-12-19T16:09:45.824 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/generic/group.list 2023-12-19T16:09:46.159 INFO:teuthology.orchestra.run.smithi151.stdout:Building nfs 2023-12-19T16:09:46.174 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/nfs/group.list 2023-12-19T16:09:46.226 INFO:teuthology.orchestra.run.smithi151.stdout:Building ocfs2 2023-12-19T16:09:46.242 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/ocfs2/group.list 2023-12-19T16:09:46.293 INFO:teuthology.orchestra.run.smithi151.stdout:Building overlay 2023-12-19T16:09:46.308 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/overlay/group.list 2023-12-19T16:09:46.460 INFO:teuthology.orchestra.run.smithi151.stdout:Building perf 2023-12-19T16:09:46.474 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/perf/group.list 2023-12-19T16:09:46.516 INFO:teuthology.orchestra.run.smithi151.stdout:Building selftest 2023-12-19T16:09:46.529 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/selftest/group.list 2023-12-19T16:09:46.575 INFO:teuthology.orchestra.run.smithi151.stdout:Building shared 2023-12-19T16:09:46.588 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/shared/group.list 2023-12-19T16:09:46.653 INFO:teuthology.orchestra.run.smithi151.stdout:Building tmpfs 2023-12-19T16:09:46.667 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/tmpfs/group.list 2023-12-19T16:09:46.718 INFO:teuthology.orchestra.run.smithi151.stdout:Building udf 2023-12-19T16:09:46.732 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/udf/group.list 2023-12-19T16:09:46.771 INFO:teuthology.orchestra.run.smithi151.stdout:Building xfs 2023-12-19T16:09:46.785 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/xfs/group.list 2023-12-19T16:09:47.167 DEBUG:teuthology.orchestra.run.smithi151:> (cd /tmp/tmp.t6fx4IVDVzxfstests-dev && exec sudo make install) 2023-12-19T16:09:47.292 INFO:teuthology.orchestra.run.smithi151.stdout:Building include 2023-12-19T16:09:47.303 INFO:teuthology.orchestra.run.smithi151.stdout:Building lib 2023-12-19T16:09:47.315 INFO:teuthology.orchestra.run.smithi151.stdout:Building ltp 2023-12-19T16:09:47.327 INFO:teuthology.orchestra.run.smithi151.stdout:Building src 2023-12-19T16:09:47.409 INFO:teuthology.orchestra.run.smithi151.stdout:Building log-writes 2023-12-19T16:09:47.419 INFO:teuthology.orchestra.run.smithi151.stdout:Building perf 2023-12-19T16:09:47.430 INFO:teuthology.orchestra.run.smithi151.stdout:Building aio-dio-regress 2023-12-19T16:09:47.440 INFO:teuthology.orchestra.run.smithi151.stdout:Building vfs 2023-12-19T16:09:47.451 INFO:teuthology.orchestra.run.smithi151.stdout:Building m4 2023-12-19T16:09:47.461 INFO:teuthology.orchestra.run.smithi151.stdout:Building common 2023-12-19T16:09:47.473 INFO:teuthology.orchestra.run.smithi151.stdout:Building tests 2023-12-19T16:09:47.484 INFO:teuthology.orchestra.run.smithi151.stdout:Building btrfs 2023-12-19T16:09:47.499 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/btrfs/group.list 2023-12-19T16:09:47.711 INFO:teuthology.orchestra.run.smithi151.stdout:Building ceph 2023-12-19T16:09:47.726 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/ceph/group.list 2023-12-19T16:09:47.780 INFO:teuthology.orchestra.run.smithi151.stdout:Building cifs 2023-12-19T16:09:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/cifs/group.list 2023-12-19T16:09:47.837 INFO:teuthology.orchestra.run.smithi151.stdout:Building ext4 2023-12-19T16:09:47.850 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/ext4/group.list 2023-12-19T16:09:47.996 INFO:teuthology.orchestra.run.smithi151.stdout:Building f2fs 2023-12-19T16:09:48.010 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/f2fs/group.list 2023-12-19T16:09:48.077 INFO:teuthology.orchestra.run.smithi151.stdout:Building generic 2023-12-19T16:09:48.093 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/generic/group.list 2023-12-19T16:09:48.477 INFO:teuthology.orchestra.run.smithi151.stdout:Building nfs 2023-12-19T16:09:48.492 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/nfs/group.list 2023-12-19T16:09:48.546 INFO:teuthology.orchestra.run.smithi151.stdout:Building ocfs2 2023-12-19T16:09:48.561 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/ocfs2/group.list 2023-12-19T16:09:48.612 INFO:teuthology.orchestra.run.smithi151.stdout:Building overlay 2023-12-19T16:09:48.628 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/overlay/group.list 2023-12-19T16:09:48.786 INFO:teuthology.orchestra.run.smithi151.stdout:Building perf 2023-12-19T16:09:48.801 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/perf/group.list 2023-12-19T16:09:48.845 INFO:teuthology.orchestra.run.smithi151.stdout:Building selftest 2023-12-19T16:09:48.862 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/selftest/group.list 2023-12-19T16:09:48.905 INFO:teuthology.orchestra.run.smithi151.stdout:Building shared 2023-12-19T16:09:48.918 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/shared/group.list 2023-12-19T16:09:48.977 INFO:teuthology.orchestra.run.smithi151.stdout:Building tmpfs 2023-12-19T16:09:48.992 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/tmpfs/group.list 2023-12-19T16:09:49.043 INFO:teuthology.orchestra.run.smithi151.stdout:Building udf 2023-12-19T16:09:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/udf/group.list 2023-12-19T16:09:49.100 INFO:teuthology.orchestra.run.smithi151.stdout:Building xfs 2023-12-19T16:09:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: [GROUP] /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/xfs/group.list 2023-12-19T16:09:49.476 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-12-19T16:09:49.481 INFO:teuthology.orchestra.run.smithi151.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-19T16:09:49.481 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-12-19T16:09:49.486 INFO:teuthology.orchestra.run.smithi151.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-19T16:09:49.486 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-12-19T16:09:49.492 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-12-19T16:09:49.527 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-12-19T16:09:49.774 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-12-19T16:09:49.808 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-12-19T16:09:49.852 INFO:teuthology.orchestra.run.smithi151.stdout:Building log-writes 2023-12-19T16:09:49.863 INFO:teuthology.orchestra.run.smithi151.stdout:Building perf 2023-12-19T16:09:49.874 INFO:teuthology.orchestra.run.smithi151.stdout:Building aio-dio-regress 2023-12-19T16:09:49.885 INFO:teuthology.orchestra.run.smithi151.stdout:Building vfs 2023-12-19T16:09:49.893 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake -C log-writes install 2023-12-19T16:09:49.897 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-12-19T16:09:49.931 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-12-19T16:09:49.964 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake -C perf install 2023-12-19T16:09:49.967 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-12-19T16:09:50.000 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-12-19T16:09:50.082 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-12-19T16:09:50.087 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-12-19T16:09:50.120 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-12-19T16:09:50.314 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake -C vfs install 2023-12-19T16:09:50.317 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-12-19T16:09:50.350 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-12-19T16:09:50.395 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-12-19T16:09:50.428 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2023-12-19T16:09:54.901 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-12-19T16:09:55.242 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-12-19T16:09:55.310 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-12-19T16:09:55.315 INFO:teuthology.orchestra.run.smithi151.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-19T16:09:55.315 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-12-19T16:09:55.318 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-12-19T16:09:55.350 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-12-19T16:09:55.835 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-12-19T16:09:55.838 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/btrfs/ install 2023-12-19T16:09:55.845 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-12-19T16:09:55.878 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 /var/lib/xfstests/tests/btrfs 2023-12-19T16:09:59.045 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-12-19T16:09:59.080 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out /var/lib/xfstests/tests/btrfs 2023-12-19T16:09:59.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:09:59.141 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:09:59.144 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:10:02.143 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/ceph/ install 2023-12-19T16:10:02.147 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-12-19T16:10:02.178 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-12-19T16:10:02.251 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-12-19T16:10:02.282 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-12-19T16:10:02.355 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/cifs/ install 2023-12-19T16:10:02.359 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-12-19T16:10:02.394 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-12-19T16:10:02.427 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-12-19T16:10:02.460 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-12-19T16:10:02.494 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/ext4/ install 2023-12-19T16:10:02.499 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-12-19T16:10:02.533 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-12-19T16:10:03.248 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-12-19T16:10:03.283 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-12-19T16:10:04.055 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/f2fs/ install 2023-12-19T16:10:04.059 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-12-19T16:10:04.092 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-12-19T16:10:04.134 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-12-19T16:10:04.168 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-12-19T16:10:04.212 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/generic/ install 2023-12-19T16:10:04.223 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-12-19T16:10:04.255 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 /var/lib/xfstests/tests/generic 2023-12-19T16:10:11.967 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-12-19T16:10:12.003 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out /var/lib/xfstests/tests/generic 2023-12-19T16:10:20.778 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/nfs/ install 2023-12-19T16:10:20.783 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-12-19T16:10:20.818 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-12-19T16:10:20.853 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-12-19T16:10:20.885 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-12-19T16:10:20.917 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/ocfs2/ install 2023-12-19T16:10:20.921 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-12-19T16:10:20.953 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-12-19T16:10:20.986 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-12-19T16:10:21.020 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-12-19T16:10:21.054 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/overlay/ install 2023-12-19T16:10:21.059 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-12-19T16:10:21.094 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-12-19T16:10:22.140 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-12-19T16:10:22.172 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-12-19T16:10:23.209 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/perf/ install 2023-12-19T16:10:23.212 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-12-19T16:10:23.247 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-12-19T16:10:23.280 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-12-19T16:10:23.313 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-12-19T16:10:23.347 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/selftest/ install 2023-12-19T16:10:23.352 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-12-19T16:10:23.384 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-12-19T16:10:23.465 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-12-19T16:10:23.497 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-12-19T16:10:23.579 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/shared/ install 2023-12-19T16:10:23.583 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-12-19T16:10:23.616 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-12-19T16:10:23.670 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-12-19T16:10:23.704 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-12-19T16:10:23.758 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/tmpfs/ install 2023-12-19T16:10:23.762 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-12-19T16:10:23.797 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-12-19T16:10:23.830 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-12-19T16:10:23.863 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-12-19T16:10:23.896 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/udf/ install 2023-12-19T16:10:23.900 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-12-19T16:10:23.934 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-12-19T16:10:23.967 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-12-19T16:10:24.001 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-12-19T16:10:24.035 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.t6fx4IVDVzxfstests-dev/tests/xfs/ install 2023-12-19T16:10:24.045 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-12-19T16:10:24.079 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-12-19T16:10:29.277 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:10:29.280 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:10:29.283 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:10:31.663 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-12-19T16:10:31.693 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-12-19T16:10:39.436 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-12-19T16:10:39.470 INFO:teuthology.orchestra.run.smithi151.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-12-19T16:10:39.504 INFO:teuthology.orchestra.run.smithi151.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-12-19T16:10:39.537 INFO:teuthology.orchestra.run.smithi151.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-12-19T16:10:39.577 DEBUG:teuthology.orchestra.run.smithi151:> (cd /tmp/tmp.LLmHOUESMaxfsprogs-dev && exec sudo make) 2023-12-19T16:10:39.689 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize -c -i -f 2023-12-19T16:10:40.042 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, '.'. 2023-12-19T16:10:40.043 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: copying file './config.guess' 2023-12-19T16:10:40.057 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: copying file './config.sub' 2023-12-19T16:10:40.071 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: copying file './install-sh' 2023-12-19T16:10:40.085 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: copying file './ltmain.sh' 2023-12-19T16:10:40.169 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-12-19T16:10:40.169 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-12-19T16:10:40.186 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-12-19T16:10:40.202 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-12-19T16:10:40.219 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-12-19T16:10:40.236 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-12-19T16:10:40.259 INFO:teuthology.orchestra.run.smithi151.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-12-19T16:10:40.263 INFO:teuthology.orchestra.run.smithi151.stdout:cp include/install-sh . 2023-12-19T16:10:40.266 INFO:teuthology.orchestra.run.smithi151.stdout:aclocal -I m4 2023-12-19T16:10:41.641 INFO:teuthology.orchestra.run.smithi151.stdout:autoconf 2023-12-19T16:10:42.152 INFO:teuthology.orchestra.run.smithi151.stdout:./configure $LOCAL_CONFIGURE_OPTIONS 2023-12-19T16:10:42.343 INFO:teuthology.orchestra.run.smithi151.stdout:configure: loading site script /usr/share/config.site 2023-12-19T16:10:42.392 INFO:teuthology.orchestra.run.smithi151.stdout:checking for a BSD-compatible install... /bin/install -c 2023-12-19T16:10:42.527 INFO:teuthology.orchestra.run.smithi151.stdout:checking build system type... x86_64-pc-linux-gnu 2023-12-19T16:10:42.527 INFO:teuthology.orchestra.run.smithi151.stdout:checking host system type... x86_64-pc-linux-gnu 2023-12-19T16:10:42.532 INFO:teuthology.orchestra.run.smithi151.stdout:checking how to print strings... printf 2023-12-19T16:10:42.532 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gcc... gcc 2023-12-19T16:10:42.662 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether the C compiler works... yes 2023-12-19T16:10:42.662 INFO:teuthology.orchestra.run.smithi151.stdout:checking for C compiler default output file name... a.out 2023-12-19T16:10:42.732 INFO:teuthology.orchestra.run.smithi151.stdout:checking for suffix of executables... 2023-12-19T16:10:42.809 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether we are cross compiling... no 2023-12-19T16:10:42.862 INFO:teuthology.orchestra.run.smithi151.stdout:checking for suffix of object files... o 2023-12-19T16:10:42.908 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether we are using the GNU C compiler... yes 2023-12-19T16:10:42.955 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether gcc accepts -g... yes 2023-12-19T16:10:43.018 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gcc option to accept ISO C89... none needed 2023-12-19T16:10:43.027 INFO:teuthology.orchestra.run.smithi151.stdout:checking for a sed that does not truncate output... /bin/sed 2023-12-19T16:10:43.036 INFO:teuthology.orchestra.run.smithi151.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-12-19T16:10:43.040 INFO:teuthology.orchestra.run.smithi151.stdout:checking for egrep... /bin/grep -E 2023-12-19T16:10:43.044 INFO:teuthology.orchestra.run.smithi151.stdout:checking for fgrep... /bin/grep -F 2023-12-19T16:10:43.056 INFO:teuthology.orchestra.run.smithi151.stdout:checking for ld used by gcc... /bin/ld 2023-12-19T16:10:43.061 INFO:teuthology.orchestra.run.smithi151.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-12-19T16:10:43.067 INFO:teuthology.orchestra.run.smithi151.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-12-19T16:10:43.145 INFO:teuthology.orchestra.run.smithi151.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-12-19T16:10:43.146 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether ln -s works... yes 2023-12-19T16:10:43.155 INFO:teuthology.orchestra.run.smithi151.stdout:checking the maximum length of command line arguments... 1572864 2023-12-19T16:10:43.163 INFO:teuthology.orchestra.run.smithi151.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-12-19T16:10:43.163 INFO:teuthology.orchestra.run.smithi151.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-12-19T16:10:43.163 INFO:teuthology.orchestra.run.smithi151.stdout:checking for /bin/ld option to reload object files... -r 2023-12-19T16:10:43.164 INFO:teuthology.orchestra.run.smithi151.stdout:checking for objdump... objdump 2023-12-19T16:10:43.164 INFO:teuthology.orchestra.run.smithi151.stdout:checking how to recognize dependent libraries... pass_all 2023-12-19T16:10:43.164 INFO:teuthology.orchestra.run.smithi151.stdout:checking for dlltool... no 2023-12-19T16:10:43.165 INFO:teuthology.orchestra.run.smithi151.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-12-19T16:10:43.165 INFO:teuthology.orchestra.run.smithi151.stdout:checking for ar... ar 2023-12-19T16:10:43.249 INFO:teuthology.orchestra.run.smithi151.stdout:checking for archiver @FILE support... @ 2023-12-19T16:10:43.250 INFO:teuthology.orchestra.run.smithi151.stdout:checking for strip... strip 2023-12-19T16:10:43.251 INFO:teuthology.orchestra.run.smithi151.stdout:checking for ranlib... ranlib 2023-12-19T16:10:43.251 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gawk... gawk 2023-12-19T16:10:43.435 INFO:teuthology.orchestra.run.smithi151.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-12-19T16:10:43.439 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sysroot... no 2023-12-19T16:10:43.449 INFO:teuthology.orchestra.run.smithi151.stdout:checking for a working dd... /bin/dd 2023-12-19T16:10:43.460 INFO:teuthology.orchestra.run.smithi151.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-12-19T16:10:43.499 INFO:teuthology.orchestra.run.smithi151.stdout:checking for mt... no 2023-12-19T16:10:43.509 INFO:teuthology.orchestra.run.smithi151.stdout:checking if : is a manifest tool... no 2023-12-19T16:10:43.582 INFO:teuthology.orchestra.run.smithi151.stdout:checking how to run the C preprocessor... gcc -E 2023-12-19T16:10:43.870 INFO:teuthology.orchestra.run.smithi151.stdout:checking for ANSI C header files... yes 2023-12-19T16:10:43.929 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/types.h... yes 2023-12-19T16:10:43.995 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/stat.h... yes 2023-12-19T16:10:44.065 INFO:teuthology.orchestra.run.smithi151.stdout:checking for stdlib.h... yes 2023-12-19T16:10:44.137 INFO:teuthology.orchestra.run.smithi151.stdout:checking for string.h... yes 2023-12-19T16:10:44.209 INFO:teuthology.orchestra.run.smithi151.stdout:checking for memory.h... yes 2023-12-19T16:10:44.282 INFO:teuthology.orchestra.run.smithi151.stdout:checking for strings.h... yes 2023-12-19T16:10:44.352 INFO:teuthology.orchestra.run.smithi151.stdout:checking for inttypes.h... yes 2023-12-19T16:10:44.428 INFO:teuthology.orchestra.run.smithi151.stdout:checking for stdint.h... yes 2023-12-19T16:10:44.501 INFO:teuthology.orchestra.run.smithi151.stdout:checking for unistd.h... yes 2023-12-19T16:10:44.574 INFO:teuthology.orchestra.run.smithi151.stdout:checking for dlfcn.h... yes 2023-12-19T16:10:44.586 INFO:teuthology.orchestra.run.smithi151.stdout:checking for objdir... .libs 2023-12-19T16:10:44.760 INFO:teuthology.orchestra.run.smithi151.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-12-19T16:10:44.761 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-12-19T16:10:44.812 INFO:teuthology.orchestra.run.smithi151.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-12-19T16:10:44.861 INFO:teuthology.orchestra.run.smithi151.stdout:checking if gcc static flag -static works... no 2023-12-19T16:10:44.935 INFO:teuthology.orchestra.run.smithi151.stdout:checking if gcc supports -c -o file.o... yes 2023-12-19T16:10:44.935 INFO:teuthology.orchestra.run.smithi151.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-12-19T16:10:44.958 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-12-19T16:10:45.028 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether -lc should be explicitly linked in... no 2023-12-19T16:10:45.158 INFO:teuthology.orchestra.run.smithi151.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-12-19T16:10:45.158 INFO:teuthology.orchestra.run.smithi151.stdout:checking how to hardcode library paths into programs... immediate 2023-12-19T16:10:45.162 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether stripping libraries is possible... yes 2023-12-19T16:10:45.162 INFO:teuthology.orchestra.run.smithi151.stdout:checking if libtool supports shared libraries... yes 2023-12-19T16:10:45.162 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether to build shared libraries... yes 2023-12-19T16:10:45.162 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether to build static libraries... yes 2023-12-19T16:10:45.163 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gcc... (cached) gcc 2023-12-19T16:10:45.212 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-19T16:10:45.212 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-19T16:10:45.212 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-19T16:10:45.229 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gcc... (cached) gcc 2023-12-19T16:10:45.282 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-19T16:10:45.282 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-19T16:10:45.282 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-19T16:10:45.292 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gcc... (cached) gcc 2023-12-19T16:10:45.344 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-19T16:10:45.345 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-19T16:10:45.345 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-19T16:10:45.345 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gmake... /bin/gmake 2023-12-19T16:10:45.345 INFO:teuthology.orchestra.run.smithi151.stdout:checking for tar... /bin/tar 2023-12-19T16:10:45.345 INFO:teuthology.orchestra.run.smithi151.stdout:checking for gzip... /bin/gzip 2023-12-19T16:10:45.370 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether gcc -MM is supported... yes 2023-12-19T16:10:45.370 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sort... /bin/sort 2023-12-19T16:10:45.370 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether ln -s works... yes 2023-12-19T16:10:45.371 INFO:teuthology.orchestra.run.smithi151.stdout:checking for msgfmt... /bin/msgfmt 2023-12-19T16:10:45.371 INFO:teuthology.orchestra.run.smithi151.stdout:checking for msgmerge... /bin/msgmerge 2023-12-19T16:10:45.371 INFO:teuthology.orchestra.run.smithi151.stdout:checking for xgettext... /bin/xgettext 2023-12-19T16:10:45.371 INFO:teuthology.orchestra.run.smithi151.stdout:checking for rpm... /bin/rpm 2023-12-19T16:10:45.382 INFO:teuthology.orchestra.run.smithi151.stdout:checking for rpmbuild... no 2023-12-19T16:10:45.448 INFO:teuthology.orchestra.run.smithi151.stdout:checking ini.h usability... yes 2023-12-19T16:10:45.475 INFO:teuthology.orchestra.run.smithi151.stdout:checking ini.h presence... yes 2023-12-19T16:10:45.475 INFO:teuthology.orchestra.run.smithi151.stdout:checking for ini.h... yes 2023-12-19T16:10:45.560 INFO:teuthology.orchestra.run.smithi151.stdout:checking for ini_parse in -linih... yes 2023-12-19T16:10:45.632 INFO:teuthology.orchestra.run.smithi151.stdout:checking uuid.h usability... no 2023-12-19T16:10:45.674 INFO:teuthology.orchestra.run.smithi151.stdout:checking uuid.h presence... no 2023-12-19T16:10:45.675 INFO:teuthology.orchestra.run.smithi151.stdout:checking for uuid.h... no 2023-12-19T16:10:45.746 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/uuid.h usability... no 2023-12-19T16:10:45.786 INFO:teuthology.orchestra.run.smithi151.stdout:checking sys/uuid.h presence... no 2023-12-19T16:10:45.786 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sys/uuid.h... no 2023-12-19T16:10:45.858 INFO:teuthology.orchestra.run.smithi151.stdout:checking uuid/uuid.h usability... yes 2023-12-19T16:10:45.888 INFO:teuthology.orchestra.run.smithi151.stdout:checking uuid/uuid.h presence... yes 2023-12-19T16:10:45.888 INFO:teuthology.orchestra.run.smithi151.stdout:checking for uuid/uuid.h... yes 2023-12-19T16:10:45.981 INFO:teuthology.orchestra.run.smithi151.stdout:checking for uuid_compare... no 2023-12-19T16:10:46.058 INFO:teuthology.orchestra.run.smithi151.stdout:checking for uuid_compare in -luuid... yes 2023-12-19T16:10:46.121 INFO:teuthology.orchestra.run.smithi151.stdout:checking pthread.h usability... yes 2023-12-19T16:10:46.153 INFO:teuthology.orchestra.run.smithi151.stdout:checking pthread.h presence... yes 2023-12-19T16:10:46.154 INFO:teuthology.orchestra.run.smithi151.stdout:checking for pthread.h... yes 2023-12-19T16:10:46.238 INFO:teuthology.orchestra.run.smithi151.stdout:checking for pthread_mutex_init in -lpthread... yes 2023-12-19T16:10:46.309 INFO:teuthology.orchestra.run.smithi151.stdout:checking urcu.h usability... yes 2023-12-19T16:10:46.348 INFO:teuthology.orchestra.run.smithi151.stdout:checking urcu.h presence... yes 2023-12-19T16:10:46.348 INFO:teuthology.orchestra.run.smithi151.stdout:checking for urcu.h... yes 2023-12-19T16:10:46.416 INFO:teuthology.orchestra.run.smithi151.stdout:checking for liburcu... yes 2023-12-19T16:10:46.469 INFO:teuthology.orchestra.run.smithi151.stdout:checking for fadvise ... yes 2023-12-19T16:10:46.519 INFO:teuthology.orchestra.run.smithi151.stdout:checking for madvise ... yes 2023-12-19T16:10:46.575 INFO:teuthology.orchestra.run.smithi151.stdout:checking for mincore ... yes 2023-12-19T16:10:46.631 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sendfile ... yes 2023-12-19T16:10:46.684 INFO:teuthology.orchestra.run.smithi151.stdout:checking for getmntent ... yes 2023-12-19T16:10:46.769 INFO:teuthology.orchestra.run.smithi151.stdout:checking for fallocate... yes 2023-12-19T16:10:46.853 INFO:teuthology.orchestra.run.smithi151.stdout:checking for fiemap... yes 2023-12-19T16:10:46.938 INFO:teuthology.orchestra.run.smithi151.stdout:checking for pwritev2... yes 2023-12-19T16:10:47.024 INFO:teuthology.orchestra.run.smithi151.stdout:checking for preadv... yes 2023-12-19T16:10:47.112 INFO:teuthology.orchestra.run.smithi151.stdout:checking for copy_file_range... yes 2023-12-19T16:10:47.195 INFO:teuthology.orchestra.run.smithi151.stdout:checking for sync_file_range... yes 2023-12-19T16:10:47.277 INFO:teuthology.orchestra.run.smithi151.stdout:checking for syncfs... yes 2023-12-19T16:10:47.339 INFO:teuthology.orchestra.run.smithi151.stdout:checking mntent.h usability... yes 2023-12-19T16:10:47.367 INFO:teuthology.orchestra.run.smithi151.stdout:checking mntent.h presence... yes 2023-12-19T16:10:47.367 INFO:teuthology.orchestra.run.smithi151.stdout:checking for mntent.h... yes 2023-12-19T16:10:47.427 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether fls is declared... no 2023-12-19T16:10:47.506 INFO:teuthology.orchestra.run.smithi151.stdout:checking for readdir... yes 2023-12-19T16:10:47.575 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether fsetxattr is declared... yes 2023-12-19T16:10:47.639 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether mremap is declared... yes 2023-12-19T16:10:47.736 INFO:teuthology.orchestra.run.smithi151.stdout:checking for struct fsxattr... yes 2023-12-19T16:10:47.790 INFO:teuthology.orchestra.run.smithi151.stdout:checking for struct fsxattr.fsx_cowextsize... yes 2023-12-19T16:10:47.887 INFO:teuthology.orchestra.run.smithi151.stdout:checking for struct fscrypt_add_key_arg... yes 2023-12-19T16:10:47.938 INFO:teuthology.orchestra.run.smithi151.stdout:checking for struct fscrypt_add_key_arg.key_id... yes 2023-12-19T16:10:48.030 INFO:teuthology.orchestra.run.smithi151.stdout:checking for GETFSMAP... yes 2023-12-19T16:10:48.131 INFO:teuthology.orchestra.run.smithi151.stdout:checking for struct statfs... yes 2023-12-19T16:10:48.186 INFO:teuthology.orchestra.run.smithi151.stdout:checking for struct statfs.f_flags... yes 2023-12-19T16:10:48.237 INFO:teuthology.orchestra.run.smithi151.stdout:checking for MAP_SYNC... yes 2023-12-19T16:10:48.411 INFO:teuthology.orchestra.run.smithi151.stdout:checking for library containing dm_task_create... -ldevmapper 2023-12-19T16:10:48.471 INFO:teuthology.orchestra.run.smithi151.stdout:checking for mallinfo ... yes 2023-12-19T16:10:48.524 INFO:teuthology.orchestra.run.smithi151.stdout:checking for mallinfo2 ... yes 2023-12-19T16:10:48.585 INFO:teuthology.orchestra.run.smithi151.stdout:checking attr/attributes.h usability... yes 2023-12-19T16:10:48.609 INFO:teuthology.orchestra.run.smithi151.stdout:checking attr/attributes.h presence... yes 2023-12-19T16:10:48.609 INFO:teuthology.orchestra.run.smithi151.stdout:checking for attr/attributes.h... yes 2023-12-19T16:10:48.660 INFO:teuthology.orchestra.run.smithi151.stdout:checking for struct attrlist_cursor... yes 2023-12-19T16:10:48.665 INFO:teuthology.orchestra.run.smithi151.stdout:checking for pkg-config... /bin/pkg-config 2023-12-19T16:10:48.684 INFO:teuthology.orchestra.run.smithi151.stdout:checking pkg-config is at least version 0.9.0... yes 2023-12-19T16:10:48.768 INFO:teuthology.orchestra.run.smithi151.stdout:checking for libicu... yes 2023-12-19T16:10:48.838 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether openat is declared... yes 2023-12-19T16:10:48.905 INFO:teuthology.orchestra.run.smithi151.stdout:checking whether fstatat is declared... yes 2023-12-19T16:10:48.971 INFO:teuthology.orchestra.run.smithi151.stdout:checking for struct sg_io_hdr ... yes 2023-12-19T16:10:49.037 INFO:teuthology.orchestra.run.smithi151.stdout:checking for struct hd_geometry ... yes 2023-12-19T16:10:49.125 INFO:teuthology.orchestra.run.smithi151.stdout:checking for systemd... yes 2023-12-19T16:10:49.144 INFO:teuthology.orchestra.run.smithi151.stdout:checking for systemd system unit dir... /usr/lib/systemd/system 2023-12-19T16:10:49.145 INFO:teuthology.orchestra.run.smithi151.stdout:checking for system crontab dir... /etc/cron.d 2023-12-19T16:10:49.225 INFO:teuthology.orchestra.run.smithi151.stdout:checking for udev... yes 2023-12-19T16:10:49.244 INFO:teuthology.orchestra.run.smithi151.stdout:checking for udev rule dir... /usr/lib/udev/rules.d 2023-12-19T16:10:49.437 INFO:teuthology.orchestra.run.smithi151.stdout:checking for library containing blkid_probe_all... -lblkid 2023-12-19T16:10:49.527 INFO:teuthology.orchestra.run.smithi151.stdout:checking for blkid_probe_get_topology... yes 2023-12-19T16:10:49.636 INFO:teuthology.orchestra.run.smithi151.stdout:checking size of long... 8 2023-12-19T16:10:49.751 INFO:teuthology.orchestra.run.smithi151.stdout:checking size of char *... 8 2023-12-19T16:10:49.797 INFO:teuthology.orchestra.run.smithi151.stdout:checking for umode_t... no 2023-12-19T16:10:49.910 INFO:teuthology.orchestra.run.smithi151.stdout:checking for atomic64_t support in liburcu... yes 2023-12-19T16:10:49.958 INFO:teuthology.orchestra.run.smithi151.stdout:configure: creating ./config.status 2023-12-19T16:10:51.283 INFO:teuthology.orchestra.run.smithi151.stdout:config.status: creating include/builddefs 2023-12-19T16:10:51.323 INFO:teuthology.orchestra.run.smithi151.stdout:config.status: creating include/platform_defs.h 2023-12-19T16:10:51.356 INFO:teuthology.orchestra.run.smithi151.stdout:config.status: executing libtool commands 2023-12-19T16:10:51.481 INFO:teuthology.orchestra.run.smithi151.stdout: [HEADERS] include 2023-12-19T16:10:51.506 INFO:teuthology.orchestra.run.smithi151.stdout: [HEADERS] libxfs 2023-12-19T16:10:51.546 INFO:teuthology.orchestra.run.smithi151.stdout:Building include 2023-12-19T16:10:51.560 INFO:teuthology.orchestra.run.smithi151.stdout: [LN] disk 2023-12-19T16:10:51.566 INFO:teuthology.orchestra.run.smithi151.stdout:Building libfrog 2023-12-19T16:10:51.576 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] gen_crc32table 2023-12-19T16:10:51.670 INFO:teuthology.orchestra.run.smithi151.stdout: [GENERATE] crc32table.h 2023-12-19T16:10:52.388 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] avl64.lo 2023-12-19T16:10:53.129 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] bitmap.lo 2023-12-19T16:10:53.714 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] bulkstat.lo 2023-12-19T16:10:54.394 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] convert.lo 2023-12-19T16:10:55.055 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] crc32.lo 2023-12-19T16:10:55.517 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fsgeom.lo 2023-12-19T16:10:56.139 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] list_sort.lo 2023-12-19T16:10:56.597 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] linux.lo 2023-12-19T16:10:57.212 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] logging.lo 2023-12-19T16:10:57.648 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] paths.lo 2023-12-19T16:10:58.328 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] projects.lo 2023-12-19T16:10:58.858 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] ptvar.lo 2023-12-19T16:10:59.353 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] radix-tree.lo 2023-12-19T16:10:59.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:10:59.451 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:10:59.454 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:11:00.113 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] randbytes.lo 2023-12-19T16:11:00.566 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] scrub.lo 2023-12-19T16:11:01.017 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] util.lo 2023-12-19T16:11:01.514 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] workqueue.lo 2023-12-19T16:11:02.093 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] libfrog.la 2023-12-19T16:11:02.313 INFO:teuthology.orchestra.run.smithi151.stdout:Building libxfs 2023-12-19T16:11:04.680 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] cache.lo 2023-12-19T16:11:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] defer_item.lo 2023-12-19T16:11:06.278 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] init.lo 2023-12-19T16:11:07.292 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] kmem.lo 2023-12-19T16:11:07.826 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] logitem.lo 2023-12-19T16:11:08.425 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] rdwr.lo 2023-12-19T16:11:09.631 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] topology.lo 2023-12-19T16:11:10.228 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] trans.lo 2023-12-19T16:11:11.036 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] util.lo 2023-12-19T16:11:11.864 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_ag.lo 2023-12-19T16:11:12.934 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_ag_resv.lo 2023-12-19T16:11:13.558 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_alloc.lo 2023-12-19T16:11:15.457 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_alloc_btree.lo 2023-12-19T16:11:16.261 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_attr.lo 2023-12-19T16:11:17.135 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_attr_leaf.lo 2023-12-19T16:11:18.815 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_attr_remote.lo 2023-12-19T16:11:19.697 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_bit.lo 2023-12-19T16:11:20.278 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_bmap.lo 2023-12-19T16:11:23.388 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_bmap_btree.lo 2023-12-19T16:11:24.217 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_btree.lo 2023-12-19T16:11:26.712 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_btree_staging.lo 2023-12-19T16:11:27.438 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_da_btree.lo 2023-12-19T16:11:29.020 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_defer.lo 2023-12-19T16:11:29.592 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:11:29.595 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:11:29.597 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:11:29.857 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_dir2.lo 2023-12-19T16:11:30.668 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_dir2_block.lo 2023-12-19T16:11:31.855 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_dir2_data.lo 2023-12-19T16:11:32.942 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_dir2_leaf.lo 2023-12-19T16:11:34.160 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_dir2_node.lo 2023-12-19T16:11:35.502 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_dir2_sf.lo 2023-12-19T16:11:36.612 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_dquot_buf.lo 2023-12-19T16:11:37.233 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_ialloc.lo 2023-12-19T16:11:38.866 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_iext_tree.lo 2023-12-19T16:11:39.940 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_inode_buf.lo 2023-12-19T16:11:40.902 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_inode_fork.lo 2023-12-19T16:11:41.840 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_ialloc_btree.lo 2023-12-19T16:11:42.696 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_log_rlimit.lo 2023-12-19T16:11:43.283 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_refcount.lo 2023-12-19T16:11:44.477 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_refcount_btree.lo 2023-12-19T16:11:45.179 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_rmap.lo 2023-12-19T16:11:46.747 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_rmap_btree.lo 2023-12-19T16:11:47.647 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_rtbitmap.lo 2023-12-19T16:11:48.586 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_sb.lo 2023-12-19T16:11:49.735 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_symlink_remote.lo 2023-12-19T16:11:50.353 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_trans_inode.lo 2023-12-19T16:11:50.959 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_trans_resv.lo 2023-12-19T16:11:51.819 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_types.lo 2023-12-19T16:11:52.440 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] libxfs.la 2023-12-19T16:11:52.768 INFO:teuthology.orchestra.run.smithi151.stdout:Building libxlog 2023-12-19T16:11:52.893 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_log_recover.lo 2023-12-19T16:11:54.032 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] util.lo 2023-12-19T16:11:54.621 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] libxlog.la 2023-12-19T16:11:54.829 INFO:teuthology.orchestra.run.smithi151.stdout:Building libxcmd 2023-12-19T16:11:55.021 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] command.lo 2023-12-19T16:11:55.629 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] input.lo 2023-12-19T16:11:56.181 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] help.lo 2023-12-19T16:11:56.658 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] quit.lo 2023-12-19T16:11:57.118 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] libxcmd.la 2023-12-19T16:11:57.317 INFO:teuthology.orchestra.run.smithi151.stdout:Building libhandle 2023-12-19T16:11:57.431 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] handle.lo 2023-12-19T16:11:58.041 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] jdm.lo 2023-12-19T16:11:58.550 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] libhandle.la 2023-12-19T16:11:58.820 INFO:teuthology.orchestra.run.smithi151.stdout:Building copy 2023-12-19T16:11:58.904 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_copy.o 2023-12-19T16:11:59.420 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] xfs_copy 2023-12-19T16:11:59.670 INFO:teuthology.orchestra.run.smithi151.stdout:Building db 2023-12-19T16:11:59.726 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:11:59.729 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:11:59.732 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:12:02.630 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] addr.o 2023-12-19T16:12:02.781 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] agf.o 2023-12-19T16:12:02.919 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] agfl.o 2023-12-19T16:12:03.060 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] agi.o 2023-12-19T16:12:03.208 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] attr.o 2023-12-19T16:12:03.466 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] attrshort.o 2023-12-19T16:12:03.636 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] bit.o 2023-12-19T16:12:03.804 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] block.o 2023-12-19T16:12:03.996 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] bmap.o 2023-12-19T16:12:04.243 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] btblock.o 2023-12-19T16:12:04.415 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] bmroot.o 2023-12-19T16:12:04.629 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] check.o 2023-12-19T16:12:06.494 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] command.o 2023-12-19T16:12:06.644 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] crc.o 2023-12-19T16:12:06.800 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] debug.o 2023-12-19T16:12:06.931 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] dir2.o 2023-12-19T16:12:07.261 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] dir2sf.o 2023-12-19T16:12:07.442 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] dquot.o 2023-12-19T16:12:07.586 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] echo.o 2023-12-19T16:12:07.715 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] faddr.o 2023-12-19T16:12:07.945 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] field.o 2023-12-19T16:12:08.100 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] flist.o 2023-12-19T16:12:08.371 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fprint.o 2023-12-19T16:12:08.567 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] frag.o 2023-12-19T16:12:08.842 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] freesp.o 2023-12-19T16:12:09.070 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] hash.o 2023-12-19T16:12:09.159 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c: In function ‘hash_f’: 2023-12-19T16:12:09.159 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c:76:58: warning: pointer targets in passing argument 1 of ‘libxfs_da_hashname’ differ in signedness [-Wpointer-sign] 2023-12-19T16:12:09.160 INFO:teuthology.orchestra.run.smithi151.stderr: 76 | hashval = libxfs_da_hashname(argv[c], strlen(argv[c])); 2023-12-19T16:12:09.160 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~^~~ 2023-12-19T16:12:09.160 INFO:teuthology.orchestra.run.smithi151.stderr: | | 2023-12-19T16:12:09.160 INFO:teuthology.orchestra.run.smithi151.stderr: | char * 2023-12-19T16:12:09.160 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from ../include/libxfs.h:59, 2023-12-19T16:12:09.160 INFO:teuthology.orchestra.run.smithi151.stderr: from hash.c:7: 2023-12-19T16:12:09.160 INFO:teuthology.orchestra.run.smithi151.stderr:../libxfs/xfs_da_btree.h:223:37: note: expected ‘const uint8_t *’ {aka ‘const unsigned char *’} but argument is of type ‘char *’ 2023-12-19T16:12:09.160 INFO:teuthology.orchestra.run.smithi151.stderr: 223 | uint xfs_da_hashname(const uint8_t *name_string, int name_length); 2023-12-19T16:12:09.161 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~^~~~~~~~~~~ 2023-12-19T16:12:09.163 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c: In function ‘collide_dirents’: 2023-12-19T16:12:09.163 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c:258:36: warning: pointer targets in passing argument 2 of ‘openat’ differ in signedness [-Wpointer-sign] 2023-12-19T16:12:09.163 INFO:teuthology.orchestra.run.smithi151.stderr: 258 | newfd = openat(fd, name, O_CREAT, 0600); 2023-12-19T16:12:09.163 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~ 2023-12-19T16:12:09.163 INFO:teuthology.orchestra.run.smithi151.stderr: | | 2023-12-19T16:12:09.164 INFO:teuthology.orchestra.run.smithi151.stderr: | const unsigned char * 2023-12-19T16:12:09.164 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from /usr/include/features.h:490, 2023-12-19T16:12:09.164 INFO:teuthology.orchestra.run.smithi151.stderr: from /usr/include/bits/libc-header-start.h:33, 2023-12-19T16:12:09.164 INFO:teuthology.orchestra.run.smithi151.stderr: from /usr/include/stdio.h:27, 2023-12-19T16:12:09.164 INFO:teuthology.orchestra.run.smithi151.stderr: from ../include/platform_defs.h:10, 2023-12-19T16:12:09.164 INFO:teuthology.orchestra.run.smithi151.stderr: from ../include/libxfs.h:11, 2023-12-19T16:12:09.164 INFO:teuthology.orchestra.run.smithi151.stderr: from hash.c:7: 2023-12-19T16:12:09.164 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/fcntl.h:237:12: note: expected ‘const char *’ but argument is of type ‘const unsigned char *’ 2023-12-19T16:12:09.164 INFO:teuthology.orchestra.run.smithi151.stderr: 237 | extern int __REDIRECT (openat, (int __fd, const char *__file, int __oflag, 2023-12-19T16:12:09.164 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~ 2023-12-19T16:12:09.164 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c:273:25: warning: pointer targets in passing argument 1 of ‘strncpy’ differ in signedness [-Wpointer-sign] 2023-12-19T16:12:09.164 INFO:teuthology.orchestra.run.smithi151.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2023-12-19T16:12:09.164 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~ 2023-12-19T16:12:09.164 INFO:teuthology.orchestra.run.smithi151.stderr: | | 2023-12-19T16:12:09.165 INFO:teuthology.orchestra.run.smithi151.stderr: | unsigned char * 2023-12-19T16:12:09.165 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from ../include/platform_defs.h:17, 2023-12-19T16:12:09.165 INFO:teuthology.orchestra.run.smithi151.stderr: from ../include/libxfs.h:11, 2023-12-19T16:12:09.165 INFO:teuthology.orchestra.run.smithi151.stderr: from hash.c:7: 2023-12-19T16:12:09.165 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/string.h:128:40: note: expected ‘char * restrict’ but argument is of type ‘unsigned char *’ 2023-12-19T16:12:09.165 INFO:teuthology.orchestra.run.smithi151.stderr: 128 | extern char *strncpy (char *__restrict __dest, 2023-12-19T16:12:09.165 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~^~~~~~ 2023-12-19T16:12:09.165 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c:273:37: warning: pointer targets in passing argument 2 of ‘strncpy’ differ in signedness [-Wpointer-sign] 2023-12-19T16:12:09.165 INFO:teuthology.orchestra.run.smithi151.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2023-12-19T16:12:09.165 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~ 2023-12-19T16:12:09.165 INFO:teuthology.orchestra.run.smithi151.stderr: | | 2023-12-19T16:12:09.165 INFO:teuthology.orchestra.run.smithi151.stderr: | const unsigned char * 2023-12-19T16:12:09.165 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from ../include/platform_defs.h:17, 2023-12-19T16:12:09.166 INFO:teuthology.orchestra.run.smithi151.stderr: from ../include/libxfs.h:11, 2023-12-19T16:12:09.166 INFO:teuthology.orchestra.run.smithi151.stderr: from hash.c:7: 2023-12-19T16:12:09.166 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/string.h:129:46: note: expected ‘const char * restrict’ but argument is of type ‘const unsigned char *’ 2023-12-19T16:12:09.166 INFO:teuthology.orchestra.run.smithi151.stderr: 129 | const char *__restrict __src, size_t __n) 2023-12-19T16:12:09.166 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~^~~~~ 2023-12-19T16:12:09.166 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c:278:44: warning: pointer targets in passing argument 2 of ‘linkat’ differ in signedness [-Wpointer-sign] 2023-12-19T16:12:09.166 INFO:teuthology.orchestra.run.smithi151.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2023-12-19T16:12:09.166 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~ 2023-12-19T16:12:09.166 INFO:teuthology.orchestra.run.smithi151.stderr: | | 2023-12-19T16:12:09.166 INFO:teuthology.orchestra.run.smithi151.stderr: | const unsigned char * 2023-12-19T16:12:09.166 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from ../include/platform_defs.h:19, 2023-12-19T16:12:09.166 INFO:teuthology.orchestra.run.smithi151.stderr: from ../include/libxfs.h:11, 2023-12-19T16:12:09.166 INFO:teuthology.orchestra.run.smithi151.stderr: from hash.c:7: 2023-12-19T16:12:09.166 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/unistd.h:825:46: note: expected ‘const char *’ but argument is of type ‘const unsigned char *’ 2023-12-19T16:12:09.167 INFO:teuthology.orchestra.run.smithi151.stderr: 825 | extern int linkat (int __fromfd, const char *__from, int __tofd, 2023-12-19T16:12:09.167 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-12-19T16:12:09.167 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c:278:54: warning: pointer targets in passing argument 4 of ‘linkat’ differ in signedness [-Wpointer-sign] 2023-12-19T16:12:09.167 INFO:teuthology.orchestra.run.smithi151.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2023-12-19T16:12:09.167 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~~ 2023-12-19T16:12:09.167 INFO:teuthology.orchestra.run.smithi151.stderr: | | 2023-12-19T16:12:09.167 INFO:teuthology.orchestra.run.smithi151.stderr: | unsigned char * 2023-12-19T16:12:09.167 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from ../include/platform_defs.h:19, 2023-12-19T16:12:09.167 INFO:teuthology.orchestra.run.smithi151.stderr: from ../include/libxfs.h:11, 2023-12-19T16:12:09.167 INFO:teuthology.orchestra.run.smithi151.stderr: from hash.c:7: 2023-12-19T16:12:09.167 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/unistd.h:826:32: note: expected ‘const char *’ but argument is of type ‘unsigned char *’ 2023-12-19T16:12:09.167 INFO:teuthology.orchestra.run.smithi151.stderr: 826 | const char *__to, int __flags) 2023-12-19T16:12:09.167 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~^~~~ 2023-12-19T16:12:09.167 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c: In function ‘collide_xattrs’: 2023-12-19T16:12:09.168 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c:318:26: warning: pointer targets in passing argument 1 of ‘snprintf’ differ in signedness [-Wpointer-sign] 2023-12-19T16:12:09.168 INFO:teuthology.orchestra.run.smithi151.stderr: 318 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-12-19T16:12:09.168 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~ 2023-12-19T16:12:09.168 INFO:teuthology.orchestra.run.smithi151.stderr: | | 2023-12-19T16:12:09.168 INFO:teuthology.orchestra.run.smithi151.stderr: | unsigned char * 2023-12-19T16:12:09.168 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from ../include/platform_defs.h:10, 2023-12-19T16:12:09.168 INFO:teuthology.orchestra.run.smithi151.stderr: from ../include/libxfs.h:11, 2023-12-19T16:12:09.168 INFO:teuthology.orchestra.run.smithi151.stderr: from hash.c:7: 2023-12-19T16:12:09.168 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/stdio.h:372:39: note: expected ‘char * restrict’ but argument is of type ‘unsigned char *’ 2023-12-19T16:12:09.168 INFO:teuthology.orchestra.run.smithi151.stderr: 372 | extern int snprintf (char *__restrict __s, size_t __maxlen, 2023-12-19T16:12:09.168 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~^~~ 2023-12-19T16:12:09.168 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c:319:39: warning: pointer targets in passing argument 2 of ‘fsetxattr’ differ in signedness [-Wpointer-sign] 2023-12-19T16:12:09.169 INFO:teuthology.orchestra.run.smithi151.stderr: 319 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-12-19T16:12:09.169 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~ 2023-12-19T16:12:09.169 INFO:teuthology.orchestra.run.smithi151.stderr: | | 2023-12-19T16:12:09.169 INFO:teuthology.orchestra.run.smithi151.stderr: | unsigned char * 2023-12-19T16:12:09.169 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from hash.c:16: 2023-12-19T16:12:09.169 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/sys/xattr.h:54:45: note: expected ‘const char *’ but argument is of type ‘unsigned char *’ 2023-12-19T16:12:09.169 INFO:teuthology.orchestra.run.smithi151.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-12-19T16:12:09.169 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-12-19T16:12:09.169 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c:332:26: warning: pointer targets in passing argument 1 of ‘snprintf’ differ in signedness [-Wpointer-sign] 2023-12-19T16:12:09.169 INFO:teuthology.orchestra.run.smithi151.stderr: 332 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-12-19T16:12:09.169 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~ 2023-12-19T16:12:09.169 INFO:teuthology.orchestra.run.smithi151.stderr: | | 2023-12-19T16:12:09.169 INFO:teuthology.orchestra.run.smithi151.stderr: | unsigned char * 2023-12-19T16:12:09.170 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from ../include/platform_defs.h:10, 2023-12-19T16:12:09.170 INFO:teuthology.orchestra.run.smithi151.stderr: from ../include/libxfs.h:11, 2023-12-19T16:12:09.170 INFO:teuthology.orchestra.run.smithi151.stderr: from hash.c:7: 2023-12-19T16:12:09.170 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/stdio.h:372:39: note: expected ‘char * restrict’ but argument is of type ‘unsigned char *’ 2023-12-19T16:12:09.170 INFO:teuthology.orchestra.run.smithi151.stderr: 372 | extern int snprintf (char *__restrict __s, size_t __maxlen, 2023-12-19T16:12:09.170 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~^~~ 2023-12-19T16:12:09.170 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c:337:47: warning: pointer targets in passing argument 2 of ‘fsetxattr’ differ in signedness [-Wpointer-sign] 2023-12-19T16:12:09.170 INFO:teuthology.orchestra.run.smithi151.stderr: 337 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-12-19T16:12:09.170 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~~~~~~~ 2023-12-19T16:12:09.170 INFO:teuthology.orchestra.run.smithi151.stderr: | | 2023-12-19T16:12:09.170 INFO:teuthology.orchestra.run.smithi151.stderr: | unsigned char * 2023-12-19T16:12:09.170 INFO:teuthology.orchestra.run.smithi151.stderr:In file included from hash.c:16: 2023-12-19T16:12:09.171 INFO:teuthology.orchestra.run.smithi151.stderr:/usr/include/sys/xattr.h:54:45: note: expected ‘const char *’ but argument is of type ‘unsigned char *’ 2023-12-19T16:12:09.171 INFO:teuthology.orchestra.run.smithi151.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-12-19T16:12:09.171 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-12-19T16:12:09.171 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c: In function ‘hashcoll_f’: 2023-12-19T16:12:09.171 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c:417:52: warning: pointer targets in passing argument 2 of ‘collide_xattrs’ differ in signedness [-Wpointer-sign] 2023-12-19T16:12:09.171 INFO:teuthology.orchestra.run.smithi151.stderr: 417 | error = collide_xattrs(nr, buf, len, fd); 2023-12-19T16:12:09.171 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~ 2023-12-19T16:12:09.171 INFO:teuthology.orchestra.run.smithi151.stderr: | | 2023-12-19T16:12:09.171 INFO:teuthology.orchestra.run.smithi151.stderr: | char * 2023-12-19T16:12:09.171 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c:300:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-12-19T16:12:09.171 INFO:teuthology.orchestra.run.smithi151.stderr: 300 | const unsigned char *name, 2023-12-19T16:12:09.171 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-12-19T16:12:09.172 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c:419:53: warning: pointer targets in passing argument 2 of ‘collide_dirents’ differ in signedness [-Wpointer-sign] 2023-12-19T16:12:09.172 INFO:teuthology.orchestra.run.smithi151.stderr: 419 | error = collide_dirents(nr, buf, len, fd); 2023-12-19T16:12:09.172 INFO:teuthology.orchestra.run.smithi151.stderr: | ^~~ 2023-12-19T16:12:09.172 INFO:teuthology.orchestra.run.smithi151.stderr: | | 2023-12-19T16:12:09.172 INFO:teuthology.orchestra.run.smithi151.stderr: | char * 2023-12-19T16:12:09.172 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c:234:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-12-19T16:12:09.172 INFO:teuthology.orchestra.run.smithi151.stderr: 234 | const unsigned char *name, 2023-12-19T16:12:09.172 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-12-19T16:12:09.172 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c:431:56: warning: pointer targets in passing argument 2 of ‘collide_xattrs’ differ in signedness [-Wpointer-sign] 2023-12-19T16:12:09.172 INFO:teuthology.orchestra.run.smithi151.stderr: 431 | error = collide_xattrs(nr, argv[c], len, fd); 2023-12-19T16:12:09.172 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~^~~ 2023-12-19T16:12:09.172 INFO:teuthology.orchestra.run.smithi151.stderr: | | 2023-12-19T16:12:09.173 INFO:teuthology.orchestra.run.smithi151.stderr: | char * 2023-12-19T16:12:09.173 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c:300:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-12-19T16:12:09.173 INFO:teuthology.orchestra.run.smithi151.stderr: 300 | const unsigned char *name, 2023-12-19T16:12:09.173 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-12-19T16:12:09.173 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c:433:57: warning: pointer targets in passing argument 2 of ‘collide_dirents’ differ in signedness [-Wpointer-sign] 2023-12-19T16:12:09.173 INFO:teuthology.orchestra.run.smithi151.stderr: 433 | error = collide_dirents(nr, argv[c], len, fd); 2023-12-19T16:12:09.173 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~^~~ 2023-12-19T16:12:09.173 INFO:teuthology.orchestra.run.smithi151.stderr: | | 2023-12-19T16:12:09.173 INFO:teuthology.orchestra.run.smithi151.stderr: | char * 2023-12-19T16:12:09.173 INFO:teuthology.orchestra.run.smithi151.stderr:hash.c:234:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-12-19T16:12:09.173 INFO:teuthology.orchestra.run.smithi151.stderr: 234 | const unsigned char *name, 2023-12-19T16:12:09.173 INFO:teuthology.orchestra.run.smithi151.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-12-19T16:12:09.270 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] help.o 2023-12-19T16:12:09.403 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] init.o 2023-12-19T16:12:09.557 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] inode.o 2023-12-19T16:12:09.872 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] input.o 2023-12-19T16:12:10.056 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] io.o 2023-12-19T16:12:10.296 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] logformat.o 2023-12-19T16:12:10.463 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] malloc.o 2023-12-19T16:12:10.596 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] metadump.o 2023-12-19T16:12:11.469 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] output.o 2023-12-19T16:12:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] print.o 2023-12-19T16:12:11.799 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] quit.o 2023-12-19T16:12:11.920 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] sb.o 2023-12-19T16:12:12.201 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] sig.o 2023-12-19T16:12:12.327 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] strvec.o 2023-12-19T16:12:12.472 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] text.o 2023-12-19T16:12:12.608 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] type.o 2023-12-19T16:12:12.764 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] write.o 2023-12-19T16:12:13.035 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] attrset.o 2023-12-19T16:12:13.206 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] symlink.o 2023-12-19T16:12:13.343 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fsmap.o 2023-12-19T16:12:13.517 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fuzz.o 2023-12-19T16:12:13.730 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] obfuscate.o 2023-12-19T16:12:13.913 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] btdump.o 2023-12-19T16:12:14.130 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] btheight.o 2023-12-19T16:12:14.322 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] convert.o 2023-12-19T16:12:14.500 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] info.o 2023-12-19T16:12:14.651 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] iunlink.o 2023-12-19T16:12:14.873 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] namei.o 2023-12-19T16:12:15.130 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] timelimit.o 2023-12-19T16:12:15.277 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] xfs_db 2023-12-19T16:12:15.608 INFO:teuthology.orchestra.run.smithi151.stdout:Building estimate 2023-12-19T16:12:15.685 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_estimate.o 2023-12-19T16:12:15.863 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] xfs_estimate 2023-12-19T16:12:15.988 INFO:teuthology.orchestra.run.smithi151.stdout:Building fsck 2023-12-19T16:12:15.999 INFO:teuthology.orchestra.run.smithi151.stdout:Building fsr 2023-12-19T16:12:16.082 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_fsr.o 2023-12-19T16:12:16.568 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] xfs_fsr 2023-12-19T16:12:16.759 INFO:teuthology.orchestra.run.smithi151.stdout:Building growfs 2023-12-19T16:12:16.836 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_growfs.o 2023-12-19T16:12:17.060 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] xfs_growfs 2023-12-19T16:12:17.313 INFO:teuthology.orchestra.run.smithi151.stdout:Building io 2023-12-19T16:12:19.330 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] init.o 2023-12-19T16:12:19.474 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] attr.o 2023-12-19T16:12:19.648 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] bmap.o 2023-12-19T16:12:19.854 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] bulkstat.o 2023-12-19T16:12:20.047 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] crc32cselftest.o 2023-12-19T16:12:20.159 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] cowextsize.o 2023-12-19T16:12:20.318 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] encrypt.o 2023-12-19T16:12:20.573 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] file.o 2023-12-19T16:12:20.707 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] freeze.o 2023-12-19T16:12:20.820 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fsuuid.o 2023-12-19T16:12:20.950 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fsync.o 2023-12-19T16:12:21.054 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] getrusage.o 2023-12-19T16:12:21.172 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] imap.o 2023-12-19T16:12:21.285 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] inject.o 2023-12-19T16:12:21.411 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] label.o 2023-12-19T16:12:21.554 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] link.o 2023-12-19T16:12:21.654 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] mmap.o 2023-12-19T16:12:21.896 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] open.o 2023-12-19T16:12:22.209 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] parent.o 2023-12-19T16:12:22.399 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] pread.o 2023-12-19T16:12:22.606 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] prealloc.o 2023-12-19T16:12:22.765 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] pwrite.o 2023-12-19T16:12:22.953 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] reflink.o 2023-12-19T16:12:23.109 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] resblks.o 2023-12-19T16:12:23.216 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] scrub.o 2023-12-19T16:12:23.375 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] seek.o 2023-12-19T16:12:23.509 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] shutdown.o 2023-12-19T16:12:23.620 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] stat.o 2023-12-19T16:12:23.858 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] swapext.o 2023-12-19T16:12:23.965 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] sync.o 2023-12-19T16:12:24.064 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] truncate.o 2023-12-19T16:12:24.167 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] utimes.o 2023-12-19T16:12:24.271 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fadvise.o 2023-12-19T16:12:24.381 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] madvise.o 2023-12-19T16:12:24.495 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] mincore.o 2023-12-19T16:12:24.617 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] sendfile.o 2023-12-19T16:12:24.750 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fiemap.o 2023-12-19T16:12:24.928 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] copy_file_range.o 2023-12-19T16:12:25.052 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] sync_file_range.o 2023-12-19T16:12:25.165 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] readdir.o 2023-12-19T16:12:25.309 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] log_writes.o 2023-12-19T16:12:25.422 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fsmap.o 2023-12-19T16:12:25.687 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] xfs_io 2023-12-19T16:12:25.941 INFO:teuthology.orchestra.run.smithi151.stdout:Building logprint 2023-12-19T16:12:26.332 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] logprint.o 2023-12-19T16:12:26.508 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] log_copy.o 2023-12-19T16:12:26.653 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] log_dump.o 2023-12-19T16:12:26.812 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] log_misc.o 2023-12-19T16:12:27.350 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] log_print_all.o 2023-12-19T16:12:27.609 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] log_print_trans.o 2023-12-19T16:12:27.754 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] log_redo.o 2023-12-19T16:12:28.057 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] xfs_logprint 2023-12-19T16:12:28.314 INFO:teuthology.orchestra.run.smithi151.stdout:Building mkfs 2023-12-19T16:12:28.445 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] proto.o 2023-12-19T16:12:28.772 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_mkfs.o 2023-12-19T16:12:29.538 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] mkfs.xfs 2023-12-19T16:12:29.806 INFO:teuthology.orchestra.run.smithi151.stdout:Building quota 2023-12-19T16:12:29.877 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:12:29.880 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:12:29.883 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:12:30.354 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] init.o 2023-12-19T16:12:30.481 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] util.o 2023-12-19T16:12:30.682 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] edit.o 2023-12-19T16:12:30.917 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] free.o 2023-12-19T16:12:31.086 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] linux.o 2023-12-19T16:12:31.187 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] path.o 2023-12-19T16:12:31.320 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] project.o 2023-12-19T16:12:31.488 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] quot.o 2023-12-19T16:12:31.674 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] quota.o 2023-12-19T16:12:31.875 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] report.o 2023-12-19T16:12:32.141 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] state.o 2023-12-19T16:12:32.354 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] xfs_quota 2023-12-19T16:12:32.549 INFO:teuthology.orchestra.run.smithi151.stdout:Building mdrestore 2023-12-19T16:12:32.626 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_mdrestore.o 2023-12-19T16:12:32.824 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] xfs_mdrestore 2023-12-19T16:12:33.053 INFO:teuthology.orchestra.run.smithi151.stdout:Building repair 2023-12-19T16:12:34.939 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] agheader.o 2023-12-19T16:12:35.195 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] agbtree.o 2023-12-19T16:12:35.481 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] attr_repair.o 2023-12-19T16:12:35.890 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] avl.o 2023-12-19T16:12:36.153 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] bulkload.o 2023-12-19T16:12:36.306 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] bmap.o 2023-12-19T16:12:36.495 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] btree.o 2023-12-19T16:12:36.897 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] da_util.o 2023-12-19T16:12:37.168 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] dino_chunks.o 2023-12-19T16:12:37.617 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] dinode.o 2023-12-19T16:12:38.427 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] dir2.o 2023-12-19T16:12:38.870 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] globals.o 2023-12-19T16:12:38.989 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] incore_bmc.o 2023-12-19T16:12:39.112 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] incore.o 2023-12-19T16:12:39.277 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] incore_ext.o 2023-12-19T16:12:39.526 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] incore_ino.o 2023-12-19T16:12:39.846 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] init.o 2023-12-19T16:12:40.008 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] phase1.o 2023-12-19T16:12:40.147 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] phase2.o 2023-12-19T16:12:40.377 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] phase3.o 2023-12-19T16:12:40.552 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] phase4.o 2023-12-19T16:12:40.781 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] phase5.o 2023-12-19T16:12:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] phase6.o 2023-12-19T16:12:42.019 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] phase7.o 2023-12-19T16:12:42.185 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] prefetch.o 2023-12-19T16:12:42.556 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] progress.o 2023-12-19T16:12:42.796 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] quotacheck.o 2023-12-19T16:12:43.034 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] rmap.o 2023-12-19T16:12:43.457 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] rt.o 2023-12-19T16:12:43.658 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] sb.o 2023-12-19T16:12:43.927 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] scan.o 2023-12-19T16:12:44.732 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] slab.o 2023-12-19T16:12:44.923 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] threads.o 2023-12-19T16:12:45.064 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] versions.o 2023-12-19T16:12:45.224 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_repair.o 2023-12-19T16:12:45.584 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] xfs_repair 2023-12-19T16:12:45.920 INFO:teuthology.orchestra.run.smithi151.stdout:Building rtcp 2023-12-19T16:12:46.003 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_rtcp.o 2023-12-19T16:12:46.206 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] xfs_rtcp 2023-12-19T16:12:46.352 INFO:teuthology.orchestra.run.smithi151.stdout:Building m4 2023-12-19T16:12:46.363 INFO:teuthology.orchestra.run.smithi151.stdout:Building man 2023-12-19T16:12:46.378 INFO:teuthology.orchestra.run.smithi151.stdout:Building man2 2023-12-19T16:12:46.396 INFO:teuthology.orchestra.run.smithi151.stdout:Building man3 2023-12-19T16:12:46.410 INFO:teuthology.orchestra.run.smithi151.stdout:Building man5 2023-12-19T16:12:46.424 INFO:teuthology.orchestra.run.smithi151.stdout:Building man8 2023-12-19T16:12:46.453 INFO:teuthology.orchestra.run.smithi151.stdout: [SED] mkfs.xfs.8 2023-12-19T16:12:46.464 INFO:teuthology.orchestra.run.smithi151.stdout:Building doc 2023-12-19T16:12:46.479 INFO:teuthology.orchestra.run.smithi151.stdout: [ZIP] CHANGES.gz 2023-12-19T16:12:46.499 INFO:teuthology.orchestra.run.smithi151.stdout:Building debian 2023-12-19T16:12:46.509 INFO:teuthology.orchestra.run.smithi151.stdout:Building spaceman 2023-12-19T16:12:46.912 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] info.o 2023-12-19T16:12:47.048 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] init.o 2023-12-19T16:12:47.194 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] file.o 2023-12-19T16:12:47.349 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] health.o 2023-12-19T16:12:47.547 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] prealloc.o 2023-12-19T16:12:47.696 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] trim.o 2023-12-19T16:12:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] freesp.o 2023-12-19T16:12:48.070 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] xfs_spaceman 2023-12-19T16:12:48.250 INFO:teuthology.orchestra.run.smithi151.stdout:Building scrub 2023-12-19T16:12:49.301 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] common.o 2023-12-19T16:12:49.476 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] counter.o 2023-12-19T16:12:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] descr.o 2023-12-19T16:12:49.684 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] disk.o 2023-12-19T16:12:49.829 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] filemap.o 2023-12-19T16:12:49.950 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] fscounters.o 2023-12-19T16:12:50.077 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] inodes.o 2023-12-19T16:12:50.258 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] phase1.o 2023-12-19T16:12:50.389 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] phase2.o 2023-12-19T16:12:50.524 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] phase3.o 2023-12-19T16:12:50.669 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] phase4.o 2023-12-19T16:12:50.798 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] phase5.o 2023-12-19T16:12:50.972 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] phase6.o 2023-12-19T16:12:51.198 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] phase7.o 2023-12-19T16:12:51.348 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] progress.o 2023-12-19T16:12:51.487 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] read_verify.o 2023-12-19T16:12:51.642 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] repair.o 2023-12-19T16:12:51.803 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] scrub.o 2023-12-19T16:12:52.050 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] spacemap.o 2023-12-19T16:12:52.198 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] vfs.o 2023-12-19T16:12:52.349 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] xfs_scrub.o 2023-12-19T16:12:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: [CC] unicrash.o 2023-12-19T16:12:52.807 INFO:teuthology.orchestra.run.smithi151.stdout: [LD] xfs_scrub 2023-12-19T16:12:53.162 INFO:teuthology.orchestra.run.smithi151.stdout: [SED] xfs_scrub_all 2023-12-19T16:12:53.175 INFO:teuthology.orchestra.run.smithi151.stdout: [SED] xfs_scrub@.service 2023-12-19T16:12:53.184 INFO:teuthology.orchestra.run.smithi151.stdout: [SED] xfs_scrub_all.service 2023-12-19T16:12:53.196 INFO:teuthology.orchestra.run.smithi151.stdout: [SED] xfs_scrub_fail@.service 2023-12-19T16:12:53.207 INFO:teuthology.orchestra.run.smithi151.stdout: [SED] xfs_scrub_all.cron 2023-12-19T16:12:53.219 INFO:teuthology.orchestra.run.smithi151.stdout:Building po 2023-12-19T16:12:53.261 INFO:teuthology.orchestra.run.smithi151.stdout: [GETTXT] xfsprogs.pot 2023-12-19T16:12:53.534 INFO:teuthology.orchestra.run.smithi151.stdout: [MSGFMT] de.mo 2023-12-19T16:12:53.583 INFO:teuthology.orchestra.run.smithi151.stderr:2345 translated messages. 2023-12-19T16:12:53.588 INFO:teuthology.orchestra.run.smithi151.stdout: [MSGFMT] pl.mo 2023-12-19T16:12:53.640 INFO:teuthology.orchestra.run.smithi151.stderr:3104 translated messages. 2023-12-19T16:12:53.642 INFO:teuthology.orchestra.run.smithi151.stdout:gmake[2]: Nothing to be done for 'include'. 2023-12-19T16:12:53.648 DEBUG:teuthology.orchestra.run.smithi151:> (cd /tmp/tmp.LLmHOUESMaxfsprogs-dev && exec sudo make install) 2023-12-19T16:12:53.760 INFO:teuthology.orchestra.run.smithi151.stdout:Installing libfrog-install 2023-12-19T16:12:54.420 INFO:teuthology.orchestra.run.smithi151.stdout:Installing libxfs-install 2023-12-19T16:12:56.791 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-12-19T16:12:56.824 INFO:teuthology.orchestra.run.smithi151.stdout:Installing libxlog-install 2023-12-19T16:12:56.947 INFO:teuthology.orchestra.run.smithi151.stdout:Installing libxcmd-install 2023-12-19T16:12:57.134 INFO:teuthology.orchestra.run.smithi151.stdout:Installing libhandle-install 2023-12-19T16:12:57.231 INFO:teuthology.orchestra.run.smithi151.stdout:cd ../libhandle/.libs; ../../install-sh -o root -g root -m 755 -d /lib64; ../../install-sh -o root -g root -m 755 -T so_dot_version libhandle.lai /lib64; ../../install-sh -o root -g root -T so_dot_current libhandle.lai /lib64 2023-12-19T16:12:57.359 INFO:teuthology.orchestra.run.smithi151.stdout:Installing copy-install 2023-12-19T16:12:57.431 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T16:12:57.462 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_copy /usr/sbin 2023-12-19T16:12:57.536 INFO:teuthology.orchestra.run.smithi151.stdout:Installing db-install 2023-12-19T16:13:00.016 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:13:00.019 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:13:00.021 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:13:00.469 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T16:13:00.499 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_db /usr/sbin 2023-12-19T16:13:00.577 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 xfs_admin.sh /usr/sbin/xfs_admin 2023-12-19T16:13:00.610 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 xfs_ncheck.sh /usr/sbin/xfs_ncheck 2023-12-19T16:13:00.644 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 xfs_metadump.sh /usr/sbin/xfs_metadump 2023-12-19T16:13:00.681 INFO:teuthology.orchestra.run.smithi151.stdout:Installing estimate-install 2023-12-19T16:13:00.753 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T16:13:00.784 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_estimate /usr/sbin 2023-12-19T16:13:00.858 INFO:teuthology.orchestra.run.smithi151.stdout:Installing fsck-install 2023-12-19T16:13:00.862 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-12-19T16:13:00.891 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 xfs_fsck.sh /sbin/fsck.xfs 2023-12-19T16:13:00.927 INFO:teuthology.orchestra.run.smithi151.stdout:Installing fsr-install 2023-12-19T16:13:00.996 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T16:13:01.028 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_fsr /usr/sbin 2023-12-19T16:13:01.100 INFO:teuthology.orchestra.run.smithi151.stdout:Installing growfs-install 2023-12-19T16:13:01.175 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T16:13:01.204 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_growfs /usr/sbin 2023-12-19T16:13:01.284 INFO:teuthology.orchestra.run.smithi151.stdout:Installing io-install 2023-12-19T16:13:03.294 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T16:13:03.324 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_io /usr/sbin 2023-12-19T16:13:03.395 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_bmap.sh /usr/sbin/xfs_bmap 2023-12-19T16:13:03.463 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_freeze.sh /usr/sbin/xfs_freeze 2023-12-19T16:13:03.532 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mkfile.sh /usr/sbin/xfs_mkfile 2023-12-19T16:13:03.605 INFO:teuthology.orchestra.run.smithi151.stdout:Installing logprint-install 2023-12-19T16:13:03.999 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T16:13:04.030 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_logprint /usr/sbin 2023-12-19T16:13:04.109 INFO:teuthology.orchestra.run.smithi151.stdout:Installing mkfs-install 2023-12-19T16:13:04.236 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-12-19T16:13:04.266 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 mkfs.xfs /sbin 2023-12-19T16:13:04.339 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/share/xfsprogs/mkfs 2023-12-19T16:13:04.378 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 644 dax_x86_64.conf lts_4.19.conf lts_5.4.conf lts_5.10.conf lts_5.15.conf lts_6.1.conf lts_6.6.conf /usr/share/xfsprogs/mkfs 2023-12-19T16:13:04.475 INFO:teuthology.orchestra.run.smithi151.stdout:Installing quota-install 2023-12-19T16:13:04.996 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T16:13:05.029 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_quota /usr/sbin 2023-12-19T16:13:05.106 INFO:teuthology.orchestra.run.smithi151.stdout:Installing mdrestore-install 2023-12-19T16:13:05.179 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T16:13:05.209 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mdrestore /usr/sbin 2023-12-19T16:13:05.283 INFO:teuthology.orchestra.run.smithi151.stdout:Installing repair-install 2023-12-19T16:13:07.153 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-12-19T16:13:07.186 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_repair /sbin 2023-12-19T16:13:07.270 INFO:teuthology.orchestra.run.smithi151.stdout:Installing rtcp-install 2023-12-19T16:13:07.344 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T16:13:07.375 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_rtcp /usr/sbin 2023-12-19T16:13:07.446 INFO:teuthology.orchestra.run.smithi151.stdout:Installing m4-install 2023-12-19T16:13:07.451 INFO:teuthology.orchestra.run.smithi151.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-19T16:13:07.454 INFO:teuthology.orchestra.run.smithi151.stdout:Installing man-install 2023-12-19T16:13:07.466 INFO:teuthology.orchestra.run.smithi151.stdout:gmake[2]: Nothing to be done for 'install'. 2023-12-19T16:13:07.473 INFO:teuthology.orchestra.run.smithi151.stdout:gmake[2]: Nothing to be done for 'install'. 2023-12-19T16:13:07.484 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man5 2023-12-19T16:13:07.525 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 projects.5 /usr/share/man/man5/projects.5 2023-12-19T16:13:07.562 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 projid.5 /usr/share/man/man5/projid.5 2023-12-19T16:13:07.601 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs.5 /usr/share/man/man5/xfs.5 2023-12-19T16:13:07.647 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man8 2023-12-19T16:13:07.689 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 fsck.xfs.8 /usr/share/man/man8/fsck.xfs.8 2023-12-19T16:13:07.728 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-12-19T16:13:07.769 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_admin.8 /usr/share/man/man8/xfs_admin.8 2023-12-19T16:13:07.810 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_bmap.8 /usr/share/man/man8/xfs_bmap.8 2023-12-19T16:13:07.851 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_copy.8 /usr/share/man/man8/xfs_copy.8 2023-12-19T16:13:07.892 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_db.8 /usr/share/man/man8/xfs_db.8 2023-12-19T16:13:07.933 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_estimate.8 /usr/share/man/man8/xfs_estimate.8 2023-12-19T16:13:07.976 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_freeze.8 /usr/share/man/man8/xfs_freeze.8 2023-12-19T16:13:08.017 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_fsr.8 /usr/share/man/man8/xfs_fsr.8 2023-12-19T16:13:08.061 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_growfs.8 /usr/share/man/man8/xfs_growfs.8 2023-12-19T16:13:08.102 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_info.8 /usr/share/man/man8/xfs_info.8 2023-12-19T16:13:08.146 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_io.8 /usr/share/man/man8/xfs_io.8 2023-12-19T16:13:08.186 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_logprint.8 /usr/share/man/man8/xfs_logprint.8 2023-12-19T16:13:08.228 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_mdrestore.8 /usr/share/man/man8/xfs_mdrestore.8 2023-12-19T16:13:08.269 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_metadump.8 /usr/share/man/man8/xfs_metadump.8 2023-12-19T16:13:08.311 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_mkfile.8 /usr/share/man/man8/xfs_mkfile.8 2023-12-19T16:13:08.353 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_ncheck.8 /usr/share/man/man8/xfs_ncheck.8 2023-12-19T16:13:08.395 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_quota.8 /usr/share/man/man8/xfs_quota.8 2023-12-19T16:13:08.436 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_repair.8 /usr/share/man/man8/xfs_repair.8 2023-12-19T16:13:08.477 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_rtcp.8 /usr/share/man/man8/xfs_rtcp.8 2023-12-19T16:13:08.518 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_scrub.8 /usr/share/man/man8/xfs_scrub.8 2023-12-19T16:13:08.558 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_scrub_all.8 /usr/share/man/man8/xfs_scrub_all.8 2023-12-19T16:13:08.599 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 xfs_spaceman.8 /usr/share/man/man8/xfs_spaceman.8 2023-12-19T16:13:08.639 INFO:teuthology.orchestra.run.smithi151.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-12-19T16:13:08.678 INFO:teuthology.orchestra.run.smithi151.stdout:Installing doc-install 2023-12-19T16:13:08.682 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-12-19T16:13:08.715 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 644 CHANGES.gz CREDITS /usr/share/doc/xfsprogs 2023-12-19T16:13:08.762 INFO:teuthology.orchestra.run.smithi151.stdout:Installing debian-install 2023-12-19T16:13:08.766 INFO:teuthology.orchestra.run.smithi151.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-19T16:13:08.769 INFO:teuthology.orchestra.run.smithi151.stdout:Installing spaceman-install 2023-12-19T16:13:09.160 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T16:13:09.192 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_spaceman /usr/sbin 2023-12-19T16:13:09.258 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 xfs_info.sh /usr/sbin/xfs_info 2023-12-19T16:13:09.292 INFO:teuthology.orchestra.run.smithi151.stdout:Installing scrub-install 2023-12-19T16:13:10.333 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T16:13:10.362 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_scrub /usr/sbin 2023-12-19T16:13:10.428 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 xfs_scrub_all /usr/sbin 2023-12-19T16:13:10.461 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/systemd/system 2023-12-19T16:13:10.494 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 644 xfs_scrub@.service xfs_scrub_all.service xfs_scrub_all.timer xfs_scrub_fail@.service /usr/lib/systemd/system 2023-12-19T16:13:10.559 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-12-19T16:13:10.592 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 xfs_scrub_fail /usr/lib64/xfsprogs 2023-12-19T16:13:10.625 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-12-19T16:13:10.656 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 644 xfs_scrub_all.cron /usr/lib64/xfsprogs 2023-12-19T16:13:10.691 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/udev/rules.d 2023-12-19T16:13:10.723 INFO:teuthology.orchestra.run.smithi151.stdout:for i in xfs.rules; do \ 2023-12-19T16:13:10.723 INFO:teuthology.orchestra.run.smithi151.stdout: ../install-sh -o root -g root -m 644 $i /usr/lib/udev/rules.d/64-$i; \ 2023-12-19T16:13:10.724 INFO:teuthology.orchestra.run.smithi151.stdout:done 2023-12-19T16:13:10.766 INFO:teuthology.orchestra.run.smithi151.stdout:Installing po-install 2023-12-19T16:13:10.926 INFO:teuthology.orchestra.run.smithi151.stdout:Installing include-install 2023-12-19T16:13:10.930 INFO:teuthology.orchestra.run.smithi151.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-12-19T16:13:10.964 INFO:teuthology.orchestra.run.smithi151.stdout:./install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-12-19T16:13:10.997 INFO:teuthology.orchestra.run.smithi151.stdout:./install-sh -o root -g root -m 644 README /usr/share/doc/xfsprogs 2023-12-19T16:13:11.036 INFO:tasks.cephfs.test_fscrypt:client is kernel mounted 2023-12-19T16:13:11.036 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-12-19T16:13:11.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.151+0000 7ff11f64a640 1 Processor -- start 2023-12-19T16:13:11.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.151+0000 7ff11f64a640 1 -- start start 2023-12-19T16:13:11.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.152+0000 7ff11f64a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff1180bcdd0 0x7ff1180b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:13:11.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.152+0000 7ff11f64a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff1180b64c0 0x7ff118144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:13:11.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.152+0000 7ff11f64a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff118144cd0 0x7ff11814e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:13:11.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.152+0000 7ff11f64a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1180bc6b0 con 0x7ff1180bcdd0 2023-12-19T16:13:11.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.152+0000 7ff11f64a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1180b6900 con 0x7ff118144cd0 2023-12-19T16:13:11.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.152+0000 7ff11f64a640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1180a59f0 con 0x7ff1180b64c0 2023-12-19T16:13:11.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.152+0000 7ff11d3e6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff1180bcdd0 0x7ff1180b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:13:11.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.152+0000 7ff11d3e6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff1180bcdd0 0x7ff1180b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53346/0 (socket says 172.21.15.37:53346) 2023-12-19T16:13:11.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.152+0000 7ff11d3e6640 1 -- 172.21.15.37:0/3573641962 learned_addr learned my addr 172.21.15.37:0/3573641962 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:13:11.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.152+0000 7ff11dbe7640 1 --2- 172.21.15.37:0/3573641962 >> v2:172.21.15.78:3300/0 conn(0x7ff118144cd0 0x7ff11814e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:13:11.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.152+0000 7ff11cbe5640 1 --2- 172.21.15.37:0/3573641962 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff1180b64c0 0x7ff118144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:13:11.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.152+0000 7ff11d3e6640 1 -- 172.21.15.37:0/3573641962 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff1180b64c0 msgr2=0x7ff118144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:13:11.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.152+0000 7ff11d3e6640 1 --2- 172.21.15.37:0/3573641962 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff1180b64c0 0x7ff118144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.152+0000 7ff11d3e6640 1 -- 172.21.15.37:0/3573641962 >> v2:172.21.15.78:3300/0 conn(0x7ff118144cd0 msgr2=0x7ff11814e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:13:11.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.152+0000 7ff11d3e6640 1 --2- 172.21.15.37:0/3573641962 >> v2:172.21.15.78:3300/0 conn(0x7ff118144cd0 0x7ff11814e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.152+0000 7ff11d3e6640 1 -- 172.21.15.37:0/3573641962 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1180bc0a0 con 0x7ff1180bcdd0 2023-12-19T16:13:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.153+0000 7ff11d3e6640 1 --2- 172.21.15.37:0/3573641962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1180bcdd0 0x7ff1180b5f80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff1181486d0 tx=0x7ff11402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a956248a07c2e36 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:13:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.153+0000 7ff10ffff640 1 -- 172.21.15.37:0/3573641962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff114030860 con 0x7ff1180bcdd0 2023-12-19T16:13:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.153+0000 7ff10ffff640 1 -- 172.21.15.37:0/3573641962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1140309c0 con 0x7ff1180bcdd0 2023-12-19T16:13:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.153+0000 7ff10ffff640 1 -- 172.21.15.37:0/3573641962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff114030d50 con 0x7ff1180bcdd0 2023-12-19T16:13:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.154+0000 7ff11f64a640 1 -- 172.21.15.37:0/3573641962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1180bcdd0 msgr2=0x7ff1180b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:13:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.154+0000 7ff11f64a640 1 --2- 172.21.15.37:0/3573641962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1180bcdd0 0x7ff1180b5f80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff1181486d0 tx=0x7ff11402b9a0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.154+0000 7ff11f64a640 1 -- 172.21.15.37:0/3573641962 shutdown_connections 2023-12-19T16:13:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.154+0000 7ff11f64a640 1 --2- 172.21.15.37:0/3573641962 >> v2:172.21.15.78:3300/0 conn(0x7ff118144cd0 0x7ff11814e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.154+0000 7ff11f64a640 1 --2- 172.21.15.37:0/3573641962 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff1180b64c0 0x7ff118144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.154+0000 7ff11f64a640 1 --2- 172.21.15.37:0/3573641962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1180bcdd0 0x7ff1180b5f80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.154+0000 7ff11f64a640 1 -- 172.21.15.37:0/3573641962 >> 172.21.15.37:0/3573641962 conn(0x7ff118071e60 msgr2=0x7ff1180c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:13:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.154+0000 7ff11f64a640 1 -- 172.21.15.37:0/3573641962 shutdown_connections 2023-12-19T16:13:11.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.154+0000 7ff11f64a640 1 -- 172.21.15.37:0/3573641962 wait complete. 2023-12-19T16:13:11.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.155+0000 7ff11f64a640 1 Processor -- start 2023-12-19T16:13:11.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.155+0000 7ff11f64a640 1 -- start start 2023-12-19T16:13:11.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.156+0000 7ff11f64a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1180b64c0 0x7ff1181d4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:13:11.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.156+0000 7ff11f64a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff1180bcdd0 0x7ff1181dfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:13:11.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.156+0000 7ff11f64a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff118144cd0 0x7ff1181e0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:13:11.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.156+0000 7ff11f64a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1181d4eb0 con 0x7ff1180b64c0 2023-12-19T16:13:11.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.156+0000 7ff11f64a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff118145880 con 0x7ff118144cd0 2023-12-19T16:13:11.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.156+0000 7ff11f64a640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1181d3370 con 0x7ff1180bcdd0 2023-12-19T16:13:11.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.156+0000 7ff11d3e6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1180b64c0 0x7ff1181d4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:13:11.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.156+0000 7ff11d3e6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1180b64c0 0x7ff1181d4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53362/0 (socket says 172.21.15.37:53362) 2023-12-19T16:13:11.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.156+0000 7ff11d3e6640 1 -- 172.21.15.37:0/3951122365 learned_addr learned my addr 172.21.15.37:0/3951122365 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:13:11.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.156+0000 7ff11cbe5640 1 --2- 172.21.15.37:0/3951122365 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff1180bcdd0 0x7ff1181dfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:13:11.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.156+0000 7ff11dbe7640 1 --2- 172.21.15.37:0/3951122365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff118144cd0 0x7ff1181e0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:13:11.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.156+0000 7ff11d3e6640 1 -- 172.21.15.37:0/3951122365 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff1180bcdd0 msgr2=0x7ff1181dfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:13:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.156+0000 7ff11d3e6640 1 --2- 172.21.15.37:0/3951122365 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff1180bcdd0 0x7ff1181dfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.156+0000 7ff11d3e6640 1 -- 172.21.15.37:0/3951122365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff118144cd0 msgr2=0x7ff1181e0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:13:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.156+0000 7ff11d3e6640 1 --2- 172.21.15.37:0/3951122365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff118144cd0 0x7ff1181e0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.156+0000 7ff11d3e6640 1 -- 172.21.15.37:0/3951122365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1140094d0 con 0x7ff1180b64c0 2023-12-19T16:13:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.156+0000 7ff11cbe5640 1 --2- 172.21.15.37:0/3951122365 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff1180bcdd0 0x7ff1181dfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:13:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.156+0000 7ff11d3e6640 1 --2- 172.21.15.37:0/3951122365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1180b64c0 0x7ff1181d4970 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff114000c00 tx=0x7ff114004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:13:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.157+0000 7ff10dffb640 1 -- 172.21.15.37:0/3951122365 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff114039d60 con 0x7ff1180b64c0 2023-12-19T16:13:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.157+0000 7ff10dffb640 1 -- 172.21.15.37:0/3951122365 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff114043400 con 0x7ff1180b64c0 2023-12-19T16:13:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.157+0000 7ff11f64a640 1 -- 172.21.15.37:0/3951122365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1181d3650 con 0x7ff1180b64c0 2023-12-19T16:13:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.157+0000 7ff10dffb640 1 -- 172.21.15.37:0/3951122365 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1140437b0 con 0x7ff1180b64c0 2023-12-19T16:13:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.157+0000 7ff11f64a640 1 -- 172.21.15.37:0/3951122365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1181d3930 con 0x7ff1180b64c0 2023-12-19T16:13:11.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.158+0000 7ff11f64a640 1 -- 172.21.15.37:0/3951122365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1180bc320 con 0x7ff1180b64c0 2023-12-19T16:13:11.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.158+0000 7ff10dffb640 1 -- 172.21.15.37:0/3951122365 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff114043910 con 0x7ff1180b64c0 2023-12-19T16:13:11.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.159+0000 7ff10dffb640 1 --2- 172.21.15.37:0/3951122365 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff0fc06a430 0x7ff0fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:13:11.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.159+0000 7ff10dffb640 1 -- 172.21.15.37:0/3951122365 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff11403e070 con 0x7ff1180b64c0 2023-12-19T16:13:11.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.159+0000 7ff11cbe5640 1 --2- 172.21.15.37:0/3951122365 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff0fc06a430 0x7ff0fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:13:11.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.160+0000 7ff11cbe5640 1 --2- 172.21.15.37:0/3951122365 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff0fc06a430 0x7ff0fc06c8f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff1180a57e0 tx=0x7ff108008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:13:11.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.164+0000 7ff10dffb640 1 -- 172.21.15.37:0/3951122365 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff1180bc320 con 0x7ff1180b64c0 2023-12-19T16:13:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.413+0000 7ff11f64a640 1 -- 172.21.15.37:0/3951122365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff1180bc320 con 0x7ff1180b64c0 2023-12-19T16:13:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.414+0000 7ff10dffb640 1 -- 172.21.15.37:0/3951122365 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7ff114034510 con 0x7ff1180b64c0 2023-12-19T16:13:11.416 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T16:13:11.417 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","modified":"2023-12-19T16:06:00.058907Z","created":"2023-12-19T16:06:00.058907Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3301","nonce":0},{"type":"v1","addr":"172.21.15.78:6790","nonce":0}]},"addr":"172.21.15.78:6790/0","public_addr":"172.21.15.78:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-12-19T16:13:11.417 INFO:teuthology.orchestra.run.smithi037.stderr:dumped monmap epoch 1 2023-12-19T16:13:11.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.416+0000 7ff11f64a640 1 -- 172.21.15.37:0/3951122365 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff0fc06a430 msgr2=0x7ff0fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:13:11.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.416+0000 7ff11f64a640 1 --2- 172.21.15.37:0/3951122365 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff0fc06a430 0x7ff0fc06c8f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff1180a57e0 tx=0x7ff108008040 comp rx=0 tx=0).stop 2023-12-19T16:13:11.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.416+0000 7ff11f64a640 1 -- 172.21.15.37:0/3951122365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1180b64c0 msgr2=0x7ff1181d4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:13:11.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.416+0000 7ff11f64a640 1 --2- 172.21.15.37:0/3951122365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1180b64c0 0x7ff1181d4970 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff114000c00 tx=0x7ff114004730 comp rx=0 tx=0).stop 2023-12-19T16:13:11.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.416+0000 7ff11f64a640 1 -- 172.21.15.37:0/3951122365 shutdown_connections 2023-12-19T16:13:11.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.416+0000 7ff11f64a640 1 --2- 172.21.15.37:0/3951122365 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7ff0fc06a430 0x7ff0fc06c8f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.416+0000 7ff11f64a640 1 --2- 172.21.15.37:0/3951122365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff118144cd0 0x7ff1181e0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.416+0000 7ff11f64a640 1 --2- 172.21.15.37:0/3951122365 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff1180bcdd0 0x7ff1181dfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.416+0000 7ff11f64a640 1 --2- 172.21.15.37:0/3951122365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1180b64c0 0x7ff1181d4970 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.416+0000 7ff11f64a640 1 -- 172.21.15.37:0/3951122365 >> 172.21.15.37:0/3951122365 conn(0x7ff118071e60 msgr2=0x7ff118072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:13:11.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.416+0000 7ff11f64a640 1 -- 172.21.15.37:0/3951122365 shutdown_connections 2023-12-19T16:13:11.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.416+0000 7ff11f64a640 1 -- 172.21.15.37:0/3951122365 wait complete. 2023-12-19T16:13:11.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-12-19T16:13:11.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.534+0000 7f7f4e1c9640 1 Processor -- start 2023-12-19T16:13:11.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.534+0000 7f7f4e1c9640 1 -- start start 2023-12-19T16:13:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.535+0000 7f7f4e1c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7f480b6690 0x7f7f48144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:13:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.535+0000 7f7f4e1c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f48144cd0 0x7f7f48155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:13:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.535+0000 7f7f4e1c9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f480bc6b0 con 0x7f7f480bcdd0 2023-12-19T16:13:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.535+0000 7f7f4e1c9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f480a59f0 con 0x7f7f48144cd0 2023-12-19T16:13:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.535+0000 7f7f4e1c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f480bc0a0 con 0x7f7f480b6690 2023-12-19T16:13:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.535+0000 7f7f47fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f48144cd0 0x7f7f48155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:13:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.535+0000 7f7f47fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f48144cd0 0x7f7f48155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53372/0 (socket says 172.21.15.37:53372) 2023-12-19T16:13:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.535+0000 7f7f47fff640 1 -- 172.21.15.37:0/2408539978 learned_addr learned my addr 172.21.15.37:0/2408539978 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:13:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.535+0000 7f7f46ffd640 1 --2- 172.21.15.37:0/2408539978 >> v2:172.21.15.78:3300/0 conn(0x7f7f480b6690 0x7f7f48144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:13:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.535+0000 7f7f47fff640 1 -- 172.21.15.37:0/2408539978 >> v2:172.21.15.78:3300/0 conn(0x7f7f480b6690 msgr2=0x7f7f48144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:13:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.535+0000 7f7f47fff640 1 --2- 172.21.15.37:0/2408539978 >> v2:172.21.15.78:3300/0 conn(0x7f7f480b6690 0x7f7f48144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.535+0000 7f7f47fff640 1 -- 172.21.15.37:0/2408539978 >> v1:172.21.15.78:6789/0 conn(0x7f7f480bcdd0 legacy=0x7f7f480b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:13:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.535+0000 7f7f47fff640 1 -- 172.21.15.37:0/2408539978 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f480bc340 con 0x7f7f48144cd0 2023-12-19T16:13:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.536+0000 7f7f47fff640 1 --2- 172.21.15.37:0/2408539978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f48144cd0 0x7f7f48155340 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7f480b72e0 tx=0x7f7f4002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f24a48080e03ae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:13:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.536+0000 7f7f467fc640 1 -- 172.21.15.37:0/2408539978 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4002cbb0 con 0x7f7f48144cd0 2023-12-19T16:13:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.536+0000 7f7f467fc640 1 -- 172.21.15.37:0/2408539978 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4002cd10 con 0x7f7f48144cd0 2023-12-19T16:13:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.536+0000 7f7f467fc640 1 -- 172.21.15.37:0/2408539978 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40034610 con 0x7f7f48144cd0 2023-12-19T16:13:11.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.536+0000 7f7f4e1c9640 1 -- 172.21.15.37:0/2408539978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f48144cd0 msgr2=0x7f7f48155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:13:11.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.536+0000 7f7f4e1c9640 1 --2- 172.21.15.37:0/2408539978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f48144cd0 0x7f7f48155340 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7f480b72e0 tx=0x7f7f4002c010 comp rx=0 tx=0).stop 2023-12-19T16:13:11.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.537+0000 7f7f4e1c9640 1 -- 172.21.15.37:0/2408539978 shutdown_connections 2023-12-19T16:13:11.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.537+0000 7f7f4e1c9640 1 --2- 172.21.15.37:0/2408539978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f48144cd0 0x7f7f48155340 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.537+0000 7f7f4e1c9640 1 --2- 172.21.15.37:0/2408539978 >> v2:172.21.15.78:3300/0 conn(0x7f7f480b6690 0x7f7f48144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.537+0000 7f7f4e1c9640 1 -- 172.21.15.37:0/2408539978 >> 172.21.15.37:0/2408539978 conn(0x7f7f48071e60 msgr2=0x7f7f480c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:13:11.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.537+0000 7f7f4e1c9640 1 -- 172.21.15.37:0/2408539978 shutdown_connections 2023-12-19T16:13:11.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.537+0000 7f7f4e1c9640 1 -- 172.21.15.37:0/2408539978 wait complete. 2023-12-19T16:13:11.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.538+0000 7f7f4e1c9640 1 Processor -- start 2023-12-19T16:13:11.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.538+0000 7f7f4e1c9640 1 -- start start 2023-12-19T16:13:11.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.538+0000 7f7f4e1c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f480b6690 0x7f7f4814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:13:11.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.538+0000 7f7f4e1c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f480bcdd0 0x7f7f48149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:13:11.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.538+0000 7f7f4e1c9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f48144cd0 0x7f7f481df640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:13:11.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.538+0000 7f7f4e1c9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4814a0b0 con 0x7f7f480bcdd0 2023-12-19T16:13:11.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.538+0000 7f7f4e1c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f481496e0 con 0x7f7f480b6690 2023-12-19T16:13:11.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.538+0000 7f7f4e1c9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4814b200 con 0x7f7f48144cd0 2023-12-19T16:13:11.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.538+0000 7f7f46ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f480bcdd0 0x7f7f48149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:13:11.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.538+0000 7f7f46ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f480bcdd0 0x7f7f48149b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53388/0 (socket says 172.21.15.37:53388) 2023-12-19T16:13:11.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.538+0000 7f7f46ffd640 1 -- 172.21.15.37:0/3928804743 learned_addr learned my addr 172.21.15.37:0/3928804743 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T16:13:11.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.539+0000 7f7f477fe640 1 --2- 172.21.15.37:0/3928804743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f480b6690 0x7f7f4814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:13:11.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.539+0000 7f7f46ffd640 1 -- 172.21.15.37:0/3928804743 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f48144cd0 msgr2=0x7f7f481df640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:13:11.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.539+0000 7f7f46ffd640 1 --2- 172.21.15.37:0/3928804743 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f48144cd0 0x7f7f481df640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.539+0000 7f7f46ffd640 1 -- 172.21.15.37:0/3928804743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f480b6690 msgr2=0x7f7f4814ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:13:11.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.539+0000 7f7f46ffd640 1 --2- 172.21.15.37:0/3928804743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f480b6690 0x7f7f4814ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.539+0000 7f7f46ffd640 1 -- 172.21.15.37:0/3928804743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f40009b30 con 0x7f7f480bcdd0 2023-12-19T16:13:11.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.539+0000 7f7f46ffd640 1 --2- 172.21.15.37:0/3928804743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f480bcdd0 0x7f7f48149b70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800e9b0 tx=0x7f7f3800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:13:11.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.539+0000 7f7f2ffff640 1 -- 172.21.15.37:0/3928804743 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f38009670 con 0x7f7f480bcdd0 2023-12-19T16:13:11.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.539+0000 7f7f2ffff640 1 -- 172.21.15.37:0/3928804743 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3800c9a0 con 0x7f7f480bcdd0 2023-12-19T16:13:11.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.539+0000 7f7f4e1c9640 1 -- 172.21.15.37:0/3928804743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f4814b7c0 con 0x7f7f480bcdd0 2023-12-19T16:13:11.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.539+0000 7f7f2ffff640 1 -- 172.21.15.37:0/3928804743 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3800cd50 con 0x7f7f480bcdd0 2023-12-19T16:13:11.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.539+0000 7f7f4e1c9640 1 -- 172.21.15.37:0/3928804743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f481491c0 con 0x7f7f480bcdd0 2023-12-19T16:13:11.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.540+0000 7f7f4e1c9640 1 -- 172.21.15.37:0/3928804743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f4814b9e0 con 0x7f7f480bcdd0 2023-12-19T16:13:11.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.541+0000 7f7f2ffff640 1 -- 172.21.15.37:0/3928804743 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7f38013470 con 0x7f7f480bcdd0 2023-12-19T16:13:11.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.541+0000 7f7f2ffff640 1 --2- 172.21.15.37:0/3928804743 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7f3406a430 0x7f7f3406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:13:11.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.541+0000 7f7f2ffff640 1 -- 172.21.15.37:0/3928804743 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f38088be0 con 0x7f7f480bcdd0 2023-12-19T16:13:11.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.541+0000 7f7f477fe640 1 --2- 172.21.15.37:0/3928804743 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7f3406a430 0x7f7f3406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:13:11.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.542+0000 7f7f477fe640 1 --2- 172.21.15.37:0/3928804743 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7f3406a430 0x7f7f3406c8f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c000f60 tx=0x7f7f3c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:13:11.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.545+0000 7f7f2ffff640 1 -- 172.21.15.37:0/3928804743 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7f380541d0 con 0x7f7f480bcdd0 2023-12-19T16:13:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.788+0000 7f7f4e1c9640 1 -- 172.21.15.37:0/3928804743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f7f4804e840 con 0x7f7f480bcdd0 2023-12-19T16:13:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.789+0000 7f7f2ffff640 1 -- 172.21.15.37:0/3928804743 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7f7f380170a0 con 0x7f7f480bcdd0 2023-12-19T16:13:11.791 INFO:teuthology.orchestra.run.smithi037.stdout:[client.admin] 2023-12-19T16:13:11.791 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQBov4FlDqP1FxAAgmeUG5CfJbsHOkLlF2UByQ== 2023-12-19T16:13:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.790+0000 7f7f4e1c9640 1 -- 172.21.15.37:0/3928804743 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7f3406a430 msgr2=0x7f7f3406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:13:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.790+0000 7f7f4e1c9640 1 --2- 172.21.15.37:0/3928804743 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7f3406a430 0x7f7f3406c8f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c000f60 tx=0x7f7f3c009040 comp rx=0 tx=0).stop 2023-12-19T16:13:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.790+0000 7f7f4e1c9640 1 -- 172.21.15.37:0/3928804743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f480bcdd0 msgr2=0x7f7f48149b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:13:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.790+0000 7f7f4e1c9640 1 --2- 172.21.15.37:0/3928804743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f480bcdd0 0x7f7f48149b70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800e9b0 tx=0x7f7f3800ee70 comp rx=0 tx=0).stop 2023-12-19T16:13:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.790+0000 7f7f4e1c9640 1 -- 172.21.15.37:0/3928804743 shutdown_connections 2023-12-19T16:13:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.790+0000 7f7f4e1c9640 1 --2- 172.21.15.37:0/3928804743 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f7f3406a430 0x7f7f3406c8f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.790+0000 7f7f4e1c9640 1 --2- 172.21.15.37:0/3928804743 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7f48144cd0 0x7f7f481df640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.790+0000 7f7f4e1c9640 1 --2- 172.21.15.37:0/3928804743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f480bcdd0 0x7f7f48149b70 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.790+0000 7f7f4e1c9640 1 --2- 172.21.15.37:0/3928804743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f480b6690 0x7f7f4814ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:13:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.790+0000 7f7f4e1c9640 1 -- 172.21.15.37:0/3928804743 >> 172.21.15.37:0/3928804743 conn(0x7f7f48071e60 msgr2=0x7f7f481430e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:13:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.790+0000 7f7f4e1c9640 1 -- 172.21.15.37:0/3928804743 shutdown_connections 2023-12-19T16:13:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T16:13:11.790+0000 7f7f4e1c9640 1 -- 172.21.15.37:0/3928804743 wait complete. 2023-12-19T16:13:11.803 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T16:13:11.803 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/tmp/tmp.t6fx4IVDVzxfstests-dev/local.config 2023-12-19T16:13:11.906 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.37:6789:/test export TEST_DIR=/tmp/tmp.VQWFH9MHpotest export SCRATCH_DEV=172.21.15.37:6789:/scratch export SCRATCH_MNT=/tmp/tmp.QHjjk1hzmdscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBov4FlDqP1FxAAgmeUG5CfJbsHOkLlF2UByQ==,test_dummy_encryption" 2023-12-19T16:13:11.906 INFO:teuthology.orchestra.run:Running command with timeout 10800 2023-12-19T16:13:11.906 DEBUG:teuthology.orchestra.run.smithi151:running tests for dummy_encryption from xfstests-dev> (cd /tmp/tmp.t6fx4IVDVzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check -g quick -E ./ceph.exclude) 2023-12-19T16:13:14.613 INFO:teuthology.orchestra.run.smithi151.stdout:FSTYP -- ceph 2023-12-19T16:13:14.625 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM -- Linux/x86_64 smithi151 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-19T16:13:14.626 INFO:teuthology.orchestra.run.smithi151.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-19T16:13:14.629 INFO:teuthology.orchestra.run.smithi151.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBov4FlDqP1FxAAgmeUG5CfJbsHOkLlF2UByQ==,test_dummy_encryption -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.QHjjk1hzmdscratch 2023-12-19T16:13:14.629 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:13:14.820 INFO:teuthology.orchestra.run.smithi151.stdout:ceph/001 [expunged] 2023-12-19T16:13:15.291 INFO:teuthology.orchestra.run.smithi151.stdout:ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T16:13:15.734 INFO:teuthology.orchestra.run.smithi151.stdout:ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T16:13:16.350 INFO:teuthology.orchestra.run.smithi151.stdout:ceph/004 1s 2023-12-19T16:13:16.794 INFO:teuthology.orchestra.run.smithi151.stdout:ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T16:13:27.336 INFO:teuthology.orchestra.run.smithi151.stdout:generic/001 11s 2023-12-19T16:13:28.222 INFO:teuthology.orchestra.run.smithi151.stdout:generic/002 1s 2023-12-19T16:13:28.671 INFO:teuthology.orchestra.run.smithi151.stdout:generic/003 [not run] atime not maintained by ceph 2023-12-19T16:13:29.146 INFO:teuthology.orchestra.run.smithi151.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-12-19T16:13:30.009 INFO:teuthology.orchestra.run.smithi151.stdout:generic/005 0s 2023-12-19T16:13:30.155 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:13:30.158 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:13:30.160 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:13:51.700 INFO:teuthology.orchestra.run.smithi151.stdout:generic/006 21s 2023-12-19T16:14:00.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:14:00.276 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:14:00.279 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:14:30.835 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:14:30.838 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:14:30.841 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:14:39.358 INFO:teuthology.orchestra.run.smithi151.stdout:generic/007 48s 2023-12-19T16:14:41.232 INFO:teuthology.orchestra.run.smithi151.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-19T16:14:43.356 INFO:teuthology.orchestra.run.smithi151.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-19T16:15:01.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:01.195 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:01.198 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:11.365 INFO:teuthology.orchestra.run.smithi151.stdout:generic/011 28s 2023-12-19T16:15:13.907 INFO:teuthology.orchestra.run.smithi151.stdout:generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T16:15:31.514 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:31.517 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:31.520 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:45.283 INFO:teuthology.orchestra.run.smithi151.stdout:generic/013 32s 2023-12-19T16:16:01.785 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:16:01.789 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:16:01.791 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:16:32.102 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:16:32.107 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:16:32.113 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:02.243 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:02.247 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:02.249 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:32.631 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:32.634 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:32.636 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:02.827 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:02.830 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:02.832 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:11.121 INFO:teuthology.orchestra.run.smithi151.stdout:generic/014 146s 2023-12-19T16:18:11.594 INFO:teuthology.orchestra.run.smithi151.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-19T16:18:14.748 INFO:teuthology.orchestra.run.smithi151.stdout:generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T16:18:15.376 INFO:teuthology.orchestra.run.smithi151.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-12-19T16:18:24.306 INFO:teuthology.orchestra.run.smithi151.stdout:generic/020 9s 2023-12-19T16:18:28.130 INFO:teuthology.orchestra.run.smithi151.stdout:generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T16:18:32.639 INFO:teuthology.orchestra.run.smithi151.stdout:generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T16:18:33.019 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:33.022 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:33.024 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:34.592 INFO:teuthology.orchestra.run.smithi151.stdout:generic/023 2s 2023-12-19T16:18:35.047 INFO:teuthology.orchestra.run.smithi151.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-12-19T16:18:35.524 INFO:teuthology.orchestra.run.smithi151.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-12-19T16:18:36.001 INFO:teuthology.orchestra.run.smithi151.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-12-19T16:18:41.491 INFO:teuthology.orchestra.run.smithi151.stdout:generic/028 5s 2023-12-19T16:18:42.886 INFO:teuthology.orchestra.run.smithi151.stdout:generic/029 1s 2023-12-19T16:18:50.425 INFO:teuthology.orchestra.run.smithi151.stdout:generic/030 8s 2023-12-19T16:18:54.147 INFO:teuthology.orchestra.run.smithi151.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-12-19T16:18:54.629 INFO:teuthology.orchestra.run.smithi151.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T16:18:59.423 INFO:teuthology.orchestra.run.smithi151.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-19T16:18:59.923 INFO:teuthology.orchestra.run.smithi151.stdout:generic/034 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:19:00.521 INFO:teuthology.orchestra.run.smithi151.stdout:generic/035 1s 2023-12-19T16:19:03.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:19:03.140 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:19:03.142 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:19:03.186 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-19T16:19:03.183+0000 7f4a782f4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 101634) UID: 0 2023-12-19T16:19:03.186 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-19T16:19:03.183+0000 7fb17b5e3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 101634) UID: 0 2023-12-19T16:19:08.023 INFO:teuthology.orchestra.run.smithi151.stdout:generic/037 8s 2023-12-19T16:19:08.537 INFO:teuthology.orchestra.run.smithi151.stdout:generic/039 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:19:09.020 INFO:teuthology.orchestra.run.smithi151.stdout:generic/040 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:19:09.534 INFO:teuthology.orchestra.run.smithi151.stdout:generic/041 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:19:10.162 INFO:teuthology.orchestra.run.smithi151.stdout:generic/042 [not run] ceph does not support shutdown 2023-12-19T16:19:10.787 INFO:teuthology.orchestra.run.smithi151.stdout:generic/050 [not run] ceph does not support shutdown 2023-12-19T16:19:11.404 INFO:teuthology.orchestra.run.smithi151.stdout:generic/052 [not run] ceph does not support shutdown 2023-12-19T16:19:12.665 INFO:teuthology.orchestra.run.smithi151.stdout:generic/053 1s 2023-12-19T16:19:13.221 INFO:teuthology.orchestra.run.smithi151.stdout:generic/056 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:19:13.745 INFO:teuthology.orchestra.run.smithi151.stdout:generic/057 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:19:19.937 INFO:teuthology.orchestra.run.smithi151.stdout:generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T16:19:20.424 INFO:teuthology.orchestra.run.smithi151.stdout:generic/059 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:19:23.817 INFO:teuthology.orchestra.run.smithi151.stdout:generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T16:19:30.004 INFO:teuthology.orchestra.run.smithi151.stdout:generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T16:19:32.462 INFO:teuthology.orchestra.run.smithi151.stdout:generic/062 2s 2023-12-19T16:19:35.795 INFO:teuthology.orchestra.run.smithi151.stdout:generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T16:19:36.313 INFO:teuthology.orchestra.run.smithi151.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-19T16:19:36.831 INFO:teuthology.orchestra.run.smithi151.stdout:generic/065 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:19:37.324 INFO:teuthology.orchestra.run.smithi151.stdout:generic/066 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:19:37.839 INFO:teuthology.orchestra.run.smithi151.stdout:generic/067 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:19:59.957 INFO:teuthology.orchestra.run.smithi151.stdout:generic/069 22s 2023-12-19T16:20:13.093 INFO:teuthology.orchestra.run.smithi151.stdout:generic/070 14s 2023-12-19T16:20:13.547 INFO:teuthology.orchestra.run.smithi151.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-19T16:20:14.032 INFO:teuthology.orchestra.run.smithi151.stdout:generic/073 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:20:42.986 INFO:teuthology.orchestra.run.smithi151.stdout:generic/075 28s 2023-12-19T16:20:43.436 INFO:teuthology.orchestra.run.smithi151.stdout:generic/076 [not run] require 172.21.15.37:6789:/scratch to be local device 2023-12-19T16:20:43.935 INFO:teuthology.orchestra.run.smithi151.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-12-19T16:20:44.387 INFO:teuthology.orchestra.run.smithi151.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-12-19T16:20:46.920 INFO:teuthology.orchestra.run.smithi151.stdout:generic/080 2s 2023-12-19T16:20:47.411 INFO:teuthology.orchestra.run.smithi151.stdout:generic/081 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:20:47.895 INFO:teuthology.orchestra.run.smithi151.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T16:20:53.822 INFO:teuthology.orchestra.run.smithi151.stdout:generic/084 6s 2023-12-19T16:20:54.352 INFO:teuthology.orchestra.run.smithi151.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T16:20:54.974 INFO:teuthology.orchestra.run.smithi151.stdout:generic/087 0s 2023-12-19T16:20:55.495 INFO:teuthology.orchestra.run.smithi151.stdout:generic/088 1s 2023-12-19T16:20:55.997 INFO:teuthology.orchestra.run.smithi151.stdout:generic/090 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:21:45.859 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:21:45.863 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:21:45.866 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:21:59.901 INFO:teuthology.orchestra.run.smithi151.stdout:generic/091 63s 2023-12-19T16:22:00.333 INFO:teuthology.orchestra.run.smithi151.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T16:22:00.897 INFO:teuthology.orchestra.run.smithi151.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-19T16:22:04.740 INFO:teuthology.orchestra.run.smithi151.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-19T16:22:05.561 INFO:teuthology.orchestra.run.smithi151.stdout:generic/097 1s 2023-12-19T16:22:06.745 INFO:teuthology.orchestra.run.smithi151.stdout:generic/098 1s 2023-12-19T16:22:08.288 INFO:teuthology.orchestra.run.smithi151.stdout:generic/099 2s 2023-12-19T16:22:08.764 INFO:teuthology.orchestra.run.smithi151.stdout:generic/101 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:22:09.239 INFO:teuthology.orchestra.run.smithi151.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T16:22:09.766 INFO:teuthology.orchestra.run.smithi151.stdout:generic/104 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:22:10.830 INFO:teuthology.orchestra.run.smithi151.stdout:generic/105 1s 2023-12-19T16:22:11.355 INFO:teuthology.orchestra.run.smithi151.stdout:generic/106 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:22:11.874 INFO:teuthology.orchestra.run.smithi151.stdout:generic/107 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:22:12.528 INFO:teuthology.orchestra.run.smithi151.stdout:generic/108 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:22:13.064 INFO:teuthology.orchestra.run.smithi151.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:22:13.593 INFO:teuthology.orchestra.run.smithi151.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:22:16.205 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:22:16.208 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:22:16.210 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:22:38.327 INFO:teuthology.orchestra.run.smithi151.stdout:generic/112 25s 2023-12-19T16:22:46.344 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:22:46.348 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:22:46.351 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:23:16.592 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:23:16.595 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:23:16.598 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:23:46.767 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:23:46.772 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:23:46.775 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:24:16.908 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:24:16.911 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:24:16.914 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:24:45.884 INFO:teuthology.orchestra.run.smithi151.stdout:generic/113 127s 2023-12-19T16:24:46.414 INFO:teuthology.orchestra.run.smithi151.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-12-19T16:24:46.917 INFO:teuthology.orchestra.run.smithi151.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:24:47.053 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:24:47.056 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:24:47.058 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:24:47.353 INFO:teuthology.orchestra.run.smithi151.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:24:54.378 INFO:teuthology.orchestra.run.smithi151.stdout:generic/117 7s 2023-12-19T16:24:54.984 INFO:teuthology.orchestra.run.smithi151.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:24:55.521 INFO:teuthology.orchestra.run.smithi151.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:24:55.989 INFO:teuthology.orchestra.run.smithi151.stdout:generic/120 [not run] atime not maintained by ceph 2023-12-19T16:24:56.497 INFO:teuthology.orchestra.run.smithi151.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T16:24:57.030 INFO:teuthology.orchestra.run.smithi151.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T16:24:58.139 INFO:teuthology.orchestra.run.smithi151.stdout:generic/123 1s 2023-12-19T16:25:17.459 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:25:17.462 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:25:17.466 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:25:38.790 INFO:teuthology.orchestra.run.smithi151.stdout:generic/124 40s 2023-12-19T16:25:39.646 INFO:teuthology.orchestra.run.smithi151.stdout:generic/126 1s 2023-12-19T16:25:42.002 INFO:teuthology.orchestra.run.smithi151.stdout:generic/128 2s 2023-12-19T16:25:47.809 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:25:47.812 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:25:47.814 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:26:17.949 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:26:17.955 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:26:17.957 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:26:48.393 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:26:48.396 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:26:48.400 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:27:18.677 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:27:18.680 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:27:18.682 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:27:48.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:27:48.826 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:27:48.829 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:28:19.195 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:28:19.198 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:28:19.201 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:28:49.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:28:49.334 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:28:49.336 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:29:19.468 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:29:19.474 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:29:19.478 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:29:49.623 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:29:49.627 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:29:49.630 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:30:19.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:30:19.843 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:30:19.847 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:30:49.977 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:30:49.981 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:30:49.986 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:31:20.112 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:31:20.117 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:31:20.121 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:31:50.249 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:31:50.252 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:31:50.255 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:32:20.396 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:32:20.399 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:32:20.402 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:32:50.699 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:32:50.705 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:32:50.710 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:33:20.855 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:33:20.859 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:33:20.861 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:33:51.002 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:33:51.005 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:33:51.007 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:34:21.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:34:21.175 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:34:21.179 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:34:51.626 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:34:51.629 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:34:51.631 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:35:21.767 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:35:21.773 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:35:21.777 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:35:52.131 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:35:52.137 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:35:52.139 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:36:22.283 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:36:22.286 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:36:22.288 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:36:52.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:36:52.489 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:36:52.492 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:37:22.686 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:37:22.710 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:37:22.712 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:37:52.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:37:52.868 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:37:52.870 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:38:23.010 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:38:23.013 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:38:23.016 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:38:53.155 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:38:53.158 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:38:53.161 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:39:23.340 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:39:23.343 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:39:23.346 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:39:53.687 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:39:53.690 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:39:53.695 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:40:23.873 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:40:23.876 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:40:23.922 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:40:54.113 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:40:54.117 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:40:54.119 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:41:24.254 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:41:24.257 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:41:24.260 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:41:54.417 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:41:54.420 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:41:54.422 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:42:24.563 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:42:24.649 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:42:24.651 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:42:54.935 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:42:54.939 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:42:54.943 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:43:25.071 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:43:25.075 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:43:25.077 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:43:55.210 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:43:55.214 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:43:55.218 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:44:25.502 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:44:25.506 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:44:25.509 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:44:55.661 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:44:55.665 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:44:55.667 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:45:25.806 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:45:25.809 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:45:25.812 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:45:56.104 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:45:56.107 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:45:56.109 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:46:26.492 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:46:26.498 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:46:26.501 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:46:56.825 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:46:56.830 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:46:56.834 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:47:26.992 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:47:26.995 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:47:26.997 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:47:57.205 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:47:57.208 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:47:57.210 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:47:57.446 INFO:teuthology.orchestra.run.smithi151.stdout:generic/129 1335s 2023-12-19T16:48:11.983 INFO:teuthology.orchestra.run.smithi151.stdout:generic/130 14s 2023-12-19T16:48:13.684 INFO:teuthology.orchestra.run.smithi151.stdout:generic/131 2s 2023-12-19T16:48:14.166 INFO:teuthology.orchestra.run.smithi151.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:15.710 INFO:teuthology.orchestra.run.smithi151.stdout:generic/135 1s 2023-12-19T16:48:16.318 INFO:teuthology.orchestra.run.smithi151.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T16:48:16.823 INFO:teuthology.orchestra.run.smithi151.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:17.365 INFO:teuthology.orchestra.run.smithi151.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:17.887 INFO:teuthology.orchestra.run.smithi151.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:19.744 INFO:teuthology.orchestra.run.smithi151.stdout:generic/141 2s 2023-12-19T16:48:20.349 INFO:teuthology.orchestra.run.smithi151.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:20.887 INFO:teuthology.orchestra.run.smithi151.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:21.399 INFO:teuthology.orchestra.run.smithi151.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:21.912 INFO:teuthology.orchestra.run.smithi151.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:22.422 INFO:teuthology.orchestra.run.smithi151.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:22.945 INFO:teuthology.orchestra.run.smithi151.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:23.483 INFO:teuthology.orchestra.run.smithi151.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:23.987 INFO:teuthology.orchestra.run.smithi151.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:24.521 INFO:teuthology.orchestra.run.smithi151.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:25.046 INFO:teuthology.orchestra.run.smithi151.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:25.563 INFO:teuthology.orchestra.run.smithi151.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:26.070 INFO:teuthology.orchestra.run.smithi151.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:26.560 INFO:teuthology.orchestra.run.smithi151.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:27.075 INFO:teuthology.orchestra.run.smithi151.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:27.525 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:48:27.528 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:48:27.531 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:48:27.566 INFO:teuthology.orchestra.run.smithi151.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:28.084 INFO:teuthology.orchestra.run.smithi151.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:28.604 INFO:teuthology.orchestra.run.smithi151.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T16:48:29.054 INFO:teuthology.orchestra.run.smithi151.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-12-19T16:48:29.540 INFO:teuthology.orchestra.run.smithi151.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-12-19T16:48:30.357 INFO:teuthology.orchestra.run.smithi151.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:48:31.053 INFO:teuthology.orchestra.run.smithi151.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-19T16:48:31.899 INFO:teuthology.orchestra.run.smithi151.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-19T16:48:33.362 INFO:teuthology.orchestra.run.smithi151.stdout:generic/169 1s 2023-12-19T16:48:34.201 INFO:teuthology.orchestra.run.smithi151.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:48:35.012 INFO:teuthology.orchestra.run.smithi151.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:48:35.832 INFO:teuthology.orchestra.run.smithi151.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:48:36.644 INFO:teuthology.orchestra.run.smithi151.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:48:42.979 INFO:teuthology.orchestra.run.smithi151.stdout:generic/177 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T16:48:43.510 INFO:teuthology.orchestra.run.smithi151.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:44.030 INFO:teuthology.orchestra.run.smithi151.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:44.536 INFO:teuthology.orchestra.run.smithi151.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:45.047 INFO:teuthology.orchestra.run.smithi151.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:48:45.555 INFO:teuthology.orchestra.run.smithi151.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T16:48:46.347 INFO:teuthology.orchestra.run.smithi151.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:48:46.897 INFO:teuthology.orchestra.run.smithi151.stdout:generic/184 0s 2023-12-19T16:48:47.649 INFO:teuthology.orchestra.run.smithi151.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:48:48.441 INFO:teuthology.orchestra.run.smithi151.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:48:49.214 INFO:teuthology.orchestra.run.smithi151.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:48:49.963 INFO:teuthology.orchestra.run.smithi151.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:48:50.752 INFO:teuthology.orchestra.run.smithi151.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:48:52.859 INFO:teuthology.orchestra.run.smithi151.stdout:generic/193 2s 2023-12-19T16:48:53.682 INFO:teuthology.orchestra.run.smithi151.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:48:54.462 INFO:teuthology.orchestra.run.smithi151.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:48:55.227 INFO:teuthology.orchestra.run.smithi151.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:48:55.990 INFO:teuthology.orchestra.run.smithi151.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:48:57.649 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:48:57.652 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:48:57.655 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:48:57.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-19T16:48:57.711+0000 7f00e9748640 -1 received signal: Hangup from (PID: 102678) UID: 0 2023-12-19T16:48:57.716 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-19T16:48:57.711+0000 7f377071d640 -1 Fail to open '/proc/102678/cmdline' error = (2) No such file or directory 2023-12-19T16:48:57.716 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-19T16:48:57.711+0000 7f377071d640 -1 received signal: Hangup from (PID: 102678) UID: 0 2023-12-19T16:48:57.716 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-19T16:48:57.712+0000 7fa290eb4640 -1 Fail to open '/proc/102678/cmdline' error = (2) No such file or directory 2023-12-19T16:48:57.717 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-19T16:48:57.712+0000 7fa290eb4640 -1 received signal: Hangup from (PID: 102678) UID: 0 2023-12-19T16:48:57.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-19T16:48:57.717+0000 7f96376b4640 -1 Fail to open '/proc/102678/cmdline' error = (2) No such file or directory 2023-12-19T16:48:57.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-19T16:48:57.717+0000 7f96376b4640 -1 received signal: Hangup from (PID: 102678) UID: 0 2023-12-19T16:49:27.088 INFO:teuthology.orchestra.run.smithi151.stdout:generic/198 31s 2023-12-19T16:49:27.872 INFO:teuthology.orchestra.run.smithi151.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:49:28.715 INFO:teuthology.orchestra.run.smithi151.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:49:29.458 INFO:teuthology.orchestra.run.smithi151.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:49:30.256 INFO:teuthology.orchestra.run.smithi151.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:49:31.039 INFO:teuthology.orchestra.run.smithi151.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:49:31.840 INFO:teuthology.orchestra.run.smithi151.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:49:32.657 INFO:teuthology.orchestra.run.smithi151.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:49:50.288 INFO:teuthology.orchestra.run.smithi151.stdout:generic/207 18s 2023-12-19T16:49:50.871 INFO:teuthology.orchestra.run.smithi151.stdout:generic/210 0s 2023-12-19T16:49:51.916 INFO:teuthology.orchestra.run.smithi151.stdout:generic/211 1s 2023-12-19T16:49:52.473 INFO:teuthology.orchestra.run.smithi151.stdout:generic/212 1s 2023-12-19T16:49:52.948 INFO:teuthology.orchestra.run.smithi151.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T16:49:53.445 INFO:teuthology.orchestra.run.smithi151.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T16:49:56.017 INFO:teuthology.orchestra.run.smithi151.stdout:generic/215 3s 2023-12-19T16:49:56.767 INFO:teuthology.orchestra.run.smithi151.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:49:57.577 INFO:teuthology.orchestra.run.smithi151.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:49:58.389 INFO:teuthology.orchestra.run.smithi151.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:49:58.847 INFO:teuthology.orchestra.run.smithi151.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T16:49:59.921 INFO:teuthology.orchestra.run.smithi151.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:50:01.469 INFO:teuthology.orchestra.run.smithi151.stdout:generic/221 2s 2023-12-19T16:50:02.242 INFO:teuthology.orchestra.run.smithi151.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:50:02.710 INFO:teuthology.orchestra.run.smithi151.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T16:50:03.260 INFO:teuthology.orchestra.run.smithi151.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-19T16:50:04.071 INFO:teuthology.orchestra.run.smithi151.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:50:04.563 INFO:teuthology.orchestra.run.smithi151.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T16:50:05.340 INFO:teuthology.orchestra.run.smithi151.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:50:05.827 INFO:teuthology.orchestra.run.smithi151.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T16:50:06.284 INFO:teuthology.orchestra.run.smithi151.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T16:50:07.864 INFO:teuthology.orchestra.run.smithi151.stdout:generic/236 1s 2023-12-19T16:50:08.428 INFO:teuthology.orchestra.run.smithi151.stdout:generic/237 1s 2023-12-19T16:50:09.200 INFO:teuthology.orchestra.run.smithi151.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:50:26.562 INFO:teuthology.orchestra.run.smithi151.stdout:generic/240 17s 2023-12-19T16:50:26.984 INFO:teuthology.orchestra.run.smithi151.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T16:50:27.555 INFO:teuthology.orchestra.run.smithi151.stdout:generic/245 0s 2023-12-19T16:50:28.036 INFO:teuthology.orchestra.run.smithi151.stdout:generic/246 1s 2023-12-19T16:51:54.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:51:54.846 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:51:54.850 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:51:54.978 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-12-19T16:51:54.974+0000 7f4fb3269640 -1 received signal: Hangup from (PID: 96721) UID: 0 2023-12-19T16:51:54.978 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-12-19T16:51:54.975+0000 7f870b35e640 -1 Fail to open '/proc/96721/cmdline' error = (2) No such file or directory 2023-12-19T16:51:54.978 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-12-19T16:51:54.975+0000 7f870b35e640 -1 received signal: Hangup from (PID: 96721) UID: 0 2023-12-19T16:51:54.979 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-12-19T16:51:54.975+0000 7f2eabc78640 -1 Fail to open '/proc/96721/cmdline' error = (2) No such file or directory 2023-12-19T16:51:54.979 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-12-19T16:51:54.975+0000 7f2eabc78640 -1 received signal: Hangup from (PID: 96721) UID: 0 2023-12-19T16:51:54.985 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-12-19T16:51:54.976+0000 7fa395e04640 -1 Fail to open '/proc/96721/cmdline' error = (2) No such file or directory 2023-12-19T16:51:54.990 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-12-19T16:51:54.976+0000 7fa395e04640 -1 received signal: Hangup from (PID: 96721) UID: 0 2023-12-19T16:54:45.694 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:54:45.698 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:54:45.701 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:54:45.758 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-12-19T16:54:45.755+0000 7f2eabc78640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96743) UID: 0 2023-12-19T16:54:45.759 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-12-19T16:54:45.755+0000 7f4fb3269640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96743) UID: 0 2023-12-19T16:54:45.759 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-12-19T16:54:45.755+0000 7f870b35e640 -1 received signal: Hangup from (PID: 96743) UID: 0 2023-12-19T16:54:45.760 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-19T16:54:45.756+0000 7fa290eb4640 -1 Fail to open '/proc/102726/cmdline' error = (2) No such file or directory 2023-12-19T16:54:45.760 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-19T16:54:45.756+0000 7fa290eb4640 -1 received signal: Hangup from (PID: 102726) UID: 0 2023-12-19T16:54:45.760 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-12-19T16:54:45.755+0000 7fa395e04640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96743) UID: 0 2023-12-19T16:54:45.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-19T16:54:45.757+0000 7f00e9748640 -1 Fail to open '/proc/102726/cmdline' error = (2) No such file or directory 2023-12-19T16:54:45.761 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-19T16:54:45.757+0000 7f377071d640 -1 Fail to open '/proc/102726/cmdline' error = (2) No such file or directory 2023-12-19T16:54:45.761 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-19T16:54:45.757+0000 7f377071d640 -1 received signal: Hangup from (PID: 102726) UID: 0 2023-12-19T16:54:45.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-19T16:54:45.757+0000 7f00e9748640 -1 received signal: Hangup from (PID: 102726) UID: 0 2023-12-19T16:54:45.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-19T16:54:45.757+0000 7f96376b4640 -1 Fail to open '/proc/102726/cmdline' error = (2) No such file or directory 2023-12-19T16:54:45.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-19T16:54:45.757+0000 7f96376b4640 -1 received signal: Hangup from (PID: 102726) UID: 0 2023-12-19T16:55:50.994 INFO:teuthology.orchestra.run.smithi151.stdout:generic/247 322s 2023-12-19T16:55:51.558 INFO:teuthology.orchestra.run.smithi151.stdout:generic/248 0s 2023-12-19T16:56:18.607 INFO:teuthology.orchestra.run.smithi151.stdout:generic/249 27s 2023-12-19T16:56:19.127 INFO:teuthology.orchestra.run.smithi151.stdout:generic/250 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:56:19.625 INFO:teuthology.orchestra.run.smithi151.stdout:generic/252 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:56:20.418 INFO:teuthology.orchestra.run.smithi151.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:56:21.171 INFO:teuthology.orchestra.run.smithi151.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:56:30.672 INFO:teuthology.orchestra.run.smithi151.stdout:generic/255 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T16:56:41.243 INFO:teuthology.orchestra.run.smithi151.stdout:generic/256 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T16:56:42.653 INFO:teuthology.orchestra.run.smithi151.stdout:generic/257 1s 2023-12-19T16:56:43.117 INFO:teuthology.orchestra.run.smithi151.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-12-19T16:56:43.948 INFO:teuthology.orchestra.run.smithi151.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:56:44.648 INFO:teuthology.orchestra.run.smithi151.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.QHjjk1hzmdscratch 2023-12-19T16:56:45.456 INFO:teuthology.orchestra.run.smithi151.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:56:46.266 INFO:teuthology.orchestra.run.smithi151.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:57:13.938 INFO:teuthology.orchestra.run.smithi037.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.1.log.1: 2023-12-19T16:57:13.939 INFO:teuthology.orchestra.run.smithi037.stderr:gzip: stdin: file size changed while zipping 2023-12-19T16:57:45.413 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:57:45.417 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:57:45.419 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:57:45.450 INFO:tasks.ceph.osd.5.smithi078.stderr:2023-12-19T16:57:45.447+0000 7f2eabc78640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96768) UID: 0 2023-12-19T16:57:45.451 INFO:tasks.ceph.osd.4.smithi078.stderr:2023-12-19T16:57:45.447+0000 7f870b35e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96768) UID: 0 2023-12-19T16:57:45.451 INFO:tasks.ceph.osd.6.smithi078.stderr:2023-12-19T16:57:45.447+0000 7f4fb3269640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96768) UID: 0 2023-12-19T16:57:45.451 INFO:tasks.ceph.osd.7.smithi078.stderr:2023-12-19T16:57:45.447+0000 7fa395e04640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96768) UID: 0 2023-12-19T16:58:04.476 INFO:teuthology.orchestra.run.smithi151.stdout:generic/263 78s 2023-12-19T16:58:05.269 INFO:teuthology.orchestra.run.smithi151.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:06.102 INFO:teuthology.orchestra.run.smithi151.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:06.903 INFO:teuthology.orchestra.run.smithi151.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:07.711 INFO:teuthology.orchestra.run.smithi151.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:08.558 INFO:teuthology.orchestra.run.smithi151.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:09.368 INFO:teuthology.orchestra.run.smithi151.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:10.162 INFO:teuthology.orchestra.run.smithi151.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:10.964 INFO:teuthology.orchestra.run.smithi151.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:11.443 INFO:teuthology.orchestra.run.smithi151.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-12-19T16:58:12.288 INFO:teuthology.orchestra.run.smithi151.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:13.112 INFO:teuthology.orchestra.run.smithi151.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:13.962 INFO:teuthology.orchestra.run.smithi151.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:14.792 INFO:teuthology.orchestra.run.smithi151.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:15.602 INFO:teuthology.orchestra.run.smithi151.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:16.397 INFO:teuthology.orchestra.run.smithi151.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:16.878 INFO:teuthology.orchestra.run.smithi151.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T16:58:17.661 INFO:teuthology.orchestra.run.smithi151.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:18.282 INFO:teuthology.orchestra.run.smithi151.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.QHjjk1hzmdscratch 2023-12-19T16:58:19.101 INFO:teuthology.orchestra.run.smithi151.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:19.884 INFO:teuthology.orchestra.run.smithi151.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:20.660 INFO:teuthology.orchestra.run.smithi151.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:21.428 INFO:teuthology.orchestra.run.smithi151.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:22.243 INFO:teuthology.orchestra.run.smithi151.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:23.237 INFO:teuthology.orchestra.run.smithi151.stdout:generic/294 1s 2023-12-19T16:58:24.090 INFO:teuthology.orchestra.run.smithi151.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:24.856 INFO:teuthology.orchestra.run.smithi151.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:25.696 INFO:teuthology.orchestra.run.smithi151.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:26.469 INFO:teuthology.orchestra.run.smithi151.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:27.021 INFO:teuthology.orchestra.run.smithi151.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T16:58:27.558 INFO:teuthology.orchestra.run.smithi151.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T16:58:28.351 INFO:teuthology.orchestra.run.smithi151.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:29.284 INFO:teuthology.orchestra.run.smithi151.stdout:generic/306 1s 2023-12-19T16:58:31.558 INFO:teuthology.orchestra.run.smithi151.stdout:generic/307 2s 2023-12-19T16:58:32.130 INFO:teuthology.orchestra.run.smithi151.stdout:generic/308 1s 2023-12-19T16:58:33.663 INFO:teuthology.orchestra.run.smithi151.stdout:generic/309 1s 2023-12-19T16:58:34.117 INFO:teuthology.orchestra.run.smithi151.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T16:58:38.671 INFO:teuthology.orchestra.run.smithi151.stdout:generic/313 4s 2023-12-19T16:58:39.625 INFO:teuthology.orchestra.run.smithi151.stdout:generic/314 1s 2023-12-19T16:58:40.027 INFO:teuthology.orchestra.run.smithi151.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-19T16:58:48.398 INFO:teuthology.orchestra.run.smithi151.stdout:generic/316 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T16:58:49.415 INFO:teuthology.orchestra.run.smithi151.stdout:generic/317 - output mismatch (see /tmp/tmp.t6fx4IVDVzxfstests-dev/results//generic/317.out.bad) 2023-12-19T16:58:49.422 INFO:teuthology.orchestra.run.smithi151.stdout: --- tests/generic/317.out 2023-12-19 16:07:53.320482777 +0000 2023-12-19T16:58:49.422 INFO:teuthology.orchestra.run.smithi151.stdout: +++ /tmp/tmp.t6fx4IVDVzxfstests-dev/results//generic/317.out.bad 2023-12-19 16:58:49.408520892 +0000 2023-12-19T16:58:49.422 INFO:teuthology.orchestra.run.smithi151.stdout: @@ -4,9 +4,7 @@ 2023-12-19T16:58:49.422 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 0 Filetype: Regular File 2023-12-19T16:58:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) 2023-12-19T16:58:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: From user_ns 2023-12-19T16:58:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: - File: "$SCRATCH_MNT/file1" 2023-12-19T16:58:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: - Size: 0 Filetype: Regular File 2023-12-19T16:58:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) 2023-12-19T16:58:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: +execvp: Permission denied 2023-12-19T16:58:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:58:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: *** Remounting *** 2023-12-19T16:58:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T16:58:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: @@ -15,6 +13,4 @@ 2023-12-19T16:58:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 0 Filetype: Regular File 2023-12-19T16:58:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) 2023-12-19T16:58:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: From user_ns 2023-12-19T16:58:49.424 INFO:teuthology.orchestra.run.smithi151.stdout: - File: "$SCRATCH_MNT/file1" 2023-12-19T16:58:49.424 INFO:teuthology.orchestra.run.smithi151.stdout: - Size: 0 Filetype: Regular File 2023-12-19T16:58:49.424 INFO:teuthology.orchestra.run.smithi151.stdout: - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) 2023-12-19T16:58:49.424 INFO:teuthology.orchestra.run.smithi151.stdout: +execvp: Permission denied 2023-12-19T16:58:50.434 INFO:teuthology.orchestra.run.smithi151.stdout:generic/318 1s 2023-12-19T16:58:51.223 INFO:teuthology.orchestra.run.smithi151.stdout:generic/319 1s 2023-12-19T16:58:51.769 INFO:teuthology.orchestra.run.smithi151.stdout:generic/321 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:58:52.223 INFO:teuthology.orchestra.run.smithi151.stdout:generic/322 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:58:52.668 INFO:teuthology.orchestra.run.smithi151.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-12-19T16:58:53.163 INFO:teuthology.orchestra.run.smithi151.stdout:generic/325 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:58:53.946 INFO:teuthology.orchestra.run.smithi151.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:54.736 INFO:teuthology.orchestra.run.smithi151.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:55.514 INFO:teuthology.orchestra.run.smithi151.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:56.351 INFO:teuthology.orchestra.run.smithi151.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:57.146 INFO:teuthology.orchestra.run.smithi151.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:57.964 INFO:teuthology.orchestra.run.smithi151.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:58.759 INFO:teuthology.orchestra.run.smithi151.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T16:58:59.240 INFO:teuthology.orchestra.run.smithi151.stdout:generic/335 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:58:59.764 INFO:teuthology.orchestra.run.smithi151.stdout:generic/336 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:59:00.760 INFO:teuthology.orchestra.run.smithi151.stdout:generic/337 1s 2023-12-19T16:59:01.302 INFO:teuthology.orchestra.run.smithi151.stdout:generic/338 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:59:01.790 INFO:teuthology.orchestra.run.smithi151.stdout:generic/341 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:59:02.292 INFO:teuthology.orchestra.run.smithi151.stdout:generic/342 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T16:59:02.804 INFO:teuthology.orchestra.run.smithi151.stdout:generic/343 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:00:31.800 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:00:31.805 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:00:31.808 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:01:01.951 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:01:01.955 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:01:01.958 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:01:32.097 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:01:32.100 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:01:32.103 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:02:02.261 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:02:02.264 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:02:02.267 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:02:32.380 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:02:32.384 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:02:32.387 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:02:59.321 INFO:teuthology.orchestra.run.smithi151.stdout:generic/346 237s 2023-12-19T17:02:59.946 INFO:teuthology.orchestra.run.smithi151.stdout:generic/347 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:03:00.467 INFO:teuthology.orchestra.run.smithi151.stdout:generic/348 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:03:01.273 INFO:teuthology.orchestra.run.smithi151.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:03:02.507 INFO:teuthology.orchestra.run.smithi151.stdout:generic/355 1s 2023-12-19T17:03:02.630 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:03:02.633 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:03:02.636 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:03:03.143 INFO:teuthology.orchestra.run.smithi151.stdout:generic/356 [not run] swapfiles are not supported 2023-12-19T17:03:03.808 INFO:teuthology.orchestra.run.smithi151.stdout:generic/357 [not run] swapfiles are not supported 2023-12-19T17:03:04.577 INFO:teuthology.orchestra.run.smithi151.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:03:05.332 INFO:teuthology.orchestra.run.smithi151.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:03:05.923 INFO:teuthology.orchestra.run.smithi151.stdout:generic/360 0s 2023-12-19T17:03:06.371 INFO:teuthology.orchestra.run.smithi151.stdout:generic/361 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:03:06.827 INFO:teuthology.orchestra.run.smithi151.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T17:03:07.308 INFO:teuthology.orchestra.run.smithi151.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T17:03:07.762 INFO:teuthology.orchestra.run.smithi151.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T17:03:08.220 INFO:teuthology.orchestra.run.smithi151.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T17:03:08.669 INFO:teuthology.orchestra.run.smithi151.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T17:03:09.117 INFO:teuthology.orchestra.run.smithi151.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T17:03:09.547 INFO:teuthology.orchestra.run.smithi151.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T17:03:10.033 INFO:teuthology.orchestra.run.smithi151.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T17:03:10.478 INFO:teuthology.orchestra.run.smithi151.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T17:03:10.941 INFO:teuthology.orchestra.run.smithi151.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T17:03:11.739 INFO:teuthology.orchestra.run.smithi151.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:03:12.561 INFO:teuthology.orchestra.run.smithi151.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:03:13.271 INFO:teuthology.orchestra.run.smithi151.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-19T17:03:14.008 INFO:teuthology.orchestra.run.smithi151.stdout:generic/375 0s 2023-12-19T17:03:14.470 INFO:teuthology.orchestra.run.smithi151.stdout:generic/376 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:03:15.588 INFO:teuthology.orchestra.run.smithi151.stdout:generic/377 1s 2023-12-19T17:03:16.690 INFO:teuthology.orchestra.run.smithi151.stdout:generic/378 1s 2023-12-19T17:03:17.129 INFO:teuthology.orchestra.run.smithi151.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T17:03:17.574 INFO:teuthology.orchestra.run.smithi151.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T17:03:18.023 INFO:teuthology.orchestra.run.smithi151.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T17:03:18.478 INFO:teuthology.orchestra.run.smithi151.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T17:03:18.922 INFO:teuthology.orchestra.run.smithi151.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T17:03:19.399 INFO:teuthology.orchestra.run.smithi151.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T17:03:19.828 INFO:teuthology.orchestra.run.smithi151.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T17:03:20.278 INFO:teuthology.orchestra.run.smithi151.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T17:03:20.746 INFO:teuthology.orchestra.run.smithi151.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-12-19T17:03:21.214 INFO:teuthology.orchestra.run.smithi151.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T17:03:21.827 INFO:teuthology.orchestra.run.smithi151.stdout:generic/392 [not run] ceph does not support shutdown 2023-12-19T17:03:23.479 INFO:teuthology.orchestra.run.smithi151.stdout:generic/393 2s 2023-12-19T17:03:24.062 INFO:teuthology.orchestra.run.smithi151.stdout:generic/394 1s 2023-12-19T17:03:24.674 INFO:teuthology.orchestra.run.smithi151.stdout:generic/395 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:03:25.315 INFO:teuthology.orchestra.run.smithi151.stdout:generic/396 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:03:25.958 INFO:teuthology.orchestra.run.smithi151.stdout:generic/397 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:03:26.602 INFO:teuthology.orchestra.run.smithi151.stdout:generic/398 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:03:27.031 INFO:teuthology.orchestra.run.smithi151.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T17:03:28.145 INFO:teuthology.orchestra.run.smithi151.stdout:generic/401 1s 2023-12-19T17:03:28.882 INFO:teuthology.orchestra.run.smithi151.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-12-19T17:03:30.351 INFO:teuthology.orchestra.run.smithi151.stdout:generic/403 2s 2023-12-19T17:03:30.862 INFO:teuthology.orchestra.run.smithi151.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T17:03:32.748 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:03:32.752 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:03:32.754 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:03:34.573 INFO:teuthology.orchestra.run.smithi151.stdout:generic/406 4s 2023-12-19T17:03:35.187 INFO:teuthology.orchestra.run.smithi151.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T17:03:35.741 INFO:teuthology.orchestra.run.smithi151.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T17:03:36.185 INFO:teuthology.orchestra.run.smithi151.stdout:generic/409 [not run] require 172.21.15.37:6789:/scratch to be local device 2023-12-19T17:03:36.663 INFO:teuthology.orchestra.run.smithi151.stdout:generic/410 [not run] require 172.21.15.37:6789:/scratch to be local device 2023-12-19T17:03:37.160 INFO:teuthology.orchestra.run.smithi151.stdout:generic/411 [not run] require 172.21.15.37:6789:/scratch to be local device 2023-12-19T17:03:38.436 INFO:teuthology.orchestra.run.smithi151.stdout:generic/412 1s 2023-12-19T17:03:39.140 INFO:teuthology.orchestra.run.smithi151.stdout:generic/413 [not run] mount 172.21.15.37:6789:/scratch with dax failed 2023-12-19T17:03:39.944 INFO:teuthology.orchestra.run.smithi151.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:03:40.609 INFO:teuthology.orchestra.run.smithi151.stdout:generic/417 [not run] ceph does not support shutdown 2023-12-19T17:03:41.218 INFO:teuthology.orchestra.run.smithi151.stdout:generic/419 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:03:50.131 INFO:teuthology.orchestra.run.smithi151.stdout:generic/420 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T17:03:50.746 INFO:teuthology.orchestra.run.smithi151.stdout:generic/421 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:03:51.241 INFO:teuthology.orchestra.run.smithi151.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-19T17:03:51.873 INFO:teuthology.orchestra.run.smithi151.stdout:generic/423 0s 2023-12-19T17:03:52.365 INFO:teuthology.orchestra.run.smithi151.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-12-19T17:03:52.898 INFO:teuthology.orchestra.run.smithi151.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-12-19T17:04:02.890 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:04:02.893 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:04:02.896 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:04:15.217 INFO:teuthology.orchestra.run.smithi151.stdout:generic/426 23s 2023-12-19T17:04:16.163 INFO:teuthology.orchestra.run.smithi151.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-19T17:04:16.723 INFO:teuthology.orchestra.run.smithi151.stdout:generic/428 0s 2023-12-19T17:04:17.439 INFO:teuthology.orchestra.run.smithi151.stdout:generic/430 1s 2023-12-19T17:04:18.098 INFO:teuthology.orchestra.run.smithi151.stdout:generic/431 1s 2023-12-19T17:04:18.767 INFO:teuthology.orchestra.run.smithi151.stdout:generic/432 0s 2023-12-19T17:04:19.409 INFO:teuthology.orchestra.run.smithi151.stdout:generic/433 1s 2023-12-19T17:04:20.082 INFO:teuthology.orchestra.run.smithi151.stdout:generic/434 1s 2023-12-19T17:04:20.773 INFO:teuthology.orchestra.run.smithi151.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T17:04:22.092 INFO:teuthology.orchestra.run.smithi151.stdout:generic/437 2s 2023-12-19T17:04:33.733 INFO:teuthology.orchestra.run.smithi151.stdout:generic/439 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T17:04:33.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:04:33.816 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:04:33.819 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:04:34.310 INFO:teuthology.orchestra.run.smithi151.stdout:generic/440 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:04:34.835 INFO:teuthology.orchestra.run.smithi151.stdout:generic/441 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:04:35.394 INFO:teuthology.orchestra.run.smithi151.stdout:generic/443 1s 2023-12-19T17:04:36.019 INFO:teuthology.orchestra.run.smithi151.stdout:generic/444 0s 2023-12-19T17:04:36.700 INFO:teuthology.orchestra.run.smithi151.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T17:04:46.187 INFO:teuthology.orchestra.run.smithi151.stdout:generic/446 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T17:04:47.017 INFO:teuthology.orchestra.run.smithi151.stdout:generic/448 1s 2023-12-19T17:04:47.589 INFO:teuthology.orchestra.run.smithi151.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-19T17:04:52.930 INFO:teuthology.orchestra.run.smithi151.stdout:generic/450 5s 2023-12-19T17:05:04.536 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:05:04.539 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:05:04.542 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:05:23.512 INFO:teuthology.orchestra.run.smithi151.stdout:generic/451 31s 2023-12-19T17:05:25.288 INFO:teuthology.orchestra.run.smithi151.stdout:generic/452 2s 2023-12-19T17:05:25.758 INFO:teuthology.orchestra.run.smithi151.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-12-19T17:05:26.242 INFO:teuthology.orchestra.run.smithi151.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-12-19T17:05:26.798 INFO:teuthology.orchestra.run.smithi151.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T17:05:27.571 INFO:teuthology.orchestra.run.smithi151.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:05:34.683 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:05:34.687 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:05:34.690 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:06:04.893 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:06:04.898 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:06:04.900 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:06:35.028 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:06:35.032 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:06:35.034 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:07:05.375 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:07:05.381 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:07:05.384 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:07:35.646 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:07:35.649 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:07:35.652 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:08:05.792 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:08:05.795 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:08:05.797 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:08:35.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:08:35.932 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:08:35.935 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:09:06.075 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:09:06.080 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:09:06.082 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:09:36.213 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:09:36.216 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:09:36.220 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:10:06.368 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:10:06.371 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:10:06.373 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:10:24.072 INFO:teuthology.orchestra.run.smithi151.stdout:generic/460 296s 2023-12-19T17:10:24.790 INFO:teuthology.orchestra.run.smithi151.stdout:generic/462 [not run] mount 172.21.15.37:6789:/scratch with dax failed 2023-12-19T17:10:25.377 INFO:teuthology.orchestra.run.smithi151.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T17:10:33.262 INFO:teuthology.orchestra.run.smithi151.stdout:generic/465 8s 2023-12-19T17:10:33.787 INFO:teuthology.orchestra.run.smithi151.stdout:generic/466 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:10:36.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:10:36.524 INFO:teuthology.orchestra.run.smithi151.stdout:generic/467 3s 2023-12-19T17:10:36.527 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:10:36.529 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:10:38.419 INFO:teuthology.orchestra.run.smithi151.stdout:generic/468 [not run] ceph does not support shutdown 2023-12-19T17:10:38.911 INFO:teuthology.orchestra.run.smithi151.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-19T17:10:39.463 INFO:teuthology.orchestra.run.smithi151.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-12-19T17:11:07.430 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:11:07.434 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:11:07.437 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:11:18.103 INFO:teuthology.orchestra.run.smithi151.stdout:generic/471 39s 2023-12-19T17:11:19.102 INFO:teuthology.orchestra.run.smithi151.stdout:generic/472 [not run] swapfiles are not supported 2023-12-19T17:11:19.762 INFO:teuthology.orchestra.run.smithi151.stdout:generic/474 [not run] ceph does not support shutdown 2023-12-19T17:11:26.334 INFO:teuthology.orchestra.run.smithi151.stdout:generic/477 7s 2023-12-19T17:11:37.576 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:11:37.579 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:11:37.581 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:11:38.608 INFO:teuthology.orchestra.run.smithi151.stdout:generic/478 12s 2023-12-19T17:11:39.245 INFO:teuthology.orchestra.run.smithi151.stdout:generic/479 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:11:39.771 INFO:teuthology.orchestra.run.smithi151.stdout:generic/480 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:11:40.258 INFO:teuthology.orchestra.run.smithi151.stdout:generic/481 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:11:40.730 INFO:teuthology.orchestra.run.smithi151.stdout:generic/483 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:11:41.258 INFO:teuthology.orchestra.run.smithi151.stdout:generic/484 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:11:41.735 INFO:teuthology.orchestra.run.smithi151.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-19T17:11:43.432 INFO:teuthology.orchestra.run.smithi151.stdout:generic/486 2s 2023-12-19T17:11:44.014 INFO:teuthology.orchestra.run.smithi151.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-12-19T17:11:44.461 INFO:teuthology.orchestra.run.smithi151.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-19T17:11:44.965 INFO:teuthology.orchestra.run.smithi151.stdout:generic/489 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:11:45.883 INFO:teuthology.orchestra.run.smithi151.stdout:generic/490 1s 2023-12-19T17:11:46.389 INFO:teuthology.orchestra.run.smithi151.stdout:generic/491 [not run] ceph does not support freezing 2023-12-19T17:11:46.874 INFO:teuthology.orchestra.run.smithi151.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-12-19T17:11:47.706 INFO:teuthology.orchestra.run.smithi151.stdout:generic/493 [not run] swapfiles are not supported 2023-12-19T17:11:48.501 INFO:teuthology.orchestra.run.smithi151.stdout:generic/494 [not run] swapfiles are not supported 2023-12-19T17:11:49.261 INFO:teuthology.orchestra.run.smithi151.stdout:generic/495 [not run] swapfiles are not supported 2023-12-19T17:11:50.016 INFO:teuthology.orchestra.run.smithi151.stdout:generic/496 [not run] swapfiles are not supported 2023-12-19T17:11:50.789 INFO:teuthology.orchestra.run.smithi151.stdout:generic/497 [not run] swapfiles are not supported 2023-12-19T17:11:51.276 INFO:teuthology.orchestra.run.smithi151.stdout:generic/498 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:11:51.724 INFO:teuthology.orchestra.run.smithi151.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-19T17:11:52.556 INFO:teuthology.orchestra.run.smithi151.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:11:53.080 INFO:teuthology.orchestra.run.smithi151.stdout:generic/502 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:11:53.596 INFO:teuthology.orchestra.run.smithi151.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T17:11:54.175 INFO:teuthology.orchestra.run.smithi151.stdout:generic/504 1s 2023-12-19T17:11:54.844 INFO:teuthology.orchestra.run.smithi151.stdout:generic/505 [not run] ceph does not support shutdown 2023-12-19T17:11:55.330 INFO:teuthology.orchestra.run.smithi151.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T17:11:55.810 INFO:teuthology.orchestra.run.smithi151.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-12-19T17:11:56.269 INFO:teuthology.orchestra.run.smithi151.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-12-19T17:11:56.833 INFO:teuthology.orchestra.run.smithi151.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-12-19T17:11:57.351 INFO:teuthology.orchestra.run.smithi151.stdout:generic/510 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:11:57.834 INFO:teuthology.orchestra.run.smithi151.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-19T17:11:58.325 INFO:teuthology.orchestra.run.smithi151.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T17:11:59.177 INFO:teuthology.orchestra.run.smithi151.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:12:00.019 INFO:teuthology.orchestra.run.smithi151.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:12:00.854 INFO:teuthology.orchestra.run.smithi151.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:12:01.417 INFO:teuthology.orchestra.run.smithi151.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T17:12:02.149 INFO:teuthology.orchestra.run.smithi151.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-19T17:12:03.112 INFO:teuthology.orchestra.run.smithi151.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:12:03.605 INFO:teuthology.orchestra.run.smithi151.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-12-19T17:12:04.077 INFO:teuthology.orchestra.run.smithi151.stdout:generic/520 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:12:05.315 INFO:teuthology.orchestra.run.smithi151.stdout:generic/523 1s 2023-12-19T17:12:08.309 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:12:08.311 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:12:08.314 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:12:38.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:12:38.443 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:12:38.446 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:13:08.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:13:08.584 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:13:08.586 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:13:38.718 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:13:38.720 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:13:38.723 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:14:08.926 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:14:08.929 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:14:08.932 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:14:39.069 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:14:39.072 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:14:39.074 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:15:09.233 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:15:09.236 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:15:09.238 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:15:09.330 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-19T17:15:09.328+0000 7fa290eb4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103326) UID: 0 2023-12-19T17:15:09.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-19T17:15:09.328+0000 7f00e9748640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103326) UID: 0 2023-12-19T17:15:09.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-19T17:15:09.328+0000 7f96376b4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103326) UID: 0 2023-12-19T17:15:09.331 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-19T17:15:09.328+0000 7f377071d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103326) UID: 0 2023-12-19T17:16:28.160 INFO:teuthology.orchestra.run.smithi151.stdout:generic/524 263s 2023-12-19T17:16:28.901 INFO:teuthology.orchestra.run.smithi151.stdout:generic/525 [not run] filesystem does not support huge file size 2023-12-19T17:16:29.446 INFO:teuthology.orchestra.run.smithi151.stdout:generic/526 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:16:29.983 INFO:teuthology.orchestra.run.smithi151.stdout:generic/527 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:16:30.626 INFO:teuthology.orchestra.run.smithi151.stdout:generic/528 0s 2023-12-19T17:16:31.612 INFO:teuthology.orchestra.run.smithi151.stdout:generic/529 1s 2023-12-19T17:16:32.312 INFO:teuthology.orchestra.run.smithi151.stdout:generic/530 [not run] ceph does not support shutdown 2023-12-19T17:16:32.797 INFO:teuthology.orchestra.run.smithi151.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-12-19T17:16:33.370 INFO:teuthology.orchestra.run.smithi151.stdout:generic/532 1s 2023-12-19T17:16:34.411 INFO:teuthology.orchestra.run.smithi151.stdout:generic/533 1s 2023-12-19T17:16:34.888 INFO:teuthology.orchestra.run.smithi151.stdout:generic/534 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:16:35.393 INFO:teuthology.orchestra.run.smithi151.stdout:generic/535 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:16:36.073 INFO:teuthology.orchestra.run.smithi151.stdout:generic/536 [not run] ceph does not support shutdown 2023-12-19T17:16:36.712 INFO:teuthology.orchestra.run.smithi151.stdout:generic/537 [not run] FSTRIM not supported 2023-12-19T17:17:51.931 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:17:51.934 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:17:51.936 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:18:22.355 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:18:22.358 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:18:22.360 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:18:52.756 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:18:52.759 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:18:52.762 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:19:22.894 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:19:22.897 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:19:22.899 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:19:53.039 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:19:53.042 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:19:53.045 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:20:23.169 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:20:23.173 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:20:23.175 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:20:53.372 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:20:53.375 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:20:53.377 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:21:23.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:21:23.526 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:21:23.528 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:21:53.650 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:21:53.653 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:21:53.655 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:22:23.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:22:23.808 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:22:23.810 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:22:53.942 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:22:53.946 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:22:53.950 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:23:24.072 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:23:24.075 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:23:24.077 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:23:54.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:23:54.349 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:23:54.352 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:24:24.802 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:24:24.805 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:24:24.808 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:24:55.278 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:24:55.282 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:24:55.284 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:25:25.416 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:25:25.419 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:25:25.422 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:25:55.543 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:25:55.546 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:25:55.549 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:26:25.691 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:26:25.694 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:26:25.696 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:26:55.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:26:55.831 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:26:55.833 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:27:25.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:27:25.959 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:27:25.961 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:27:56.080 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:27:56.083 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:27:56.085 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:28:26.225 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:28:26.228 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:28:26.231 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:28:56.528 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:28:56.531 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:28:56.534 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:29:26.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:29:26.654 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:29:26.657 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:29:56.789 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:29:56.792 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:29:56.795 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:30:27.019 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:30:27.022 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:30:27.024 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:30:57.165 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:30:57.168 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:30:57.170 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:31:18.258 INFO:teuthology.orchestra.run.smithi151.stdout:generic/538 882s 2023-12-19T17:31:27.399 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:31:27.402 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:31:27.404 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:31:28.033 INFO:teuthology.orchestra.run.smithi151.stdout:generic/539 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T17:31:28.839 INFO:teuthology.orchestra.run.smithi151.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:31:29.622 INFO:teuthology.orchestra.run.smithi151.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:31:30.418 INFO:teuthology.orchestra.run.smithi151.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:31:31.183 INFO:teuthology.orchestra.run.smithi151.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:31:31.957 INFO:teuthology.orchestra.run.smithi151.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:31:32.443 INFO:teuthology.orchestra.run.smithi151.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-12-19T17:31:32.930 INFO:teuthology.orchestra.run.smithi151.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T17:31:33.437 INFO:teuthology.orchestra.run.smithi151.stdout:generic/547 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:31:34.067 INFO:teuthology.orchestra.run.smithi151.stdout:generic/548 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:31:34.654 INFO:teuthology.orchestra.run.smithi151.stdout:generic/549 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:31:35.255 INFO:teuthology.orchestra.run.smithi151.stdout:generic/550 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:31:35.779 INFO:teuthology.orchestra.run.smithi151.stdout:generic/552 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:31:36.352 INFO:teuthology.orchestra.run.smithi151.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2023-12-19T17:31:37.207 INFO:teuthology.orchestra.run.smithi151.stdout:generic/554 [not run] swapfiles are not supported 2023-12-19T17:31:37.721 INFO:teuthology.orchestra.run.smithi151.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2023-12-19T17:31:38.214 INFO:teuthology.orchestra.run.smithi151.stdout:generic/556 [not run] ceph does not support casefold feature 2023-12-19T17:31:38.719 INFO:teuthology.orchestra.run.smithi151.stdout:generic/557 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:31:39.239 INFO:teuthology.orchestra.run.smithi151.stdout:generic/563 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:31:40.111 INFO:teuthology.orchestra.run.smithi151.stdout:generic/564 1s 2023-12-19T17:31:41.022 INFO:teuthology.orchestra.run.smithi151.stdout:generic/565 1s 2023-12-19T17:31:41.460 INFO:teuthology.orchestra.run.smithi151.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T17:31:50.526 INFO:teuthology.orchestra.run.smithi151.stdout:generic/567 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T17:31:51.018 INFO:teuthology.orchestra.run.smithi151.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T17:31:51.502 INFO:teuthology.orchestra.run.smithi151.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T17:31:51.963 INFO:teuthology.orchestra.run.smithi151.stdout:generic/570 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:31:52.436 INFO:teuthology.orchestra.run.smithi151.stdout:generic/571 [not run] Require fcntl setlease support 2023-12-19T17:31:52.894 INFO:teuthology.orchestra.run.smithi151.stdout:generic/572 [not run] fsverity utility required, skipped this test 2023-12-19T17:31:53.373 INFO:teuthology.orchestra.run.smithi151.stdout:generic/573 [not run] fsverity utility required, skipped this test 2023-12-19T17:31:53.857 INFO:teuthology.orchestra.run.smithi151.stdout:generic/574 [not run] fsverity utility required, skipped this test 2023-12-19T17:31:54.327 INFO:teuthology.orchestra.run.smithi151.stdout:generic/575 [not run] fsverity utility required, skipped this test 2023-12-19T17:31:54.903 INFO:teuthology.orchestra.run.smithi151.stdout:generic/576 [not run] fsverity utility required, skipped this test 2023-12-19T17:31:55.358 INFO:teuthology.orchestra.run.smithi151.stdout:generic/577 [not run] fsverity utility required, skipped this test 2023-12-19T17:31:55.875 INFO:teuthology.orchestra.run.smithi151.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-19T17:31:56.498 INFO:teuthology.orchestra.run.smithi151.stdout:generic/580 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:31:57.532 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:31:57.535 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:31:57.537 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:31:58.005 INFO:teuthology.orchestra.run.smithi151.stdout:generic/581 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:31:58.518 INFO:teuthology.orchestra.run.smithi151.stdout:generic/582 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:31:58.999 INFO:teuthology.orchestra.run.smithi151.stdout:generic/583 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:31:59.601 INFO:teuthology.orchestra.run.smithi151.stdout:generic/584 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:32:00.147 INFO:teuthology.orchestra.run.smithi151.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T17:32:00.662 INFO:teuthology.orchestra.run.smithi151.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T17:32:01.589 INFO:teuthology.orchestra.run.smithi151.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:32:02.274 INFO:teuthology.orchestra.run.smithi151.stdout:generic/591 1s 2023-12-19T17:32:02.858 INFO:teuthology.orchestra.run.smithi151.stdout:generic/592 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:32:03.500 INFO:teuthology.orchestra.run.smithi151.stdout:generic/593 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:32:03.967 INFO:teuthology.orchestra.run.smithi151.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T17:32:04.569 INFO:teuthology.orchestra.run.smithi151.stdout:generic/595 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:32:05.088 INFO:teuthology.orchestra.run.smithi151.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-12-19T17:32:06.400 INFO:teuthology.orchestra.run.smithi151.stdout:generic/597 1s 2023-12-19T17:32:07.821 INFO:teuthology.orchestra.run.smithi151.stdout:generic/598 1s 2023-12-19T17:32:08.438 INFO:teuthology.orchestra.run.smithi151.stdout:generic/599 [not run] ceph does not support shutdown 2023-12-19T17:32:08.883 INFO:teuthology.orchestra.run.smithi151.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T17:32:09.363 INFO:teuthology.orchestra.run.smithi151.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T17:32:10.063 INFO:teuthology.orchestra.run.smithi151.stdout:generic/602 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:32:10.537 INFO:teuthology.orchestra.run.smithi151.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T17:32:16.128 INFO:teuthology.orchestra.run.smithi151.stdout:generic/604 6s 2023-12-19T17:32:17.959 INFO:teuthology.orchestra.run.smithi151.stdout:generic/605 [not run] mount 172.21.15.37:6789:/scratch with dax=always failed 2023-12-19T17:32:18.701 INFO:teuthology.orchestra.run.smithi151.stdout:generic/606 [not run] mount 172.21.15.37:6789:/scratch with dax=always failed 2023-12-19T17:32:19.228 INFO:teuthology.orchestra.run.smithi151.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2023-12-19T17:32:19.848 INFO:teuthology.orchestra.run.smithi151.stdout:generic/608 [not run] mount 172.21.15.37:6789:/scratch with dax=always failed 2023-12-19T17:32:20.571 INFO:teuthology.orchestra.run.smithi151.stdout:generic/609 1s 2023-12-19T17:32:27.800 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:32:27.802 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:32:27.805 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:32:28.827 INFO:teuthology.orchestra.run.smithi151.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-19T17:32:29.839 INFO:teuthology.orchestra.run.smithi151.stdout:generic/611 1s 2023-12-19T17:32:30.487 INFO:teuthology.orchestra.run.smithi151.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T17:32:31.093 INFO:teuthology.orchestra.run.smithi151.stdout:generic/613 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:32:31.738 INFO:teuthology.orchestra.run.smithi151.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2023-12-19T17:32:32.741 INFO:teuthology.orchestra.run.smithi151.stdout:generic/618 1s 2023-12-19T17:32:33.361 INFO:teuthology.orchestra.run.smithi151.stdout:generic/620 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:32:33.988 INFO:teuthology.orchestra.run.smithi151.stdout:generic/621 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:32:34.629 INFO:teuthology.orchestra.run.smithi151.stdout:generic/623 [not run] ceph does not support shutdown 2023-12-19T17:32:35.080 INFO:teuthology.orchestra.run.smithi151.stdout:generic/624 [not run] fsverity utility required, skipped this test 2023-12-19T17:32:35.542 INFO:teuthology.orchestra.run.smithi151.stdout:generic/625 [not run] fsverity utility required, skipped this test 2023-12-19T17:32:36.054 INFO:teuthology.orchestra.run.smithi151.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2023-12-19T17:32:36.867 INFO:teuthology.orchestra.run.smithi151.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:32:37.378 INFO:teuthology.orchestra.run.smithi151.stdout:generic/629 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:32:38.071 INFO:teuthology.orchestra.run.smithi151.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-19T17:32:40.300 INFO:teuthology.orchestra.run.smithi151.stdout:generic/632 2s 2023-12-19T17:32:41.619 INFO:teuthology.orchestra.run.smithi151.stdout:generic/633 1s 2023-12-19T17:32:43.224 INFO:teuthology.orchestra.run.smithi151.stdout:generic/634 2s 2023-12-19T17:32:43.931 INFO:teuthology.orchestra.run.smithi151.stdout:generic/635 [not run] ceph does not support shutdown 2023-12-19T17:32:44.672 INFO:teuthology.orchestra.run.smithi151.stdout:generic/636 [not run] swapfiles are not supported 2023-12-19T17:32:45.630 INFO:teuthology.orchestra.run.smithi151.stdout:generic/637 1s 2023-12-19T17:32:46.171 INFO:teuthology.orchestra.run.smithi151.stdout:generic/638 1s 2023-12-19T17:32:47.091 INFO:teuthology.orchestra.run.smithi151.stdout:generic/639 1s 2023-12-19T17:32:47.581 INFO:teuthology.orchestra.run.smithi151.stdout:generic/640 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:32:48.355 INFO:teuthology.orchestra.run.smithi151.stdout:generic/641 [not run] swapfiles are not supported 2023-12-19T17:32:48.910 INFO:teuthology.orchestra.run.smithi151.stdout:generic/644 0s 2023-12-19T17:32:57.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:32:57.975 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:32:57.977 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:33:28.446 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:33:28.449 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:33:28.451 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:33:28.488 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-19T17:33:28.487+0000 7fb17b5e3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103935) UID: 0 2023-12-19T17:33:28.489 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-19T17:33:28.487+0000 7f4a782f4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103935) UID: 0 2023-12-19T17:34:47.571 INFO:teuthology.orchestra.run.smithi151.stdout:generic/645 119s 2023-12-19T17:34:48.317 INFO:teuthology.orchestra.run.smithi151.stdout:generic/646 [not run] ceph does not support shutdown 2023-12-19T17:34:48.977 INFO:teuthology.orchestra.run.smithi151.stdout:generic/647 0s 2023-12-19T17:34:49.748 INFO:teuthology.orchestra.run.smithi151.stdout:generic/651 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:34:50.593 INFO:teuthology.orchestra.run.smithi151.stdout:generic/652 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:34:51.409 INFO:teuthology.orchestra.run.smithi151.stdout:generic/653 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:34:52.273 INFO:teuthology.orchestra.run.smithi151.stdout:generic/654 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:34:53.068 INFO:teuthology.orchestra.run.smithi151.stdout:generic/655 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:34:53.841 INFO:teuthology.orchestra.run.smithi151.stdout:generic/657 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:34:54.652 INFO:teuthology.orchestra.run.smithi151.stdout:generic/658 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:34:55.419 INFO:teuthology.orchestra.run.smithi151.stdout:generic/659 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:34:56.215 INFO:teuthology.orchestra.run.smithi151.stdout:generic/660 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:34:56.984 INFO:teuthology.orchestra.run.smithi151.stdout:generic/661 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:34:57.798 INFO:teuthology.orchestra.run.smithi151.stdout:generic/662 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:34:58.584 INFO:teuthology.orchestra.run.smithi151.stdout:generic/663 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:34:59.384 INFO:teuthology.orchestra.run.smithi151.stdout:generic/664 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:35:00.191 INFO:teuthology.orchestra.run.smithi151.stdout:generic/665 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:35:01.026 INFO:teuthology.orchestra.run.smithi151.stdout:generic/666 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:35:01.867 INFO:teuthology.orchestra.run.smithi151.stdout:generic/667 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:35:02.650 INFO:teuthology.orchestra.run.smithi151.stdout:generic/668 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:35:03.454 INFO:teuthology.orchestra.run.smithi151.stdout:generic/669 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:35:04.637 INFO:teuthology.orchestra.run.smithi151.stdout:generic/673 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:35:05.457 INFO:teuthology.orchestra.run.smithi151.stdout:generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-19T17:35:06.474 INFO:teuthology.orchestra.run.smithi151.stdout:generic/675 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:36:45.731 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:36:45.735 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:36:45.737 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:37:16.076 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:37:16.079 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:37:16.082 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:37:16.112 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-19T17:37:16.110+0000 7fb17b5e3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103976) UID: 0 2023-12-19T17:37:16.112 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-19T17:37:16.110+0000 7f4a782f4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103976) UID: 0 2023-12-19T17:39:39.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:39:39.724 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:39:39.728 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:40:10.033 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:40:10.036 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:40:10.039 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:40:40.183 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:40:40.186 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:40:40.189 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:40:40.218 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-19T17:40:40.216+0000 7fb17b5e3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 104035) UID: 0 2023-12-19T17:40:40.218 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-19T17:40:40.216+0000 7f4a782f4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 104035) UID: 0 2023-12-19T17:42:59.516 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:42:59.519 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:42:59.521 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:43:29.657 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:43:29.660 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:43:29.663 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:43:59.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:43:59.815 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:43:59.818 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:44:30.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:44:30.111 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:44:30.114 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:44:30.143 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-19T17:44:30.142+0000 7fb17b5e3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 104111) UID: 0 2023-12-19T17:44:30.144 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-19T17:44:30.142+0000 7f4a782f4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 104111) UID: 0 2023-12-19T17:47:08.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:47:08.321 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:47:08.324 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:47:38.574 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:47:38.577 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:47:38.580 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:48:08.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:48:08.736 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:48:08.739 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:48:08.769 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-19T17:48:08.768+0000 7f4a782f4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 104170) UID: 0 2023-12-19T17:48:08.769 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-19T17:48:08.768+0000 7fb17b5e3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 104170) UID: 0 2023-12-19T17:48:31.484 INFO:teuthology.orchestra.run.smithi151.stdout:generic/676 805s 2023-12-19T17:48:31.987 INFO:teuthology.orchestra.run.smithi151.stdout:generic/677 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:48:32.594 INFO:teuthology.orchestra.run.smithi151.stdout:generic/678 [not run] kernel does not support IO_URING 2023-12-19T17:48:33.068 INFO:teuthology.orchestra.run.smithi151.stdout:generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T17:48:34.034 INFO:teuthology.orchestra.run.smithi151.stdout:generic/680 1s 2023-12-19T17:48:34.401 INFO:teuthology.orchestra.run.smithi151.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T17:48:34.756 INFO:teuthology.orchestra.run.smithi151.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T17:48:35.208 INFO:teuthology.orchestra.run.smithi151.stdout:generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T17:48:44.322 INFO:teuthology.orchestra.run.smithi151.stdout:generic/684 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T17:48:53.847 INFO:teuthology.orchestra.run.smithi151.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-19T17:49:02.683 INFO:teuthology.orchestra.run.smithi151.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-12-19T17:49:14.270 INFO:teuthology.orchestra.run.smithi151.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-12-19T17:49:15.092 INFO:teuthology.orchestra.run.smithi151.stdout:generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T17:49:15.732 INFO:teuthology.orchestra.run.smithi151.stdout:generic/689 0s 2023-12-19T17:49:16.212 INFO:teuthology.orchestra.run.smithi151.stdout:generic/690 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:49:16.706 INFO:teuthology.orchestra.run.smithi151.stdout:generic/692 [not run] fsverity utility required, skipped this test 2023-12-19T17:49:17.300 INFO:teuthology.orchestra.run.smithi151.stdout:generic/693 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T17:49:17.817 INFO:teuthology.orchestra.run.smithi151.stdout:generic/695 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-19T17:49:18.603 INFO:teuthology.orchestra.run.smithi151.stdout:generic/696 1s 2023-12-19T17:49:19.139 INFO:teuthology.orchestra.run.smithi151.stdout:generic/697 1s 2023-12-19T17:49:21.004 INFO:teuthology.orchestra.run.smithi151.stdout:generic/698 1s 2023-12-19T17:49:22.168 INFO:teuthology.orchestra.run.smithi151.stdout:generic/699 [not run] overlayfs doesn't support idmappped layers 2023-12-19T17:49:22.688 INFO:teuthology.orchestra.run.smithi151.stdout:generic/700 [not run] kernel doesn't support renameat2 syscall 2023-12-19T17:49:23.553 INFO:teuthology.orchestra.run.smithi151.stdout:generic/702 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T17:49:24.114 INFO:teuthology.orchestra.run.smithi151.stdout:generic/703 [not run] kernel does not support IO_URING 2023-12-19T17:49:24.655 INFO:teuthology.orchestra.run.smithi151.stdout:generic/704 [not run] require 172.21.15.37:6789:/test to be valid block disk 2023-12-19T17:49:25.674 INFO:teuthology.orchestra.run.smithi151.stdout:generic/706 1s 2023-12-19T17:49:26.302 INFO:teuthology.orchestra.run.smithi151.stdout:generic/708 1s 2023-12-19T17:49:26.791 INFO:teuthology.orchestra.run.smithi151.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T17:49:27.263 INFO:teuthology.orchestra.run.smithi151.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T17:49:27.771 INFO:teuthology.orchestra.run.smithi151.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T17:49:28.264 INFO:teuthology.orchestra.run.smithi151.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T17:49:28.787 INFO:teuthology.orchestra.run.smithi151.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2023-12-19T17:49:29.278 INFO:teuthology.orchestra.run.smithi151.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T17:49:29.790 INFO:teuthology.orchestra.run.smithi151.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2023-12-19T17:49:30.289 INFO:teuthology.orchestra.run.smithi151.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T17:49:30.795 INFO:teuthology.orchestra.run.smithi151.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T17:49:31.286 INFO:teuthology.orchestra.run.smithi151.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T17:49:31.808 INFO:teuthology.orchestra.run.smithi151.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T17:49:32.277 INFO:teuthology.orchestra.run.smithi151.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T17:49:32.761 INFO:teuthology.orchestra.run.smithi151.stdout:generic/721 [not run] xfs_io startupdate support is missing 2023-12-19T17:49:33.275 INFO:teuthology.orchestra.run.smithi151.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2023-12-19T17:49:33.757 INFO:teuthology.orchestra.run.smithi151.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-19T17:49:34.279 INFO:teuthology.orchestra.run.smithi151.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2023-12-19T17:49:34.768 INFO:teuthology.orchestra.run.smithi151.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2023-12-19T17:49:35.594 INFO:teuthology.orchestra.run.smithi151.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2023-12-19T17:49:36.190 INFO:teuthology.orchestra.run.smithi151.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2023-12-19T17:49:40.779 INFO:teuthology.orchestra.run.smithi151.stdout:generic/728 4s 2023-12-19T17:49:41.481 INFO:teuthology.orchestra.run.smithi151.stdout:generic/729 1s 2023-12-19T17:49:41.942 INFO:teuthology.orchestra.run.smithi151.stdout:generic/730 [not run] require 172.21.15.37:6789:/test to be valid block disk 2023-12-19T17:49:42.426 INFO:teuthology.orchestra.run.smithi151.stdout:generic/731 [not run] require 172.21.15.37:6789:/test to be valid block disk 2023-12-19T17:49:43.551 INFO:teuthology.orchestra.run.smithi151.stdout:generic/732 1s 2023-12-19T17:49:44.090 INFO:teuthology.orchestra.run.smithi151.stdout:shared/002 [not run] not suitable for this filesystem type: ceph 2023-12-19T17:49:44.505 INFO:teuthology.orchestra.run.smithi151.stdout:shared/032 [not run] not suitable for this filesystem type: ceph 2023-12-19T17:49:44.526 INFO:teuthology.orchestra.run.smithi151.stdout:Ran: ceph/002 ceph/003 ceph/004 ceph/005 generic/001 generic/002 generic/003 generic/004 generic/005 generic/006 generic/007 generic/008 generic/009 generic/011 generic/012 generic/013 generic/014 generic/015 generic/016 generic/018 generic/020 generic/021 generic/022 generic/023 generic/024 generic/025 generic/026 generic/028 generic/029 generic/030 generic/031 generic/032 generic/033 generic/034 generic/035 generic/037 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/053 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/062 generic/063 generic/064 generic/065 generic/066 generic/067 generic/069 generic/070 generic/071 generic/073 generic/075 generic/076 generic/078 generic/079 generic/080 generic/081 generic/082 generic/084 generic/086 generic/087 generic/088 generic/090 generic/091 generic/092 generic/094 generic/096 generic/097 generic/098 generic/099 generic/101 generic/103 generic/104 generic/105 generic/106 generic/107 generic/108 generic/110 generic/111 generic/112 generic/113 generic/114 generic/115 generic/116 generic/117 generic/118 generic/119 generic/120 generic/121 generic/122 generic/123 generic/124 generic/126 generic/128 generic/129 generic/130 generic/131 generic/134 generic/135 generic/136 generic/138 generic/139 generic/140 generic/141 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/169 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/184 generic/185 generic/188 generic/189 generic/190 generic/191 generic/193 generic/194 generic/195 generic/196 generic/197 generic/198 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/207 generic/210 generic/211 generic/212 generic/213 generic/214 generic/215 generic/216 generic/217 generic/218 generic/219 generic/220 generic/221 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/236 generic/237 generic/238 generic/240 generic/244 generic/245 generic/246 generic/247 generic/248 generic/249 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/257 generic/258 generic/259 generic/260 generic/261 generic/262 generic/263 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/294 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/306 generic/307 generic/308 generic/309 generic/312 generic/313 generic/314 generic/315 generic/316 generic/317 generic/318 generic/319 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/337 generic/338 generic/341 generic/342 generic/343 generic/346 generic/347 generic/348 generic/353 generic/355 generic/356 generic/357 generic/358 generic/359 generic/360 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/375 generic/376 generic/377 generic/378 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/393 generic/394 generic/395 generic/396 generic/397 generic/398 generic/400 generic/401 generic/402 generic/403 generic/404 generic/406 generic/407 generic/408 generic/409 generic/410 generic/411 generic/412 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/423 generic/424 generic/425 generic/426 generic/427 generic/428 generic/430 generic/431 generic/432 generic/433 generic/434 generic/436 generic/437 generic/439 generic/440 generic/441 generic/443 generic/444 generic/445 generic/446 generic/448 generic/449 generic/450 generic/451 generic/452 generic/453 generic/454 generic/456 generic/458 generic/460 generic/462 generic/463 generic/465 generic/466 generic/467 generic/468 generic/469 generic/470 generic/471 generic/472 generic/474 generic/477 generic/478 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/486 generic/487 generic/488 generic/489 generic/490 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/504 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/523 generic/524 generic/525 generic/526 generic/527 generic/528 generic/529 generic/530 generic/531 generic/532 generic/533 generic/534 generic/535 generic/536 generic/537 generic/538 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/564 generic/565 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/591 generic/592 generic/593 generic/594 generic/595 generic/596 generic/597 generic/598 generic/599 generic/600 generic/601 generic/602 generic/603 generic/604 generic/605 generic/606 generic/607 generic/608 generic/609 generic/610 generic/611 generic/612 generic/613 generic/614 generic/618 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/632 generic/633 generic/634 generic/635 generic/636 generic/637 generic/638 generic/639 generic/640 generic/641 generic/644 generic/645 generic/646 generic/647 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/676 generic/677 generic/678 generic/679 generic/680 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/689 generic/690 generic/692 generic/693 generic/695 generic/696 generic/697 generic/698 generic/699 generic/700 generic/702 generic/703 generic/704 generic/706 generic/708 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/728 generic/729 generic/730 generic/731 generic/732 shared/002 shared/032 2023-12-19T17:49:44.527 INFO:teuthology.orchestra.run.smithi151.stdout:Not run: ceph/002 ceph/003 ceph/005 generic/003 generic/004 generic/008 generic/009 generic/012 generic/015 generic/016 generic/018 generic/021 generic/022 generic/024 generic/025 generic/026 generic/031 generic/032 generic/033 generic/034 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/063 generic/064 generic/065 generic/066 generic/067 generic/071 generic/073 generic/076 generic/078 generic/079 generic/081 generic/082 generic/086 generic/090 generic/092 generic/094 generic/096 generic/101 generic/103 generic/104 generic/106 generic/107 generic/108 generic/110 generic/111 generic/114 generic/115 generic/116 generic/118 generic/119 generic/120 generic/121 generic/122 generic/134 generic/136 generic/138 generic/139 generic/140 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/185 generic/188 generic/189 generic/190 generic/191 generic/194 generic/195 generic/196 generic/197 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/213 generic/214 generic/216 generic/217 generic/218 generic/219 generic/220 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/238 generic/244 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/258 generic/259 generic/260 generic/261 generic/262 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/312 generic/315 generic/316 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/338 generic/341 generic/342 generic/343 generic/347 generic/348 generic/353 generic/356 generic/357 generic/358 generic/359 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/376 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/395 generic/396 generic/397 generic/398 generic/400 generic/402 generic/404 generic/407 generic/408 generic/409 generic/410 generic/411 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/424 generic/425 generic/427 generic/436 generic/439 generic/440 generic/441 generic/445 generic/446 generic/449 generic/453 generic/454 generic/456 generic/458 generic/462 generic/463 generic/466 generic/468 generic/469 generic/470 generic/472 generic/474 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/487 generic/488 generic/489 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/525 generic/526 generic/527 generic/530 generic/531 generic/534 generic/535 generic/536 generic/537 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/592 generic/593 generic/594 generic/595 generic/596 generic/599 generic/600 generic/601 generic/602 generic/603 generic/605 generic/606 generic/607 generic/608 generic/610 generic/612 generic/613 generic/614 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/635 generic/636 generic/640 generic/641 generic/646 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/677 generic/678 generic/679 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/690 generic/692 generic/693 generic/695 generic/699 generic/700 generic/702 generic/703 generic/704 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/730 generic/731 shared/002 shared/032 2023-12-19T17:49:44.527 INFO:teuthology.orchestra.run.smithi151.stdout:Failures: generic/317 2023-12-19T17:49:44.527 INFO:teuthology.orchestra.run.smithi151.stdout:Failed 1 of 598 tests 2023-12-19T17:49:44.563 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-19T17:49:45.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:49:45.309 INFO:tasks.cephfs.test_fscrypt:Command failed. 2023-12-19T17:49:45.309 INFO:tasks.cephfs.test_fscrypt:Command return value: 1 2023-12-19T17:49:45.309 INFO:tasks.cephfs.test_fscrypt:Command stdout - FSTYP -- ceph PLATFORM -- Linux/x86_64 smithi151 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 MKFS_OPTIONS -- 172.21.15.37:6789:/scratch MOUNT_OPTIONS -- -o name=admin,secret=AQBov4FlDqP1FxAAgmeUG5CfJbsHOkLlF2UByQ==,test_dummy_encryption -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.QHjjk1hzmdscratch ceph/001 [expunged] ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test ceph/004 1s ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test generic/001 11s generic/002 1s generic/003 [not run] atime not maintained by ceph generic/004 [not run] O_TMPFILE is not supported generic/005 0s generic/006 21s generic/007 48s generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/011 28s generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/013 32s generic/014 146s generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/018 [not run] defragmentation not supported for fstype "ceph" generic/020 9s generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/023 2s generic/024 [not run] kernel doesn't support renameat2 syscall generic/025 [not run] kernel doesn't support renameat2 syscall generic/026 [not run] ceph does not define maximum ACL count generic/028 5s generic/029 1s generic/030 8s generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/034 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/035 1s generic/037 8s generic/039 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/040 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/041 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/042 [not run] ceph does not support shutdown generic/050 [not run] ceph does not support shutdown generic/052 [not run] ceph does not support shutdown generic/053 1s generic/056 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/057 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/059 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/062 2s generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/065 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/066 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/067 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/069 22s generic/070 14s generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/073 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/075 28s generic/076 [not run] require 172.21.15.37:6789:/scratch to be local device generic/078 [not run] kernel doesn't support renameat2 syscall generic/079 [not run] file system doesn't support chattr +ia generic/080 2s generic/081 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/082 [not run] disk quotas not supported by this filesystem type: ceph generic/084 6s generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/087 0s generic/088 1s generic/090 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/091 63s generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/097 1s generic/098 1s generic/099 2s generic/101 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/104 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/105 1s generic/106 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/107 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/108 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/110 [not run] Reflink not supported by test filesystem type: ceph generic/111 [not run] Reflink not supported by test filesystem type: ceph generic/112 25s generic/113 127s generic/114 [not run] device block size: 4096 greater than 512 generic/115 [not run] Reflink not supported by test filesystem type: ceph generic/116 [not run] Reflink not supported by test filesystem type: ceph generic/117 7s generic/118 [not run] Reflink not supported by test filesystem type: ceph generic/119 [not run] Reflink not supported by test filesystem type: ceph generic/120 [not run] atime not maintained by ceph generic/121 [not run] Dedupe not supported by test filesystem type: ceph generic/122 [not run] Dedupe not supported by test filesystem type: ceph generic/123 1s generic/124 40s generic/126 1s generic/128 2s generic/129 1335s generic/130 14s generic/131 2s generic/134 [not run] Reflink not supported by test filesystem type: ceph generic/135 1s generic/136 [not run] Dedupe not supported by test filesystem type: ceph generic/138 [not run] Reflink not supported by test filesystem type: ceph generic/139 [not run] Reflink not supported by test filesystem type: ceph generic/140 [not run] Reflink not supported by test filesystem type: ceph generic/141 2s generic/142 [not run] Reflink not supported by test filesystem type: ceph generic/143 [not run] Reflink not supported by test filesystem type: ceph generic/144 [not run] Reflink not supported by test filesystem type: ceph generic/145 [not run] Reflink not supported by test filesystem type: ceph generic/146 [not run] Reflink not supported by test filesystem type: ceph generic/147 [not run] Reflink not supported by test filesystem type: ceph generic/148 [not run] Reflink not supported by test filesystem type: ceph generic/149 [not run] Reflink not supported by test filesystem type: ceph generic/150 [not run] Reflink not supported by test filesystem type: ceph generic/151 [not run] Reflink not supported by test filesystem type: ceph generic/152 [not run] Reflink not supported by test filesystem type: ceph generic/153 [not run] Reflink not supported by test filesystem type: ceph generic/154 [not run] Reflink not supported by test filesystem type: ceph generic/155 [not run] Reflink not supported by test filesystem type: ceph generic/156 [not run] Reflink not supported by test filesystem type: ceph generic/157 [not run] Reflink not supported by test filesystem type: ceph generic/158 [not run] Dedupe not supported by test filesystem type: ceph generic/159 [not run] file system doesn't support chattr +i generic/160 [not run] file system doesn't support chattr +i generic/161 [not run] Reflink not supported by scratch filesystem type: ceph generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph generic/169 1s generic/171 [not run] Reflink not supported by scratch filesystem type: ceph generic/172 [not run] Reflink not supported by scratch filesystem type: ceph generic/173 [not run] Reflink not supported by scratch filesystem type: ceph generic/174 [not run] Reflink not supported by scratch filesystem type: ceph generic/177 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/178 [not run] Reflink not supported by test filesystem type: ceph generic/179 [not run] Reflink not supported by test filesystem type: ceph generic/180 [not run] Reflink not supported by test filesystem type: ceph generic/181 [not run] Reflink not supported by test filesystem type: ceph generic/182 [not run] Dedupe not supported by test filesystem type: ceph generic/183 [not run] Reflink not supported by scratch filesystem type: ceph generic/184 0s generic/185 [not run] Reflink not supported by scratch filesystem type: ceph generic/188 [not run] Reflink not supported by scratch filesystem type: ceph generic/189 [not run] Reflink not supported by scratch filesystem type: ceph generic/190 [not run] Reflink not supported by scratch filesystem type: ceph generic/191 [not run] Reflink not supported by scratch filesystem type: ceph generic/193 2s generic/194 [not run] Reflink not supported by scratch filesystem type: ceph generic/195 [not run] Reflink not supported by scratch filesystem type: ceph generic/196 [not run] Reflink not supported by scratch filesystem type: ceph generic/197 [not run] Reflink not supported by scratch filesystem type: ceph generic/198 31s generic/199 [not run] Reflink not supported by scratch filesystem type: ceph generic/200 [not run] Reflink not supported by scratch filesystem type: ceph generic/201 [not run] Reflink not supported by scratch filesystem type: ceph generic/202 [not run] Reflink not supported by scratch filesystem type: ceph generic/203 [not run] Reflink not supported by scratch filesystem type: ceph generic/205 [not run] Reflink not supported by scratch filesystem type: ceph generic/206 [not run] Reflink not supported by scratch filesystem type: ceph generic/207 18s generic/210 0s generic/211 1s generic/212 1s generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/215 3s generic/216 [not run] Reflink not supported by scratch filesystem type: ceph generic/217 [not run] Reflink not supported by scratch filesystem type: ceph generic/218 [not run] Reflink not supported by scratch filesystem type: ceph generic/219 [not run] disk quotas not supported by this filesystem type: ceph generic/220 [not run] Reflink not supported by scratch filesystem type: ceph generic/221 2s generic/222 [not run] Reflink not supported by scratch filesystem type: ceph generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/227 [not run] Reflink not supported by scratch filesystem type: ceph generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/229 [not run] Reflink not supported by scratch filesystem type: ceph generic/230 [not run] disk quotas not supported by this filesystem type: ceph generic/235 [not run] disk quotas not supported by this filesystem type: ceph generic/236 1s generic/237 1s generic/238 [not run] Reflink not supported by scratch filesystem type: ceph generic/240 17s generic/244 [not run] disk quotas not supported by this filesystem type: ceph generic/245 0s generic/246 1s generic/247 322s generic/248 0s generic/249 27s generic/250 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/252 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/253 [not run] Reflink not supported by scratch filesystem type: ceph generic/254 [not run] Reflink not supported by scratch filesystem type: ceph generic/255 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/256 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/257 1s generic/258 [not run] ceph does not support negative timestamps generic/259 [not run] Reflink not supported by scratch filesystem type: ceph generic/260 [not run] FITRIM not supported on /tmp/tmp.QHjjk1hzmdscratch generic/261 [not run] Reflink not supported by scratch filesystem type: ceph generic/262 [not run] Reflink not supported by scratch filesystem type: ceph generic/263 78s generic/264 [not run] Reflink not supported by scratch filesystem type: ceph generic/265 [not run] Reflink not supported by scratch filesystem type: ceph generic/266 [not run] Reflink not supported by scratch filesystem type: ceph generic/267 [not run] Reflink not supported by scratch filesystem type: ceph generic/268 [not run] Reflink not supported by scratch filesystem type: ceph generic/271 [not run] Reflink not supported by scratch filesystem type: ceph generic/272 [not run] Reflink not supported by scratch filesystem type: ceph generic/276 [not run] Reflink not supported by scratch filesystem type: ceph generic/277 [not run] file system doesn't support chattr +A generic/278 [not run] Reflink not supported by scratch filesystem type: ceph generic/279 [not run] Reflink not supported by scratch filesystem type: ceph generic/281 [not run] Reflink not supported by scratch filesystem type: ceph generic/282 [not run] Reflink not supported by scratch filesystem type: ceph generic/283 [not run] Reflink not supported by scratch filesystem type: ceph generic/284 [not run] Reflink not supported by scratch filesystem type: ceph generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/287 [not run] Reflink not supported by scratch filesystem type: ceph generic/288 [not run] FITRIM not supported on /tmp/tmp.QHjjk1hzmdscratch generic/289 [not run] Reflink not supported by scratch filesystem type: ceph generic/290 [not run] Reflink not supported by scratch filesystem type: ceph generic/291 [not run] Reflink not supported by scratch filesystem type: ceph generic/292 [not run] Reflink not supported by scratch filesystem type: ceph generic/293 [not run] Reflink not supported by scratch filesystem type: ceph generic/294 1s generic/295 [not run] Reflink not supported by scratch filesystem type: ceph generic/296 [not run] Reflink not supported by scratch filesystem type: ceph generic/301 [not run] Reflink not supported by scratch filesystem type: ceph generic/302 [not run] Reflink not supported by scratch filesystem type: ceph generic/303 [not run] Reflink not supported by test filesystem type: ceph generic/304 [not run] Dedupe not supported by test filesystem type: ceph generic/305 [not run] Reflink not supported by scratch filesystem type: ceph generic/306 1s generic/307 2s generic/308 1s generic/309 1s generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/313 4s generic/314 1s generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/316 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/317 - output mismatch (see /tmp/tmp.t6fx4IVDVzxfstests-dev/results//generic/317.out.bad) --- tests/generic/317.out 2023-12-19 16:07:53.320482777 +0000 +++ /tmp/tmp.t6fx4IVDVzxfstests-dev/results//generic/317.out.bad 2023-12-19 16:58:49.408520892 +0000 @@ -4,9 +4,7 @@ Size: 0 Filetype: Regular File Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) From user_ns - File: "$SCRATCH_MNT/file1" - Size: 0 Filetype: Regular File - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) +execvp: Permission denied *** Remounting *** @@ -15,6 +13,4 @@ Size: 0 Filetype: Regular File Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) From user_ns - File: "$SCRATCH_MNT/file1" - Size: 0 Filetype: Regular File - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) +execvp: Permission denied generic/318 1s generic/319 1s generic/321 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/322 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/324 [not run] defragmentation not supported for fstype "ceph" generic/325 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/326 [not run] Reflink not supported by scratch filesystem type: ceph generic/327 [not run] Reflink not supported by scratch filesystem type: ceph generic/328 [not run] Reflink not supported by scratch filesystem type: ceph generic/329 [not run] Reflink not supported by scratch filesystem type: ceph generic/330 [not run] Reflink not supported by scratch filesystem type: ceph generic/331 [not run] Reflink not supported by scratch filesystem type: ceph generic/332 [not run] Reflink not supported by scratch filesystem type: ceph generic/335 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/336 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/337 1s generic/338 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/341 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/342 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/343 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/346 237s generic/347 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/348 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/353 [not run] Reflink not supported by scratch filesystem type: ceph generic/355 1s generic/356 [not run] swapfiles are not supported generic/357 [not run] swapfiles are not supported generic/358 [not run] Reflink not supported by scratch filesystem type: ceph generic/359 [not run] Reflink not supported by scratch filesystem type: ceph generic/360 0s generic/361 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/362 [not run] this test requires richacl support on $SCRATCH_DEV generic/363 [not run] this test requires richacl support on $SCRATCH_DEV generic/364 [not run] this test requires richacl support on $SCRATCH_DEV generic/365 [not run] this test requires richacl support on $SCRATCH_DEV generic/366 [not run] this test requires richacl support on $SCRATCH_DEV generic/367 [not run] this test requires richacl support on $SCRATCH_DEV generic/368 [not run] this test requires richacl support on $SCRATCH_DEV generic/369 [not run] this test requires richacl support on $SCRATCH_DEV generic/370 [not run] this test requires richacl support on $SCRATCH_DEV generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/372 [not run] Reflink not supported by scratch filesystem type: ceph generic/373 [not run] Reflink not supported by scratch filesystem type: ceph generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph generic/375 0s generic/376 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/377 1s generic/378 1s generic/379 [not run] disk quotas not supported by this filesystem type: ceph generic/380 [not run] disk quotas not supported by this filesystem type: ceph generic/381 [not run] disk quotas not supported by this filesystem type: ceph generic/382 [not run] disk quotas not supported by this filesystem type: ceph generic/383 [not run] disk quotas not supported by this filesystem type: ceph generic/384 [not run] disk quotas not supported by this filesystem type: ceph generic/385 [not run] disk quotas not supported by this filesystem type: ceph generic/386 [not run] disk quotas not supported by this filesystem type: ceph generic/389 [not run] O_TMPFILE is not supported generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/392 [not run] ceph does not support shutdown generic/393 2s generic/394 1s generic/395 [not run] mount option "test_dummy_encryption" not allowed in this test generic/396 [not run] mount option "test_dummy_encryption" not allowed in this test generic/397 [not run] mount option "test_dummy_encryption" not allowed in this test generic/398 [not run] mount option "test_dummy_encryption" not allowed in this test generic/400 [not run] disk quotas not supported by this filesystem type: ceph generic/401 1s generic/402 [not run] filesystem ceph timestamp bounds are unknown generic/403 2s generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/406 4s generic/407 [not run] Reflink not supported by test filesystem type: ceph generic/408 [not run] Dedupe not supported by test filesystem type: ceph generic/409 [not run] require 172.21.15.37:6789:/scratch to be local device generic/410 [not run] require 172.21.15.37:6789:/scratch to be local device generic/411 [not run] require 172.21.15.37:6789:/scratch to be local device generic/412 1s generic/413 [not run] mount 172.21.15.37:6789:/scratch with dax failed generic/414 [not run] Reflink not supported by scratch filesystem type: ceph generic/417 [not run] ceph does not support shutdown generic/419 [not run] mount option "test_dummy_encryption" not allowed in this test generic/420 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/421 [not run] mount option "test_dummy_encryption" not allowed in this test generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/423 0s generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) generic/426 23s generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/428 0s generic/430 1s generic/431 1s generic/432 0s generic/433 1s generic/434 1s generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/437 2s generic/439 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/440 [not run] mount option "test_dummy_encryption" not allowed in this test generic/441 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/443 1s generic/444 0s generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/446 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/448 1s generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/450 5s generic/451 31s generic/452 2s generic/453 [not run] ceph does not allow unrestricted byte streams for names generic/454 [not run] ceph does not allow unrestricted byte streams for names generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/458 [not run] Reflink not supported by scratch filesystem type: ceph generic/460 296s generic/462 [not run] mount 172.21.15.37:6789:/scratch with dax failed generic/463 [not run] Reflink not supported by test filesystem type: ceph generic/465 8s generic/466 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/467 3s generic/468 [not run] ceph does not support shutdown generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/470 [not run] This test requires a valid $LOGWRITES_DEV generic/471 39s generic/472 [not run] swapfiles are not supported generic/474 [not run] ceph does not support shutdown generic/477 7s generic/478 12s generic/479 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/480 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/481 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/483 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/484 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/486 2s generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/489 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/490 1s generic/491 [not run] ceph does not support freezing generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) generic/493 [not run] swapfiles are not supported generic/494 [not run] swapfiles are not supported generic/495 [not run] swapfiles are not supported generic/496 [not run] swapfiles are not supported generic/497 [not run] swapfiles are not supported generic/498 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/501 [not run] Reflink not supported by scratch filesystem type: ceph generic/502 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/504 1s generic/505 [not run] ceph does not support shutdown generic/506 [not run] disk quotas not supported by this filesystem type: ceph generic/507 [not run] file system doesn't support chattr +ASai generic/508 [not run] lsattr not supported by test filesystem type: ceph generic/509 [not run] O_TMPFILE is not supported generic/510 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/513 [not run] Reflink not supported by scratch filesystem type: ceph generic/514 [not run] Reflink not supported by scratch filesystem type: ceph generic/515 [not run] Reflink not supported by scratch filesystem type: ceph generic/516 [not run] Dedupe not supported by test filesystem type: ceph generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph generic/518 [not run] Reflink not supported by scratch filesystem type: ceph generic/519 [not run] FIBMAP not supported by this filesystem generic/520 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/523 1s generic/524 263s generic/525 [not run] filesystem does not support huge file size generic/526 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/527 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/528 0s generic/529 1s generic/530 [not run] ceph does not support shutdown generic/531 [not run] O_TMPFILE is not supported generic/532 1s generic/533 1s generic/534 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/535 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/536 [not run] ceph does not support shutdown generic/537 [not run] FSTRIM not supported generic/538 882s generic/539 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/540 [not run] Reflink not supported by scratch filesystem type: ceph generic/541 [not run] Reflink not supported by scratch filesystem type: ceph generic/542 [not run] Reflink not supported by scratch filesystem type: ceph generic/543 [not run] Reflink not supported by scratch filesystem type: ceph generic/544 [not run] Reflink not supported by scratch filesystem type: ceph generic/545 [not run] file system doesn't support chattr +i generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/547 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/548 [not run] mount option "test_dummy_encryption" not allowed in this test generic/549 [not run] mount option "test_dummy_encryption" not allowed in this test generic/550 [not run] mount option "test_dummy_encryption" not allowed in this test generic/552 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) generic/554 [not run] swapfiles are not supported generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) generic/556 [not run] ceph does not support casefold feature generic/557 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/563 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/564 1s generic/565 1s generic/566 [not run] disk quotas not supported by this filesystem type: ceph generic/567 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/570 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/571 [not run] Require fcntl setlease support generic/572 [not run] fsverity utility required, skipped this test generic/573 [not run] fsverity utility required, skipped this test generic/574 [not run] fsverity utility required, skipped this test generic/575 [not run] fsverity utility required, skipped this test generic/576 [not run] fsverity utility required, skipped this test generic/577 [not run] fsverity utility required, skipped this test generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/580 [not run] mount option "test_dummy_encryption" not allowed in this test generic/581 [not run] mount option "test_dummy_encryption" not allowed in this test generic/582 [not run] mount option "test_dummy_encryption" not allowed in this test generic/583 [not run] mount option "test_dummy_encryption" not allowed in this test generic/584 [not run] mount option "test_dummy_encryption" not allowed in this test generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/587 [not run] disk quotas not supported by this filesystem type: ceph generic/588 [not run] Reflink not supported by scratch filesystem type: ceph generic/591 1s generic/592 [not run] mount option "test_dummy_encryption" not allowed in this test generic/593 [not run] mount option "test_dummy_encryption" not allowed in this test generic/594 [not run] disk quotas not supported by this filesystem type: ceph generic/595 [not run] mount option "test_dummy_encryption" not allowed in this test generic/596 [not run] file system doesn't support chattr +S generic/597 1s generic/598 1s generic/599 [not run] ceph does not support shutdown generic/600 [not run] disk quotas not supported by this filesystem type: ceph generic/601 [not run] disk quotas not supported by this filesystem type: ceph generic/602 [not run] mount option "test_dummy_encryption" not allowed in this test generic/603 [not run] disk quotas not supported by this filesystem type: ceph generic/604 6s generic/605 [not run] mount 172.21.15.37:6789:/scratch with dax=always failed generic/606 [not run] mount 172.21.15.37:6789:/scratch with dax=always failed generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) generic/608 [not run] mount 172.21.15.37:6789:/scratch with dax=always failed generic/609 1s generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/611 1s generic/612 [not run] Reflink not supported by test filesystem type: ceph generic/613 [not run] mount option "test_dummy_encryption" not allowed in this test generic/614 [not run] test requires delayed allocation buffered writes generic/618 1s generic/620 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/621 [not run] mount option "test_dummy_encryption" not allowed in this test generic/623 [not run] ceph does not support shutdown generic/624 [not run] fsverity utility required, skipped this test generic/625 [not run] fsverity utility required, skipped this test generic/626 [not run] kernel doesn't support renameat2 syscall generic/628 [not run] Reflink not supported by scratch filesystem type: ceph generic/629 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph generic/632 2s generic/633 1s generic/634 2s generic/635 [not run] ceph does not support shutdown generic/636 [not run] swapfiles are not supported generic/637 1s generic/638 1s generic/639 1s generic/640 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/641 [not run] swapfiles are not supported generic/644 0s generic/645 119s generic/646 [not run] ceph does not support shutdown generic/647 0s generic/651 [not run] Reflink not supported by scratch filesystem type: ceph generic/652 [not run] Reflink not supported by scratch filesystem type: ceph generic/653 [not run] Reflink not supported by scratch filesystem type: ceph generic/654 [not run] Reflink not supported by scratch filesystem type: ceph generic/655 [not run] Reflink not supported by scratch filesystem type: ceph generic/657 [not run] Reflink not supported by scratch filesystem type: ceph generic/658 [not run] Reflink not supported by scratch filesystem type: ceph generic/659 [not run] Reflink not supported by scratch filesystem type: ceph generic/660 [not run] Reflink not supported by scratch filesystem type: ceph generic/661 [not run] Reflink not supported by scratch filesystem type: ceph generic/662 [not run] Reflink not supported by scratch filesystem type: ceph generic/663 [not run] Reflink not supported by scratch filesystem type: ceph generic/664 [not run] Reflink not supported by scratch filesystem type: ceph generic/665 [not run] Reflink not supported by scratch filesystem type: ceph generic/666 [not run] Reflink not supported by scratch filesystem type: ceph generic/667 [not run] Reflink not supported by scratch filesystem type: ceph generic/668 [not run] Reflink not supported by scratch filesystem type: ceph generic/669 [not run] Reflink not supported by scratch filesystem type: ceph generic/673 [not run] Reflink not supported by scratch filesystem type: ceph generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph generic/675 [not run] Reflink not supported by scratch filesystem type: ceph generic/676 805s generic/677 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/678 [not run] kernel does not support IO_URING generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/680 1s generic/681 [not run] disk quotas not supported by this filesystem type: ceph generic/682 [not run] disk quotas not supported by this filesystem type: ceph generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/684 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/689 0s generic/690 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/692 [not run] fsverity utility required, skipped this test generic/693 [not run] mount option "test_dummy_encryption" not allowed in this test generic/695 [not run] require 172.21.15.37:6789:/scratch to be valid block disk generic/696 1s generic/697 1s generic/698 1s generic/699 [not run] overlayfs doesn't support idmappped layers generic/700 [not run] kernel doesn't support renameat2 syscall generic/702 [not run] Reflink not supported by scratch filesystem type: ceph generic/703 [not run] kernel does not support IO_URING generic/704 [not run] require 172.21.15.37:6789:/test to be valid block disk generic/706 1s generic/708 1s generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph generic/721 [not run] xfs_io startupdate support is missing generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/728 4s generic/729 1s generic/730 [not run] require 172.21.15.37:6789:/test to be valid block disk generic/731 [not run] require 172.21.15.37:6789:/test to be valid block disk generic/732 1s shared/002 [not run] not suitable for this filesystem type: ceph shared/032 [not run] not suitable for this filesystem type: ceph Ran: ceph/002 ceph/003 ceph/004 ceph/005 generic/001 generic/002 generic/003 generic/004 generic/005 generic/006 generic/007 generic/008 generic/009 generic/011 generic/012 generic/013 generic/014 generic/015 generic/016 generic/018 generic/020 generic/021 generic/022 generic/023 generic/024 generic/025 generic/026 generic/028 generic/029 generic/030 generic/031 generic/032 generic/033 generic/034 generic/035 generic/037 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/053 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/062 generic/063 generic/064 generic/065 generic/066 generic/067 generic/069 generic/070 generic/071 generic/073 generic/075 generic/076 generic/078 generic/079 generic/080 generic/081 generic/082 generic/084 generic/086 generic/087 generic/088 generic/090 generic/091 generic/092 generic/094 generic/096 generic/097 generic/098 generic/099 generic/101 generic/103 generic/104 generic/105 generic/106 generic/107 generic/108 generic/110 generic/111 generic/112 generic/113 generic/114 generic/115 generic/116 generic/117 generic/118 generic/119 generic/120 generic/121 generic/122 generic/123 generic/124 generic/126 generic/128 generic/129 generic/130 generic/131 generic/134 generic/135 generic/136 generic/138 generic/139 generic/140 generic/141 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/169 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/184 generic/185 generic/188 generic/189 generic/190 generic/191 generic/193 generic/194 generic/195 generic/196 generic/197 generic/198 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/207 generic/210 generic/211 generic/212 generic/213 generic/214 generic/215 generic/216 generic/217 generic/218 generic/219 generic/220 generic/221 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/236 generic/237 generic/238 generic/240 generic/244 generic/245 generic/246 generic/247 generic/248 generic/249 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/257 generic/258 generic/259 generic/260 generic/261 generic/262 generic/263 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/294 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/306 generic/307 generic/308 generic/309 generic/312 generic/313 generic/314 generic/315 generic/316 generic/317 generic/318 generic/319 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/337 generic/338 generic/341 generic/342 generic/343 generic/346 generic/347 generic/348 generic/353 generic/355 generic/356 generic/357 generic/358 generic/359 generic/360 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/375 generic/376 generic/377 generic/378 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/393 generic/394 generic/395 generic/396 generic/397 generic/398 generic/400 generic/401 generic/402 generic/403 generic/404 generic/406 generic/407 generic/408 generic/409 generic/410 generic/411 generic/412 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/423 generic/424 generic/425 generic/426 generic/427 generic/428 generic/430 generic/431 generic/432 generic/433 generic/434 generic/436 generic/437 generic/439 generic/440 generic/441 generic/443 generic/444 generic/445 generic/446 generic/448 generic/449 generic/450 generic/451 generic/452 generic/453 generic/454 generic/456 generic/458 generic/460 generic/462 generic/463 generic/465 generic/466 generic/467 generic/468 generic/469 generic/470 generic/471 generic/472 generic/474 generic/477 generic/478 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/486 generic/487 generic/488 generic/489 generic/490 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/504 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/523 generic/524 generic/525 generic/526 generic/527 generic/528 generic/529 generic/530 generic/531 generic/532 generic/533 generic/534 generic/535 generic/536 generic/537 generic/538 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/564 generic/565 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/591 generic/592 generic/593 generic/594 generic/595 generic/596 generic/597 generic/598 generic/599 generic/600 generic/601 generic/602 generic/603 generic/604 generic/605 generic/606 generic/607 generic/608 generic/609 generic/610 generic/611 generic/612 generic/613 generic/614 generic/618 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/632 generic/633 generic/634 generic/635 generic/636 generic/637 generic/638 generic/639 generic/640 generic/641 generic/644 generic/645 generic/646 generic/647 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/676 generic/677 generic/678 generic/679 generic/680 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/689 generic/690 generic/692 generic/693 generic/695 generic/696 generic/697 generic/698 generic/699 generic/700 generic/702 generic/703 generic/704 generic/706 generic/708 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/728 generic/729 generic/730 generic/731 generic/732 shared/002 shared/032 Not run: ceph/002 ceph/003 ceph/005 generic/003 generic/004 generic/008 generic/009 generic/012 generic/015 generic/016 generic/018 generic/021 generic/022 generic/024 generic/025 generic/026 generic/031 generic/032 generic/033 generic/034 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/063 generic/064 generic/065 generic/066 generic/067 generic/071 generic/073 generic/076 generic/078 generic/079 generic/081 generic/082 generic/086 generic/090 generic/092 generic/094 generic/096 generic/101 generic/103 generic/104 generic/106 generic/107 generic/108 generic/110 generic/111 generic/114 generic/115 generic/116 generic/118 generic/119 generic/120 generic/121 generic/122 generic/134 generic/136 generic/138 generic/139 generic/140 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/185 generic/188 generic/189 generic/190 generic/191 generic/194 generic/195 generic/196 generic/197 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/213 generic/214 generic/216 generic/217 generic/218 generic/219 generic/220 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/238 generic/244 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/258 generic/259 generic/260 generic/261 generic/262 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/312 generic/315 generic/316 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/338 generic/341 generic/342 generic/343 generic/347 generic/348 generic/353 generic/356 generic/357 generic/358 generic/359 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/376 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/395 generic/396 generic/397 generic/398 generic/400 generic/402 generic/404 generic/407 generic/408 generic/409 generic/410 generic/411 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/424 generic/425 generic/427 generic/436 generic/439 generic/440 generic/441 generic/445 generic/446 generic/449 generic/453 generic/454 generic/456 generic/458 generic/462 generic/463 generic/466 generic/468 generic/469 generic/470 generic/472 generic/474 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/487 generic/488 generic/489 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/525 generic/526 generic/527 generic/530 generic/531 generic/534 generic/535 generic/536 generic/537 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/592 generic/593 generic/594 generic/595 generic/596 generic/599 generic/600 generic/601 generic/602 generic/603 generic/605 generic/606 generic/607 generic/608 generic/610 generic/612 generic/613 generic/614 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/635 generic/636 generic/640 generic/641 generic/646 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/677 generic/678 generic/679 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/690 generic/692 generic/693 generic/695 generic/699 generic/700 generic/702 generic/703 generic/704 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/730 generic/731 shared/002 shared/032 Failures: generic/317 Failed 1 of 598 tests 2023-12-19T17:49:45.309 INFO:tasks.cephfs.test_fscrypt:Command stderr - 2023-12-19T17:49:45.310 DEBUG:teuthology.orchestra.run.smithi151:> sudo userdel --force --remove fsgqa 2023-12-19T17:49:45.450 INFO:teuthology.orchestra.run.smithi151.stderr:userdel: user fsgqa is currently used by process 306997 2023-12-19T17:49:46.130 DEBUG:teuthology.orchestra.run.smithi151:> sudo userdel --force --remove 123456-fsgqa 2023-12-19T17:49:46.810 DEBUG:teuthology.orchestra.run.smithi151:> sudo groupdel fsgqa 2023-12-19T17:49:46.927 INFO:teuthology.orchestra.run.smithi151.stderr:groupdel: group 'fsgqa' does not exist 2023-12-19T17:49:46.931 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-12-19T17:49:46.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:49:46.932 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.t6fx4IVDVzxfstests-dev/results) 2023-12-19T17:49:47.028 INFO:teuthology.orchestra.run.smithi151.stdout: File: /tmp/tmp.t6fx4IVDVzxfstests-dev/results 2023-12-19T17:49:47.028 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2023-12-19T17:49:47.028 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 801h/2049d Inode: 416641 Links: 5 2023-12-19T17:49:47.029 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T17:49:47.029 INFO:teuthology.orchestra.run.smithi151.stdout:Context: unconfined_u:object_r:user_tmp_t:s0 2023-12-19T17:49:47.029 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-12-19 16:13:14.562486613 +0000 2023-12-19T17:49:47.029 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-12-19 17:49:44.522918828 +0000 2023-12-19T17:49:47.029 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-12-19 17:49:44.522918828 +0000 2023-12-19T17:49:47.029 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-12-19 16:13:14.562486613 +0000 2023-12-19T17:49:47.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:49:47.033 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2023-12-19T17:49:47.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:49:47.126 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.t6fx4IVDVzxfstests-dev/results /var/log/ceph/xfstests-dev-results) 2023-12-19T17:49:47.690 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.t6fx4IVDVzxfstests-dev to /var/log/ceph. 2023-12-19T17:49:47.690 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf /tmp/tmp.t6fx4IVDVzxfstests-dev 2023-12-19T17:49:48.223 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf /tmp/tmp.LLmHOUESMaxfsprogs-dev 2023-12-19T17:49:48.447 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T17:49:48.447 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T17:49:48.537 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T17:49:48.607 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T17:49:48.778 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T17:49:48.779 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T17:49:48.779 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:49:48.861 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T17:49:48.861 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:49:48.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:49:49.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.306+0000 7f27f4941640 1 Processor -- start 2023-12-19T17:49:49.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.306+0000 7f27f4941640 1 -- start start 2023-12-19T17:49:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.307+0000 7f27f4941640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27f006fc10 0x7f27f014ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.307+0000 7f27f4941640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f0070480 con 0x7f27f0141cb0 2023-12-19T17:49:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.307+0000 7f27f4941640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f00701a0 con 0x7f27f006af20 2023-12-19T17:49:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.307+0000 7f27f4941640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f0071080 con 0x7f27f006fc10 2023-12-19T17:49:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.307+0000 7f27edd9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f27f0141cb0 0x7f27f0150080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60512/0 (socket says 172.21.15.37:60512) 2023-12-19T17:49:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.307+0000 7f27edd9b640 1 -- 172.21.15.37:0/2343636302 learned_addr learned my addr 172.21.15.37:0/2343636302 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:49:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.307+0000 7f27ed59a640 1 -- 172.21.15.37:0/2343636302 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1729372072 0 0) 0x7f27f0070480 con 0x7f27f0141cb0 2023-12-19T17:49:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.307+0000 7f27eed9d640 1 --2- 172.21.15.37:0/2343636302 >> v2:172.21.15.78:3300/0 conn(0x7f27f006fc10 0x7f27f014ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27ed59a640 1 -- 172.21.15.37:0/2343636302 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27dc003520 con 0x7f27f0141cb0 2023-12-19T17:49:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27ed59a640 1 -- 172.21.15.37:0/2343636302 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 191185080 0 0) 0x7f27dc003520 con 0x7f27f0141cb0 2023-12-19T17:49:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27ed59a640 1 -- 172.21.15.37:0/2343636302 >> v2:172.21.15.78:3300/0 conn(0x7f27f006fc10 msgr2=0x7f27f014ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27ed59a640 1 --2- 172.21.15.37:0/2343636302 >> v2:172.21.15.78:3300/0 conn(0x7f27f006fc10 0x7f27f014ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27ed59a640 1 -- 172.21.15.37:0/2343636302 >> v1:172.21.15.78:6789/0 conn(0x7f27f006af20 legacy=0x7f27f01415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27ed59a640 1 -- 172.21.15.37:0/2343636302 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f0070ca0 con 0x7f27f0141cb0 2023-12-19T17:49:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27ed59a640 1 -- 172.21.15.37:0/2343636302 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f27d8001670 con 0x7f27f0141cb0 2023-12-19T17:49:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27ed59a640 1 -- 172.21.15.37:0/2343636302 >> v1:172.21.15.37:6789/0 conn(0x7f27f0141cb0 legacy=0x7f27f0150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27ed59a640 1 --2- 172.21.15.37:0/2343636302 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27dc003970 0x7f27dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27ed59a640 1 --2- 172.21.15.37:0/2343636302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27dc0047c0 0x7f27dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27ed59a640 1 --2- 172.21.15.37:0/2343636302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27dc005180 0x7f27dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27ed59a640 1 -- 172.21.15.37:0/2343636302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f0071080 con 0x7f27dc005180 2023-12-19T17:49:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27ed59a640 1 -- 172.21.15.37:0/2343636302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc00c120 con 0x7f27dc0047c0 2023-12-19T17:49:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27ed59a640 1 -- 172.21.15.37:0/2343636302 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc00c2e0 con 0x7f27dc003970 2023-12-19T17:49:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27eed9d640 1 --2- 172.21.15.37:0/2343636302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27dc005180 0x7f27dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27ee59c640 1 --2- 172.21.15.37:0/2343636302 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27dc003970 0x7f27dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27edd9b640 1 --2- 172.21.15.37:0/2343636302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27dc0047c0 0x7f27dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27eed9d640 1 -- 172.21.15.37:0/2343636302 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27dc003970 msgr2=0x7f27dc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27eed9d640 1 --2- 172.21.15.37:0/2343636302 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27dc003970 0x7f27dc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27eed9d640 1 -- 172.21.15.37:0/2343636302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27dc0047c0 msgr2=0x7f27dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27eed9d640 1 --2- 172.21.15.37:0/2343636302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27dc0047c0 0x7f27dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.308+0000 7f27eed9d640 1 -- 172.21.15.37:0/2343636302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc003520 con 0x7f27dc005180 2023-12-19T17:49:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.309+0000 7f27eed9d640 1 -- 172.21.15.37:0/2343636302 reap_dead start 2023-12-19T17:49:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.309+0000 7f27eed9d640 1 --2- 172.21.15.37:0/2343636302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27dc005180 0x7f27dc00b980 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009fc0 tx=0x7f27dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb77f3e7727fbb16 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:49.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.309+0000 7f27ed59a640 1 -- 172.21.15.37:0/2343636302 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e002cc60 con 0x7f27dc005180 2023-12-19T17:49:49.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.309+0000 7f27ed59a640 1 -- 172.21.15.37:0/2343636302 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e000f040 con 0x7f27dc005180 2023-12-19T17:49:49.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.309+0000 7f27ed59a640 1 -- 172.21.15.37:0/2343636302 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0003990 con 0x7f27dc005180 2023-12-19T17:49:49.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.310+0000 7f27f4941640 1 -- 172.21.15.37:0/2343636302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27dc005180 msgr2=0x7f27dc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:49.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.310+0000 7f27f4941640 1 --2- 172.21.15.37:0/2343636302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27dc005180 0x7f27dc00b980 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009fc0 tx=0x7f27dc0057f0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.310+0000 7f27f4941640 1 -- 172.21.15.37:0/2343636302 shutdown_connections 2023-12-19T17:49:49.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.310+0000 7f27f4941640 1 --2- 172.21.15.37:0/2343636302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27dc005180 0x7f27dc00b980 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.310+0000 7f27f4941640 1 -- 172.21.15.37:0/2343636302 >> 172.21.15.37:0/2343636302 conn(0x7f27f00b9c30 msgr2=0x7f27f00ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:49.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.310+0000 7f27f4941640 1 -- 172.21.15.37:0/2343636302 shutdown_connections 2023-12-19T17:49:49.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.310+0000 7f27f4941640 1 -- 172.21.15.37:0/2343636302 wait complete. 2023-12-19T17:49:49.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.311+0000 7f27f4941640 1 Processor -- start 2023-12-19T17:49:49.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.311+0000 7f27f4941640 1 -- start start 2023-12-19T17:49:49.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.312+0000 7f27f4941640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27dc005180 0x7f27f01d5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.312+0000 7f27f4941640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27f0142580 0x7f27f01429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.312+0000 7f27f4941640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f0144630 0x7f27f0144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.312+0000 7f27f4941640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f01d5560 con 0x7f27f0144630 2023-12-19T17:49:49.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.312+0000 7f27f4941640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f0144230 con 0x7f27dc005180 2023-12-19T17:49:49.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.312+0000 7f27f4941640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f0143c50 con 0x7f27f0142580 2023-12-19T17:49:49.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.312+0000 7f27eed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f0144630 0x7f27f0144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.312+0000 7f27eed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f0144630 0x7f27f0144ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39162/0 (socket says 172.21.15.37:39162) 2023-12-19T17:49:49.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.312+0000 7f27eed9d640 1 -- 172.21.15.37:0/1940211411 learned_addr learned my addr 172.21.15.37:0/1940211411 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:49.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.312+0000 7f27ee59c640 1 --2- 172.21.15.37:0/1940211411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27dc005180 0x7f27f01d5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.312+0000 7f27edd9b640 1 --2- 172.21.15.37:0/1940211411 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27f0142580 0x7f27f01429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.312+0000 7f27eed9d640 1 -- 172.21.15.37:0/1940211411 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27f0142580 msgr2=0x7f27f01429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:49.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.312+0000 7f27eed9d640 1 --2- 172.21.15.37:0/1940211411 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27f0142580 0x7f27f01429a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.312+0000 7f27eed9d640 1 -- 172.21.15.37:0/1940211411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27dc005180 msgr2=0x7f27f01d5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:49.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.312+0000 7f27eed9d640 1 --2- 172.21.15.37:0/1940211411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27dc005180 0x7f27f01d5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.312+0000 7f27eed9d640 1 -- 172.21.15.37:0/1940211411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00b7240 con 0x7f27f0144630 2023-12-19T17:49:49.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.312+0000 7f27ee59c640 1 --2- 172.21.15.37:0/1940211411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27dc005180 0x7f27f01d5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:49:49.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.312+0000 7f27eed9d640 1 --2- 172.21.15.37:0/1940211411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f0144630 0x7f27f0144ab0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f27e000e200 tx=0x7f27e0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:49.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.313+0000 7f27e6ffd640 1 -- 172.21.15.37:0/1940211411 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0035df0 con 0x7f27f0144630 2023-12-19T17:49:49.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.313+0000 7f27e6ffd640 1 -- 172.21.15.37:0/1940211411 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e0003990 con 0x7f27f0144630 2023-12-19T17:49:49.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.313+0000 7f27f4941640 1 -- 172.21.15.37:0/1940211411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f0143ec0 con 0x7f27f0144630 2023-12-19T17:49:49.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.313+0000 7f27e6ffd640 1 -- 172.21.15.37:0/1940211411 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0003d40 con 0x7f27f0144630 2023-12-19T17:49:49.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.313+0000 7f27f4941640 1 -- 172.21.15.37:0/1940211411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f00b65b0 con 0x7f27f0144630 2023-12-19T17:49:49.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.314+0000 7f27f4941640 1 -- 172.21.15.37:0/1940211411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f00b8b90 con 0x7f27f0144630 2023-12-19T17:49:49.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.314+0000 7f27e6ffd640 1 -- 172.21.15.37:0/1940211411 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f27e0004030 con 0x7f27f0144630 2023-12-19T17:49:49.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.314+0000 7f27e6ffd640 1 --2- 172.21.15.37:0/1940211411 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f27d006a430 0x7f27d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.315+0000 7f27e6ffd640 1 -- 172.21.15.37:0/1940211411 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27e00ab630 con 0x7f27f0144630 2023-12-19T17:49:49.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.315+0000 7f27ee59c640 1 --2- 172.21.15.37:0/1940211411 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f27d006a430 0x7f27d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.315+0000 7f27ee59c640 1 --2- 172.21.15.37:0/1940211411 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f27d006a430 0x7f27d006c8f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f27e8000c00 tx=0x7f27e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:49.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.319+0000 7f27e6ffd640 1 -- 172.21.15.37:0/1940211411 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f27e0076c10 con 0x7f27f0144630 2023-12-19T17:49:49.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.496+0000 7f27f4941640 1 -- 172.21.15.37:0/1940211411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27f01443e0 con 0x7f27f0144630 2023-12-19T17:49:49.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.497+0000 7f27e6ffd640 1 -- 172.21.15.37:0/1940211411 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16053 (secure 0 0 0) 0x7f27f01443e0 con 0x7f27f0144630 2023-12-19T17:49:49.498 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T17:49:49.498 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:07:42.899048+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:07:39.626181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T16:07:40.871535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:49:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.499+0000 7f27f4941640 1 -- 172.21.15.37:0/1940211411 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f27d006a430 msgr2=0x7f27d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.499+0000 7f27f4941640 1 --2- 172.21.15.37:0/1940211411 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f27d006a430 0x7f27d006c8f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f27e8000c00 tx=0x7f27e8009040 comp rx=0 tx=0).stop 2023-12-19T17:49:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.499+0000 7f27f4941640 1 -- 172.21.15.37:0/1940211411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f0144630 msgr2=0x7f27f0144ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.499+0000 7f27f4941640 1 --2- 172.21.15.37:0/1940211411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f0144630 0x7f27f0144ab0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f27e000e200 tx=0x7f27e0009750 comp rx=0 tx=0).stop 2023-12-19T17:49:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.499+0000 7f27f4941640 1 -- 172.21.15.37:0/1940211411 shutdown_connections 2023-12-19T17:49:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.499+0000 7f27f4941640 1 --2- 172.21.15.37:0/1940211411 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f27d006a430 0x7f27d006c8f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.499+0000 7f27f4941640 1 --2- 172.21.15.37:0/1940211411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f0144630 0x7f27f0144ab0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.499+0000 7f27f4941640 1 --2- 172.21.15.37:0/1940211411 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27f0142580 0x7f27f01429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.499+0000 7f27f4941640 1 --2- 172.21.15.37:0/1940211411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27dc005180 0x7f27f01d5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.499+0000 7f27f4941640 1 -- 172.21.15.37:0/1940211411 >> 172.21.15.37:0/1940211411 conn(0x7f27f00b9c30 msgr2=0x7f27f01407e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.499+0000 7f27f4941640 1 -- 172.21.15.37:0/1940211411 shutdown_connections 2023-12-19T17:49:49.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.499+0000 7f27f4941640 1 -- 172.21.15.37:0/1940211411 wait complete. 2023-12-19T17:49:49.511 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:06:46.684027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:07:39.626181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:07:40.871535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T17:49:49.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:49:49.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.620+0000 7fdce8677640 1 Processor -- start 2023-12-19T17:49:49.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.620+0000 7fdce8677640 1 -- start start 2023-12-19T17:49:49.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.621+0000 7fdce8677640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdce01451f0 0x7fdce00b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.621+0000 7fdce8677640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce00b20c0 con 0x7fdce0144e10 2023-12-19T17:49:49.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.621+0000 7fdce8677640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce006cc20 con 0x7fdce00719f0 2023-12-19T17:49:49.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.621+0000 7fdce8677640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce00b2cd0 con 0x7fdce01451f0 2023-12-19T17:49:49.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.621+0000 7fdce6413640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdce0144e10 0x7fdce00b0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33240/0 (socket says 172.21.15.37:33240) 2023-12-19T17:49:49.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.621+0000 7fdce6413640 1 -- 172.21.15.37:0/655854428 learned_addr learned my addr 172.21.15.37:0/655854428 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:49:49.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.621+0000 7fdce5c12640 1 --2- 172.21.15.37:0/655854428 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdce01451f0 0x7fdce00b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.621+0000 7fdce5411640 1 -- 172.21.15.37:0/655854428 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485447811 0 0) 0x7fdce00b20c0 con 0x7fdce0144e10 2023-12-19T17:49:49.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.621+0000 7fdce5411640 1 -- 172.21.15.37:0/655854428 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdccc003520 con 0x7fdce0144e10 2023-12-19T17:49:49.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.621+0000 7fdce5411640 1 -- 172.21.15.37:0/655854428 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631175893 0 0) 0x7fdce006cc20 con 0x7fdce00719f0 2023-12-19T17:49:49.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.621+0000 7fdce5411640 1 -- 172.21.15.37:0/655854428 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdce00b20c0 con 0x7fdce00719f0 2023-12-19T17:49:49.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.621+0000 7fdce5c12640 1 -- 172.21.15.37:0/655854428 >> v1:172.21.15.78:6789/0 conn(0x7fdce00719f0 legacy=0x7fdce006c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:49.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.621+0000 7fdce5411640 1 -- 172.21.15.37:0/655854428 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 790647934 0 0) 0x7fdccc003520 con 0x7fdce0144e10 2023-12-19T17:49:49.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.621+0000 7fdce5c12640 1 -- 172.21.15.37:0/655854428 >> v1:172.21.15.37:6789/0 conn(0x7fdce0144e10 legacy=0x7fdce00b0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:49.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.621+0000 7fdce5c12640 1 -- 172.21.15.37:0/655854428 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce00b1ab0 con 0x7fdce01451f0 2023-12-19T17:49:49.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.622+0000 7fdce5c12640 1 --2- 172.21.15.37:0/655854428 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdce01451f0 0x7fdce00b2550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00097d0 tx=0x7fdcd002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=321994c692874b91 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:49.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.622+0000 7fdce5411640 1 -- 172.21.15.37:0/655854428 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc001670 con 0x7fdce01451f0 2023-12-19T17:49:49.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.622+0000 7fdce5411640 1 -- 172.21.15.37:0/655854428 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd0031580 con 0x7fdce01451f0 2023-12-19T17:49:49.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.622+0000 7fdce5411640 1 -- 172.21.15.37:0/655854428 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd00318f0 con 0x7fdce01451f0 2023-12-19T17:49:49.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.623+0000 7fdce8677640 1 -- 172.21.15.37:0/655854428 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdce01451f0 msgr2=0x7fdce00b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:49.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.623+0000 7fdce8677640 1 --2- 172.21.15.37:0/655854428 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdce01451f0 0x7fdce00b2550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00097d0 tx=0x7fdcd002b8a0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.623+0000 7fdce8677640 1 -- 172.21.15.37:0/655854428 shutdown_connections 2023-12-19T17:49:49.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.623+0000 7fdce8677640 1 --2- 172.21.15.37:0/655854428 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdce01451f0 0x7fdce00b2550 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.623+0000 7fdce8677640 1 -- 172.21.15.37:0/655854428 >> 172.21.15.37:0/655854428 conn(0x7fdce00b8a40 msgr2=0x7fdce00b8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:49.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.623+0000 7fdce8677640 1 -- 172.21.15.37:0/655854428 shutdown_connections 2023-12-19T17:49:49.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.623+0000 7fdce8677640 1 -- 172.21.15.37:0/655854428 wait complete. 2023-12-19T17:49:49.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.624+0000 7fdce8677640 1 Processor -- start 2023-12-19T17:49:49.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.624+0000 7fdce8677640 1 -- start start 2023-12-19T17:49:49.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.624+0000 7fdce8677640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdce00719f0 0x7fdce009da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdce8677640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdce0144e10 0x7fdce01dfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdce8677640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdce01451f0 0x7fdce00a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdce8677640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce009dfa0 con 0x7fdce00719f0 2023-12-19T17:49:49.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdce8677640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce00a1fd0 con 0x7fdce01451f0 2023-12-19T17:49:49.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdce8677640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce009e900 con 0x7fdce0144e10 2023-12-19T17:49:49.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdce6413640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdce00719f0 0x7fdce009da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdce6413640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdce00719f0 0x7fdce009da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54956/0 (socket says 172.21.15.37:54956) 2023-12-19T17:49:49.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdce6413640 1 -- 172.21.15.37:0/1725513238 learned_addr learned my addr 172.21.15.37:0/1725513238 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:49.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdce6c14640 1 --2- 172.21.15.37:0/1725513238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdce01451f0 0x7fdce00a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdce5c12640 1 --2- 172.21.15.37:0/1725513238 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdce0144e10 0x7fdce01dfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdce6413640 1 -- 172.21.15.37:0/1725513238 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdce0144e10 msgr2=0x7fdce01dfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:49.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdce6413640 1 --2- 172.21.15.37:0/1725513238 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdce0144e10 0x7fdce01dfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdce6413640 1 -- 172.21.15.37:0/1725513238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdce01451f0 msgr2=0x7fdce00a0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:49.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdce6413640 1 --2- 172.21.15.37:0/1725513238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdce01451f0 0x7fdce00a0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdce6413640 1 -- 172.21.15.37:0/1725513238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd0009400 con 0x7fdce00719f0 2023-12-19T17:49:49.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdce6413640 1 --2- 172.21.15.37:0/1725513238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdce00719f0 0x7fdce009da60 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00c750 tx=0x7fdcdc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdcd6ffd640 1 -- 172.21.15.37:0/1725513238 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc005ad0 con 0x7fdce00719f0 2023-12-19T17:49:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdcd6ffd640 1 -- 172.21.15.37:0/1725513238 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc005c30 con 0x7fdce00719f0 2023-12-19T17:49:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdce8677640 1 -- 172.21.15.37:0/1725513238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce00a1d30 con 0x7fdce00719f0 2023-12-19T17:49:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdcd6ffd640 1 -- 172.21.15.37:0/1725513238 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc007070 con 0x7fdce00719f0 2023-12-19T17:49:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.625+0000 7fdce8677640 1 -- 172.21.15.37:0/1725513238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce009e100 con 0x7fdce00719f0 2023-12-19T17:49:49.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.627+0000 7fdcd6ffd640 1 -- 172.21.15.37:0/1725513238 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdcdc0071d0 con 0x7fdce00719f0 2023-12-19T17:49:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.627+0000 7fdce8677640 1 -- 172.21.15.37:0/1725513238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce00740a0 con 0x7fdce00719f0 2023-12-19T17:49:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.627+0000 7fdcd6ffd640 1 --2- 172.21.15.37:0/1725513238 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fdcc406a460 0x7fdcc406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.627+0000 7fdcd6ffd640 1 -- 172.21.15.37:0/1725513238 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcdc087f30 con 0x7fdce00719f0 2023-12-19T17:49:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.627+0000 7fdce5c12640 1 --2- 172.21.15.37:0/1725513238 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fdcc406a460 0x7fdcc406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.628+0000 7fdce5c12640 1 --2- 172.21.15.37:0/1725513238 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fdcc406a460 0x7fdcc406c920 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0036000 tx=0x7fdcd003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:49.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.639+0000 7fdcd6ffd640 1 -- 172.21.15.37:0/1725513238 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdcdc0535c0 con 0x7fdce00719f0 2023-12-19T17:49:49.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.813+0000 7fdce8677640 1 -- 172.21.15.37:0/1725513238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdce00b7ec0 con 0x7fdce00719f0 2023-12-19T17:49:49.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.814+0000 7fdcd6ffd640 1 -- 172.21.15.37:0/1725513238 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdcdc0170a0 con 0x7fdce00719f0 2023-12-19T17:49:49.815 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-19T17:49:49.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.816+0000 7fdce8677640 1 -- 172.21.15.37:0/1725513238 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fdcc406a460 msgr2=0x7fdcc406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:49.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.816+0000 7fdce8677640 1 --2- 172.21.15.37:0/1725513238 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fdcc406a460 0x7fdcc406c920 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0036000 tx=0x7fdcd003d040 comp rx=0 tx=0).stop 2023-12-19T17:49:49.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.816+0000 7fdce8677640 1 -- 172.21.15.37:0/1725513238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdce00719f0 msgr2=0x7fdce009da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:49.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.816+0000 7fdce8677640 1 --2- 172.21.15.37:0/1725513238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdce00719f0 0x7fdce009da60 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00c750 tx=0x7fdcdc00cc10 comp rx=0 tx=0).stop 2023-12-19T17:49:49.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.816+0000 7fdce8677640 1 -- 172.21.15.37:0/1725513238 shutdown_connections 2023-12-19T17:49:49.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.816+0000 7fdce8677640 1 --2- 172.21.15.37:0/1725513238 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fdcc406a460 0x7fdcc406c920 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.816+0000 7fdce8677640 1 --2- 172.21.15.37:0/1725513238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdce01451f0 0x7fdce00a0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.816+0000 7fdce8677640 1 --2- 172.21.15.37:0/1725513238 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdce0144e10 0x7fdce01dfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.816+0000 7fdce8677640 1 --2- 172.21.15.37:0/1725513238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdce00719f0 0x7fdce009da60 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.816+0000 7fdce8677640 1 -- 172.21.15.37:0/1725513238 >> 172.21.15.37:0/1725513238 conn(0x7fdce00b8a40 msgr2=0x7fdce00b9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:49.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.816+0000 7fdce8677640 1 -- 172.21.15.37:0/1725513238 shutdown_connections 2023-12-19T17:49:49.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.816+0000 7fdce8677640 1 -- 172.21.15.37:0/1725513238 wait complete. 2023-12-19T17:49:49.827 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:49:49.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.937+0000 7faeaecaf640 1 Processor -- start 2023-12-19T17:49:49.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.937+0000 7faeaecaf640 1 -- start start 2023-12-19T17:49:49.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.938+0000 7faeaecaf640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faea8142d90 0x7faea80baad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.938+0000 7faeaecaf640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faea80b9740 0x7faea8153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.938+0000 7faeaecaf640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea80b4430 con 0x7faea80b1f60 2023-12-19T17:49:49.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.938+0000 7faeaecaf640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea80b3bd0 con 0x7faea80b9740 2023-12-19T17:49:49.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.938+0000 7faeaecaf640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea80bb010 con 0x7faea8142d90 2023-12-19T17:49:49.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.938+0000 7faea7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faea80b1f60 0x7faea80b9030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33248/0 (socket says 172.21.15.37:33248) 2023-12-19T17:49:49.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.938+0000 7faea7fff640 1 -- 172.21.15.37:0/3869522911 learned_addr learned my addr 172.21.15.37:0/3869522911 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:49:49.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.938+0000 7faea77fe640 1 -- 172.21.15.37:0/3869522911 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406307243 0 0) 0x7faea80b4430 con 0x7faea80b1f60 2023-12-19T17:49:49.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.938+0000 7faea77fe640 1 -- 172.21.15.37:0/3869522911 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae98003520 con 0x7faea80b1f60 2023-12-19T17:49:49.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.938+0000 7faead24c640 1 --2- 172.21.15.37:0/3869522911 >> v2:172.21.15.78:3300/0 conn(0x7faea80b9740 0x7faea8153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.938+0000 7faeaca4b640 1 --2- 172.21.15.37:0/3869522911 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faea8142d90 0x7faea80baad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faea77fe640 1 -- 172.21.15.37:0/3869522911 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 834421653 0 0) 0x7fae98003520 con 0x7faea80b1f60 2023-12-19T17:49:49.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faea77fe640 1 -- 172.21.15.37:0/3869522911 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faea8142d90 msgr2=0x7faea80baad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:49.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faea77fe640 1 --2- 172.21.15.37:0/3869522911 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faea8142d90 0x7faea80baad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faea77fe640 1 -- 172.21.15.37:0/3869522911 >> v2:172.21.15.78:3300/0 conn(0x7faea80b9740 msgr2=0x7faea8153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:49.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faea77fe640 1 --2- 172.21.15.37:0/3869522911 >> v2:172.21.15.78:3300/0 conn(0x7faea80b9740 0x7faea8153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faea77fe640 1 -- 172.21.15.37:0/3869522911 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea8143170 con 0x7faea80b1f60 2023-12-19T17:49:49.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faea77fe640 1 -- 172.21.15.37:0/3869522911 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7fae94001670 con 0x7faea80b1f60 2023-12-19T17:49:49.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faea77fe640 1 -- 172.21.15.37:0/3869522911 >> v1:172.21.15.37:6789/0 conn(0x7faea80b1f60 legacy=0x7faea80b9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:49.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faea77fe640 1 --2- 172.21.15.37:0/3869522911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae98003970 0x7fae98003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faea77fe640 1 --2- 172.21.15.37:0/3869522911 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faea8142d90 0x7fae980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faea77fe640 1 --2- 172.21.15.37:0/3869522911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae98004d00 0x7fae98005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faea77fe640 1 -- 172.21.15.37:0/3869522911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea80b3bd0 con 0x7fae98003970 2023-12-19T17:49:49.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faea77fe640 1 -- 172.21.15.37:0/3869522911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea80bb010 con 0x7fae98004d00 2023-12-19T17:49:49.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faea77fe640 1 -- 172.21.15.37:0/3869522911 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9800b980 con 0x7faea8142d90 2023-12-19T17:49:49.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faeaca4b640 1 --2- 172.21.15.37:0/3869522911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae98003970 0x7fae98003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faea7fff640 1 --2- 172.21.15.37:0/3869522911 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faea8142d90 0x7fae980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faead24c640 1 --2- 172.21.15.37:0/3869522911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae98004d00 0x7fae98005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faeaca4b640 1 -- 172.21.15.37:0/3869522911 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faea8142d90 msgr2=0x7fae980047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:49.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faeaca4b640 1 --2- 172.21.15.37:0/3869522911 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faea8142d90 0x7fae980047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faeaca4b640 1 -- 172.21.15.37:0/3869522911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae98004d00 msgr2=0x7fae98005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:49.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faeaca4b640 1 --2- 172.21.15.37:0/3869522911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae98004d00 0x7fae98005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faeaca4b640 1 -- 172.21.15.37:0/3869522911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae98003520 con 0x7fae98003970 2023-12-19T17:49:49.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.939+0000 7faead24c640 1 --2- 172.21.15.37:0/3869522911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae98004d00 0x7fae98005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:49:49.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.940+0000 7faeaca4b640 1 --2- 172.21.15.37:0/3869522911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae98003970 0x7fae98003d90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009ac0 tx=0x7fae980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b80a803492ab960 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:49.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.940+0000 7faea77fe640 1 -- 172.21.15.37:0/3869522911 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c02c6b0 con 0x7fae98003970 2023-12-19T17:49:49.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.940+0000 7faea77fe640 1 -- 172.21.15.37:0/3869522911 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9c02c810 con 0x7fae98003970 2023-12-19T17:49:49.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.940+0000 7faea77fe640 1 -- 172.21.15.37:0/3869522911 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c02cba0 con 0x7fae98003970 2023-12-19T17:49:49.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.941+0000 7faeaecaf640 1 -- 172.21.15.37:0/3869522911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae98003970 msgr2=0x7fae98003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:49.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.941+0000 7faeaecaf640 1 --2- 172.21.15.37:0/3869522911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae98003970 0x7fae98003d90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009ac0 tx=0x7fae980057f0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.941+0000 7faead24c640 1 -- 172.21.15.37:0/3869522911 reap_dead start 2023-12-19T17:49:49.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.941+0000 7faeaecaf640 1 -- 172.21.15.37:0/3869522911 shutdown_connections 2023-12-19T17:49:49.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.941+0000 7faeaecaf640 1 -- 172.21.15.37:0/3869522911 >> 172.21.15.37:0/3869522911 conn(0x7faea80be0c0 msgr2=0x7faea80be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:49.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.941+0000 7faeaecaf640 1 -- 172.21.15.37:0/3869522911 shutdown_connections 2023-12-19T17:49:49.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.941+0000 7faeaecaf640 1 -- 172.21.15.37:0/3869522911 wait complete. 2023-12-19T17:49:49.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.942+0000 7faeaecaf640 1 Processor -- start 2023-12-19T17:49:49.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.942+0000 7faeaecaf640 1 -- start start 2023-12-19T17:49:49.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faeaecaf640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae98003970 0x7faea813fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faeaecaf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faea813efa0 0x7faea80b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faeaecaf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faea81e3c40 0x7faea81e40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faeaecaf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea80b7cf0 con 0x7faea81e3c40 2023-12-19T17:49:49.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faeaecaf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea81e4600 con 0x7faea813efa0 2023-12-19T17:49:49.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faeaecaf640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea806c4f0 con 0x7fae98003970 2023-12-19T17:49:49.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faead24c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faea81e3c40 0x7faea81e40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faead24c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faea81e3c40 0x7faea81e40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54972/0 (socket says 172.21.15.37:54972) 2023-12-19T17:49:49.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faead24c640 1 -- 172.21.15.37:0/3903121823 learned_addr learned my addr 172.21.15.37:0/3903121823 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:49.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faeaca4b640 1 --2- 172.21.15.37:0/3903121823 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae98003970 0x7faea813fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faea7fff640 1 --2- 172.21.15.37:0/3903121823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faea813efa0 0x7faea80b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faead24c640 1 -- 172.21.15.37:0/3903121823 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae98003970 msgr2=0x7faea813fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:49.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faead24c640 1 --2- 172.21.15.37:0/3903121823 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae98003970 0x7faea813fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faead24c640 1 -- 172.21.15.37:0/3903121823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faea813efa0 msgr2=0x7faea80b77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faead24c640 1 --2- 172.21.15.37:0/3903121823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faea813efa0 0x7faea80b77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faead24c640 1 -- 172.21.15.37:0/3903121823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea806c7d0 con 0x7faea81e3c40 2023-12-19T17:49:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faead24c640 1 --2- 172.21.15.37:0/3903121823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faea81e3c40 0x7faea81e40c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7faea80b8b60 tx=0x7faea0010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faea57fa640 1 -- 172.21.15.37:0/3903121823 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea000e050 con 0x7faea81e3c40 2023-12-19T17:49:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faea57fa640 1 -- 172.21.15.37:0/3903121823 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea000f040 con 0x7faea81e3c40 2023-12-19T17:49:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faeaecaf640 1 -- 172.21.15.37:0/3903121823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea806cab0 con 0x7faea81e3c40 2023-12-19T17:49:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faea57fa640 1 -- 172.21.15.37:0/3903121823 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0003990 con 0x7faea81e3c40 2023-12-19T17:49:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.943+0000 7faeaecaf640 1 -- 172.21.15.37:0/3903121823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea813b860 con 0x7faea81e3c40 2023-12-19T17:49:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.944+0000 7faeaecaf640 1 -- 172.21.15.37:0/3903121823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea80740a0 con 0x7faea81e3c40 2023-12-19T17:49:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.945+0000 7faea57fa640 1 -- 172.21.15.37:0/3903121823 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faea0015440 con 0x7faea81e3c40 2023-12-19T17:49:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.945+0000 7faea57fa640 1 --2- 172.21.15.37:0/3903121823 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fae8c06a430 0x7fae8c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:49.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.945+0000 7faea57fa640 1 -- 172.21.15.37:0/3903121823 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faea0089240 con 0x7faea81e3c40 2023-12-19T17:49:49.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.945+0000 7faeaca4b640 1 --2- 172.21.15.37:0/3903121823 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fae8c06a430 0x7fae8c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:49.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.946+0000 7faeaca4b640 1 --2- 172.21.15.37:0/3903121823 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fae8c06a430 0x7fae8c06c8f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fae9c036000 tx=0x7fae9c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:49.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:49.949+0000 7faea57fa640 1 -- 172.21.15.37:0/3903121823 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7faea00548c0 con 0x7faea81e3c40 2023-12-19T17:49:50.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.127+0000 7faeaecaf640 1 -- 172.21.15.37:0/3903121823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faea80badf0 con 0x7faea81e3c40 2023-12-19T17:49:50.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.127+0000 7faea57fa640 1 -- 172.21.15.37:0/3903121823 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7faea0057ee0 con 0x7faea81e3c40 2023-12-19T17:49:50.128 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-19T17:49:50.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.129+0000 7faeaecaf640 1 -- 172.21.15.37:0/3903121823 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fae8c06a430 msgr2=0x7fae8c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:50.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.129+0000 7faeaecaf640 1 --2- 172.21.15.37:0/3903121823 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fae8c06a430 0x7fae8c06c8f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fae9c036000 tx=0x7fae9c030000 comp rx=0 tx=0).stop 2023-12-19T17:49:50.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.129+0000 7faeaecaf640 1 -- 172.21.15.37:0/3903121823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faea81e3c40 msgr2=0x7faea81e40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:50.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.129+0000 7faeaecaf640 1 --2- 172.21.15.37:0/3903121823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faea81e3c40 0x7faea81e40c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7faea80b8b60 tx=0x7faea0010590 comp rx=0 tx=0).stop 2023-12-19T17:49:50.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.130+0000 7faeaecaf640 1 -- 172.21.15.37:0/3903121823 shutdown_connections 2023-12-19T17:49:50.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.130+0000 7faeaecaf640 1 --2- 172.21.15.37:0/3903121823 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fae8c06a430 0x7fae8c06c8f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.130+0000 7faeaecaf640 1 --2- 172.21.15.37:0/3903121823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faea81e3c40 0x7faea81e40c0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.130+0000 7faeaecaf640 1 --2- 172.21.15.37:0/3903121823 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faea813efa0 0x7faea80b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.130+0000 7faeaecaf640 1 --2- 172.21.15.37:0/3903121823 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fae98003970 0x7faea813fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.130+0000 7faeaecaf640 1 -- 172.21.15.37:0/3903121823 >> 172.21.15.37:0/3903121823 conn(0x7faea80be0c0 msgr2=0x7faea80bc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:50.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.130+0000 7faeaecaf640 1 -- 172.21.15.37:0/3903121823 shutdown_connections 2023-12-19T17:49:50.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.130+0000 7faeaecaf640 1 -- 172.21.15.37:0/3903121823 wait complete. 2023-12-19T17:49:50.141 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:49:50.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.250+0000 7f45bcb99640 1 Processor -- start 2023-12-19T17:49:50.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.250+0000 7f45bcb99640 1 -- start start 2023-12-19T17:49:50.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.251+0000 7f45bcb99640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45b8142d90 0x7f45b80baad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:50.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.251+0000 7f45bcb99640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45b80b1f60 0x7f45b80b9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:50.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.251+0000 7f45bcb99640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f45b80b23a0 0x7f45b80b9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:50.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.251+0000 7f45bcb99640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b80b3bd0 con 0x7f45b8142d90 2023-12-19T17:49:50.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.251+0000 7f45bcb99640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b80b4430 con 0x7f45b80b23a0 2023-12-19T17:49:50.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.251+0000 7f45bcb99640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b80bb010 con 0x7f45b80b1f60 2023-12-19T17:49:50.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.251+0000 7f45b659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45b8142d90 0x7f45b80baad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:50.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.251+0000 7f45b659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45b8142d90 0x7f45b80baad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54982/0 (socket says 172.21.15.37:54982) 2023-12-19T17:49:50.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.251+0000 7f45b659c640 1 -- 172.21.15.37:0/1104322536 learned_addr learned my addr 172.21.15.37:0/1104322536 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:50.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.251+0000 7f45b5d9b640 1 --2- 172.21.15.37:0/1104322536 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45b80b1f60 0x7f45b80b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:50.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.251+0000 7f45b6d9d640 1 --2- 172.21.15.37:0/1104322536 >> v2:172.21.15.78:3300/0 conn(0x7f45b80b23a0 0x7f45b80b9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:50.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.251+0000 7f45b659c640 1 -- 172.21.15.37:0/1104322536 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45b80b1f60 msgr2=0x7f45b80b9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:50.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.251+0000 7f45b659c640 1 --2- 172.21.15.37:0/1104322536 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45b80b1f60 0x7f45b80b9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.251+0000 7f45b659c640 1 -- 172.21.15.37:0/1104322536 >> v2:172.21.15.78:3300/0 conn(0x7f45b80b23a0 msgr2=0x7f45b80b9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:50.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.251+0000 7f45b659c640 1 --2- 172.21.15.37:0/1104322536 >> v2:172.21.15.78:3300/0 conn(0x7f45b80b23a0 0x7f45b80b9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.251+0000 7f45b659c640 1 -- 172.21.15.37:0/1104322536 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b8143170 con 0x7f45b8142d90 2023-12-19T17:49:50.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.252+0000 7f45b659c640 1 --2- 172.21.15.37:0/1104322536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b8142d90 0x7f45b80baad0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f45b80b8d60 tx=0x7f45ac02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb78daa108ea7e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:50.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.252+0000 7f45b559a640 1 -- 172.21.15.37:0/1104322536 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac030860 con 0x7f45b8142d90 2023-12-19T17:49:50.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.252+0000 7f45b559a640 1 -- 172.21.15.37:0/1104322536 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac0309c0 con 0x7f45b8142d90 2023-12-19T17:49:50.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.252+0000 7f45b559a640 1 -- 172.21.15.37:0/1104322536 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac030d50 con 0x7f45b8142d90 2023-12-19T17:49:50.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.253+0000 7f45bcb99640 1 -- 172.21.15.37:0/1104322536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b8142d90 msgr2=0x7f45b80baad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:50.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.253+0000 7f45bcb99640 1 --2- 172.21.15.37:0/1104322536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b8142d90 0x7f45b80baad0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f45b80b8d60 tx=0x7f45ac02b9a0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.253+0000 7f45bcb99640 1 -- 172.21.15.37:0/1104322536 shutdown_connections 2023-12-19T17:49:50.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.253+0000 7f45bcb99640 1 --2- 172.21.15.37:0/1104322536 >> v2:172.21.15.78:3300/0 conn(0x7f45b80b23a0 0x7f45b80b9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.253+0000 7f45bcb99640 1 --2- 172.21.15.37:0/1104322536 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45b80b1f60 0x7f45b80b9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.253+0000 7f45bcb99640 1 --2- 172.21.15.37:0/1104322536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b8142d90 0x7f45b80baad0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.253+0000 7f45bcb99640 1 -- 172.21.15.37:0/1104322536 >> 172.21.15.37:0/1104322536 conn(0x7f45b80be0c0 msgr2=0x7f45b80be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.253+0000 7f45bcb99640 1 -- 172.21.15.37:0/1104322536 shutdown_connections 2023-12-19T17:49:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.253+0000 7f45bcb99640 1 -- 172.21.15.37:0/1104322536 wait complete. 2023-12-19T17:49:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.254+0000 7f45bcb99640 1 Processor -- start 2023-12-19T17:49:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.254+0000 7f45bcb99640 1 -- start start 2023-12-19T17:49:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.255+0000 7f45bcb99640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45b80b1f60 0x7f45b814c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.255+0000 7f45bcb99640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b80b23a0 0x7f45b8144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.255+0000 7f45bcb99640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45b8142d90 0x7f45b80b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.255+0000 7f45bcb99640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b8145190 con 0x7f45b80b23a0 2023-12-19T17:49:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.255+0000 7f45bcb99640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b8146440 con 0x7f45b8142d90 2023-12-19T17:49:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.255+0000 7f45bcb99640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b8145680 con 0x7f45b80b1f60 2023-12-19T17:49:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.255+0000 7f45b5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b80b23a0 0x7f45b8144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.255+0000 7f45b5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b80b23a0 0x7f45b8144c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54984/0 (socket says 172.21.15.37:54984) 2023-12-19T17:49:50.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.255+0000 7f45b5d9b640 1 -- 172.21.15.37:0/713563563 learned_addr learned my addr 172.21.15.37:0/713563563 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:50.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.255+0000 7f45b6d9d640 1 --2- 172.21.15.37:0/713563563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45b8142d90 0x7f45b80b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:50.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.255+0000 7f45b659c640 1 --2- 172.21.15.37:0/713563563 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45b80b1f60 0x7f45b814c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:50.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.255+0000 7f45b5d9b640 1 -- 172.21.15.37:0/713563563 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45b80b1f60 msgr2=0x7f45b814c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:50.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.255+0000 7f45b5d9b640 1 --2- 172.21.15.37:0/713563563 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45b80b1f60 0x7f45b814c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.255+0000 7f45b5d9b640 1 -- 172.21.15.37:0/713563563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45b8142d90 msgr2=0x7f45b80b75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:50.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.255+0000 7f45b5d9b640 1 --2- 172.21.15.37:0/713563563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45b8142d90 0x7f45b80b75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.255+0000 7f45b5d9b640 1 -- 172.21.15.37:0/713563563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac0094d0 con 0x7f45b80b23a0 2023-12-19T17:49:50.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.255+0000 7f45b659c640 1 --2- 172.21.15.37:0/713563563 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45b80b1f60 0x7f45b814c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:49:50.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.256+0000 7f45b5d9b640 1 --2- 172.21.15.37:0/713563563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b80b23a0 0x7f45b8144c50 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f45a800d830 tx=0x7f45a800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:50.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.256+0000 7f45a6ffd640 1 -- 172.21.15.37:0/713563563 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a800be10 con 0x7f45b80b23a0 2023-12-19T17:49:50.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.256+0000 7f45a6ffd640 1 -- 172.21.15.37:0/713563563 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a8009850 con 0x7f45b80b23a0 2023-12-19T17:49:50.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.256+0000 7f45a6ffd640 1 -- 172.21.15.37:0/713563563 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a80099e0 con 0x7f45b80b23a0 2023-12-19T17:49:50.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.256+0000 7f45bcb99640 1 -- 172.21.15.37:0/713563563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b8144270 con 0x7f45b80b23a0 2023-12-19T17:49:50.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.256+0000 7f45bcb99640 1 -- 172.21.15.37:0/713563563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b81453a0 con 0x7f45b80b23a0 2023-12-19T17:49:50.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.257+0000 7f45bcb99640 1 -- 172.21.15.37:0/713563563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b80b2fc0 con 0x7f45b80b23a0 2023-12-19T17:49:50.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.257+0000 7f45a6ffd640 1 -- 172.21.15.37:0/713563563 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f45a8009b40 con 0x7f45b80b23a0 2023-12-19T17:49:50.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.258+0000 7f45a6ffd640 1 --2- 172.21.15.37:0/713563563 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f459806a430 0x7f459806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:50.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.258+0000 7f45a6ffd640 1 -- 172.21.15.37:0/713563563 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45a8088b00 con 0x7f45b80b23a0 2023-12-19T17:49:50.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.258+0000 7f45b659c640 1 --2- 172.21.15.37:0/713563563 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f459806a430 0x7f459806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:50.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.258+0000 7f45b659c640 1 --2- 172.21.15.37:0/713563563 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f459806a430 0x7f459806c8f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f45ac036000 tx=0x7f45ac008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:50.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.262+0000 7f45a6ffd640 1 -- 172.21.15.37:0/713563563 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f45a8054180 con 0x7f45b80b23a0 2023-12-19T17:49:50.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.441+0000 7f45bcb99640 1 -- 172.21.15.37:0/713563563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45b8145b40 con 0x7f45b80b23a0 2023-12-19T17:49:50.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.441+0000 7f45a6ffd640 1 -- 172.21.15.37:0/713563563 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f45a800b3a0 con 0x7f45b80b23a0 2023-12-19T17:49:50.442 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-19T17:49:50.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.443+0000 7f45bcb99640 1 -- 172.21.15.37:0/713563563 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f459806a430 msgr2=0x7f459806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:50.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.443+0000 7f45bcb99640 1 --2- 172.21.15.37:0/713563563 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f459806a430 0x7f459806c8f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f45ac036000 tx=0x7f45ac008030 comp rx=0 tx=0).stop 2023-12-19T17:49:50.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.444+0000 7f45bcb99640 1 -- 172.21.15.37:0/713563563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b80b23a0 msgr2=0x7f45b8144c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:50.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.444+0000 7f45bcb99640 1 --2- 172.21.15.37:0/713563563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b80b23a0 0x7f45b8144c50 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f45a800d830 tx=0x7f45a800dcf0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.444+0000 7f45bcb99640 1 -- 172.21.15.37:0/713563563 shutdown_connections 2023-12-19T17:49:50.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.444+0000 7f45bcb99640 1 --2- 172.21.15.37:0/713563563 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f459806a430 0x7f459806c8f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.444+0000 7f45bcb99640 1 --2- 172.21.15.37:0/713563563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45b8142d90 0x7f45b80b75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.444+0000 7f45bcb99640 1 --2- 172.21.15.37:0/713563563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b80b23a0 0x7f45b8144c50 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.444+0000 7f45bcb99640 1 --2- 172.21.15.37:0/713563563 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f45b80b1f60 0x7f45b814c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.444+0000 7f45bcb99640 1 -- 172.21.15.37:0/713563563 >> 172.21.15.37:0/713563563 conn(0x7f45b80be0c0 msgr2=0x7f45b8070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:50.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.444+0000 7f45bcb99640 1 -- 172.21.15.37:0/713563563 shutdown_connections 2023-12-19T17:49:50.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.444+0000 7f45bcb99640 1 -- 172.21.15.37:0/713563563 wait complete. 2023-12-19T17:49:50.455 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T17:49:50.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.562+0000 7f2a50481640 1 Processor -- start 2023-12-19T17:49:50.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.562+0000 7f2a50481640 1 -- start start 2023-12-19T17:49:50.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.563+0000 7f2a50481640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2a480b69a0 0x7f2a4814aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:50.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.563+0000 7f2a50481640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a48069ba0 0x7f2a4814b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:50.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.563+0000 7f2a50481640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a48071330 con 0x7f2a480707d0 2023-12-19T17:49:50.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.563+0000 7f2a50481640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4806b950 con 0x7f2a480b69a0 2023-12-19T17:49:50.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.563+0000 7f2a50481640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a480b6d80 con 0x7f2a48069ba0 2023-12-19T17:49:50.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.563+0000 7f2a4ea1e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2a480707d0 0x7f2a48070c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33264/0 (socket says 172.21.15.37:33264) 2023-12-19T17:49:50.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.563+0000 7f2a4ea1e640 1 -- 172.21.15.37:0/2623204196 learned_addr learned my addr 172.21.15.37:0/2623204196 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:49:50.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.563+0000 7f2a4da1c640 1 --2- 172.21.15.37:0/2623204196 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a48069ba0 0x7f2a4814b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:50.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.563+0000 7f2a4e21d640 1 --2- 172.21.15.37:0/2623204196 >> v2:172.21.15.78:3300/0 conn(0x7f2a480b69a0 0x7f2a4814aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:50.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.563+0000 7f2a4d21b640 1 -- 172.21.15.37:0/2623204196 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502569894 0 0) 0x7f2a48071330 con 0x7f2a480707d0 2023-12-19T17:49:50.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.563+0000 7f2a4d21b640 1 -- 172.21.15.37:0/2623204196 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a34003520 con 0x7f2a480707d0 2023-12-19T17:49:50.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4d21b640 1 -- 172.21.15.37:0/2623204196 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 46322860 0 0) 0x7f2a34003520 con 0x7f2a480707d0 2023-12-19T17:49:50.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4d21b640 1 -- 172.21.15.37:0/2623204196 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a48069ba0 msgr2=0x7f2a4814b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:50.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4d21b640 1 --2- 172.21.15.37:0/2623204196 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a48069ba0 0x7f2a4814b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4d21b640 1 -- 172.21.15.37:0/2623204196 >> v2:172.21.15.78:3300/0 conn(0x7f2a480b69a0 msgr2=0x7f2a4814aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:50.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4d21b640 1 --2- 172.21.15.37:0/2623204196 >> v2:172.21.15.78:3300/0 conn(0x7f2a480b69a0 0x7f2a4814aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4d21b640 1 -- 172.21.15.37:0/2623204196 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4806a0c0 con 0x7f2a480707d0 2023-12-19T17:49:50.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4d21b640 1 -- 172.21.15.37:0/2623204196 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f2a400019f0 con 0x7f2a480707d0 2023-12-19T17:49:50.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4d21b640 1 -- 172.21.15.37:0/2623204196 >> v1:172.21.15.37:6789/0 conn(0x7f2a480707d0 legacy=0x7f2a48070c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:50.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4d21b640 1 --2- 172.21.15.37:0/2623204196 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a48069ba0 0x7f2a34003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:50.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4d21b640 1 --2- 172.21.15.37:0/2623204196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a34003ef0 0x7f2a340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:50.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4d21b640 1 --2- 172.21.15.37:0/2623204196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a34004d00 0x7f2a34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:50.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4d21b640 1 -- 172.21.15.37:0/2623204196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4806b950 con 0x7f2a34003ef0 2023-12-19T17:49:50.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4d21b640 1 -- 172.21.15.37:0/2623204196 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a480b6d80 con 0x7f2a34004d00 2023-12-19T17:49:50.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4d21b640 1 -- 172.21.15.37:0/2623204196 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3400b9b0 con 0x7f2a48069ba0 2023-12-19T17:49:50.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4e21d640 1 --2- 172.21.15.37:0/2623204196 >> v2:172.21.15.78:3300/0 conn(0x7f2a480b69a0 0x7f2a4814aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:49:50.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4da1c640 1 --2- 172.21.15.37:0/2623204196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a34003ef0 0x7f2a340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:50.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4ea1e640 1 --2- 172.21.15.37:0/2623204196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a34004d00 0x7f2a34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:50.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4e21d640 1 --2- 172.21.15.37:0/2623204196 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a48069ba0 0x7f2a34003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:50.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4da1c640 1 -- 172.21.15.37:0/2623204196 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a48069ba0 msgr2=0x7f2a34003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:50.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4da1c640 1 --2- 172.21.15.37:0/2623204196 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a48069ba0 0x7f2a34003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4da1c640 1 -- 172.21.15.37:0/2623204196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a34004d00 msgr2=0x7f2a34005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:50.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4da1c640 1 --2- 172.21.15.37:0/2623204196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a34004d00 0x7f2a34005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4da1c640 1 -- 172.21.15.37:0/2623204196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a34003520 con 0x7f2a34003ef0 2023-12-19T17:49:50.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.564+0000 7f2a4e21d640 1 --2- 172.21.15.37:0/2623204196 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a48069ba0 0x7f2a34003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:49:50.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.565+0000 7f2a4da1c640 1 --2- 172.21.15.37:0/2623204196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a34003ef0 0x7f2a340047c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009aa0 tx=0x7f2a340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11a1d2ece7ee390 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:50.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.565+0000 7f2a4d21b640 1 -- 172.21.15.37:0/2623204196 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4402c6b0 con 0x7f2a34003ef0 2023-12-19T17:49:50.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.565+0000 7f2a4d21b640 1 -- 172.21.15.37:0/2623204196 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4402c810 con 0x7f2a34003ef0 2023-12-19T17:49:50.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.565+0000 7f2a4d21b640 1 -- 172.21.15.37:0/2623204196 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4402cbc0 con 0x7f2a34003ef0 2023-12-19T17:49:50.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.566+0000 7f2a50481640 1 -- 172.21.15.37:0/2623204196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a34003ef0 msgr2=0x7f2a340047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:50.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.566+0000 7f2a50481640 1 --2- 172.21.15.37:0/2623204196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a34003ef0 0x7f2a340047c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009aa0 tx=0x7f2a340057f0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.566+0000 7f2a4ea1e640 1 -- 172.21.15.37:0/2623204196 reap_dead start 2023-12-19T17:49:50.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.566+0000 7f2a50481640 1 -- 172.21.15.37:0/2623204196 shutdown_connections 2023-12-19T17:49:50.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.566+0000 7f2a50481640 1 -- 172.21.15.37:0/2623204196 >> 172.21.15.37:0/2623204196 conn(0x7f2a480bcfc0 msgr2=0x7f2a480bd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:50.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.566+0000 7f2a50481640 1 -- 172.21.15.37:0/2623204196 shutdown_connections 2023-12-19T17:49:50.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.566+0000 7f2a50481640 1 -- 172.21.15.37:0/2623204196 wait complete. 2023-12-19T17:49:50.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.567+0000 7f2a50481640 1 Processor -- start 2023-12-19T17:49:50.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.567+0000 7f2a50481640 1 -- start start 2023-12-19T17:49:50.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.567+0000 7f2a50481640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a34003ef0 0x7f2a4814bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:50.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a50481640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a4814d890 0x7f2a480b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:50.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a50481640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a4814ccb0 0x7f2a481e31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:50.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a50481640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4814eea0 con 0x7f2a34003ef0 2023-12-19T17:49:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a50481640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a480b5aa0 con 0x7f2a4814ccb0 2023-12-19T17:49:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a50481640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a480b5c70 con 0x7f2a4814d890 2023-12-19T17:49:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a4e21d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a34003ef0 0x7f2a4814bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a4e21d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a34003ef0 0x7f2a4814bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55008/0 (socket says 172.21.15.37:55008) 2023-12-19T17:49:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a4e21d640 1 -- 172.21.15.37:0/361445462 learned_addr learned my addr 172.21.15.37:0/361445462 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a4e21d640 1 -- 172.21.15.37:0/361445462 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a4814d890 msgr2=0x7f2a480b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a4da1c640 1 --2- 172.21.15.37:0/361445462 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a4814d890 0x7f2a480b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a4ea1e640 1 --2- 172.21.15.37:0/361445462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a4814ccb0 0x7f2a481e31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a4e21d640 1 --2- 172.21.15.37:0/361445462 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a4814d890 0x7f2a480b5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a4e21d640 1 -- 172.21.15.37:0/361445462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a4814ccb0 msgr2=0x7f2a481e31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a4e21d640 1 --2- 172.21.15.37:0/361445462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a4814ccb0 0x7f2a481e31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a4e21d640 1 -- 172.21.15.37:0/361445462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4814dd10 con 0x7f2a34003ef0 2023-12-19T17:49:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a4e21d640 1 --2- 172.21.15.37:0/361445462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a34003ef0 0x7f2a4814bf00 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2a38011900 tx=0x7f2a38011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a3effd640 1 -- 172.21.15.37:0/361445462 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3800fbd0 con 0x7f2a34003ef0 2023-12-19T17:49:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a3effd640 1 -- 172.21.15.37:0/361445462 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3800fd30 con 0x7f2a34003ef0 2023-12-19T17:49:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a50481640 1 -- 172.21.15.37:0/361445462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4814d470 con 0x7f2a34003ef0 2023-12-19T17:49:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a3effd640 1 -- 172.21.15.37:0/361445462 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a38015680 con 0x7f2a34003ef0 2023-12-19T17:49:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.568+0000 7f2a50481640 1 -- 172.21.15.37:0/361445462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4814ebc0 con 0x7f2a34003ef0 2023-12-19T17:49:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.569+0000 7f2a50481640 1 -- 172.21.15.37:0/361445462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4814e740 con 0x7f2a34003ef0 2023-12-19T17:49:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.570+0000 7f2a3effd640 1 -- 172.21.15.37:0/361445462 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2a380157e0 con 0x7f2a34003ef0 2023-12-19T17:49:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.570+0000 7f2a3effd640 1 --2- 172.21.15.37:0/361445462 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2a2c06a430 0x7f2a2c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.570+0000 7f2a3effd640 1 -- 172.21.15.37:0/361445462 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a380894f0 con 0x7f2a34003ef0 2023-12-19T17:49:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.570+0000 7f2a4da1c640 1 --2- 172.21.15.37:0/361445462 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2a2c06a430 0x7f2a2c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.571+0000 7f2a4da1c640 1 --2- 172.21.15.37:0/361445462 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2a2c06a430 0x7f2a2c06c8f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2a44036000 tx=0x7f2a44030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.574+0000 7f2a3effd640 1 -- 172.21.15.37:0/361445462 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2a4814e740 con 0x7f2a34003ef0 2023-12-19T17:49:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.765+0000 7f2a50481640 1 -- 172.21.15.37:0/361445462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2a4814e740 con 0x7f2a34003ef0 2023-12-19T17:49:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.765+0000 7f2a3effd640 1 -- 172.21.15.37:0/361445462 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2a4814e740 con 0x7f2a34003ef0 2023-12-19T17:49:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-12-19T17:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.767+0000 7f2a50481640 1 -- 172.21.15.37:0/361445462 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2a2c06a430 msgr2=0x7f2a2c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.767+0000 7f2a50481640 1 --2- 172.21.15.37:0/361445462 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2a2c06a430 0x7f2a2c06c8f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2a44036000 tx=0x7f2a44030000 comp rx=0 tx=0).stop 2023-12-19T17:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.767+0000 7f2a50481640 1 -- 172.21.15.37:0/361445462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a34003ef0 msgr2=0x7f2a4814bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.767+0000 7f2a50481640 1 --2- 172.21.15.37:0/361445462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a34003ef0 0x7f2a4814bf00 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2a38011900 tx=0x7f2a38011dc0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.767+0000 7f2a50481640 1 -- 172.21.15.37:0/361445462 shutdown_connections 2023-12-19T17:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.767+0000 7f2a50481640 1 --2- 172.21.15.37:0/361445462 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2a2c06a430 0x7f2a2c06c8f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.767+0000 7f2a50481640 1 --2- 172.21.15.37:0/361445462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a4814ccb0 0x7f2a481e31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.767+0000 7f2a50481640 1 --2- 172.21.15.37:0/361445462 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2a4814d890 0x7f2a480b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.767+0000 7f2a50481640 1 --2- 172.21.15.37:0/361445462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a34003ef0 0x7f2a4814bf00 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.767+0000 7f2a50481640 1 -- 172.21.15.37:0/361445462 >> 172.21.15.37:0/361445462 conn(0x7f2a480bcfc0 msgr2=0x7f2a481491c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.767+0000 7f2a50481640 1 -- 172.21.15.37:0/361445462 shutdown_connections 2023-12-19T17:49:50.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:50.767+0000 7f2a50481640 1 -- 172.21.15.37:0/361445462 wait complete. 2023-12-19T17:49:50.778 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T17:49:50.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:49:50.778 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T17:49:50.895 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T17:49:50.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:49:50.895 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T17:49:50.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:49:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.055+0000 7f9419c28640 1 Processor -- start 2023-12-19T17:49:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.055+0000 7f9419c28640 1 -- start start 2023-12-19T17:49:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.056+0000 7f9419c28640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f941406ae20 0x7f9414071f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.056+0000 7f9419c28640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9414070800 0x7f94140b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.056+0000 7f9419c28640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941406f3f0 con 0x7f94140b82c0 2023-12-19T17:49:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.056+0000 7f9419c28640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94140718a0 con 0x7f9414070800 2023-12-19T17:49:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.056+0000 7f9419c28640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941406fbb0 con 0x7f941406ae20 2023-12-19T17:49:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.056+0000 7f94137fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f941406ae20 0x7f9414071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.056+0000 7f9413fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9414070800 0x7f94140b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.056+0000 7f9413fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9414070800 0x7f94140b5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:59878/0 (socket says 172.21.15.37:59878) 2023-12-19T17:49:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.056+0000 7f94137fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f941406ae20 0x7f9414071f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:37354/0 (socket says 172.21.15.37:37354) 2023-12-19T17:49:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.056+0000 7f9412ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f94140b82c0 0x7f941414df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.37:37160/0 (socket says 172.21.15.37:37160) 2023-12-19T17:49:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.056+0000 7f9413fff640 1 -- 172.21.15.37:0/3780935394 learned_addr learned my addr 172.21.15.37:0/3780935394 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.057+0000 7f9413fff640 1 -- 172.21.15.37:0/3780935394 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f941406ae20 msgr2=0x7f9414071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.057+0000 7f9413fff640 1 --2- 172.21.15.37:0/3780935394 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f941406ae20 0x7f9414071f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.057+0000 7f9413fff640 1 -- 172.21.15.37:0/3780935394 >> v1:172.21.15.78:6789/0 conn(0x7f94140b82c0 legacy=0x7f941414df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.057+0000 7f9413fff640 1 -- 172.21.15.37:0/3780935394 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941406f690 con 0x7f9414070800 2023-12-19T17:49:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.057+0000 7f94137fe640 1 --2- 172.21.15.37:0/3780935394 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f941406ae20 0x7f9414071f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:49:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.057+0000 7f9413fff640 1 --2- 172.21.15.37:0/3780935394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9414070800 0x7f94140b5e90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f940c009e50 tx=0x7f940c02bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40eb449c281ef248 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.058+0000 7f94127fc640 1 -- 172.21.15.37:0/3780935394 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c02cb00 con 0x7f9414070800 2023-12-19T17:49:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.058+0000 7f94127fc640 1 -- 172.21.15.37:0/3780935394 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c02cc60 con 0x7f9414070800 2023-12-19T17:49:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.058+0000 7f94127fc640 1 -- 172.21.15.37:0/3780935394 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c0343f0 con 0x7f9414070800 2023-12-19T17:49:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.058+0000 7f9419c28640 1 -- 172.21.15.37:0/3780935394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9414070800 msgr2=0x7f94140b5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.058+0000 7f9419c28640 1 --2- 172.21.15.37:0/3780935394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9414070800 0x7f94140b5e90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f940c009e50 tx=0x7f940c02bf60 comp rx=0 tx=0).stop 2023-12-19T17:49:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.058+0000 7f9419c28640 1 -- 172.21.15.37:0/3780935394 shutdown_connections 2023-12-19T17:49:51.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.058+0000 7f9419c28640 1 --2- 172.21.15.37:0/3780935394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9414070800 0x7f94140b5e90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.058+0000 7f9419c28640 1 --2- 172.21.15.37:0/3780935394 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f941406ae20 0x7f9414071f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.058+0000 7f9419c28640 1 -- 172.21.15.37:0/3780935394 >> 172.21.15.37:0/3780935394 conn(0x7f94140b9130 msgr2=0x7f94140b9510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:51.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.058+0000 7f9419c28640 1 -- 172.21.15.37:0/3780935394 shutdown_connections 2023-12-19T17:49:51.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.058+0000 7f9419c28640 1 -- 172.21.15.37:0/3780935394 wait complete. 2023-12-19T17:49:51.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.059+0000 7f9419c28640 1 Processor -- start 2023-12-19T17:49:51.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.059+0000 7f9419c28640 1 -- start start 2023-12-19T17:49:51.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.060+0000 7f9419c28640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f941406ae20 0x7f94140b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.060+0000 7f9419c28640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9414070800 0x7f94140b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.060+0000 7f9419c28640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94140b82c0 0x7f94141e3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.060+0000 7f9419c28640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94140b32d0 con 0x7f941406ae20 2023-12-19T17:49:51.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.060+0000 7f9419c28640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94141e2cc0 con 0x7f9414070800 2023-12-19T17:49:51.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.060+0000 7f9419c28640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94140b0e70 con 0x7f94140b82c0 2023-12-19T17:49:51.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.060+0000 7f94137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f941406ae20 0x7f94140b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.060+0000 7f94137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f941406ae20 0x7f94140b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55018/0 (socket says 172.21.15.37:55018) 2023-12-19T17:49:51.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.060+0000 7f94137fe640 1 -- 172.21.15.37:0/3204667827 learned_addr learned my addr 172.21.15.37:0/3204667827 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:51.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.060+0000 7f9412ffd640 1 --2- 172.21.15.37:0/3204667827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9414070800 0x7f94140b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.060+0000 7f9413fff640 1 --2- 172.21.15.37:0/3204667827 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94140b82c0 0x7f94141e3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.060+0000 7f94137fe640 1 -- 172.21.15.37:0/3204667827 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94140b82c0 msgr2=0x7f94141e3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:51.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.060+0000 7f94137fe640 1 --2- 172.21.15.37:0/3204667827 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94140b82c0 0x7f94141e3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.060+0000 7f94137fe640 1 -- 172.21.15.37:0/3204667827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9414070800 msgr2=0x7f94140b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:51.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.060+0000 7f94137fe640 1 --2- 172.21.15.37:0/3204667827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9414070800 0x7f94140b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.061+0000 7f94137fe640 1 -- 172.21.15.37:0/3204667827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9404009400 con 0x7f941406ae20 2023-12-19T17:49:51.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.061+0000 7f9412ffd640 1 --2- 172.21.15.37:0/3204667827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9414070800 0x7f94140b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:49:51.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.061+0000 7f94137fe640 1 --2- 172.21.15.37:0/3204667827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f941406ae20 0x7f94140b1f30 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f940400ebe0 tx=0x7f940400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:51.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.061+0000 7f940bfff640 1 -- 172.21.15.37:0/3204667827 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404009760 con 0x7f941406ae20 2023-12-19T17:49:51.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.061+0000 7f940bfff640 1 -- 172.21.15.37:0/3204667827 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940400cc30 con 0x7f941406ae20 2023-12-19T17:49:51.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.061+0000 7f940bfff640 1 -- 172.21.15.37:0/3204667827 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940400eee0 con 0x7f941406ae20 2023-12-19T17:49:51.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.061+0000 7f9419c28640 1 -- 172.21.15.37:0/3204667827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f940c009b30 con 0x7f941406ae20 2023-12-19T17:49:51.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.061+0000 7f9419c28640 1 -- 172.21.15.37:0/3204667827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94140b1430 con 0x7f941406ae20 2023-12-19T17:49:51.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.062+0000 7f9419c28640 1 -- 172.21.15.37:0/3204667827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9414066d80 con 0x7f941406ae20 2023-12-19T17:49:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.062+0000 7f940bfff640 1 -- 172.21.15.37:0/3204667827 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9404013470 con 0x7f941406ae20 2023-12-19T17:49:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.063+0000 7f940bfff640 1 --2- 172.21.15.37:0/3204667827 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f93f406a430 0x7f93f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.063+0000 7f940bfff640 1 -- 172.21.15.37:0/3204667827 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9404088bf0 con 0x7f941406ae20 2023-12-19T17:49:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.063+0000 7f9412ffd640 1 --2- 172.21.15.37:0/3204667827 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f93f406a430 0x7f93f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.064+0000 7f9412ffd640 1 --2- 172.21.15.37:0/3204667827 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f93f406a430 0x7f93f406c8f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f93fc007fd0 tx=0x7f93fc007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.067+0000 7f940bfff640 1 -- 172.21.15.37:0/3204667827 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f94040541e0 con 0x7f941406ae20 2023-12-19T17:49:51.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.281+0000 7f9419c28640 1 -- 172.21.15.37:0/3204667827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f941404e840 con 0x7f941406ae20 2023-12-19T17:49:51.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.282+0000 7f940bfff640 1 -- 172.21.15.37:0/3204667827 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3946 (secure 0 0 0) 0x7f9404057800 con 0x7f941406ae20 2023-12-19T17:49:51.282 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T17:49:51.283 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/19970234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":19970234},{"type":"v1","addr":"172.21.15.37:6834","nonce":19970234}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2974397450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2974397450},{"type":"v1","addr":"172.21.15.78:6835","nonce":2974397450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:07:41.897266+0000","modified":"2023-12-19T16:07:43.904067+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1604445250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1604445250},{"type":"v1","addr":"172.21.15.37:6835","nonce":1604445250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:49:51.283 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 13 2023-12-19T17:49:51.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.284+0000 7f9419c28640 1 -- 172.21.15.37:0/3204667827 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f93f406a430 msgr2=0x7f93f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:51.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.284+0000 7f9419c28640 1 --2- 172.21.15.37:0/3204667827 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f93f406a430 0x7f93f406c8f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f93fc007fd0 tx=0x7f93fc007d40 comp rx=0 tx=0).stop 2023-12-19T17:49:51.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.284+0000 7f9419c28640 1 -- 172.21.15.37:0/3204667827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f941406ae20 msgr2=0x7f94140b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:51.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.284+0000 7f9419c28640 1 --2- 172.21.15.37:0/3204667827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f941406ae20 0x7f94140b1f30 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f940400ebe0 tx=0x7f940400c520 comp rx=0 tx=0).stop 2023-12-19T17:49:51.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.284+0000 7f9419c28640 1 -- 172.21.15.37:0/3204667827 shutdown_connections 2023-12-19T17:49:51.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.284+0000 7f9419c28640 1 --2- 172.21.15.37:0/3204667827 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f93f406a430 0x7f93f406c8f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.284+0000 7f9419c28640 1 --2- 172.21.15.37:0/3204667827 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f94140b82c0 0x7f94141e3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.284+0000 7f9419c28640 1 --2- 172.21.15.37:0/3204667827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9414070800 0x7f94140b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.284+0000 7f9419c28640 1 --2- 172.21.15.37:0/3204667827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f941406ae20 0x7f94140b1f30 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.284+0000 7f9419c28640 1 -- 172.21.15.37:0/3204667827 >> 172.21.15.37:0/3204667827 conn(0x7f94140b9130 msgr2=0x7f94140bbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:51.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.284+0000 7f9419c28640 1 -- 172.21.15.37:0/3204667827 shutdown_connections 2023-12-19T17:49:51.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.284+0000 7f9419c28640 1 -- 172.21.15.37:0/3204667827 wait complete. 2023-12-19T17:49:51.295 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:49:51.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.400+0000 7fef62617640 1 Processor -- start 2023-12-19T17:49:51.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.400+0000 7fef62617640 1 -- start start 2023-12-19T17:49:51.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.401+0000 7fef62617640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fef5c0b6730 0x7fef5c14aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.401+0000 7fef62617640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef5c0b6b10 0x7fef5c069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.401+0000 7fef62617640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5c0b4110 con 0x7fef5c0710b0 2023-12-19T17:49:51.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.401+0000 7fef62617640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5c14b010 con 0x7fef5c0b6730 2023-12-19T17:49:51.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.401+0000 7fef62617640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c06b800 con 0x7fef5c0b6b10 2023-12-19T17:49:51.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.401+0000 7fef60bb4640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fef5c0710b0 0x7fef5c06a0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33268/0 (socket says 172.21.15.37:33268) 2023-12-19T17:49:51.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.401+0000 7fef60bb4640 1 -- 172.21.15.37:0/9367260 learned_addr learned my addr 172.21.15.37:0/9367260 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:49:51.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.401+0000 7fef5bfff640 1 --2- 172.21.15.37:0/9367260 >> v2:172.21.15.78:3300/0 conn(0x7fef5c0b6730 0x7fef5c14aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.401+0000 7fef5b7fe640 1 --2- 172.21.15.37:0/9367260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef5c0b6b10 0x7fef5c069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.401+0000 7fef5affd640 1 -- 172.21.15.37:0/9367260 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967927979 0 0) 0x7fef5c0b4110 con 0x7fef5c0710b0 2023-12-19T17:49:51.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.401+0000 7fef5affd640 1 -- 172.21.15.37:0/9367260 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef44003520 con 0x7fef5c0710b0 2023-12-19T17:49:51.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef5affd640 1 -- 172.21.15.37:0/9367260 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 762188 0 0) 0x7fef44003520 con 0x7fef5c0710b0 2023-12-19T17:49:51.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef5affd640 1 -- 172.21.15.37:0/9367260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef5c0b6b10 msgr2=0x7fef5c069ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:51.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef5affd640 1 --2- 172.21.15.37:0/9367260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef5c0b6b10 0x7fef5c069ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef5affd640 1 -- 172.21.15.37:0/9367260 >> v2:172.21.15.78:3300/0 conn(0x7fef5c0b6730 msgr2=0x7fef5c14aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:51.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef5affd640 1 --2- 172.21.15.37:0/9367260 >> v2:172.21.15.78:3300/0 conn(0x7fef5c0b6730 0x7fef5c14aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef5affd640 1 -- 172.21.15.37:0/9367260 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c0b3b50 con 0x7fef5c0710b0 2023-12-19T17:49:51.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef5affd640 1 -- 172.21.15.37:0/9367260 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7fef540019f0 con 0x7fef5c0710b0 2023-12-19T17:49:51.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef5affd640 1 -- 172.21.15.37:0/9367260 >> v1:172.21.15.37:6789/0 conn(0x7fef5c0710b0 legacy=0x7fef5c06a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:51.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef5affd640 1 --2- 172.21.15.37:0/9367260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef44003970 0x7fef44003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef5affd640 1 --2- 172.21.15.37:0/9367260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef5c0b6b10 0x7fef440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef5affd640 1 --2- 172.21.15.37:0/9367260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef44004d00 0x7fef44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef5affd640 1 -- 172.21.15.37:0/9367260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c14b010 con 0x7fef44004d00 2023-12-19T17:49:51.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef5affd640 1 -- 172.21.15.37:0/9367260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c06b800 con 0x7fef44003970 2023-12-19T17:49:51.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef5affd640 1 -- 172.21.15.37:0/9367260 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4400b980 con 0x7fef5c0b6b10 2023-12-19T17:49:51.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef60bb4640 1 --2- 172.21.15.37:0/9367260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef44004d00 0x7fef44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef5b7fe640 1 --2- 172.21.15.37:0/9367260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef5c0b6b10 0x7fef440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef5bfff640 1 --2- 172.21.15.37:0/9367260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef44003970 0x7fef44003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef60bb4640 1 -- 172.21.15.37:0/9367260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef5c0b6b10 msgr2=0x7fef440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:51.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef60bb4640 1 --2- 172.21.15.37:0/9367260 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef5c0b6b10 0x7fef440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef60bb4640 1 -- 172.21.15.37:0/9367260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef44003970 msgr2=0x7fef44003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:51.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef60bb4640 1 --2- 172.21.15.37:0/9367260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef44003970 0x7fef44003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.402+0000 7fef60bb4640 1 -- 172.21.15.37:0/9367260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef44003520 con 0x7fef44004d00 2023-12-19T17:49:51.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.403+0000 7fef60bb4640 1 --2- 172.21.15.37:0/9367260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef44004d00 0x7fef44005180 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fef5400a820 tx=0x7fef440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad6c29ea7ae0955 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:51.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.403+0000 7fef5affd640 1 -- 172.21.15.37:0/9367260 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef540072d0 con 0x7fef44004d00 2023-12-19T17:49:51.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.403+0000 7fef5affd640 1 -- 172.21.15.37:0/9367260 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5402f070 con 0x7fef44004d00 2023-12-19T17:49:51.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.403+0000 7fef5affd640 1 -- 172.21.15.37:0/9367260 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54007690 con 0x7fef44004d00 2023-12-19T17:49:51.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.404+0000 7fef62617640 1 -- 172.21.15.37:0/9367260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef44004d00 msgr2=0x7fef44005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:51.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.404+0000 7fef62617640 1 --2- 172.21.15.37:0/9367260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef44004d00 0x7fef44005180 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fef5400a820 tx=0x7fef440057f0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.404+0000 7fef60bb4640 1 -- 172.21.15.37:0/9367260 reap_dead start 2023-12-19T17:49:51.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.404+0000 7fef62617640 1 -- 172.21.15.37:0/9367260 shutdown_connections 2023-12-19T17:49:51.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.404+0000 7fef62617640 1 -- 172.21.15.37:0/9367260 >> 172.21.15.37:0/9367260 conn(0x7fef5c0bcf60 msgr2=0x7fef5c0bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:51.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.404+0000 7fef62617640 1 -- 172.21.15.37:0/9367260 shutdown_connections 2023-12-19T17:49:51.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.404+0000 7fef62617640 1 -- 172.21.15.37:0/9367260 wait complete. 2023-12-19T17:49:51.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.405+0000 7fef62617640 1 Processor -- start 2023-12-19T17:49:51.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.406+0000 7fef62617640 1 -- start start 2023-12-19T17:49:51.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.407+0000 7fef62617640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef5c14e1b0 0x7fef5c14e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.407+0000 7fef62617640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef5c13ee60 0x7fef5c1e3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.407+0000 7fef62617640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c13f2c0 0x7fef5c1e37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.407+0000 7fef62617640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c140db0 con 0x7fef5c13f2c0 2023-12-19T17:49:51.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.407+0000 7fef62617640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c14d4a0 con 0x7fef5c14e1b0 2023-12-19T17:49:51.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.407+0000 7fef62617640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c14ead0 con 0x7fef5c13ee60 2023-12-19T17:49:51.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.407+0000 7fef60bb4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c13f2c0 0x7fef5c1e37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.407+0000 7fef60bb4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c13f2c0 0x7fef5c1e37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55030/0 (socket says 172.21.15.37:55030) 2023-12-19T17:49:51.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.407+0000 7fef60bb4640 1 -- 172.21.15.37:0/3768359916 learned_addr learned my addr 172.21.15.37:0/3768359916 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:51.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.407+0000 7fef5bfff640 1 --2- 172.21.15.37:0/3768359916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef5c14e1b0 0x7fef5c14e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.407+0000 7fef5b7fe640 1 --2- 172.21.15.37:0/3768359916 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef5c13ee60 0x7fef5c1e3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.407+0000 7fef60bb4640 1 -- 172.21.15.37:0/3768359916 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef5c13ee60 msgr2=0x7fef5c1e3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:51.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.407+0000 7fef60bb4640 1 --2- 172.21.15.37:0/3768359916 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef5c13ee60 0x7fef5c1e3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.407+0000 7fef60bb4640 1 -- 172.21.15.37:0/3768359916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef5c14e1b0 msgr2=0x7fef5c14e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:51.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.407+0000 7fef60bb4640 1 --2- 172.21.15.37:0/3768359916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef5c14e1b0 0x7fef5c14e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.407+0000 7fef60bb4640 1 -- 172.21.15.37:0/3768359916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c14cb70 con 0x7fef5c13f2c0 2023-12-19T17:49:51.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.407+0000 7fef60bb4640 1 --2- 172.21.15.37:0/3768359916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c13f2c0 0x7fef5c1e37c0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fef5400a940 tx=0x7fef5c06ab30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:51.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.408+0000 7fef58ff9640 1 -- 172.21.15.37:0/3768359916 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef540074e0 con 0x7fef5c13f2c0 2023-12-19T17:49:51.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.408+0000 7fef58ff9640 1 -- 172.21.15.37:0/3768359916 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef540019e0 con 0x7fef5c13f2c0 2023-12-19T17:49:51.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.408+0000 7fef62617640 1 -- 172.21.15.37:0/3768359916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5c14ce50 con 0x7fef5c13f2c0 2023-12-19T17:49:51.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.408+0000 7fef58ff9640 1 -- 172.21.15.37:0/3768359916 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54007840 con 0x7fef5c13f2c0 2023-12-19T17:49:51.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.408+0000 7fef62617640 1 -- 172.21.15.37:0/3768359916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5c14d930 con 0x7fef5c13f2c0 2023-12-19T17:49:51.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.409+0000 7fef62617640 1 -- 172.21.15.37:0/3768359916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5c14d630 con 0x7fef5c13f2c0 2023-12-19T17:49:51.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.409+0000 7fef58ff9640 1 -- 172.21.15.37:0/3768359916 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fef54031030 con 0x7fef5c13f2c0 2023-12-19T17:49:51.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.410+0000 7fef58ff9640 1 --2- 172.21.15.37:0/3768359916 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fef4806a430 0x7fef4806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.410+0000 7fef58ff9640 1 -- 172.21.15.37:0/3768359916 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef540aa3d0 con 0x7fef5c13f2c0 2023-12-19T17:49:51.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.410+0000 7fef5bfff640 1 --2- 172.21.15.37:0/3768359916 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fef4806a430 0x7fef4806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.411+0000 7fef5bfff640 1 --2- 172.21.15.37:0/3768359916 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fef4806a430 0x7fef4806c8f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fef50009bc0 tx=0x7fef50009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:51.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.414+0000 7fef58ff9640 1 -- 172.21.15.37:0/3768359916 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fef54079510 con 0x7fef5c13f2c0 2023-12-19T17:49:51.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.593+0000 7fef62617640 1 -- 172.21.15.37:0/3768359916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef5c073680 con 0x7fef5c13f2c0 2023-12-19T17:49:51.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.594+0000 7fef58ff9640 1 -- 172.21.15.37:0/3768359916 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16053 (secure 0 0 0) 0x7fef540790a0 con 0x7fef5c13f2c0 2023-12-19T17:49:51.594 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T17:49:51.594 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:07:42.899048+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:07:39.626181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T16:07:40.871535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:49:51.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.596+0000 7fef62617640 1 -- 172.21.15.37:0/3768359916 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fef4806a430 msgr2=0x7fef4806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:51.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.596+0000 7fef62617640 1 --2- 172.21.15.37:0/3768359916 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fef4806a430 0x7fef4806c8f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fef50009bc0 tx=0x7fef50009190 comp rx=0 tx=0).stop 2023-12-19T17:49:51.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.596+0000 7fef62617640 1 -- 172.21.15.37:0/3768359916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c13f2c0 msgr2=0x7fef5c1e37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:51.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.596+0000 7fef62617640 1 --2- 172.21.15.37:0/3768359916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c13f2c0 0x7fef5c1e37c0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fef5400a940 tx=0x7fef5c06ab30 comp rx=0 tx=0).stop 2023-12-19T17:49:51.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.596+0000 7fef62617640 1 -- 172.21.15.37:0/3768359916 shutdown_connections 2023-12-19T17:49:51.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.596+0000 7fef62617640 1 --2- 172.21.15.37:0/3768359916 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fef4806a430 0x7fef4806c8f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.596+0000 7fef62617640 1 --2- 172.21.15.37:0/3768359916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef5c13f2c0 0x7fef5c1e37c0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.596+0000 7fef62617640 1 --2- 172.21.15.37:0/3768359916 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fef5c13ee60 0x7fef5c1e3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.596+0000 7fef62617640 1 --2- 172.21.15.37:0/3768359916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef5c14e1b0 0x7fef5c14e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.596+0000 7fef62617640 1 -- 172.21.15.37:0/3768359916 >> 172.21.15.37:0/3768359916 conn(0x7fef5c0bcf60 msgr2=0x7fef5c072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:51.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.596+0000 7fef62617640 1 -- 172.21.15.37:0/3768359916 shutdown_connections 2023-12-19T17:49:51.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.596+0000 7fef62617640 1 -- 172.21.15.37:0/3768359916 wait complete. 2023-12-19T17:49:51.607 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:06:46.684027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:07:39.626181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:07:40.871535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T17:49:51.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:49:51.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.716+0000 7f0dcfa4a640 1 Processor -- start 2023-12-19T17:49:51.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.716+0000 7f0dcfa4a640 1 -- start start 2023-12-19T17:49:51.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.717+0000 7f0dcfa4a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0dc8145160 0x7f0dc80ba6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.717+0000 7f0dcfa4a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0dc806acb0 0x7f0dc8155500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.717+0000 7f0dcfa4a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc80bad40 con 0x7f0dc806c990 2023-12-19T17:49:51.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.717+0000 7f0dcfa4a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc80b9e40 con 0x7f0dc8145160 2023-12-19T17:49:51.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.717+0000 7f0dcd7e6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0dc8145160 0x7f0dc80ba6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.717+0000 7f0dcfa4a640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc814f140 con 0x7f0dc806acb0 2023-12-19T17:49:51.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.717+0000 7f0dccfe5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0dc806c990 0x7f0dc80b9730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33280/0 (socket says 172.21.15.37:33280) 2023-12-19T17:49:51.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.717+0000 7f0dccfe5640 1 -- 172.21.15.37:0/1616770688 learned_addr learned my addr 172.21.15.37:0/1616770688 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:49:51.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.718+0000 7f0dcdfe7640 1 --2- 172.21.15.37:0/1616770688 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0dc806acb0 0x7f0dc8155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.718+0000 7f0dbffff640 1 -- 172.21.15.37:0/1616770688 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676983268 0 0) 0x7f0dc80bad40 con 0x7f0dc806c990 2023-12-19T17:49:51.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.718+0000 7f0dbffff640 1 -- 172.21.15.37:0/1616770688 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0db4003520 con 0x7f0dc806c990 2023-12-19T17:49:51.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.718+0000 7f0dcd7e6640 1 -- 172.21.15.37:0/1616770688 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0dc806acb0 msgr2=0x7f0dc8155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:51.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.718+0000 7f0dcd7e6640 1 --2- 172.21.15.37:0/1616770688 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0dc806acb0 0x7f0dc8155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.718+0000 7f0dcd7e6640 1 -- 172.21.15.37:0/1616770688 >> v1:172.21.15.37:6789/0 conn(0x7f0dc806c990 legacy=0x7f0dc80b9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:51.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.718+0000 7f0dcd7e6640 1 -- 172.21.15.37:0/1616770688 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc80bb020 con 0x7f0dc8145160 2023-12-19T17:49:51.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.718+0000 7f0dcdfe7640 1 --2- 172.21.15.37:0/1616770688 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0dc806acb0 0x7f0dc8155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:49:51.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.719+0000 7f0dcd7e6640 1 --2- 172.21.15.37:0/1616770688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dc8145160 0x7f0dc80ba6b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0db80097d0 tx=0x7f0db802b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa5738fedf63b2a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:51.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.719+0000 7f0dbffff640 1 -- 172.21.15.37:0/1616770688 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db8031800 con 0x7f0dc8145160 2023-12-19T17:49:51.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.719+0000 7f0dbffff640 1 -- 172.21.15.37:0/1616770688 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db8031960 con 0x7f0dc8145160 2023-12-19T17:49:51.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.719+0000 7f0dbffff640 1 -- 172.21.15.37:0/1616770688 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db8031cf0 con 0x7f0dc8145160 2023-12-19T17:49:51.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.719+0000 7f0dcfa4a640 1 -- 172.21.15.37:0/1616770688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dc8145160 msgr2=0x7f0dc80ba6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:51.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.719+0000 7f0dcfa4a640 1 --2- 172.21.15.37:0/1616770688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dc8145160 0x7f0dc80ba6b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0db80097d0 tx=0x7f0db802b8a0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.720+0000 7f0dcfa4a640 1 -- 172.21.15.37:0/1616770688 shutdown_connections 2023-12-19T17:49:51.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.720+0000 7f0dcfa4a640 1 --2- 172.21.15.37:0/1616770688 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0dc806acb0 0x7f0dc8155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.720+0000 7f0dcfa4a640 1 --2- 172.21.15.37:0/1616770688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dc8145160 0x7f0dc80ba6b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.720+0000 7f0dcfa4a640 1 -- 172.21.15.37:0/1616770688 >> 172.21.15.37:0/1616770688 conn(0x7f0dc80be0c0 msgr2=0x7f0dc80be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:51.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.720+0000 7f0dcfa4a640 1 -- 172.21.15.37:0/1616770688 shutdown_connections 2023-12-19T17:49:51.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.720+0000 7f0dcfa4a640 1 -- 172.21.15.37:0/1616770688 wait complete. 2023-12-19T17:49:51.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.721+0000 7f0dcfa4a640 1 Processor -- start 2023-12-19T17:49:51.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.721+0000 7f0dcfa4a640 1 -- start start 2023-12-19T17:49:51.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.721+0000 7f0dcfa4a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0dc806acb0 0x7f0dc814af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.721+0000 7f0dcfa4a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc806c990 0x7f0dc81e2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.721+0000 7f0dcfa4a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dc8145160 0x7f0dc81416c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.721+0000 7f0dcfa4a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc814b450 con 0x7f0dc806c990 2023-12-19T17:49:51.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.721+0000 7f0dcfa4a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80b5e30 con 0x7f0dc8145160 2023-12-19T17:49:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.721+0000 7f0dcfa4a640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc8146f30 con 0x7f0dc806acb0 2023-12-19T17:49:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.721+0000 7f0dccfe5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc806c990 0x7f0dc81e2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.721+0000 7f0dccfe5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc806c990 0x7f0dc81e2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55040/0 (socket says 172.21.15.37:55040) 2023-12-19T17:49:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.721+0000 7f0dccfe5640 1 -- 172.21.15.37:0/2765198111 learned_addr learned my addr 172.21.15.37:0/2765198111 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.722+0000 7f0dcdfe7640 1 --2- 172.21.15.37:0/2765198111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dc8145160 0x7f0dc81416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.722+0000 7f0dcd7e6640 1 --2- 172.21.15.37:0/2765198111 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0dc806acb0 0x7f0dc814af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.722+0000 7f0dccfe5640 1 -- 172.21.15.37:0/2765198111 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0dc806acb0 msgr2=0x7f0dc814af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.722+0000 7f0dccfe5640 1 --2- 172.21.15.37:0/2765198111 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0dc806acb0 0x7f0dc814af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.722+0000 7f0dccfe5640 1 -- 172.21.15.37:0/2765198111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dc8145160 msgr2=0x7f0dc81416c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.722+0000 7f0dccfe5640 1 --2- 172.21.15.37:0/2765198111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dc8145160 0x7f0dc81416c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.722+0000 7f0dccfe5640 1 -- 172.21.15.37:0/2765198111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc0009a70 con 0x7f0dc806c990 2023-12-19T17:49:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.722+0000 7f0dccfe5640 1 --2- 172.21.15.37:0/2765198111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc806c990 0x7f0dc81e2f50 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0dc400c500 tx=0x7f0dc400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.722+0000 7f0dbdffb640 1 -- 172.21.15.37:0/2765198111 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4005ce0 con 0x7f0dc806c990 2023-12-19T17:49:51.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.722+0000 7f0dcfa4a640 1 -- 172.21.15.37:0/2765198111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db8009400 con 0x7f0dc806c990 2023-12-19T17:49:51.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.722+0000 7f0dbdffb640 1 -- 172.21.15.37:0/2765198111 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc4005e40 con 0x7f0dc806c990 2023-12-19T17:49:51.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.722+0000 7f0dbdffb640 1 -- 172.21.15.37:0/2765198111 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4007310 con 0x7f0dc806c990 2023-12-19T17:49:51.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.722+0000 7f0dcfa4a640 1 -- 172.21.15.37:0/2765198111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc81e3490 con 0x7f0dc806c990 2023-12-19T17:49:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.723+0000 7f0dcfa4a640 1 -- 172.21.15.37:0/2765198111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc80740a0 con 0x7f0dc806c990 2023-12-19T17:49:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.724+0000 7f0dbdffb640 1 -- 172.21.15.37:0/2765198111 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0dc4007470 con 0x7f0dc806c990 2023-12-19T17:49:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.724+0000 7f0dbdffb640 1 --2- 172.21.15.37:0/2765198111 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0dac06a460 0x7f0dac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.725+0000 7f0dbdffb640 1 -- 172.21.15.37:0/2765198111 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0dc4087e60 con 0x7f0dc806c990 2023-12-19T17:49:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.725+0000 7f0dcd7e6640 1 --2- 172.21.15.37:0/2765198111 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0dac06a460 0x7f0dac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:51.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.725+0000 7f0dcd7e6640 1 --2- 172.21.15.37:0/2765198111 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0dac06a460 0x7f0dac06c920 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0db8036000 tx=0x7f0db803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:51.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.729+0000 7f0dbdffb640 1 -- 172.21.15.37:0/2765198111 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0dc4053540 con 0x7f0dc806c990 2023-12-19T17:49:51.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.905+0000 7f0dcfa4a640 1 -- 172.21.15.37:0/2765198111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0dc80b8e70 con 0x7f0dc806c990 2023-12-19T17:49:51.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.905+0000 7f0dbdffb640 1 -- 172.21.15.37:0/2765198111 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0dc4056b60 con 0x7f0dc806c990 2023-12-19T17:49:51.906 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-19T17:49:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.907+0000 7f0dcfa4a640 1 -- 172.21.15.37:0/2765198111 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0dac06a460 msgr2=0x7f0dac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.907+0000 7f0dcfa4a640 1 --2- 172.21.15.37:0/2765198111 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0dac06a460 0x7f0dac06c920 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0db8036000 tx=0x7f0db803c040 comp rx=0 tx=0).stop 2023-12-19T17:49:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.907+0000 7f0dcfa4a640 1 -- 172.21.15.37:0/2765198111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc806c990 msgr2=0x7f0dc81e2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.907+0000 7f0dcfa4a640 1 --2- 172.21.15.37:0/2765198111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc806c990 0x7f0dc81e2f50 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0dc400c500 tx=0x7f0dc400c900 comp rx=0 tx=0).stop 2023-12-19T17:49:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.907+0000 7f0dcfa4a640 1 -- 172.21.15.37:0/2765198111 shutdown_connections 2023-12-19T17:49:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.907+0000 7f0dcfa4a640 1 --2- 172.21.15.37:0/2765198111 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0dac06a460 0x7f0dac06c920 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.907+0000 7f0dcfa4a640 1 --2- 172.21.15.37:0/2765198111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dc8145160 0x7f0dc81416c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.907+0000 7f0dcfa4a640 1 --2- 172.21.15.37:0/2765198111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc806c990 0x7f0dc81e2f50 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.907+0000 7f0dcfa4a640 1 --2- 172.21.15.37:0/2765198111 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0dc806acb0 0x7f0dc814af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.907+0000 7f0dcfa4a640 1 -- 172.21.15.37:0/2765198111 >> 172.21.15.37:0/2765198111 conn(0x7f0dc80be0c0 msgr2=0x7f0dc814c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:51.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.907+0000 7f0dcfa4a640 1 -- 172.21.15.37:0/2765198111 shutdown_connections 2023-12-19T17:49:51.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:51.907+0000 7f0dcfa4a640 1 -- 172.21.15.37:0/2765198111 wait complete. 2023-12-19T17:49:51.918 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:49:52.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.027+0000 7fe31f221640 1 Processor -- start 2023-12-19T17:49:52.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.027+0000 7fe31f221640 1 -- start start 2023-12-19T17:49:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.027+0000 7fe31f221640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe318142d90 0x7fe3180baad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.027+0000 7fe31f221640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3180b1f60 0x7fe3180b9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.027+0000 7fe31f221640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe3180b23a0 0x7fe3180b9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.027+0000 7fe31f221640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3180b3bd0 con 0x7fe318142d90 2023-12-19T17:49:52.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.027+0000 7fe31f221640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3180b4430 con 0x7fe3180b23a0 2023-12-19T17:49:52.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.027+0000 7fe31f221640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3180bb010 con 0x7fe3180b1f60 2023-12-19T17:49:52.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.028+0000 7fe31cfbd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe318142d90 0x7fe3180baad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.028+0000 7fe31cfbd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe318142d90 0x7fe3180baad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55054/0 (socket says 172.21.15.37:55054) 2023-12-19T17:49:52.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.028+0000 7fe31cfbd640 1 -- 172.21.15.37:0/1458699737 learned_addr learned my addr 172.21.15.37:0/1458699737 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:52.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.028+0000 7fe317fff640 1 --2- 172.21.15.37:0/1458699737 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3180b1f60 0x7fe3180b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.028+0000 7fe31d7be640 1 --2- 172.21.15.37:0/1458699737 >> v2:172.21.15.78:3300/0 conn(0x7fe3180b23a0 0x7fe3180b9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.028+0000 7fe31cfbd640 1 -- 172.21.15.37:0/1458699737 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3180b1f60 msgr2=0x7fe3180b9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:52.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.028+0000 7fe31cfbd640 1 --2- 172.21.15.37:0/1458699737 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3180b1f60 0x7fe3180b9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.028+0000 7fe31cfbd640 1 -- 172.21.15.37:0/1458699737 >> v2:172.21.15.78:3300/0 conn(0x7fe3180b23a0 msgr2=0x7fe3180b9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:52.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.028+0000 7fe31cfbd640 1 --2- 172.21.15.37:0/1458699737 >> v2:172.21.15.78:3300/0 conn(0x7fe3180b23a0 0x7fe3180b9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.028+0000 7fe31cfbd640 1 -- 172.21.15.37:0/1458699737 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe318143170 con 0x7fe318142d90 2023-12-19T17:49:52.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.029+0000 7fe31cfbd640 1 --2- 172.21.15.37:0/1458699737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe318142d90 0x7fe3180baad0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fe3180b8d60 tx=0x7fe30c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521a28991e57620a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:52.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.029+0000 7fe3177fe640 1 -- 172.21.15.37:0/1458699737 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c030860 con 0x7fe318142d90 2023-12-19T17:49:52.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.029+0000 7fe3177fe640 1 -- 172.21.15.37:0/1458699737 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c0309c0 con 0x7fe318142d90 2023-12-19T17:49:52.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.029+0000 7fe3177fe640 1 -- 172.21.15.37:0/1458699737 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c030d50 con 0x7fe318142d90 2023-12-19T17:49:52.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.029+0000 7fe31f221640 1 -- 172.21.15.37:0/1458699737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe318142d90 msgr2=0x7fe3180baad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.029+0000 7fe31f221640 1 --2- 172.21.15.37:0/1458699737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe318142d90 0x7fe3180baad0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fe3180b8d60 tx=0x7fe30c02b9a0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.029+0000 7fe31f221640 1 -- 172.21.15.37:0/1458699737 shutdown_connections 2023-12-19T17:49:52.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.029+0000 7fe31f221640 1 --2- 172.21.15.37:0/1458699737 >> v2:172.21.15.78:3300/0 conn(0x7fe3180b23a0 0x7fe3180b9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.029+0000 7fe31f221640 1 --2- 172.21.15.37:0/1458699737 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe3180b1f60 0x7fe3180b9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.029+0000 7fe31f221640 1 --2- 172.21.15.37:0/1458699737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe318142d90 0x7fe3180baad0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.029+0000 7fe31f221640 1 -- 172.21.15.37:0/1458699737 >> 172.21.15.37:0/1458699737 conn(0x7fe3180be0c0 msgr2=0x7fe3180be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:52.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.030+0000 7fe31f221640 1 -- 172.21.15.37:0/1458699737 shutdown_connections 2023-12-19T17:49:52.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.030+0000 7fe31f221640 1 -- 172.21.15.37:0/1458699737 wait complete. 2023-12-19T17:49:52.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.031+0000 7fe31f221640 1 Processor -- start 2023-12-19T17:49:52.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.031+0000 7fe31f221640 1 -- start start 2023-12-19T17:49:52.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.031+0000 7fe31f221640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3180b1f60 0x7fe3180b6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.031+0000 7fe31f221640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3180b23a0 0x7fe31814c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.031+0000 7fe31f221640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe318142d90 0x7fe3180b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.031+0000 7fe31f221640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31814cb40 con 0x7fe3180b1f60 2023-12-19T17:49:52.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.031+0000 7fe31f221640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3180b79b0 con 0x7fe3180b23a0 2023-12-19T17:49:52.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.031+0000 7fe31f221640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3180b62a0 con 0x7fe318142d90 2023-12-19T17:49:52.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.031+0000 7fe31cfbd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3180b1f60 0x7fe3180b6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.031+0000 7fe31cfbd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3180b1f60 0x7fe3180b6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55068/0 (socket says 172.21.15.37:55068) 2023-12-19T17:49:52.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.032+0000 7fe31cfbd640 1 -- 172.21.15.37:0/2685395207 learned_addr learned my addr 172.21.15.37:0/2685395207 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:52.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.032+0000 7fe317fff640 1 --2- 172.21.15.37:0/2685395207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3180b23a0 0x7fe31814c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.032+0000 7fe31d7be640 1 --2- 172.21.15.37:0/2685395207 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe318142d90 0x7fe3180b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.032+0000 7fe31cfbd640 1 -- 172.21.15.37:0/2685395207 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe318142d90 msgr2=0x7fe3180b5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.032+0000 7fe31cfbd640 1 --2- 172.21.15.37:0/2685395207 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe318142d90 0x7fe3180b5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.032+0000 7fe31cfbd640 1 -- 172.21.15.37:0/2685395207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3180b23a0 msgr2=0x7fe31814c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.032+0000 7fe31cfbd640 1 --2- 172.21.15.37:0/2685395207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3180b23a0 0x7fe31814c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.032+0000 7fe31cfbd640 1 -- 172.21.15.37:0/2685395207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c0094d0 con 0x7fe3180b1f60 2023-12-19T17:49:52.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.032+0000 7fe31d7be640 1 --2- 172.21.15.37:0/2685395207 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe318142d90 0x7fe3180b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:49:52.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.032+0000 7fe317fff640 1 --2- 172.21.15.37:0/2685395207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3180b23a0 0x7fe31814c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:49:52.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.032+0000 7fe31cfbd640 1 --2- 172.21.15.37:0/2685395207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3180b1f60 0x7fe3180b6bb0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fe30c02b9e0 tx=0x7fe30c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:52.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.032+0000 7fe3157fa640 1 -- 172.21.15.37:0/2685395207 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c039c90 con 0x7fe3180b1f60 2023-12-19T17:49:52.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.032+0000 7fe3157fa640 1 -- 172.21.15.37:0/2685395207 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c039e10 con 0x7fe3180b1f60 2023-12-19T17:49:52.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.032+0000 7fe31f221640 1 -- 172.21.15.37:0/2685395207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3180b7290 con 0x7fe3180b1f60 2023-12-19T17:49:52.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.032+0000 7fe3157fa640 1 -- 172.21.15.37:0/2685395207 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c043640 con 0x7fe3180b1f60 2023-12-19T17:49:52.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.032+0000 7fe31f221640 1 -- 172.21.15.37:0/2685395207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3180b5560 con 0x7fe3180b1f60 2023-12-19T17:49:52.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.033+0000 7fe31f221640 1 -- 172.21.15.37:0/2685395207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3180b2fc0 con 0x7fe3180b1f60 2023-12-19T17:49:52.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.034+0000 7fe3157fa640 1 -- 172.21.15.37:0/2685395207 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe30c0437a0 con 0x7fe3180b1f60 2023-12-19T17:49:52.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.034+0000 7fe3157fa640 1 --2- 172.21.15.37:0/2685395207 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe2fc06a430 0x7fe2fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.034+0000 7fe3157fa640 1 -- 172.21.15.37:0/2685395207 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe30c03e070 con 0x7fe3180b1f60 2023-12-19T17:49:52.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.034+0000 7fe317fff640 1 --2- 172.21.15.37:0/2685395207 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe2fc06a430 0x7fe2fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.035+0000 7fe317fff640 1 --2- 172.21.15.37:0/2685395207 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe2fc06a430 0x7fe2fc06c8f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe3181411a0 tx=0x7fe304008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:52.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.038+0000 7fe3157fa640 1 -- 172.21.15.37:0/2685395207 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe30c076f70 con 0x7fe3180b1f60 2023-12-19T17:49:52.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.215+0000 7fe31f221640 1 -- 172.21.15.37:0/2685395207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe3180740a0 con 0x7fe3180b1f60 2023-12-19T17:49:52.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.216+0000 7fe3157fa640 1 -- 172.21.15.37:0/2685395207 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe30c034020 con 0x7fe3180b1f60 2023-12-19T17:49:52.217 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-19T17:49:52.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.218+0000 7fe31f221640 1 -- 172.21.15.37:0/2685395207 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe2fc06a430 msgr2=0x7fe2fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.218+0000 7fe31f221640 1 --2- 172.21.15.37:0/2685395207 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe2fc06a430 0x7fe2fc06c8f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe3181411a0 tx=0x7fe304008040 comp rx=0 tx=0).stop 2023-12-19T17:49:52.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.218+0000 7fe31f221640 1 -- 172.21.15.37:0/2685395207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3180b1f60 msgr2=0x7fe3180b6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.218+0000 7fe31f221640 1 --2- 172.21.15.37:0/2685395207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3180b1f60 0x7fe3180b6bb0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fe30c02b9e0 tx=0x7fe30c004730 comp rx=0 tx=0).stop 2023-12-19T17:49:52.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.218+0000 7fe31f221640 1 -- 172.21.15.37:0/2685395207 shutdown_connections 2023-12-19T17:49:52.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.218+0000 7fe31f221640 1 --2- 172.21.15.37:0/2685395207 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fe2fc06a430 0x7fe2fc06c8f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.218+0000 7fe31f221640 1 --2- 172.21.15.37:0/2685395207 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe318142d90 0x7fe3180b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.218+0000 7fe31f221640 1 --2- 172.21.15.37:0/2685395207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3180b23a0 0x7fe31814c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.218+0000 7fe31f221640 1 --2- 172.21.15.37:0/2685395207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3180b1f60 0x7fe3180b6bb0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.218+0000 7fe31f221640 1 -- 172.21.15.37:0/2685395207 >> 172.21.15.37:0/2685395207 conn(0x7fe3180be0c0 msgr2=0x7fe31813e770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:52.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.218+0000 7fe31f221640 1 -- 172.21.15.37:0/2685395207 shutdown_connections 2023-12-19T17:49:52.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.218+0000 7fe31f221640 1 -- 172.21.15.37:0/2685395207 wait complete. 2023-12-19T17:49:52.229 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:49:52.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.338+0000 7fcecf0f7640 1 Processor -- start 2023-12-19T17:49:52.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.338+0000 7fcecf0f7640 1 -- start start 2023-12-19T17:49:52.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.338+0000 7fcecf0f7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcec80b5040 0x7fcec80b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.339+0000 7fcecf0f7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcec80b3bc0 0x7fcec80b4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.339+0000 7fcecf0f7640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec80b8f80 con 0x7fcec806ae20 2023-12-19T17:49:52.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.339+0000 7fcecf0f7640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec80b8d70 con 0x7fcec80b3bc0 2023-12-19T17:49:52.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.339+0000 7fcecf0f7640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcec81463a0 con 0x7fcec80b5040 2023-12-19T17:49:52.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.339+0000 7fcecce93640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcec806ae20 0x7fcec8145c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33282/0 (socket says 172.21.15.37:33282) 2023-12-19T17:49:52.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.339+0000 7fcecce93640 1 -- 172.21.15.37:0/3002972196 learned_addr learned my addr 172.21.15.37:0/3002972196 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:49:52.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.339+0000 7fcecd694640 1 --2- 172.21.15.37:0/3002972196 >> v2:172.21.15.37:3300/0 conn(0x7fcec80b3bc0 0x7fcec80b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.339+0000 7fcec7fff640 1 --2- 172.21.15.37:0/3002972196 >> v2:172.21.15.78:3300/0 conn(0x7fcec80b5040 0x7fcec80b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.339+0000 7fcec77fe640 1 -- 172.21.15.37:0/3002972196 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473038262 0 0) 0x7fcec80b8f80 con 0x7fcec806ae20 2023-12-19T17:49:52.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.339+0000 7fcec77fe640 1 -- 172.21.15.37:0/3002972196 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceb8003520 con 0x7fcec806ae20 2023-12-19T17:49:52.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.339+0000 7fcecd694640 1 -- 172.21.15.37:0/3002972196 >> v2:172.21.15.78:3300/0 conn(0x7fcec80b5040 msgr2=0x7fcec80b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:52.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.339+0000 7fcecd694640 1 --2- 172.21.15.37:0/3002972196 >> v2:172.21.15.78:3300/0 conn(0x7fcec80b5040 0x7fcec80b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.339+0000 7fcecd694640 1 -- 172.21.15.37:0/3002972196 >> v1:172.21.15.37:6789/0 conn(0x7fcec806ae20 legacy=0x7fcec8145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.339+0000 7fcecd694640 1 -- 172.21.15.37:0/3002972196 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec80b5990 con 0x7fcec80b3bc0 2023-12-19T17:49:52.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.340+0000 7fcecd694640 1 --2- 172.21.15.37:0/3002972196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec80b3bc0 0x7fcec80b4010 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fcec80b4b80 tx=0x7fcec002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f6d311555d6836 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:52.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.340+0000 7fcec77fe640 1 -- 172.21.15.37:0/3002972196 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec002cd00 con 0x7fcec80b3bc0 2023-12-19T17:49:52.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.340+0000 7fcec77fe640 1 -- 172.21.15.37:0/3002972196 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec002ce60 con 0x7fcec80b3bc0 2023-12-19T17:49:52.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.340+0000 7fcec77fe640 1 -- 172.21.15.37:0/3002972196 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec0034640 con 0x7fcec80b3bc0 2023-12-19T17:49:52.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.340+0000 7fcecf0f7640 1 -- 172.21.15.37:0/3002972196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec80b3bc0 msgr2=0x7fcec80b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.340+0000 7fcecf0f7640 1 --2- 172.21.15.37:0/3002972196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec80b3bc0 0x7fcec80b4010 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fcec80b4b80 tx=0x7fcec002bf50 comp rx=0 tx=0).stop 2023-12-19T17:49:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.341+0000 7fcecf0f7640 1 -- 172.21.15.37:0/3002972196 shutdown_connections 2023-12-19T17:49:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.341+0000 7fcecf0f7640 1 --2- 172.21.15.37:0/3002972196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec80b3bc0 0x7fcec80b4010 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.341+0000 7fcecf0f7640 1 --2- 172.21.15.37:0/3002972196 >> v2:172.21.15.78:3300/0 conn(0x7fcec80b5040 0x7fcec80b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.341+0000 7fcecf0f7640 1 -- 172.21.15.37:0/3002972196 >> 172.21.15.37:0/3002972196 conn(0x7fcec80b91b0 msgr2=0x7fcec80b95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.341+0000 7fcecf0f7640 1 -- 172.21.15.37:0/3002972196 shutdown_connections 2023-12-19T17:49:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.341+0000 7fcecf0f7640 1 -- 172.21.15.37:0/3002972196 wait complete. 2023-12-19T17:49:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.342+0000 7fcecf0f7640 1 Processor -- start 2023-12-19T17:49:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.342+0000 7fcecf0f7640 1 -- start start 2023-12-19T17:49:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.342+0000 7fcecf0f7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcec806ae20 0x7fcec814c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.342+0000 7fcecf0f7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec80b3bc0 0x7fcec80b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.342+0000 7fcecf0f7640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcec80b5040 0x7fcec80b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.342+0000 7fcecf0f7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec814c5b0 con 0x7fcec80b3bc0 2023-12-19T17:49:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.342+0000 7fcecf0f7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec814ca80 con 0x7fcec806ae20 2023-12-19T17:49:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.342+0000 7fcecf0f7640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec80b01b0 con 0x7fcec80b5040 2023-12-19T17:49:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.343+0000 7fcec7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec80b3bc0 0x7fcec80b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.343+0000 7fcec7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec80b3bc0 0x7fcec80b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55084/0 (socket says 172.21.15.37:55084) 2023-12-19T17:49:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.343+0000 7fcec7fff640 1 -- 172.21.15.37:0/2507561980 learned_addr learned my addr 172.21.15.37:0/2507561980 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.343+0000 7fcecce93640 1 --2- 172.21.15.37:0/2507561980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcec806ae20 0x7fcec814c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.343+0000 7fcecd694640 1 --2- 172.21.15.37:0/2507561980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcec80b5040 0x7fcec80b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.343+0000 7fcec7fff640 1 -- 172.21.15.37:0/2507561980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcec80b5040 msgr2=0x7fcec80b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.343+0000 7fcec7fff640 1 --2- 172.21.15.37:0/2507561980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcec80b5040 0x7fcec80b1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.343+0000 7fcec7fff640 1 -- 172.21.15.37:0/2507561980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcec806ae20 msgr2=0x7fcec814c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.343+0000 7fcec7fff640 1 --2- 172.21.15.37:0/2507561980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcec806ae20 0x7fcec814c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.343+0000 7fcec7fff640 1 -- 172.21.15.37:0/2507561980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec0009a70 con 0x7fcec80b3bc0 2023-12-19T17:49:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.343+0000 7fcecd694640 1 --2- 172.21.15.37:0/2507561980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcec80b5040 0x7fcec80b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:49:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.343+0000 7fcec7fff640 1 --2- 172.21.15.37:0/2507561980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec80b3bc0 0x7fcec80b10c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fceb400e870 tx=0x7fceb400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.343+0000 7fcec57fa640 1 -- 172.21.15.37:0/2507561980 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb40094f0 con 0x7fcec80b3bc0 2023-12-19T17:49:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.343+0000 7fcec57fa640 1 -- 172.21.15.37:0/2507561980 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb400c940 con 0x7fcec80b3bc0 2023-12-19T17:49:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.343+0000 7fcecf0f7640 1 -- 172.21.15.37:0/2507561980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec80b0400 con 0x7fcec80b3bc0 2023-12-19T17:49:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.343+0000 7fcec57fa640 1 -- 172.21.15.37:0/2507561980 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb400ccf0 con 0x7fcec80b3bc0 2023-12-19T17:49:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.343+0000 7fcecf0f7640 1 -- 172.21.15.37:0/2507561980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec8149750 con 0x7fcec80b3bc0 2023-12-19T17:49:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.344+0000 7fcecf0f7640 1 -- 172.21.15.37:0/2507561980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec80b0920 con 0x7fcec80b3bc0 2023-12-19T17:49:52.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.345+0000 7fcec57fa640 1 -- 172.21.15.37:0/2507561980 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fceb4013470 con 0x7fcec80b3bc0 2023-12-19T17:49:52.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.345+0000 7fcec57fa640 1 --2- 172.21.15.37:0/2507561980 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fceac06a430 0x7fceac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.345+0000 7fcec57fa640 1 -- 172.21.15.37:0/2507561980 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fceb4088920 con 0x7fcec80b3bc0 2023-12-19T17:49:52.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.346+0000 7fcecce93640 1 --2- 172.21.15.37:0/2507561980 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fceac06a430 0x7fceac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.346+0000 7fcecce93640 1 --2- 172.21.15.37:0/2507561980 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fceac06a430 0x7fceac06c8f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcebc005880 tx=0x7fcebc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:52.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.353+0000 7fcec57fa640 1 -- 172.21.15.37:0/2507561980 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcec80b0920 con 0x7fcec80b3bc0 2023-12-19T17:49:52.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.529+0000 7fcecf0f7640 1 -- 172.21.15.37:0/2507561980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcec80b0920 con 0x7fcec80b3bc0 2023-12-19T17:49:52.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.529+0000 7fcec57fa640 1 -- 172.21.15.37:0/2507561980 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcec80b0920 con 0x7fcec80b3bc0 2023-12-19T17:49:52.530 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-19T17:49:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.531+0000 7fcecf0f7640 1 -- 172.21.15.37:0/2507561980 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fceac06a430 msgr2=0x7fceac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.531+0000 7fcecf0f7640 1 --2- 172.21.15.37:0/2507561980 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fceac06a430 0x7fceac06c8f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcebc005880 tx=0x7fcebc009040 comp rx=0 tx=0).stop 2023-12-19T17:49:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.531+0000 7fcecf0f7640 1 -- 172.21.15.37:0/2507561980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec80b3bc0 msgr2=0x7fcec80b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.531+0000 7fcecf0f7640 1 --2- 172.21.15.37:0/2507561980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec80b3bc0 0x7fcec80b10c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fceb400e870 tx=0x7fceb400ed30 comp rx=0 tx=0).stop 2023-12-19T17:49:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.531+0000 7fcecf0f7640 1 -- 172.21.15.37:0/2507561980 shutdown_connections 2023-12-19T17:49:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.531+0000 7fcecf0f7640 1 --2- 172.21.15.37:0/2507561980 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fceac06a430 0x7fceac06c8f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.531+0000 7fcecf0f7640 1 --2- 172.21.15.37:0/2507561980 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcec80b5040 0x7fcec80b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.531+0000 7fcecf0f7640 1 --2- 172.21.15.37:0/2507561980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec80b3bc0 0x7fcec80b10c0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.531+0000 7fcecf0f7640 1 --2- 172.21.15.37:0/2507561980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcec806ae20 0x7fcec814c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.531+0000 7fcecf0f7640 1 -- 172.21.15.37:0/2507561980 >> 172.21.15.37:0/2507561980 conn(0x7fcec80b91b0 msgr2=0x7fcec80b79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:52.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.531+0000 7fcecf0f7640 1 -- 172.21.15.37:0/2507561980 shutdown_connections 2023-12-19T17:49:52.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.531+0000 7fcecf0f7640 1 -- 172.21.15.37:0/2507561980 wait complete. 2023-12-19T17:49:52.542 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:49:52.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.648+0000 7f36e8916640 1 Processor -- start 2023-12-19T17:49:52.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.648+0000 7f36e8916640 1 -- start start 2023-12-19T17:49:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.648+0000 7f36e8916640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f36e40b68d0 0x7f36e4071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.648+0000 7f36e8916640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36e406aca0 0x7f36e406b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.648+0000 7f36e8916640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e4070660 con 0x7f36e41425b0 2023-12-19T17:49:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.648+0000 7f36e8916640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e406b640 con 0x7f36e40b68d0 2023-12-19T17:49:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.648+0000 7f36e8916640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e406fc10 con 0x7f36e406aca0 2023-12-19T17:49:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.649+0000 7f36e259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f36e40b68d0 0x7f36e4071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.649+0000 7f36e259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f36e40b68d0 0x7f36e4071100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55092/0 (socket says 172.21.15.37:55092) 2023-12-19T17:49:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.649+0000 7f36e259c640 1 -- 172.21.15.37:0/3449820423 learned_addr learned my addr 172.21.15.37:0/3449820423 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.649+0000 7f36dbfff640 1 --2- 172.21.15.37:0/3449820423 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36e406aca0 0x7f36e406b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.649+0000 7f36e259c640 1 -- 172.21.15.37:0/3449820423 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36e406aca0 msgr2=0x7f36e406b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.649+0000 7f36e259c640 1 --2- 172.21.15.37:0/3449820423 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36e406aca0 0x7f36e406b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.649+0000 7f36e259c640 1 -- 172.21.15.37:0/3449820423 >> v1:172.21.15.78:6789/0 conn(0x7f36e41425b0 legacy=0x7f36e40b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.649+0000 7f36e259c640 1 -- 172.21.15.37:0/3449820423 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e406a8f0 con 0x7f36e40b68d0 2023-12-19T17:49:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.650+0000 7f36e259c640 1 --2- 172.21.15.37:0/3449820423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e40b68d0 0x7f36e4071100 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009870 tx=0x7f36d402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78ed74e677ad5ca server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.650+0000 7f36e1d9b640 1 -- 172.21.15.37:0/3449820423 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4030840 con 0x7f36e40b68d0 2023-12-19T17:49:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.650+0000 7f36e1d9b640 1 -- 172.21.15.37:0/3449820423 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d40309a0 con 0x7f36e40b68d0 2023-12-19T17:49:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.650+0000 7f36e1d9b640 1 -- 172.21.15.37:0/3449820423 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4030d30 con 0x7f36e40b68d0 2023-12-19T17:49:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.650+0000 7f36e8916640 1 -- 172.21.15.37:0/3449820423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e40b68d0 msgr2=0x7f36e4071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.650+0000 7f36e8916640 1 --2- 172.21.15.37:0/3449820423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e40b68d0 0x7f36e4071100 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009870 tx=0x7f36d402b980 comp rx=0 tx=0).stop 2023-12-19T17:49:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.650+0000 7f36e8916640 1 -- 172.21.15.37:0/3449820423 shutdown_connections 2023-12-19T17:49:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.650+0000 7f36e8916640 1 --2- 172.21.15.37:0/3449820423 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36e406aca0 0x7f36e406b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.650+0000 7f36e8916640 1 --2- 172.21.15.37:0/3449820423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e40b68d0 0x7f36e4071100 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.650+0000 7f36e8916640 1 -- 172.21.15.37:0/3449820423 >> 172.21.15.37:0/3449820423 conn(0x7f36e40b9c30 msgr2=0x7f36e40ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.650+0000 7f36e8916640 1 -- 172.21.15.37:0/3449820423 shutdown_connections 2023-12-19T17:49:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.650+0000 7f36e8916640 1 -- 172.21.15.37:0/3449820423 wait complete. 2023-12-19T17:49:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.652+0000 7f36e8916640 1 Processor -- start 2023-12-19T17:49:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.652+0000 7f36e8916640 1 -- start start 2023-12-19T17:49:52.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.652+0000 7f36e8916640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36e406aca0 0x7f36e4145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.652+0000 7f36e8916640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e40b68d0 0x7f36e413c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.652+0000 7f36e8916640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36e41425b0 0x7f36e413c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.652+0000 7f36e8916640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e4145f50 con 0x7f36e40b68d0 2023-12-19T17:49:52.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.652+0000 7f36e8916640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e41d0310 con 0x7f36e41425b0 2023-12-19T17:49:52.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.652+0000 7f36e8916640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e41cf5a0 con 0x7f36e406aca0 2023-12-19T17:49:52.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.652+0000 7f36dbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e40b68d0 0x7f36e413c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.652+0000 7f36dbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e40b68d0 0x7f36e413c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55104/0 (socket says 172.21.15.37:55104) 2023-12-19T17:49:52.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.652+0000 7f36dbfff640 1 -- 172.21.15.37:0/1984838130 learned_addr learned my addr 172.21.15.37:0/1984838130 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:52.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.653+0000 7f36dbfff640 1 -- 172.21.15.37:0/1984838130 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36e406aca0 msgr2=0x7f36e4145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.653+0000 7f36e259c640 1 --2- 172.21.15.37:0/1984838130 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36e406aca0 0x7f36e4145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.653+0000 7f36e2d9d640 1 --2- 172.21.15.37:0/1984838130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36e41425b0 0x7f36e413c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.653+0000 7f36dbfff640 1 --2- 172.21.15.37:0/1984838130 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36e406aca0 0x7f36e4145a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.653+0000 7f36dbfff640 1 -- 172.21.15.37:0/1984838130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36e41425b0 msgr2=0x7f36e413c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.653+0000 7f36dbfff640 1 --2- 172.21.15.37:0/1984838130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36e41425b0 0x7f36e413c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.653+0000 7f36dbfff640 1 -- 172.21.15.37:0/1984838130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d40094d0 con 0x7f36e40b68d0 2023-12-19T17:49:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.653+0000 7f36dbfff640 1 --2- 172.21.15.37:0/1984838130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e40b68d0 0x7f36e413c2c0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f36cc00d800 tx=0x7f36cc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.653+0000 7f36daffd640 1 -- 172.21.15.37:0/1984838130 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc00b6c0 con 0x7f36e40b68d0 2023-12-19T17:49:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.653+0000 7f36daffd640 1 -- 172.21.15.37:0/1984838130 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc00b840 con 0x7f36e40b68d0 2023-12-19T17:49:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.653+0000 7f36daffd640 1 -- 172.21.15.37:0/1984838130 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc00bbf0 con 0x7f36e40b68d0 2023-12-19T17:49:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.653+0000 7f36e8916640 1 -- 172.21.15.37:0/1984838130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e4146340 con 0x7f36e40b68d0 2023-12-19T17:49:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.653+0000 7f36e8916640 1 -- 172.21.15.37:0/1984838130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e41cfb00 con 0x7f36e40b68d0 2023-12-19T17:49:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.654+0000 7f36e8916640 1 -- 172.21.15.37:0/1984838130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e41cecb0 con 0x7f36e40b68d0 2023-12-19T17:49:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.655+0000 7f36daffd640 1 -- 172.21.15.37:0/1984838130 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f36cc00bd50 con 0x7f36e40b68d0 2023-12-19T17:49:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.655+0000 7f36daffd640 1 --2- 172.21.15.37:0/1984838130 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f36c406a430 0x7f36c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.655+0000 7f36daffd640 1 -- 172.21.15.37:0/1984838130 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36cc088d20 con 0x7f36e40b68d0 2023-12-19T17:49:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.655+0000 7f36e259c640 1 --2- 172.21.15.37:0/1984838130 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f36c406a430 0x7f36c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.656+0000 7f36e259c640 1 --2- 172.21.15.37:0/1984838130 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f36c406a430 0x7f36c406c8f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f36d4036000 tx=0x7f36d403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:52.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.659+0000 7f36daffd640 1 -- 172.21.15.37:0/1984838130 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f36e41cecb0 con 0x7f36e40b68d0 2023-12-19T17:49:52.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.871+0000 7f36e8916640 1 -- 172.21.15.37:0/1984838130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36e41cec80 con 0x7f36e40b68d0 2023-12-19T17:49:52.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.872+0000 7f36daffd640 1 -- 172.21.15.37:0/1984838130 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3946 (secure 0 0 0) 0x7f36cc054310 con 0x7f36e40b68d0 2023-12-19T17:49:52.872 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T17:49:52.872 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/19970234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":19970234},{"type":"v1","addr":"172.21.15.37:6834","nonce":19970234}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2974397450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2974397450},{"type":"v1","addr":"172.21.15.78:6835","nonce":2974397450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:07:41.897266+0000","modified":"2023-12-19T16:07:43.904067+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1604445250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1604445250},{"type":"v1","addr":"172.21.15.37:6835","nonce":1604445250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:49:52.872 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 13 2023-12-19T17:49:52.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.873+0000 7f36e8916640 1 -- 172.21.15.37:0/1984838130 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f36c406a430 msgr2=0x7f36c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.873+0000 7f36e8916640 1 --2- 172.21.15.37:0/1984838130 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f36c406a430 0x7f36c406c8f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f36d4036000 tx=0x7f36d403b040 comp rx=0 tx=0).stop 2023-12-19T17:49:52.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.873+0000 7f36e8916640 1 -- 172.21.15.37:0/1984838130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e40b68d0 msgr2=0x7f36e413c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.873+0000 7f36e8916640 1 --2- 172.21.15.37:0/1984838130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e40b68d0 0x7f36e413c2c0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f36cc00d800 tx=0x7f36cc00dcc0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.873+0000 7f36e8916640 1 -- 172.21.15.37:0/1984838130 shutdown_connections 2023-12-19T17:49:52.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.873+0000 7f36e8916640 1 --2- 172.21.15.37:0/1984838130 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f36c406a430 0x7f36c406c8f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.873+0000 7f36e8916640 1 --2- 172.21.15.37:0/1984838130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f36e41425b0 0x7f36e413c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.873+0000 7f36e8916640 1 --2- 172.21.15.37:0/1984838130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e40b68d0 0x7f36e413c2c0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.873+0000 7f36e8916640 1 --2- 172.21.15.37:0/1984838130 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f36e406aca0 0x7f36e4145a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.873+0000 7f36e8916640 1 -- 172.21.15.37:0/1984838130 >> 172.21.15.37:0/1984838130 conn(0x7f36e40b9c30 msgr2=0x7f36e40b80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.874+0000 7f36e8916640 1 -- 172.21.15.37:0/1984838130 shutdown_connections 2023-12-19T17:49:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.874+0000 7f36e8916640 1 -- 172.21.15.37:0/1984838130 wait complete. 2023-12-19T17:49:52.884 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:49:52.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.990+0000 7f15da5f0640 1 Processor -- start 2023-12-19T17:49:52.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.990+0000 7f15da5f0640 1 -- start start 2023-12-19T17:49:52.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.991+0000 7f15da5f0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15d406af20 0x7f15d406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.991+0000 7f15da5f0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f15d40b3a30 0x7f15d41477d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.991+0000 7f15da5f0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d40711c0 con 0x7f15d4141550 2023-12-19T17:49:52.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.991+0000 7f15da5f0640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d40b4110 con 0x7f15d40b3a30 2023-12-19T17:49:52.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.991+0000 7f15da5f0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d4070370 con 0x7f15d406af20 2023-12-19T17:49:52.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.991+0000 7f15d8b8d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f15d4141550 0x7f15d41419e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33286/0 (socket says 172.21.15.37:33286) 2023-12-19T17:49:52.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.991+0000 7f15d8b8d640 1 -- 172.21.15.37:0/2481199325 learned_addr learned my addr 172.21.15.37:0/2481199325 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:49:52.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.991+0000 7f15d3fff640 1 --2- 172.21.15.37:0/2481199325 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15d406af20 0x7f15d406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.991+0000 7f15d37fe640 1 --2- 172.21.15.37:0/2481199325 >> v2:172.21.15.78:3300/0 conn(0x7f15d40b3a30 0x7f15d41477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.991+0000 7f15d2ffd640 1 -- 172.21.15.37:0/2481199325 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203397026 0 0) 0x7f15d40711c0 con 0x7f15d4141550 2023-12-19T17:49:52.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.991+0000 7f15d2ffd640 1 -- 172.21.15.37:0/2481199325 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15c0003520 con 0x7f15d4141550 2023-12-19T17:49:52.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.992+0000 7f15d3fff640 1 -- 172.21.15.37:0/2481199325 >> v2:172.21.15.78:3300/0 conn(0x7f15d40b3a30 msgr2=0x7f15d41477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:52.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.992+0000 7f15d3fff640 1 --2- 172.21.15.37:0/2481199325 >> v2:172.21.15.78:3300/0 conn(0x7f15d40b3a30 0x7f15d41477d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.992+0000 7f15d3fff640 1 -- 172.21.15.37:0/2481199325 >> v1:172.21.15.37:6789/0 conn(0x7f15d4141550 legacy=0x7f15d41419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.992+0000 7f15d3fff640 1 -- 172.21.15.37:0/2481199325 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d4070b70 con 0x7f15d406af20 2023-12-19T17:49:52.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.992+0000 7f15d37fe640 1 --2- 172.21.15.37:0/2481199325 >> v2:172.21.15.78:3300/0 conn(0x7f15d40b3a30 0x7f15d41477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:49:52.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.992+0000 7f15d3fff640 1 --2- 172.21.15.37:0/2481199325 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15d406af20 0x7f15d406fca0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0097a0 tx=0x7f15bc02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=829b57233e806aa1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:52.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.993+0000 7f15d2ffd640 1 -- 172.21.15.37:0/2481199325 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc030610 con 0x7f15d406af20 2023-12-19T17:49:52.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.993+0000 7f15d2ffd640 1 -- 172.21.15.37:0/2481199325 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc030770 con 0x7f15d406af20 2023-12-19T17:49:52.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.993+0000 7f15d2ffd640 1 -- 172.21.15.37:0/2481199325 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc030ae0 con 0x7f15d406af20 2023-12-19T17:49:52.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.993+0000 7f15da5f0640 1 -- 172.21.15.37:0/2481199325 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15d406af20 msgr2=0x7f15d406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.993+0000 7f15da5f0640 1 --2- 172.21.15.37:0/2481199325 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15d406af20 0x7f15d406fca0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0097a0 tx=0x7f15bc02b960 comp rx=0 tx=0).stop 2023-12-19T17:49:52.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.993+0000 7f15da5f0640 1 -- 172.21.15.37:0/2481199325 shutdown_connections 2023-12-19T17:49:52.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.993+0000 7f15da5f0640 1 --2- 172.21.15.37:0/2481199325 >> v2:172.21.15.78:3300/0 conn(0x7f15d40b3a30 0x7f15d41477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.993+0000 7f15da5f0640 1 --2- 172.21.15.37:0/2481199325 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15d406af20 0x7f15d406fca0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.993+0000 7f15da5f0640 1 -- 172.21.15.37:0/2481199325 >> 172.21.15.37:0/2481199325 conn(0x7f15d40bcf60 msgr2=0x7f15d40bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:52.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.993+0000 7f15da5f0640 1 -- 172.21.15.37:0/2481199325 shutdown_connections 2023-12-19T17:49:52.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.993+0000 7f15da5f0640 1 -- 172.21.15.37:0/2481199325 wait complete. 2023-12-19T17:49:52.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.994+0000 7f15da5f0640 1 Processor -- start 2023-12-19T17:49:52.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.994+0000 7f15da5f0640 1 -- start start 2023-12-19T17:49:52.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.995+0000 7f15da5f0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d406af20 0x7f15d4142e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.995+0000 7f15da5f0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15d40b3a30 0x7f15d413c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.995+0000 7f15da5f0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15d4141550 0x7f15d41dd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:52.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.995+0000 7f15da5f0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d413c880 con 0x7f15d406af20 2023-12-19T17:49:52.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.995+0000 7f15da5f0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d4142500 con 0x7f15d4141550 2023-12-19T17:49:52.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.995+0000 7f15da5f0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d41d0f60 con 0x7f15d40b3a30 2023-12-19T17:49:52.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.995+0000 7f15d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d406af20 0x7f15d4142e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.995+0000 7f15d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d406af20 0x7f15d4142e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55106/0 (socket says 172.21.15.37:55106) 2023-12-19T17:49:52.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.995+0000 7f15d3fff640 1 -- 172.21.15.37:0/1542151107 learned_addr learned my addr 172.21.15.37:0/1542151107 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:52.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.995+0000 7f15d8b8d640 1 --2- 172.21.15.37:0/1542151107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15d4141550 0x7f15d41dd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.995+0000 7f15d37fe640 1 --2- 172.21.15.37:0/1542151107 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15d40b3a30 0x7f15d413c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:52.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.995+0000 7f15d3fff640 1 -- 172.21.15.37:0/1542151107 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15d40b3a30 msgr2=0x7f15d413c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.995+0000 7f15d3fff640 1 --2- 172.21.15.37:0/1542151107 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15d40b3a30 0x7f15d413c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.996+0000 7f15d3fff640 1 -- 172.21.15.37:0/1542151107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15d4141550 msgr2=0x7f15d41dd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:52.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.996+0000 7f15d3fff640 1 --2- 172.21.15.37:0/1542151107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15d4141550 0x7f15d41dd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:52.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.996+0000 7f15d3fff640 1 -- 172.21.15.37:0/1542151107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c4009400 con 0x7f15d406af20 2023-12-19T17:49:52.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.996+0000 7f15d37fe640 1 --2- 172.21.15.37:0/1542151107 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15d40b3a30 0x7f15d413c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:49:52.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.996+0000 7f15d3fff640 1 --2- 172.21.15.37:0/1542151107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d406af20 0x7f15d4142e40 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0098c0 tx=0x7f15bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:52.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.996+0000 7f15d0ff9640 1 -- 172.21.15.37:0/1542151107 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc03f070 con 0x7f15d406af20 2023-12-19T17:49:52.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.996+0000 7f15d0ff9640 1 -- 172.21.15.37:0/1542151107 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc0044c0 con 0x7f15d406af20 2023-12-19T17:49:52.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.996+0000 7f15d0ff9640 1 -- 172.21.15.37:0/1542151107 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc030ea0 con 0x7f15d406af20 2023-12-19T17:49:52.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.996+0000 7f15da5f0640 1 -- 172.21.15.37:0/1542151107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15bc009400 con 0x7f15d406af20 2023-12-19T17:49:52.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.996+0000 7f15da5f0640 1 -- 172.21.15.37:0/1542151107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d41ddc90 con 0x7f15d406af20 2023-12-19T17:49:52.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.997+0000 7f15da5f0640 1 -- 172.21.15.37:0/1542151107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d404e840 con 0x7f15d406af20 2023-12-19T17:49:53.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.998+0000 7f15d0ff9640 1 -- 172.21.15.37:0/1542151107 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f15bc003830 con 0x7f15d406af20 2023-12-19T17:49:53.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.998+0000 7f15d0ff9640 1 --2- 172.21.15.37:0/1542151107 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f15b406a430 0x7f15b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:53.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.998+0000 7f15d0ff9640 1 -- 172.21.15.37:0/1542151107 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15bc0aa740 con 0x7f15d406af20 2023-12-19T17:49:53.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.998+0000 7f15d37fe640 1 --2- 172.21.15.37:0/1542151107 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f15b406a430 0x7f15b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:53.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:52.999+0000 7f15d37fe640 1 --2- 172.21.15.37:0/1542151107 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f15b406a430 0x7f15b406c8f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f15d413cb20 tx=0x7f15c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:53.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.002+0000 7f15d0ff9640 1 -- 172.21.15.37:0/1542151107 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f15bc075d30 con 0x7f15d406af20 2023-12-19T17:49:53.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.180+0000 7f15da5f0640 1 -- 172.21.15.37:0/1542151107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15d40b3780 con 0x7f15d406af20 2023-12-19T17:49:53.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.181+0000 7f15d0ff9640 1 -- 172.21.15.37:0/1542151107 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16053 (secure 0 0 0) 0x7f15bc079350 con 0x7f15d406af20 2023-12-19T17:49:53.182 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T17:49:53.182 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:07:42.899048+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:07:39.626181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T16:07:40.871535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:49:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.183+0000 7f15da5f0640 1 -- 172.21.15.37:0/1542151107 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f15b406a430 msgr2=0x7f15b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.183+0000 7f15da5f0640 1 --2- 172.21.15.37:0/1542151107 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f15b406a430 0x7f15b406c8f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f15d413cb20 tx=0x7f15c4008040 comp rx=0 tx=0).stop 2023-12-19T17:49:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.183+0000 7f15da5f0640 1 -- 172.21.15.37:0/1542151107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d406af20 msgr2=0x7f15d4142e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.183+0000 7f15da5f0640 1 --2- 172.21.15.37:0/1542151107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d406af20 0x7f15d4142e40 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0098c0 tx=0x7f15bc0046c0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.183+0000 7f15da5f0640 1 -- 172.21.15.37:0/1542151107 shutdown_connections 2023-12-19T17:49:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.183+0000 7f15da5f0640 1 --2- 172.21.15.37:0/1542151107 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f15b406a430 0x7f15b406c8f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.183+0000 7f15da5f0640 1 --2- 172.21.15.37:0/1542151107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15d4141550 0x7f15d41dd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.183+0000 7f15da5f0640 1 --2- 172.21.15.37:0/1542151107 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15d40b3a30 0x7f15d413c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.183+0000 7f15da5f0640 1 --2- 172.21.15.37:0/1542151107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d406af20 0x7f15d4142e40 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.183+0000 7f15da5f0640 1 -- 172.21.15.37:0/1542151107 >> 172.21.15.37:0/1542151107 conn(0x7f15d40bcf60 msgr2=0x7f15d413e690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.183+0000 7f15da5f0640 1 -- 172.21.15.37:0/1542151107 shutdown_connections 2023-12-19T17:49:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.183+0000 7f15da5f0640 1 -- 172.21.15.37:0/1542151107 wait complete. 2023-12-19T17:49:53.195 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T17:49:53.195 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:49:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.301+0000 7f0eddf16640 1 Processor -- start 2023-12-19T17:49:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.301+0000 7f0eddf16640 1 -- start start 2023-12-19T17:49:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.302+0000 7f0eddf16640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ed8070ff0 0x7f0ed8142850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.302+0000 7f0eddf16640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ed8142d90 0x7f0ed81531a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.302+0000 7f0eddf16640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed80b56e0 con 0x7f0ed80b4f90 2023-12-19T17:49:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.302+0000 7f0eddf16640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed80b6d70 con 0x7f0ed8070ff0 2023-12-19T17:49:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.302+0000 7f0eddf16640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed80b59c0 con 0x7f0ed8142d90 2023-12-19T17:49:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.302+0000 7f0ed77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ed8070ff0 0x7f0ed8142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.302+0000 7f0ed6ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0ed80b4f90 0x7f0ed80b78c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33292/0 (socket says 172.21.15.37:33292) 2023-12-19T17:49:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.302+0000 7f0ed6ffd640 1 -- 172.21.15.37:0/706207688 learned_addr learned my addr 172.21.15.37:0/706207688 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:49:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.302+0000 7f0ed7fff640 1 --2- 172.21.15.37:0/706207688 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ed8142d90 0x7f0ed81531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.302+0000 7f0ed77fe640 1 -- 172.21.15.37:0/706207688 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ed8142d90 msgr2=0x7f0ed81531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:53.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.302+0000 7f0ed77fe640 1 --2- 172.21.15.37:0/706207688 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ed8142d90 0x7f0ed81531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.302+0000 7f0ed77fe640 1 -- 172.21.15.37:0/706207688 >> v1:172.21.15.37:6789/0 conn(0x7f0ed80b4f90 legacy=0x7f0ed80b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:53.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.302+0000 7f0ed77fe640 1 -- 172.21.15.37:0/706207688 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed80b5ca0 con 0x7f0ed8070ff0 2023-12-19T17:49:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.303+0000 7f0ed77fe640 1 --2- 172.21.15.37:0/706207688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8070ff0 0x7f0ed8142850 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0097a0 tx=0x7f0ecc02b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bdfec62c4b3fcd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.303+0000 7f0ed67fc640 1 -- 172.21.15.37:0/706207688 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc030710 con 0x7f0ed8070ff0 2023-12-19T17:49:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.303+0000 7f0ed67fc640 1 -- 172.21.15.37:0/706207688 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc02e050 con 0x7f0ed8070ff0 2023-12-19T17:49:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.303+0000 7f0ed67fc640 1 -- 172.21.15.37:0/706207688 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc030a90 con 0x7f0ed8070ff0 2023-12-19T17:49:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.304+0000 7f0eddf16640 1 -- 172.21.15.37:0/706207688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8070ff0 msgr2=0x7f0ed8142850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.304+0000 7f0eddf16640 1 --2- 172.21.15.37:0/706207688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8070ff0 0x7f0ed8142850 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0097a0 tx=0x7f0ecc02b790 comp rx=0 tx=0).stop 2023-12-19T17:49:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.304+0000 7f0eddf16640 1 -- 172.21.15.37:0/706207688 shutdown_connections 2023-12-19T17:49:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.304+0000 7f0eddf16640 1 --2- 172.21.15.37:0/706207688 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ed8142d90 0x7f0ed81531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.304+0000 7f0eddf16640 1 --2- 172.21.15.37:0/706207688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8070ff0 0x7f0ed8142850 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.304+0000 7f0eddf16640 1 -- 172.21.15.37:0/706207688 >> 172.21.15.37:0/706207688 conn(0x7f0ed80be120 msgr2=0x7f0ed80be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:53.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.304+0000 7f0eddf16640 1 -- 172.21.15.37:0/706207688 shutdown_connections 2023-12-19T17:49:53.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.304+0000 7f0eddf16640 1 -- 172.21.15.37:0/706207688 wait complete. 2023-12-19T17:49:53.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.305+0000 7f0eddf16640 1 Processor -- start 2023-12-19T17:49:53.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.305+0000 7f0eddf16640 1 -- start start 2023-12-19T17:49:53.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.305+0000 7f0eddf16640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ed8070ff0 0x7f0ed8139a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:53.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.305+0000 7f0eddf16640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ed80b4f90 0x7f0ed81de430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:53.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0eddf16640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8142d90 0x7f0ed81de970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:53.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0eddf16640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed8138910 con 0x7f0ed8142d90 2023-12-19T17:49:53.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0eddf16640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed81382e0 con 0x7f0ed80b4f90 2023-12-19T17:49:53.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0eddf16640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed813a4c0 con 0x7f0ed8070ff0 2023-12-19T17:49:53.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0ed7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8142d90 0x7f0ed81de970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:53.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0ed7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8142d90 0x7f0ed81de970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55132/0 (socket says 172.21.15.37:55132) 2023-12-19T17:49:53.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0ed7fff640 1 -- 172.21.15.37:0/3256130261 learned_addr learned my addr 172.21.15.37:0/3256130261 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:53.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0ed77fe640 1 --2- 172.21.15.37:0/3256130261 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ed8070ff0 0x7f0ed8139a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:53.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0ed6ffd640 1 --2- 172.21.15.37:0/3256130261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ed80b4f90 0x7f0ed81de430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:53.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0ed7fff640 1 -- 172.21.15.37:0/3256130261 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ed8070ff0 msgr2=0x7f0ed8139a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:53.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0ed7fff640 1 --2- 172.21.15.37:0/3256130261 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ed8070ff0 0x7f0ed8139a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0ed7fff640 1 -- 172.21.15.37:0/3256130261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ed80b4f90 msgr2=0x7f0ed81de430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:53.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0ed7fff640 1 --2- 172.21.15.37:0/3256130261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ed80b4f90 0x7f0ed81de430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0ed7fff640 1 -- 172.21.15.37:0/3256130261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc009400 con 0x7f0ed8142d90 2023-12-19T17:49:53.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0ed7fff640 1 --2- 172.21.15.37:0/3256130261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8142d90 0x7f0ed81de970 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0007e30 tx=0x7f0ed000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:53.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0ebffff640 1 -- 172.21.15.37:0/3256130261 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0014620 con 0x7f0ed8142d90 2023-12-19T17:49:53.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0ebffff640 1 -- 172.21.15.37:0/3256130261 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed000ee90 con 0x7f0ed8142d90 2023-12-19T17:49:53.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0eddf16640 1 -- 172.21.15.37:0/3256130261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed81385a0 con 0x7f0ed8142d90 2023-12-19T17:49:53.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0ebffff640 1 -- 172.21.15.37:0/3256130261 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed00149c0 con 0x7f0ed8142d90 2023-12-19T17:49:53.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.306+0000 7f0eddf16640 1 -- 172.21.15.37:0/3256130261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed8139310 con 0x7f0ed8142d90 2023-12-19T17:49:53.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.307+0000 7f0eddf16640 1 -- 172.21.15.37:0/3256130261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed804e840 con 0x7f0ed8142d90 2023-12-19T17:49:53.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.308+0000 7f0ebffff640 1 -- 172.21.15.37:0/3256130261 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0ed0014b20 con 0x7f0ed8142d90 2023-12-19T17:49:53.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.308+0000 7f0ebffff640 1 --2- 172.21.15.37:0/3256130261 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0ec406a430 0x7f0ec406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:53.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.309+0000 7f0ebffff640 1 -- 172.21.15.37:0/3256130261 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ed0089190 con 0x7f0ed8142d90 2023-12-19T17:49:53.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.309+0000 7f0ed77fe640 1 --2- 172.21.15.37:0/3256130261 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0ec406a430 0x7f0ec406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:53.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.309+0000 7f0ed77fe640 1 --2- 172.21.15.37:0/3256130261 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0ec406a430 0x7f0ec406c8f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc034000 tx=0x7f0ecc02f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:53.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.313+0000 7f0ebffff640 1 -- 172.21.15.37:0/3256130261 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0ed00547a0 con 0x7f0ed8142d90 2023-12-19T17:49:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.525+0000 7f0eddf16640 1 -- 172.21.15.37:0/3256130261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ed8140370 con 0x7f0ed8142d90 2023-12-19T17:49:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.526+0000 7f0ebffff640 1 -- 172.21.15.37:0/3256130261 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3946 (secure 0 0 0) 0x7f0ed0057dc0 con 0x7f0ed8142d90 2023-12-19T17:49:53.526 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T17:49:53.526 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/19970234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":19970234},{"type":"v1","addr":"172.21.15.37:6834","nonce":19970234}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2974397450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2974397450},{"type":"v1","addr":"172.21.15.78:6835","nonce":2974397450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:07:41.897266+0000","modified":"2023-12-19T16:07:43.904067+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1604445250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1604445250},{"type":"v1","addr":"172.21.15.37:6835","nonce":1604445250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:49:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 13 2023-12-19T17:49:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.528+0000 7f0eddf16640 1 -- 172.21.15.37:0/3256130261 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0ec406a430 msgr2=0x7f0ec406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.528+0000 7f0eddf16640 1 --2- 172.21.15.37:0/3256130261 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0ec406a430 0x7f0ec406c8f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc034000 tx=0x7f0ecc02f000 comp rx=0 tx=0).stop 2023-12-19T17:49:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.528+0000 7f0eddf16640 1 -- 172.21.15.37:0/3256130261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8142d90 msgr2=0x7f0ed81de970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.528+0000 7f0eddf16640 1 --2- 172.21.15.37:0/3256130261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8142d90 0x7f0ed81de970 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0007e30 tx=0x7f0ed000e4b0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.528+0000 7f0eddf16640 1 -- 172.21.15.37:0/3256130261 shutdown_connections 2023-12-19T17:49:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.528+0000 7f0eddf16640 1 --2- 172.21.15.37:0/3256130261 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0ec406a430 0x7f0ec406c8f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.528+0000 7f0eddf16640 1 --2- 172.21.15.37:0/3256130261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ed8142d90 0x7f0ed81de970 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.528+0000 7f0eddf16640 1 --2- 172.21.15.37:0/3256130261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ed80b4f90 0x7f0ed81de430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.528+0000 7f0eddf16640 1 --2- 172.21.15.37:0/3256130261 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ed8070ff0 0x7f0ed8139a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.528+0000 7f0eddf16640 1 -- 172.21.15.37:0/3256130261 >> 172.21.15.37:0/3256130261 conn(0x7f0ed80be120 msgr2=0x7f0ed80b7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.528+0000 7f0eddf16640 1 -- 172.21.15.37:0/3256130261 shutdown_connections 2023-12-19T17:49:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.528+0000 7f0eddf16640 1 -- 172.21.15.37:0/3256130261 wait complete. 2023-12-19T17:49:53.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:49:53.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.644+0000 7f61d11d9640 1 Processor -- start 2023-12-19T17:49:53.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.644+0000 7f61d11d9640 1 -- start start 2023-12-19T17:49:53.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.645+0000 7f61d11d9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61cc06af20 0x7f61cc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:53.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.645+0000 7f61d11d9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f61cc141550 0x7f61cc1419e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:53.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.645+0000 7f61d11d9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61cc0711c0 con 0x7f61cc0b3a30 2023-12-19T17:49:53.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.645+0000 7f61d11d9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61cc0b4110 con 0x7f61cc141550 2023-12-19T17:49:53.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.645+0000 7f61d11d9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc141f20 con 0x7f61cc06af20 2023-12-19T17:49:53.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.645+0000 7f61cad9d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61cc06af20 0x7f61cc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:53.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.645+0000 7f61cb59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f61cc141550 0x7f61cc1419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:53.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.645+0000 7f61cad9d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61cc06af20 0x7f61cc06fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:37500/0 (socket says 172.21.15.37:37500) 2023-12-19T17:49:53.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.645+0000 7f61c259c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f61cc0b3a30 0x7f61cc1477d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.37:37176/0 (socket says 172.21.15.37:37176) 2023-12-19T17:49:53.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.645+0000 7f61cad9d640 1 -- 172.21.15.37:0/868540332 learned_addr learned my addr 172.21.15.37:0/868540332 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:53.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.645+0000 7f61cad9d640 1 -- 172.21.15.37:0/868540332 >> v2:172.21.15.78:3300/0 conn(0x7f61cc141550 msgr2=0x7f61cc1419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:53.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.645+0000 7f61cad9d640 1 --2- 172.21.15.37:0/868540332 >> v2:172.21.15.78:3300/0 conn(0x7f61cc141550 0x7f61cc1419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.645+0000 7f61cad9d640 1 -- 172.21.15.37:0/868540332 >> v1:172.21.15.78:6789/0 conn(0x7f61cc0b3a30 legacy=0x7f61cc1477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:53.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.645+0000 7f61cad9d640 1 -- 172.21.15.37:0/868540332 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc070370 con 0x7f61cc06af20 2023-12-19T17:49:53.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.645+0000 7f61cb59e640 1 --2- 172.21.15.37:0/868540332 >> v2:172.21.15.78:3300/0 conn(0x7f61cc141550 0x7f61cc1419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:49:53.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.646+0000 7f61cad9d640 1 --2- 172.21.15.37:0/868540332 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61cc06af20 0x7f61cc06fca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f61bc009870 tx=0x7f61bc02ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94dbb61375b1005f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:53.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.646+0000 7f61ca59c640 1 -- 172.21.15.37:0/868540332 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc02f840 con 0x7f61cc06af20 2023-12-19T17:49:53.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.646+0000 7f61ca59c640 1 -- 172.21.15.37:0/868540332 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc02f9a0 con 0x7f61cc06af20 2023-12-19T17:49:53.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.646+0000 7f61ca59c640 1 -- 172.21.15.37:0/868540332 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc02fd30 con 0x7f61cc06af20 2023-12-19T17:49:53.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.647+0000 7f61d11d9640 1 -- 172.21.15.37:0/868540332 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61cc06af20 msgr2=0x7f61cc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:53.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.647+0000 7f61d11d9640 1 --2- 172.21.15.37:0/868540332 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61cc06af20 0x7f61cc06fca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f61bc009870 tx=0x7f61bc02ba20 comp rx=0 tx=0).stop 2023-12-19T17:49:53.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.647+0000 7f61d11d9640 1 -- 172.21.15.37:0/868540332 shutdown_connections 2023-12-19T17:49:53.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.647+0000 7f61d11d9640 1 --2- 172.21.15.37:0/868540332 >> v2:172.21.15.78:3300/0 conn(0x7f61cc141550 0x7f61cc1419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.647+0000 7f61d11d9640 1 --2- 172.21.15.37:0/868540332 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61cc06af20 0x7f61cc06fca0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.647+0000 7f61d11d9640 1 -- 172.21.15.37:0/868540332 >> 172.21.15.37:0/868540332 conn(0x7f61cc0bcf60 msgr2=0x7f61cc0bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:53.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.647+0000 7f61d11d9640 1 -- 172.21.15.37:0/868540332 shutdown_connections 2023-12-19T17:49:53.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.647+0000 7f61d11d9640 1 -- 172.21.15.37:0/868540332 wait complete. 2023-12-19T17:49:53.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.648+0000 7f61d11d9640 1 Processor -- start 2023-12-19T17:49:53.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.648+0000 7f61d11d9640 1 -- start start 2023-12-19T17:49:53.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.649+0000 7f61d11d9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61cc06af20 0x7f61cc0b9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:53.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.649+0000 7f61d11d9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61cc0b3a30 0x7f61cc0ba0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:53.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.649+0000 7f61d11d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61cc141550 0x7f61cc0b7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:53.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.649+0000 7f61d11d9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc13deb0 con 0x7f61cc141550 2023-12-19T17:49:53.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.649+0000 7f61d11d9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc13d5c0 con 0x7f61cc06af20 2023-12-19T17:49:53.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.649+0000 7f61d11d9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc0b9960 con 0x7f61cc0b3a30 2023-12-19T17:49:53.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.649+0000 7f61cb59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61cc141550 0x7f61cc0b7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:53.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.649+0000 7f61cb59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61cc141550 0x7f61cc0b7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55134/0 (socket says 172.21.15.37:55134) 2023-12-19T17:49:53.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.649+0000 7f61cb59e640 1 -- 172.21.15.37:0/2385862663 learned_addr learned my addr 172.21.15.37:0/2385862663 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:53.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.649+0000 7f61c259c640 1 --2- 172.21.15.37:0/2385862663 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61cc0b3a30 0x7f61cc0ba0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.649+0000 7f61cad9d640 1 --2- 172.21.15.37:0/2385862663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61cc06af20 0x7f61cc0b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.649+0000 7f61cb59e640 1 -- 172.21.15.37:0/2385862663 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61cc0b3a30 msgr2=0x7f61cc0ba0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.649+0000 7f61cb59e640 1 --2- 172.21.15.37:0/2385862663 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61cc0b3a30 0x7f61cc0ba0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.649+0000 7f61cb59e640 1 -- 172.21.15.37:0/2385862663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61cc06af20 msgr2=0x7f61cc0b9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.649+0000 7f61cb59e640 1 --2- 172.21.15.37:0/2385862663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61cc06af20 0x7f61cc0b9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.649+0000 7f61cb59e640 1 -- 172.21.15.37:0/2385862663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c4009a70 con 0x7f61cc141550 2023-12-19T17:49:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.649+0000 7f61cb59e640 1 --2- 172.21.15.37:0/2385862663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61cc141550 0x7f61cc0b7b40 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f61c400efc0 tx=0x7f61c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.650+0000 7f61c3fff640 1 -- 172.21.15.37:0/2385862663 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c4009cd0 con 0x7f61cc141550 2023-12-19T17:49:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.650+0000 7f61c3fff640 1 -- 172.21.15.37:0/2385862663 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c400f040 con 0x7f61cc141550 2023-12-19T17:49:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.650+0000 7f61d11d9640 1 -- 172.21.15.37:0/2385862663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61bc0094d0 con 0x7f61cc141550 2023-12-19T17:49:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.650+0000 7f61c3fff640 1 -- 172.21.15.37:0/2385862663 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c4003990 con 0x7f61cc141550 2023-12-19T17:49:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.650+0000 7f61d11d9640 1 -- 172.21.15.37:0/2385862663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61cc13db40 con 0x7f61cc141550 2023-12-19T17:49:53.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.651+0000 7f61d11d9640 1 -- 172.21.15.37:0/2385862663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61cc13e020 con 0x7f61cc141550 2023-12-19T17:49:53.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.651+0000 7f61c3fff640 1 -- 172.21.15.37:0/2385862663 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f61c4014480 con 0x7f61cc141550 2023-12-19T17:49:53.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.652+0000 7f61c3fff640 1 --2- 172.21.15.37:0/2385862663 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f61ac06a460 0x7f61ac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:53.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.652+0000 7f61c3fff640 1 -- 172.21.15.37:0/2385862663 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61c4089380 con 0x7f61cc141550 2023-12-19T17:49:53.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.652+0000 7f61cad9d640 1 --2- 172.21.15.37:0/2385862663 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f61ac06a460 0x7f61ac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:53.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.652+0000 7f61cad9d640 1 --2- 172.21.15.37:0/2385862663 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f61ac06a460 0x7f61ac06c920 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f61bc036000 tx=0x7f61bc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:53.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.656+0000 7f61c3fff640 1 -- 172.21.15.37:0/2385862663 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f61c4054a30 con 0x7f61cc141550 2023-12-19T17:49:53.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.868+0000 7f61d11d9640 1 -- 172.21.15.37:0/2385862663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61cc04e840 con 0x7f61cc141550 2023-12-19T17:49:53.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.868+0000 7f61c3fff640 1 -- 172.21.15.37:0/2385862663 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3946 (secure 0 0 0) 0x7f61c4058050 con 0x7f61cc141550 2023-12-19T17:49:53.869 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T17:49:53.869 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/19970234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":19970234},{"type":"v1","addr":"172.21.15.37:6834","nonce":19970234}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2974397450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2974397450},{"type":"v1","addr":"172.21.15.78:6835","nonce":2974397450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:07:41.897266+0000","modified":"2023-12-19T16:07:43.904067+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1604445250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1604445250},{"type":"v1","addr":"172.21.15.37:6835","nonce":1604445250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:49:53.869 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 13 2023-12-19T17:49:53.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.870+0000 7f61d11d9640 1 -- 172.21.15.37:0/2385862663 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f61ac06a460 msgr2=0x7f61ac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:53.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.870+0000 7f61d11d9640 1 --2- 172.21.15.37:0/2385862663 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f61ac06a460 0x7f61ac06c920 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f61bc036000 tx=0x7f61bc008030 comp rx=0 tx=0).stop 2023-12-19T17:49:53.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.870+0000 7f61d11d9640 1 -- 172.21.15.37:0/2385862663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61cc141550 msgr2=0x7f61cc0b7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:53.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.870+0000 7f61d11d9640 1 --2- 172.21.15.37:0/2385862663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61cc141550 0x7f61cc0b7b40 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f61c400efc0 tx=0x7f61c400c490 comp rx=0 tx=0).stop 2023-12-19T17:49:53.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.870+0000 7f61d11d9640 1 -- 172.21.15.37:0/2385862663 shutdown_connections 2023-12-19T17:49:53.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.870+0000 7f61d11d9640 1 --2- 172.21.15.37:0/2385862663 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f61ac06a460 0x7f61ac06c920 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.870+0000 7f61d11d9640 1 --2- 172.21.15.37:0/2385862663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61cc141550 0x7f61cc0b7b40 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.870+0000 7f61d11d9640 1 --2- 172.21.15.37:0/2385862663 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61cc0b3a30 0x7f61cc0ba0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.870+0000 7f61d11d9640 1 --2- 172.21.15.37:0/2385862663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61cc06af20 0x7f61cc0b9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.870+0000 7f61d11d9640 1 -- 172.21.15.37:0/2385862663 >> 172.21.15.37:0/2385862663 conn(0x7f61cc0bcf60 msgr2=0x7f61cc0b6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:53.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.871+0000 7f61d11d9640 1 -- 172.21.15.37:0/2385862663 shutdown_connections 2023-12-19T17:49:53.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.871+0000 7f61d11d9640 1 -- 172.21.15.37:0/2385862663 wait complete. 2023-12-19T17:49:53.882 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:49:53.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.988+0000 7f69d51f0640 1 Processor -- start 2023-12-19T17:49:53.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.988+0000 7f69d51f0640 1 -- start start 2023-12-19T17:49:53.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.989+0000 7f69d51f0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f69d0070ff0 0x7f69d014aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:53.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.989+0000 7f69d51f0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d014af90 con 0x7f69d00ba0e0 2023-12-19T17:49:53.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.989+0000 7f69d51f0640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d0071d10 con 0x7f69d00ba700 2023-12-19T17:49:53.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.989+0000 7f69d51f0640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d00b8630 con 0x7f69d0070ff0 2023-12-19T17:49:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.989+0000 7f69c7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f69d00ba0e0 0x7f69d00b7820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33294/0 (socket says 172.21.15.37:33294) 2023-12-19T17:49:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.989+0000 7f69c7fff640 1 -- 172.21.15.37:0/971602098 learned_addr learned my addr 172.21.15.37:0/971602098 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:49:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.989+0000 7f69ced9d640 1 --2- 172.21.15.37:0/971602098 >> v2:172.21.15.78:3300/0 conn(0x7f69d0070ff0 0x7f69d014aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.989+0000 7f69ce59c640 1 -- 172.21.15.37:0/971602098 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553800584 0 0) 0x7f69d014af90 con 0x7f69d00ba0e0 2023-12-19T17:49:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.989+0000 7f69ce59c640 1 -- 172.21.15.37:0/971602098 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69bc003520 con 0x7f69d00ba0e0 2023-12-19T17:49:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.990+0000 7f69ced9d640 1 -- 172.21.15.37:0/971602098 >> v1:172.21.15.78:6789/0 conn(0x7f69d00ba700 legacy=0x7f69d0155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.990+0000 7f69ced9d640 1 -- 172.21.15.37:0/971602098 >> v1:172.21.15.37:6789/0 conn(0x7f69d00ba0e0 legacy=0x7f69d00b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.990+0000 7f69ce59c640 1 -- 172.21.15.37:0/971602098 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2835655472 0 0) 0x7f69bc003520 con 0x7f69d00ba0e0 2023-12-19T17:49:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.990+0000 7f69ced9d640 1 -- 172.21.15.37:0/971602098 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d0071750 con 0x7f69d0070ff0 2023-12-19T17:49:53.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.990+0000 7f69ced9d640 1 --2- 172.21.15.37:0/971602098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d0070ff0 0x7f69d014aa50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f69c00097a0 tx=0x7f69c002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=402960fd3898c88b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:53.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.991+0000 7f69ce59c640 1 -- 172.21.15.37:0/971602098 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b8001670 con 0x7f69d0070ff0 2023-12-19T17:49:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.991+0000 7f69ce59c640 1 -- 172.21.15.37:0/971602098 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c002e050 con 0x7f69d0070ff0 2023-12-19T17:49:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.991+0000 7f69ce59c640 1 -- 172.21.15.37:0/971602098 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c0030710 con 0x7f69d0070ff0 2023-12-19T17:49:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.991+0000 7f69d51f0640 1 -- 172.21.15.37:0/971602098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d0070ff0 msgr2=0x7f69d014aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.991+0000 7f69d51f0640 1 --2- 172.21.15.37:0/971602098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d0070ff0 0x7f69d014aa50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f69c00097a0 tx=0x7f69c002b790 comp rx=0 tx=0).stop 2023-12-19T17:49:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.991+0000 7f69d51f0640 1 -- 172.21.15.37:0/971602098 shutdown_connections 2023-12-19T17:49:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.991+0000 7f69d51f0640 1 --2- 172.21.15.37:0/971602098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d0070ff0 0x7f69d014aa50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.991+0000 7f69d51f0640 1 -- 172.21.15.37:0/971602098 >> 172.21.15.37:0/971602098 conn(0x7f69d00be120 msgr2=0x7f69d00be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.991+0000 7f69d51f0640 1 -- 172.21.15.37:0/971602098 shutdown_connections 2023-12-19T17:49:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.991+0000 7f69d51f0640 1 -- 172.21.15.37:0/971602098 wait complete. 2023-12-19T17:49:53.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.992+0000 7f69d51f0640 1 Processor -- start 2023-12-19T17:49:53.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.992+0000 7f69d51f0640 1 -- start start 2023-12-19T17:49:53.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.993+0000 7f69d51f0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69d0070ff0 0x7f69d0149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:53.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.993+0000 7f69d51f0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69d00ba0e0 0x7f69d01405f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:53.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.993+0000 7f69d51f0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d00ba700 0x7f69d0140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:53.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.993+0000 7f69d51f0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d014a410 con 0x7f69d00ba0e0 2023-12-19T17:49:53.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.993+0000 7f69d51f0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d013f4b0 con 0x7f69d00ba700 2023-12-19T17:49:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.993+0000 7f69d51f0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d0147410 con 0x7f69d0070ff0 2023-12-19T17:49:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.993+0000 7f69c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69d00ba0e0 0x7f69d01405f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.993+0000 7f69c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69d00ba0e0 0x7f69d01405f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55142/0 (socket says 172.21.15.37:55142) 2023-12-19T17:49:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.993+0000 7f69c7fff640 1 -- 172.21.15.37:0/1607621351 learned_addr learned my addr 172.21.15.37:0/1607621351 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.993+0000 7f69cf59e640 1 --2- 172.21.15.37:0/1607621351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d00ba700 0x7f69d0140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.993+0000 7f69ced9d640 1 --2- 172.21.15.37:0/1607621351 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69d0070ff0 0x7f69d0149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.993+0000 7f69c7fff640 1 -- 172.21.15.37:0/1607621351 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69d0070ff0 msgr2=0x7f69d0149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.993+0000 7f69c7fff640 1 --2- 172.21.15.37:0/1607621351 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69d0070ff0 0x7f69d0149ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.993+0000 7f69c7fff640 1 -- 172.21.15.37:0/1607621351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d00ba700 msgr2=0x7f69d0140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.993+0000 7f69c7fff640 1 --2- 172.21.15.37:0/1607621351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d00ba700 0x7f69d0140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.993+0000 7f69c7fff640 1 -- 172.21.15.37:0/1607621351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c0009400 con 0x7f69d00ba0e0 2023-12-19T17:49:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.993+0000 7f69cf59e640 1 --2- 172.21.15.37:0/1607621351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d00ba700 0x7f69d0140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:49:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.994+0000 7f69c7fff640 1 --2- 172.21.15.37:0/1607621351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69d00ba0e0 0x7f69d01405f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f69b800c750 tx=0x7f69b800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.994+0000 7f69c77fe640 1 -- 172.21.15.37:0/1607621351 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b8005ad0 con 0x7f69d00ba0e0 2023-12-19T17:49:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.994+0000 7f69c77fe640 1 -- 172.21.15.37:0/1607621351 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b8005c30 con 0x7f69d00ba0e0 2023-12-19T17:49:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.994+0000 7f69d51f0640 1 -- 172.21.15.37:0/1607621351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d013f100 con 0x7f69d00ba0e0 2023-12-19T17:49:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.994+0000 7f69c77fe640 1 -- 172.21.15.37:0/1607621351 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b8007070 con 0x7f69d00ba0e0 2023-12-19T17:49:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.994+0000 7f69d51f0640 1 -- 172.21.15.37:0/1607621351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d013fa00 con 0x7f69d00ba0e0 2023-12-19T17:49:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.995+0000 7f69d51f0640 1 -- 172.21.15.37:0/1607621351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d0147630 con 0x7f69d00ba0e0 2023-12-19T17:49:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.995+0000 7f69c77fe640 1 -- 172.21.15.37:0/1607621351 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f69b80071d0 con 0x7f69d00ba0e0 2023-12-19T17:49:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.996+0000 7f69c77fe640 1 --2- 172.21.15.37:0/1607621351 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f69b006a430 0x7f69b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.996+0000 7f69c77fe640 1 -- 172.21.15.37:0/1607621351 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69b8087f50 con 0x7f69d00ba0e0 2023-12-19T17:49:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.996+0000 7f69ced9d640 1 --2- 172.21.15.37:0/1607621351 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f69b006a430 0x7f69b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:53.996+0000 7f69ced9d640 1 --2- 172.21.15.37:0/1607621351 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f69b006a430 0x7f69b006c8f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f69c0034000 tx=0x7f69c002f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.000+0000 7f69c77fe640 1 -- 172.21.15.37:0/1607621351 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f69d0147630 con 0x7f69d00ba0e0 2023-12-19T17:49:54.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.177+0000 7f69d51f0640 1 -- 172.21.15.37:0/1607621351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69d013fc20 con 0x7f69d00ba0e0 2023-12-19T17:49:54.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.178+0000 7f69c77fe640 1 -- 172.21.15.37:0/1607621351 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16053 (secure 0 0 0) 0x7f69b8053570 con 0x7f69d00ba0e0 2023-12-19T17:49:54.178 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T17:49:54.178 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T16:07:42.899048+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:07:39.626181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T16:07:40.871535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:49:54.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.180+0000 7f69d51f0640 1 -- 172.21.15.37:0/1607621351 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f69b006a430 msgr2=0x7f69b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:54.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.180+0000 7f69d51f0640 1 --2- 172.21.15.37:0/1607621351 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f69b006a430 0x7f69b006c8f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f69c0034000 tx=0x7f69c002f000 comp rx=0 tx=0).stop 2023-12-19T17:49:54.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.180+0000 7f69d51f0640 1 -- 172.21.15.37:0/1607621351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69d00ba0e0 msgr2=0x7f69d01405f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:54.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.180+0000 7f69d51f0640 1 --2- 172.21.15.37:0/1607621351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69d00ba0e0 0x7f69d01405f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f69b800c750 tx=0x7f69b800cc10 comp rx=0 tx=0).stop 2023-12-19T17:49:54.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.180+0000 7f69d51f0640 1 -- 172.21.15.37:0/1607621351 shutdown_connections 2023-12-19T17:49:54.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.180+0000 7f69d51f0640 1 --2- 172.21.15.37:0/1607621351 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f69b006a430 0x7f69b006c8f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:54.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.180+0000 7f69d51f0640 1 --2- 172.21.15.37:0/1607621351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69d00ba700 0x7f69d0140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:54.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.180+0000 7f69d51f0640 1 --2- 172.21.15.37:0/1607621351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69d00ba0e0 0x7f69d01405f0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:54.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.180+0000 7f69d51f0640 1 --2- 172.21.15.37:0/1607621351 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f69d0070ff0 0x7f69d0149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:54.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.180+0000 7f69d51f0640 1 -- 172.21.15.37:0/1607621351 >> 172.21.15.37:0/1607621351 conn(0x7f69d00be120 msgr2=0x7f69d00b6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:54.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.180+0000 7f69d51f0640 1 -- 172.21.15.37:0/1607621351 shutdown_connections 2023-12-19T17:49:54.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.180+0000 7f69d51f0640 1 -- 172.21.15.37:0/1607621351 wait complete. 2023-12-19T17:49:54.191 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T17:49:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.299+0000 7f6789518640 1 Processor -- start 2023-12-19T17:49:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.299+0000 7f6789518640 1 -- start start 2023-12-19T17:49:54.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.299+0000 7f6789518640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f67840bab80 0x7f678414b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:54.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.299+0000 7f6789518640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f67840b8b40 0x7f6784155320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:54.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.299+0000 7f6789518640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67840b6da0 con 0x7f6784144e30 2023-12-19T17:49:54.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.299+0000 7f6789518640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67840b8090 con 0x7f67840bab80 2023-12-19T17:49:54.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.299+0000 7f6789518640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f678414afe0 con 0x7f67840b8b40 2023-12-19T17:49:54.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.299+0000 7f67827fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f67840bab80 0x7f678414b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:54.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.299+0000 7f6782ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6784144e30 0x7f67840b7600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33296/0 (socket says 172.21.15.37:33296) 2023-12-19T17:49:54.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.299+0000 7f6782ffd640 1 -- 172.21.15.37:0/1318810358 learned_addr learned my addr 172.21.15.37:0/1318810358 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:49:54.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.300+0000 7f67837fe640 1 --2- 172.21.15.37:0/1318810358 >> v2:172.21.15.78:3300/0 conn(0x7f67840b8b40 0x7f6784155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:54.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.300+0000 7f67827fc640 1 -- 172.21.15.37:0/1318810358 >> v2:172.21.15.78:3300/0 conn(0x7f67840b8b40 msgr2=0x7f6784155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:54.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.300+0000 7f67827fc640 1 --2- 172.21.15.37:0/1318810358 >> v2:172.21.15.78:3300/0 conn(0x7f67840b8b40 0x7f6784155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:54.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.300+0000 7f67827fc640 1 -- 172.21.15.37:0/1318810358 >> v1:172.21.15.37:6789/0 conn(0x7f6784144e30 legacy=0x7f67840b7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:54.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.300+0000 7f67827fc640 1 -- 172.21.15.37:0/1318810358 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6784145210 con 0x7f67840bab80 2023-12-19T17:49:54.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.300+0000 7f6781ffb640 1 -- 172.21.15.37:0/1318810358 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844685103 0 0) 0x7f6778001110 con 0x7f6784144e30 2023-12-19T17:49:54.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.300+0000 7f67827fc640 1 --2- 172.21.15.37:0/1318810358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67840bab80 0x7f678414b470 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f67840bcc00 tx=0x7f677402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea265e235151e85 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:54.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.301+0000 7f6781ffb640 1 -- 172.21.15.37:0/1318810358 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6774030610 con 0x7f67840bab80 2023-12-19T17:49:54.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.301+0000 7f6781ffb640 1 -- 172.21.15.37:0/1318810358 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6774030770 con 0x7f67840bab80 2023-12-19T17:49:54.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.301+0000 7f6781ffb640 1 -- 172.21.15.37:0/1318810358 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6774030b00 con 0x7f67840bab80 2023-12-19T17:49:54.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.301+0000 7f6789518640 1 -- 172.21.15.37:0/1318810358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67840bab80 msgr2=0x7f678414b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:54.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.301+0000 7f6789518640 1 --2- 172.21.15.37:0/1318810358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67840bab80 0x7f678414b470 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f67840bcc00 tx=0x7f677402b960 comp rx=0 tx=0).stop 2023-12-19T17:49:54.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.301+0000 7f6789518640 1 -- 172.21.15.37:0/1318810358 shutdown_connections 2023-12-19T17:49:54.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.301+0000 7f6789518640 1 --2- 172.21.15.37:0/1318810358 >> v2:172.21.15.78:3300/0 conn(0x7f67840b8b40 0x7f6784155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:54.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.301+0000 7f6789518640 1 --2- 172.21.15.37:0/1318810358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67840bab80 0x7f678414b470 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:54.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.301+0000 7f6789518640 1 -- 172.21.15.37:0/1318810358 >> 172.21.15.37:0/1318810358 conn(0x7f67840c0200 msgr2=0x7f67840c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:54.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.301+0000 7f6789518640 1 -- 172.21.15.37:0/1318810358 shutdown_connections 2023-12-19T17:49:54.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.301+0000 7f6789518640 1 -- 172.21.15.37:0/1318810358 wait complete. 2023-12-19T17:49:54.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.302+0000 7f6789518640 1 Processor -- start 2023-12-19T17:49:54.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.302+0000 7f6789518640 1 -- start start 2023-12-19T17:49:54.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.303+0000 7f6789518640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67840b8b40 0x7f67840b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:54.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.303+0000 7f6789518640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67840bab80 0x7f6784145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:54.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.303+0000 7f6789518640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6784144e30 0x7f67840abb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:54.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.303+0000 7f6789518640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6784148440 con 0x7f67840b8b40 2023-12-19T17:49:54.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.303+0000 7f6789518640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67840b49e0 con 0x7f6784144e30 2023-12-19T17:49:54.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.303+0000 7f6789518640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6784145fd0 con 0x7f67840bab80 2023-12-19T17:49:54.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.303+0000 7f6782ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67840b8b40 0x7f67840b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:54.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.303+0000 7f6782ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67840b8b40 0x7f67840b44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55154/0 (socket says 172.21.15.37:55154) 2023-12-19T17:49:54.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.303+0000 7f6782ffd640 1 -- 172.21.15.37:0/2489102290 learned_addr learned my addr 172.21.15.37:0/2489102290 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:54.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.303+0000 7f67837fe640 1 --2- 172.21.15.37:0/2489102290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6784144e30 0x7f67840abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:54.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.303+0000 7f67827fc640 1 --2- 172.21.15.37:0/2489102290 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67840bab80 0x7f6784145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:54.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.303+0000 7f6782ffd640 1 -- 172.21.15.37:0/2489102290 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67840bab80 msgr2=0x7f6784145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:54.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.303+0000 7f6782ffd640 1 --2- 172.21.15.37:0/2489102290 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67840bab80 0x7f6784145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:54.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.303+0000 7f6782ffd640 1 -- 172.21.15.37:0/2489102290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6784144e30 msgr2=0x7f67840abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:54.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.303+0000 7f6782ffd640 1 --2- 172.21.15.37:0/2489102290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6784144e30 0x7f67840abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:54.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.303+0000 7f6782ffd640 1 -- 172.21.15.37:0/2489102290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67740093a0 con 0x7f67840b8b40 2023-12-19T17:49:54.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.303+0000 7f67837fe640 1 --2- 172.21.15.37:0/2489102290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6784144e30 0x7f67840abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:49:54.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.304+0000 7f6782ffd640 1 --2- 172.21.15.37:0/2489102290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67840b8b40 0x7f67840b44a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f677800c7b0 tx=0x7f677800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:54.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.304+0000 7f676b7fe640 1 -- 172.21.15.37:0/2489102290 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67780072d0 con 0x7f67840b8b40 2023-12-19T17:49:54.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.304+0000 7f676b7fe640 1 -- 172.21.15.37:0/2489102290 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6778007450 con 0x7f67840b8b40 2023-12-19T17:49:54.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.304+0000 7f6789518640 1 -- 172.21.15.37:0/2489102290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6784147aa0 con 0x7f67840b8b40 2023-12-19T17:49:54.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.304+0000 7f676b7fe640 1 -- 172.21.15.37:0/2489102290 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67780047e0 con 0x7f67840b8b40 2023-12-19T17:49:54.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.304+0000 7f6789518640 1 -- 172.21.15.37:0/2489102290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6784148060 con 0x7f67840b8b40 2023-12-19T17:49:54.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.305+0000 7f6789518640 1 -- 172.21.15.37:0/2489102290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678404e840 con 0x7f67840b8b40 2023-12-19T17:49:54.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.305+0000 7f676b7fe640 1 -- 172.21.15.37:0/2489102290 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6778004960 con 0x7f67840b8b40 2023-12-19T17:49:54.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.306+0000 7f676b7fe640 1 --2- 172.21.15.37:0/2489102290 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f677006a430 0x7f677006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:54.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.306+0000 7f676b7fe640 1 -- 172.21.15.37:0/2489102290 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6778087930 con 0x7f67840b8b40 2023-12-19T17:49:54.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.306+0000 7f67827fc640 1 --2- 172.21.15.37:0/2489102290 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f677006a430 0x7f677006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:54.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.307+0000 7f67827fc640 1 --2- 172.21.15.37:0/2489102290 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f677006a430 0x7f677006c8f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6774036000 tx=0x7f6774008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:54.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.314+0000 7f676b7fe640 1 -- 172.21.15.37:0/2489102290 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6778052fb0 con 0x7f67840b8b40 2023-12-19T17:49:54.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.527+0000 7f6789518640 1 -- 172.21.15.37:0/2489102290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f67840b6d80 con 0x7f67840b8b40 2023-12-19T17:49:54.536 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-12-19T17:49:54.536+0000 7f92889bd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T17:49:54.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.544+0000 7f676b7fe640 1 -- 172.21.15.37:0/2489102290 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6778018020 con 0x7f67840b8b40 2023-12-19T17:49:54.544 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T17:49:54.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.547+0000 7f6789518640 1 -- 172.21.15.37:0/2489102290 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f677006a430 msgr2=0x7f677006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:54.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.547+0000 7f6789518640 1 --2- 172.21.15.37:0/2489102290 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f677006a430 0x7f677006c8f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6774036000 tx=0x7f6774008030 comp rx=0 tx=0).stop 2023-12-19T17:49:54.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.547+0000 7f6789518640 1 -- 172.21.15.37:0/2489102290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67840b8b40 msgr2=0x7f67840b44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:54.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.547+0000 7f6789518640 1 --2- 172.21.15.37:0/2489102290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67840b8b40 0x7f67840b44a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f677800c7b0 tx=0x7f677800cc70 comp rx=0 tx=0).stop 2023-12-19T17:49:54.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.547+0000 7f6789518640 1 -- 172.21.15.37:0/2489102290 shutdown_connections 2023-12-19T17:49:54.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.547+0000 7f6789518640 1 --2- 172.21.15.37:0/2489102290 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f677006a430 0x7f677006c8f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:54.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.547+0000 7f6789518640 1 --2- 172.21.15.37:0/2489102290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6784144e30 0x7f67840abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:54.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.547+0000 7f6789518640 1 --2- 172.21.15.37:0/2489102290 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67840bab80 0x7f6784145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:54.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.547+0000 7f6789518640 1 --2- 172.21.15.37:0/2489102290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67840b8b40 0x7f67840b44a0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:54.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.547+0000 7f6789518640 1 -- 172.21.15.37:0/2489102290 >> 172.21.15.37:0/2489102290 conn(0x7f67840c0200 msgr2=0x7f6784148b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:54.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.547+0000 7f6789518640 1 -- 172.21.15.37:0/2489102290 shutdown_connections 2023-12-19T17:49:54.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.547+0000 7f6789518640 1 -- 172.21.15.37:0/2489102290 wait complete. 2023-12-19T17:49:54.558 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T17:49:54.639 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-12-19T17:49:54.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.669+0000 7f43d08c4640 1 Processor -- start 2023-12-19T17:49:54.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.669+0000 7f43d08c4640 1 -- start start 2023-12-19T17:49:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.670+0000 7f43d08c4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f43cc0b91c0 0x7f43cc1530d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.670+0000 7f43d08c4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43cc070760 con 0x7f43cc0b3e80 2023-12-19T17:49:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.670+0000 7f43d08c4640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43cc0702d0 con 0x7f43cc0b9d10 2023-12-19T17:49:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.670+0000 7f43d08c4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43cc070dc0 con 0x7f43cc0b91c0 2023-12-19T17:49:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.670+0000 7f43c9d9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f43cc0b3e80 0x7f43cc141650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33316/0 (socket says 172.21.15.37:33316) 2023-12-19T17:49:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.670+0000 7f43c9d9b640 1 -- 172.21.15.37:0/2217632248 learned_addr learned my addr 172.21.15.37:0/2217632248 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:49:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.670+0000 7f43cad9d640 1 --2- 172.21.15.37:0/2217632248 >> v2:172.21.15.37:3300/0 conn(0x7f43cc0b91c0 0x7f43cc1530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.670+0000 7f43c959a640 1 -- 172.21.15.37:0/2217632248 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403341233 0 0) 0x7f43bc001110 con 0x7f43cc0b3e80 2023-12-19T17:49:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.670+0000 7f43c959a640 1 -- 172.21.15.37:0/2217632248 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b8003520 con 0x7f43cc0b3e80 2023-12-19T17:49:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.670+0000 7f43cad9d640 1 -- 172.21.15.37:0/2217632248 >> v1:172.21.15.78:6789/0 conn(0x7f43cc0b9d10 legacy=0x7f43cc14ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.670+0000 7f43cad9d640 1 -- 172.21.15.37:0/2217632248 >> v1:172.21.15.37:6789/0 conn(0x7f43cc0b3e80 legacy=0x7f43cc141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.670+0000 7f43cad9d640 1 -- 172.21.15.37:0/2217632248 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc071750 con 0x7f43cc0b91c0 2023-12-19T17:49:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.671+0000 7f43cad9d640 1 --2- 172.21.15.37:0/2217632248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43cc0b91c0 0x7f43cc1530d0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009d90 tx=0x7f43c402bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb6161ec3f7b5df server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.671+0000 7f43c959a640 1 -- 172.21.15.37:0/2217632248 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c402ccf0 con 0x7f43cc0b91c0 2023-12-19T17:49:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.671+0000 7f43c959a640 1 -- 172.21.15.37:0/2217632248 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c402ce50 con 0x7f43cc0b91c0 2023-12-19T17:49:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.671+0000 7f43c959a640 1 -- 172.21.15.37:0/2217632248 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4034660 con 0x7f43cc0b91c0 2023-12-19T17:49:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.672+0000 7f43d08c4640 1 -- 172.21.15.37:0/2217632248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43cc0b91c0 msgr2=0x7f43cc1530d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.672+0000 7f43d08c4640 1 --2- 172.21.15.37:0/2217632248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43cc0b91c0 0x7f43cc1530d0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009d90 tx=0x7f43c402bf40 comp rx=0 tx=0).stop 2023-12-19T17:49:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.672+0000 7f43d08c4640 1 -- 172.21.15.37:0/2217632248 shutdown_connections 2023-12-19T17:49:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.672+0000 7f43d08c4640 1 --2- 172.21.15.37:0/2217632248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43cc0b91c0 0x7f43cc1530d0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.672+0000 7f43d08c4640 1 -- 172.21.15.37:0/2217632248 >> 172.21.15.37:0/2217632248 conn(0x7f43cc06acb0 msgr2=0x7f43cc06b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.672+0000 7f43d08c4640 1 -- 172.21.15.37:0/2217632248 shutdown_connections 2023-12-19T17:49:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.672+0000 7f43d08c4640 1 -- 172.21.15.37:0/2217632248 wait complete. 2023-12-19T17:49:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.673+0000 7f43d08c4640 1 Processor -- start 2023-12-19T17:49:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.673+0000 7f43d08c4640 1 -- start start 2023-12-19T17:49:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.674+0000 7f43d08c4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43cc0b3e80 0x7f43cc149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.674+0000 7f43d08c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43cc0b91c0 0x7f43cc143cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.674+0000 7f43d08c4640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43cc0b9d10 0x7f43cc13b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.674+0000 7f43d08c4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc14a440 con 0x7f43cc0b3e80 2023-12-19T17:49:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.674+0000 7f43d08c4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc0b6c10 con 0x7f43cc0b91c0 2023-12-19T17:49:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.674+0000 7f43d08c4640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc0b6ef0 con 0x7f43cc0b9d10 2023-12-19T17:49:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.674+0000 7f43ca59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43cc0b3e80 0x7f43cc149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.674+0000 7f43ca59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43cc0b3e80 0x7f43cc149f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55198/0 (socket says 172.21.15.37:55198) 2023-12-19T17:49:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.674+0000 7f43ca59c640 1 -- 172.21.15.37:0/414189389 learned_addr learned my addr 172.21.15.37:0/414189389 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.674+0000 7f43c9d9b640 1 --2- 172.21.15.37:0/414189389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43cc0b91c0 0x7f43cc143cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.674+0000 7f43cad9d640 1 --2- 172.21.15.37:0/414189389 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43cc0b9d10 0x7f43cc13b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.674+0000 7f43ca59c640 1 -- 172.21.15.37:0/414189389 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43cc0b9d10 msgr2=0x7f43cc13b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.674+0000 7f43ca59c640 1 --2- 172.21.15.37:0/414189389 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43cc0b9d10 0x7f43cc13b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.674+0000 7f43ca59c640 1 -- 172.21.15.37:0/414189389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43cc0b91c0 msgr2=0x7f43cc143cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.674+0000 7f43ca59c640 1 --2- 172.21.15.37:0/414189389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43cc0b91c0 0x7f43cc143cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.674+0000 7f43ca59c640 1 -- 172.21.15.37:0/414189389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c4009a70 con 0x7f43cc0b3e80 2023-12-19T17:49:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.674+0000 7f43cad9d640 1 --2- 172.21.15.37:0/414189389 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43cc0b9d10 0x7f43cc13b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:49:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.674+0000 7f43ca59c640 1 --2- 172.21.15.37:0/414189389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43cc0b3e80 0x7f43cc149f00 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f43b400c400 tx=0x7f43b400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.675+0000 7f43c2ffd640 1 -- 172.21.15.37:0/414189389 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b40052d0 con 0x7f43cc0b3e80 2023-12-19T17:49:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.675+0000 7f43c2ffd640 1 -- 172.21.15.37:0/414189389 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b4005430 con 0x7f43cc0b3e80 2023-12-19T17:49:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.675+0000 7f43d08c4640 1 -- 172.21.15.37:0/414189389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43cc0b71d0 con 0x7f43cc0b3e80 2023-12-19T17:49:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.675+0000 7f43c2ffd640 1 -- 172.21.15.37:0/414189389 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b4003830 con 0x7f43cc0b3e80 2023-12-19T17:49:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.675+0000 7f43d08c4640 1 -- 172.21.15.37:0/414189389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc1437b0 con 0x7f43cc0b3e80 2023-12-19T17:49:54.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.675+0000 7f43d08c4640 1 -- 172.21.15.37:0/414189389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43cc1439d0 con 0x7f43cc0b3e80 2023-12-19T17:49:54.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.676+0000 7f43c2ffd640 1 -- 172.21.15.37:0/414189389 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f43b4003990 con 0x7f43cc0b3e80 2023-12-19T17:49:54.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.677+0000 7f43c2ffd640 1 --2- 172.21.15.37:0/414189389 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f43ac06a430 0x7f43ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:54.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.677+0000 7f43c2ffd640 1 -- 172.21.15.37:0/414189389 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f43b4087f00 con 0x7f43cc0b3e80 2023-12-19T17:49:54.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.677+0000 7f43c9d9b640 1 --2- 172.21.15.37:0/414189389 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f43ac06a430 0x7f43ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:54.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.677+0000 7f43c9d9b640 1 --2- 172.21.15.37:0/414189389 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f43ac06a430 0x7f43ac06c8f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f43bc007fd0 tx=0x7f43bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:54.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.685+0000 7f43c2ffd640 1 -- 172.21.15.37:0/414189389 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f43b40534a0 con 0x7f43cc0b3e80 2023-12-19T17:49:54.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:54.903+0000 7f43d08c4640 1 -- 172.21.15.37:0/414189389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f43cc0740a0 con 0x7f43cc0b3e80 2023-12-19T17:49:55.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.546+0000 7f43c2ffd640 1 -- 172.21.15.37:0/414189389 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f43b4056ac0 con 0x7f43cc0b3e80 2023-12-19T17:49:55.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.547+0000 7f43d08c4640 1 -- 172.21.15.37:0/414189389 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f43ac06a430 msgr2=0x7f43ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:55.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.547+0000 7f43d08c4640 1 --2- 172.21.15.37:0/414189389 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f43ac06a430 0x7f43ac06c8f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f43bc007fd0 tx=0x7f43bc009040 comp rx=0 tx=0).stop 2023-12-19T17:49:55.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.547+0000 7f43d08c4640 1 -- 172.21.15.37:0/414189389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43cc0b3e80 msgr2=0x7f43cc149f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:55.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.547+0000 7f43d08c4640 1 --2- 172.21.15.37:0/414189389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43cc0b3e80 0x7f43cc149f00 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f43b400c400 tx=0x7f43b400c8c0 comp rx=0 tx=0).stop 2023-12-19T17:49:55.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.548+0000 7f43d08c4640 1 -- 172.21.15.37:0/414189389 shutdown_connections 2023-12-19T17:49:55.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.548+0000 7f43d08c4640 1 --2- 172.21.15.37:0/414189389 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f43ac06a430 0x7f43ac06c8f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:55.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.548+0000 7f43d08c4640 1 --2- 172.21.15.37:0/414189389 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43cc0b9d10 0x7f43cc13b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:55.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.548+0000 7f43d08c4640 1 --2- 172.21.15.37:0/414189389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43cc0b91c0 0x7f43cc143cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:55.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.548+0000 7f43d08c4640 1 --2- 172.21.15.37:0/414189389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43cc0b3e80 0x7f43cc149f00 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:55.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.548+0000 7f43d08c4640 1 -- 172.21.15.37:0/414189389 >> 172.21.15.37:0/414189389 conn(0x7f43cc06acb0 msgr2=0x7f43cc069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:55.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.548+0000 7f43d08c4640 1 -- 172.21.15.37:0/414189389 shutdown_connections 2023-12-19T17:49:55.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.548+0000 7f43d08c4640 1 -- 172.21.15.37:0/414189389 wait complete. 2023-12-19T17:49:55.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T17:49:55.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.669+0000 7fd3ebaaf640 1 Processor -- start 2023-12-19T17:49:55.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.669+0000 7fd3ebaaf640 1 -- start start 2023-12-19T17:49:55.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.670+0000 7fd3ebaaf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3e40b2440 0x7fd3e414c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.670+0000 7fd3ebaaf640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd3e414c830 0x7fd3e41532c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.670+0000 7fd3ebaaf640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e414cc70 con 0x7fd3e40bad70 2023-12-19T17:49:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.670+0000 7fd3ebaaf640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e40b2860 con 0x7fd3e40b2440 2023-12-19T17:49:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.670+0000 7fd3ebaaf640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e40b9050 con 0x7fd3e414c830 2023-12-19T17:49:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.670+0000 7fd3e904a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3e40b2440 0x7fd3e414c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.670+0000 7fd3e904a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3e40b2440 0x7fd3e414c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55200/0 (socket says 172.21.15.37:55200) 2023-12-19T17:49:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.670+0000 7fd3e904a640 1 -- 172.21.15.37:0/3733459245 learned_addr learned my addr 172.21.15.37:0/3733459245 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.670+0000 7fd3e904a640 1 -- 172.21.15.37:0/3733459245 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd3e414c830 msgr2=0x7fd3e41532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.671+0000 7fd3ea04c640 1 --2- 172.21.15.37:0/3733459245 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd3e414c830 0x7fd3e41532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.671+0000 7fd3e904a640 1 --2- 172.21.15.37:0/3733459245 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd3e414c830 0x7fd3e41532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.671+0000 7fd3e904a640 1 -- 172.21.15.37:0/3733459245 >> v1:172.21.15.78:6789/0 conn(0x7fd3e40bad70 legacy=0x7fd3e41428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.671+0000 7fd3e904a640 1 -- 172.21.15.37:0/3733459245 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e40b9330 con 0x7fd3e40b2440 2023-12-19T17:49:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.671+0000 7fd3ea04c640 1 --2- 172.21.15.37:0/3733459245 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd3e414c830 0x7fd3e41532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:49:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.671+0000 7fd3e904a640 1 --2- 172.21.15.37:0/3733459245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3e40b2440 0x7fd3e414c2f0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0009870 tx=0x7fd3e002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15152ef6ef284fad server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:55.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.671+0000 7fd3e8849640 1 -- 172.21.15.37:0/3733459245 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e0030840 con 0x7fd3e40b2440 2023-12-19T17:49:55.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.671+0000 7fd3e8849640 1 -- 172.21.15.37:0/3733459245 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e00309a0 con 0x7fd3e40b2440 2023-12-19T17:49:55.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.672+0000 7fd3e8849640 1 -- 172.21.15.37:0/3733459245 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e0030d30 con 0x7fd3e40b2440 2023-12-19T17:49:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.672+0000 7fd3ebaaf640 1 -- 172.21.15.37:0/3733459245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3e40b2440 msgr2=0x7fd3e414c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.672+0000 7fd3ebaaf640 1 --2- 172.21.15.37:0/3733459245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3e40b2440 0x7fd3e414c2f0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0009870 tx=0x7fd3e002b980 comp rx=0 tx=0).stop 2023-12-19T17:49:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.672+0000 7fd3ebaaf640 1 -- 172.21.15.37:0/3733459245 shutdown_connections 2023-12-19T17:49:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.672+0000 7fd3ebaaf640 1 --2- 172.21.15.37:0/3733459245 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd3e414c830 0x7fd3e41532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.672+0000 7fd3ebaaf640 1 --2- 172.21.15.37:0/3733459245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3e40b2440 0x7fd3e414c2f0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.672+0000 7fd3ebaaf640 1 -- 172.21.15.37:0/3733459245 >> 172.21.15.37:0/3733459245 conn(0x7fd3e40be0c0 msgr2=0x7fd3e40be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.672+0000 7fd3ebaaf640 1 -- 172.21.15.37:0/3733459245 shutdown_connections 2023-12-19T17:49:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.672+0000 7fd3ebaaf640 1 -- 172.21.15.37:0/3733459245 wait complete. 2023-12-19T17:49:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.673+0000 7fd3ebaaf640 1 Processor -- start 2023-12-19T17:49:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.673+0000 7fd3ebaaf640 1 -- start start 2023-12-19T17:49:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.674+0000 7fd3ebaaf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e40b2440 0x7fd3e40bd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.674+0000 7fd3ebaaf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3e40bad70 0x7fd3e4140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.674+0000 7fd3ebaaf640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd3e414c830 0x7fd3e41382e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.674+0000 7fd3ebaaf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e40bd6a0 con 0x7fd3e40bad70 2023-12-19T17:49:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.674+0000 7fd3ebaaf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e41e3280 con 0x7fd3e40b2440 2023-12-19T17:49:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.674+0000 7fd3ebaaf640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e41e3560 con 0x7fd3e414c830 2023-12-19T17:49:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.674+0000 7fd3e904a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3e40bad70 0x7fd3e4140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.674+0000 7fd3e904a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3e40bad70 0x7fd3e4140e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55210/0 (socket says 172.21.15.37:55210) 2023-12-19T17:49:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.674+0000 7fd3e904a640 1 -- 172.21.15.37:0/1194787329 learned_addr learned my addr 172.21.15.37:0/1194787329 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.674+0000 7fd3e984b640 1 --2- 172.21.15.37:0/1194787329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e40b2440 0x7fd3e40bd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.674+0000 7fd3ea04c640 1 --2- 172.21.15.37:0/1194787329 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd3e414c830 0x7fd3e41382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.674+0000 7fd3e904a640 1 -- 172.21.15.37:0/1194787329 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd3e414c830 msgr2=0x7fd3e41382e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.674+0000 7fd3e904a640 1 --2- 172.21.15.37:0/1194787329 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd3e414c830 0x7fd3e41382e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.674+0000 7fd3e904a640 1 -- 172.21.15.37:0/1194787329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e40b2440 msgr2=0x7fd3e40bd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.674+0000 7fd3e904a640 1 --2- 172.21.15.37:0/1194787329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e40b2440 0x7fd3e40bd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.674+0000 7fd3e904a640 1 -- 172.21.15.37:0/1194787329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e00094d0 con 0x7fd3e40bad70 2023-12-19T17:49:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.674+0000 7fd3ea04c640 1 --2- 172.21.15.37:0/1194787329 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd3e414c830 0x7fd3e41382e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:49:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.674+0000 7fd3e984b640 1 --2- 172.21.15.37:0/1194787329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e40b2440 0x7fd3e40bd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:49:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.674+0000 7fd3e904a640 1 --2- 172.21.15.37:0/1194787329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3e40bad70 0x7fd3e4140e50 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0000c00 tx=0x7fd3e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.675+0000 7fd3da7fc640 1 -- 172.21.15.37:0/1194787329 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e0030810 con 0x7fd3e40bad70 2023-12-19T17:49:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.675+0000 7fd3da7fc640 1 -- 172.21.15.37:0/1194787329 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e0043400 con 0x7fd3e40bad70 2023-12-19T17:49:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.675+0000 7fd3ebaaf640 1 -- 172.21.15.37:0/1194787329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e41e3840 con 0x7fd3e40bad70 2023-12-19T17:49:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.675+0000 7fd3da7fc640 1 -- 172.21.15.37:0/1194787329 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e00437d0 con 0x7fd3e40bad70 2023-12-19T17:49:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.675+0000 7fd3ebaaf640 1 -- 172.21.15.37:0/1194787329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e414b7c0 con 0x7fd3e40bad70 2023-12-19T17:49:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.676+0000 7fd3ebaaf640 1 -- 172.21.15.37:0/1194787329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e41e3d60 con 0x7fd3e40bad70 2023-12-19T17:49:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.677+0000 7fd3da7fc640 1 -- 172.21.15.37:0/1194787329 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd3e0043930 con 0x7fd3e40bad70 2023-12-19T17:49:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.677+0000 7fd3da7fc640 1 --2- 172.21.15.37:0/1194787329 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd3c806a430 0x7fd3c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.677+0000 7fd3da7fc640 1 -- 172.21.15.37:0/1194787329 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd3e003e070 con 0x7fd3e40bad70 2023-12-19T17:49:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.677+0000 7fd3e984b640 1 --2- 172.21.15.37:0/1194787329 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd3c806a430 0x7fd3c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.678+0000 7fd3e984b640 1 --2- 172.21.15.37:0/1194787329 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd3c806a430 0x7fd3c806c8f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4000f60 tx=0x7fd3d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:55.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.682+0000 7fd3da7fc640 1 -- 172.21.15.37:0/1194787329 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd3e0077100 con 0x7fd3e40bad70 2023-12-19T17:49:55.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:55.861+0000 7fd3ebaaf640 1 -- 172.21.15.37:0/1194787329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd3e404e840 con 0x7fd3e40bad70 2023-12-19T17:49:56.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.653+0000 7fd3da7fc640 1 -- 172.21.15.37:0/1194787329 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd3e00340d0 con 0x7fd3e40bad70 2023-12-19T17:49:56.654 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-12-19T17:49:56.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.661+0000 7fd3ebaaf640 1 -- 172.21.15.37:0/1194787329 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd3c806a430 msgr2=0x7fd3c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:56.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.661+0000 7fd3ebaaf640 1 --2- 172.21.15.37:0/1194787329 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd3c806a430 0x7fd3c806c8f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4000f60 tx=0x7fd3d4009040 comp rx=0 tx=0).stop 2023-12-19T17:49:56.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.661+0000 7fd3ebaaf640 1 -- 172.21.15.37:0/1194787329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3e40bad70 msgr2=0x7fd3e4140e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:56.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.661+0000 7fd3ebaaf640 1 --2- 172.21.15.37:0/1194787329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3e40bad70 0x7fd3e4140e50 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0000c00 tx=0x7fd3e0004730 comp rx=0 tx=0).stop 2023-12-19T17:49:56.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.661+0000 7fd3ebaaf640 1 -- 172.21.15.37:0/1194787329 shutdown_connections 2023-12-19T17:49:56.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.661+0000 7fd3ebaaf640 1 --2- 172.21.15.37:0/1194787329 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd3c806a430 0x7fd3c806c8f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:56.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.661+0000 7fd3ebaaf640 1 --2- 172.21.15.37:0/1194787329 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd3e414c830 0x7fd3e41382e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:56.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.661+0000 7fd3ebaaf640 1 --2- 172.21.15.37:0/1194787329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3e40bad70 0x7fd3e4140e50 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:56.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.661+0000 7fd3ebaaf640 1 --2- 172.21.15.37:0/1194787329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3e40b2440 0x7fd3e40bd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:56.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.661+0000 7fd3ebaaf640 1 -- 172.21.15.37:0/1194787329 >> 172.21.15.37:0/1194787329 conn(0x7fd3e40be0c0 msgr2=0x7fd3e40b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:56.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.665+0000 7fd3ebaaf640 1 -- 172.21.15.37:0/1194787329 shutdown_connections 2023-12-19T17:49:56.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.665+0000 7fd3ebaaf640 1 -- 172.21.15.37:0/1194787329 wait complete. 2023-12-19T17:49:56.687 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T17:49:56.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.812+0000 7f8aa83cb640 1 Processor -- start 2023-12-19T17:49:56.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.812+0000 7f8aa83cb640 1 -- start start 2023-12-19T17:49:56.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.813+0000 7f8aa83cb640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8aa0145160 0x7f8aa00b97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:56.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.813+0000 7f8aa83cb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8aa00ba670 0x7f8aa006acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:56.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.813+0000 7f8aa83cb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa00b9030 con 0x7f8aa014ac60 2023-12-19T17:49:56.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.813+0000 7f8aa83cb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa00b9ce0 con 0x7f8aa00ba670 2023-12-19T17:49:56.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.813+0000 7f8aa83cb640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa00baad0 con 0x7f8aa0145160 2023-12-19T17:49:56.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.813+0000 7f8aa5966640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8aa00ba670 0x7f8aa006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:56.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.813+0000 7f8aa5966640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8aa00ba670 0x7f8aa006acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55216/0 (socket says 172.21.15.37:55216) 2023-12-19T17:49:56.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.813+0000 7f8aa5966640 1 -- 172.21.15.37:0/4213233774 learned_addr learned my addr 172.21.15.37:0/4213233774 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:56.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.813+0000 7f8aa6167640 1 --2- 172.21.15.37:0/4213233774 >> v2:172.21.15.78:3300/0 conn(0x7f8aa0145160 0x7f8aa00b97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:56.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.813+0000 7f8aa5966640 1 -- 172.21.15.37:0/4213233774 >> v2:172.21.15.78:3300/0 conn(0x7f8aa0145160 msgr2=0x7f8aa00b97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:56.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.813+0000 7f8aa5966640 1 --2- 172.21.15.37:0/4213233774 >> v2:172.21.15.78:3300/0 conn(0x7f8aa0145160 0x7f8aa00b97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:56.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.813+0000 7f8aa5966640 1 -- 172.21.15.37:0/4213233774 >> v1:172.21.15.78:6789/0 conn(0x7f8aa014ac60 legacy=0x7f8aa006e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:56.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.813+0000 7f8aa5966640 1 -- 172.21.15.37:0/4213233774 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa00badb0 con 0x7f8aa00ba670 2023-12-19T17:49:56.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.814+0000 7f8aa5966640 1 --2- 172.21.15.37:0/4213233774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aa00ba670 0x7f8aa006acb0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00bf000 tx=0x7f8a9c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37ae89e46942534 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:56.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.814+0000 7f8aa5165640 1 -- 172.21.15.37:0/4213233774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c0317e0 con 0x7f8aa00ba670 2023-12-19T17:49:56.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.814+0000 7f8aa5165640 1 -- 172.21.15.37:0/4213233774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c031940 con 0x7f8aa00ba670 2023-12-19T17:49:56.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.814+0000 7f8aa5165640 1 -- 172.21.15.37:0/4213233774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c031cd0 con 0x7f8aa00ba670 2023-12-19T17:49:56.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.815+0000 7f8aa83cb640 1 -- 172.21.15.37:0/4213233774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aa00ba670 msgr2=0x7f8aa006acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:56.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.815+0000 7f8aa83cb640 1 --2- 172.21.15.37:0/4213233774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aa00ba670 0x7f8aa006acb0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00bf000 tx=0x7f8a9c02b880 comp rx=0 tx=0).stop 2023-12-19T17:49:56.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.815+0000 7f8aa83cb640 1 -- 172.21.15.37:0/4213233774 shutdown_connections 2023-12-19T17:49:56.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.815+0000 7f8aa83cb640 1 --2- 172.21.15.37:0/4213233774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aa00ba670 0x7f8aa006acb0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:56.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.815+0000 7f8aa83cb640 1 --2- 172.21.15.37:0/4213233774 >> v2:172.21.15.78:3300/0 conn(0x7f8aa0145160 0x7f8aa00b97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:56.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.815+0000 7f8aa83cb640 1 -- 172.21.15.37:0/4213233774 >> 172.21.15.37:0/4213233774 conn(0x7f8aa00be0c0 msgr2=0x7f8aa00be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:56.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.815+0000 7f8aa83cb640 1 -- 172.21.15.37:0/4213233774 shutdown_connections 2023-12-19T17:49:56.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.815+0000 7f8aa83cb640 1 -- 172.21.15.37:0/4213233774 wait complete. 2023-12-19T17:49:56.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.816+0000 7f8aa83cb640 1 Processor -- start 2023-12-19T17:49:56.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.816+0000 7f8aa83cb640 1 -- start start 2023-12-19T17:49:56.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8aa83cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aa00ba670 0x7f8aa00b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:56.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8aa83cb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8aa0145160 0x7f8aa0147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:56.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8aa83cb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8aa014ac60 0x7f8aa01dfd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:56.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8aa83cb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa00b3be0 con 0x7f8aa00ba670 2023-12-19T17:49:56.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8aa83cb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa01e40f0 con 0x7f8aa014ac60 2023-12-19T17:49:56.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8aa83cb640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa01483b0 con 0x7f8aa0145160 2023-12-19T17:49:56.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8aa6167640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aa00ba670 0x7f8aa00b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:56.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8aa6167640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aa00ba670 0x7f8aa00b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55226/0 (socket says 172.21.15.37:55226) 2023-12-19T17:49:56.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8aa6167640 1 -- 172.21.15.37:0/2044803824 learned_addr learned my addr 172.21.15.37:0/2044803824 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:56.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8aa6968640 1 --2- 172.21.15.37:0/2044803824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8aa014ac60 0x7f8aa01dfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:56.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8aa5966640 1 --2- 172.21.15.37:0/2044803824 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8aa0145160 0x7f8aa0147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:56.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8aa6167640 1 -- 172.21.15.37:0/2044803824 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8aa0145160 msgr2=0x7f8aa0147e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:56.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8aa6167640 1 --2- 172.21.15.37:0/2044803824 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8aa0145160 0x7f8aa0147e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:56.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8aa6167640 1 -- 172.21.15.37:0/2044803824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8aa014ac60 msgr2=0x7f8aa01dfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:56.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8aa6167640 1 --2- 172.21.15.37:0/2044803824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8aa014ac60 0x7f8aa01dfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:56.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8aa6167640 1 -- 172.21.15.37:0/2044803824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c0094d0 con 0x7f8aa00ba670 2023-12-19T17:49:56.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8aa6167640 1 --2- 172.21.15.37:0/2044803824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aa00ba670 0x7f8aa00b36a0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f8a9000d800 tx=0x7f8a9000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:56.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8a96ffd640 1 -- 172.21.15.37:0/2044803824 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9000b6c0 con 0x7f8aa00ba670 2023-12-19T17:49:56.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8a96ffd640 1 -- 172.21.15.37:0/2044803824 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9000b820 con 0x7f8aa00ba670 2023-12-19T17:49:56.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8aa83cb640 1 -- 172.21.15.37:0/2044803824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa01e3330 con 0x7f8aa00ba670 2023-12-19T17:49:56.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8a96ffd640 1 -- 172.21.15.37:0/2044803824 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9000bbb0 con 0x7f8aa00ba670 2023-12-19T17:49:56.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.817+0000 7f8aa83cb640 1 -- 172.21.15.37:0/2044803824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa01e38f0 con 0x7f8aa00ba670 2023-12-19T17:49:56.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.818+0000 7f8aa83cb640 1 -- 172.21.15.37:0/2044803824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa004e840 con 0x7f8aa00ba670 2023-12-19T17:49:56.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.819+0000 7f8a96ffd640 1 -- 172.21.15.37:0/2044803824 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8a9000bd10 con 0x7f8aa00ba670 2023-12-19T17:49:56.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.819+0000 7f8a96ffd640 1 --2- 172.21.15.37:0/2044803824 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8a8406a430 0x7f8a8406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:56.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.819+0000 7f8a96ffd640 1 -- 172.21.15.37:0/2044803824 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f8a90088b90 con 0x7f8aa00ba670 2023-12-19T17:49:56.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.819+0000 7f8aa5966640 1 --2- 172.21.15.37:0/2044803824 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8a8406a430 0x7f8a8406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:56.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.820+0000 7f8aa5966640 1 --2- 172.21.15.37:0/2044803824 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8a8406a430 0x7f8a8406c8f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c036000 tx=0x7f8a9c03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:56.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:56.824+0000 7f8a96ffd640 1 -- 172.21.15.37:0/2044803824 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8a90054390 con 0x7f8aa00ba670 2023-12-19T17:49:57.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.004+0000 7f8aa83cb640 1 -- 172.21.15.37:0/2044803824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8aa00b4190 con 0x7f8aa00ba670 2023-12-19T17:49:57.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.654+0000 7f8a96ffd640 1 -- 172.21.15.37:0/2044803824 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8a900579b0 con 0x7f8aa00ba670 2023-12-19T17:49:57.655 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-12-19T17:49:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.658+0000 7f8aa83cb640 1 -- 172.21.15.37:0/2044803824 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8a8406a430 msgr2=0x7f8a8406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.658+0000 7f8aa83cb640 1 --2- 172.21.15.37:0/2044803824 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8a8406a430 0x7f8a8406c8f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c036000 tx=0x7f8a9c03d040 comp rx=0 tx=0).stop 2023-12-19T17:49:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.658+0000 7f8aa83cb640 1 -- 172.21.15.37:0/2044803824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aa00ba670 msgr2=0x7f8aa00b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:57.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.658+0000 7f8aa83cb640 1 --2- 172.21.15.37:0/2044803824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aa00ba670 0x7f8aa00b36a0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f8a9000d800 tx=0x7f8a9000dcc0 comp rx=0 tx=0).stop 2023-12-19T17:49:57.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.658+0000 7f8aa83cb640 1 -- 172.21.15.37:0/2044803824 shutdown_connections 2023-12-19T17:49:57.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.658+0000 7f8aa83cb640 1 --2- 172.21.15.37:0/2044803824 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f8a8406a430 0x7f8a8406c8f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:57.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.658+0000 7f8aa83cb640 1 --2- 172.21.15.37:0/2044803824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8aa014ac60 0x7f8aa01dfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:57.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.658+0000 7f8aa83cb640 1 --2- 172.21.15.37:0/2044803824 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8aa0145160 0x7f8aa0147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:57.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.658+0000 7f8aa83cb640 1 --2- 172.21.15.37:0/2044803824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aa00ba670 0x7f8aa00b36a0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:57.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.658+0000 7f8aa83cb640 1 -- 172.21.15.37:0/2044803824 >> 172.21.15.37:0/2044803824 conn(0x7f8aa00be0c0 msgr2=0x7f8aa00bc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:57.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.658+0000 7f8aa83cb640 1 -- 172.21.15.37:0/2044803824 shutdown_connections 2023-12-19T17:49:57.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.658+0000 7f8aa83cb640 1 -- 172.21.15.37:0/2044803824 wait complete. 2023-12-19T17:49:57.676 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T17:49:57.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.820+0000 7f4373b6d640 1 Processor -- start 2023-12-19T17:49:57.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.820+0000 7f4373b6d640 1 -- start start 2023-12-19T17:49:57.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.821+0000 7f4373b6d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f436c0b3ab0 0x7f436c156450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:57.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.821+0000 7f4373b6d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436c0ba7f0 con 0x7f436c0c0f40 2023-12-19T17:49:57.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.821+0000 7f4373b6d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436c06aa20 con 0x7f436c0b9f00 2023-12-19T17:49:57.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.821+0000 7f4373b6d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436c06b090 con 0x7f436c0b3ab0 2023-12-19T17:49:57.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.821+0000 7f4371108640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f436c0c0f40 0x7f436c06a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33332/0 (socket says 172.21.15.37:33332) 2023-12-19T17:49:57.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.821+0000 7f4371108640 1 -- 172.21.15.37:0/4226551630 learned_addr learned my addr 172.21.15.37:0/4226551630 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:49:57.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.821+0000 7f4371909640 1 --1- 172.21.15.37:0/4226551630 >> v1:172.21.15.78:6789/0 conn(0x7f436c0b9f00 0x7f436c0be220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.37:37216/0 (socket says 172.21.15.37:37216) 2023-12-19T17:49:57.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.821+0000 7f437210a640 1 --2- 172.21.15.37:0/4226551630 >> v2:172.21.15.78:3300/0 conn(0x7f436c0b3ab0 0x7f436c156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:57.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.822+0000 7f4370907640 1 -- 172.21.15.37:0/4226551630 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741633422 0 0) 0x7f436c06aa20 con 0x7f436c0b9f00 2023-12-19T17:49:57.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.822+0000 7f4370907640 1 -- 172.21.15.37:0/4226551630 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4358003520 con 0x7f436c0b9f00 2023-12-19T17:49:57.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.822+0000 7f437210a640 1 -- 172.21.15.37:0/4226551630 >> v1:172.21.15.78:6789/0 conn(0x7f436c0b9f00 legacy=0x7f436c0be220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:57.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.822+0000 7f437210a640 1 -- 172.21.15.37:0/4226551630 >> v1:172.21.15.37:6789/0 conn(0x7f436c0c0f40 legacy=0x7f436c06a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:57.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.822+0000 7f437210a640 1 -- 172.21.15.37:0/4226551630 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c0baed0 con 0x7f436c0b3ab0 2023-12-19T17:49:57.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.823+0000 7f437210a640 1 --2- 172.21.15.37:0/4226551630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f436c0b3ab0 0x7f436c156450 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4364009d90 tx=0x7f436402bcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1333308f3ea5cd54 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:57.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.823+0000 7f4370907640 1 -- 172.21.15.37:0/4226551630 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436402ca20 con 0x7f436c0b3ab0 2023-12-19T17:49:57.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.823+0000 7f4370907640 1 -- 172.21.15.37:0/4226551630 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436402cb80 con 0x7f436c0b3ab0 2023-12-19T17:49:57.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.823+0000 7f4370907640 1 -- 172.21.15.37:0/4226551630 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364034440 con 0x7f436c0b3ab0 2023-12-19T17:49:57.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.824+0000 7f4373b6d640 1 -- 172.21.15.37:0/4226551630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f436c0b3ab0 msgr2=0x7f436c156450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:57.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.824+0000 7f4373b6d640 1 --2- 172.21.15.37:0/4226551630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f436c0b3ab0 0x7f436c156450 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4364009d90 tx=0x7f436402bcf0 comp rx=0 tx=0).stop 2023-12-19T17:49:57.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.824+0000 7f4373b6d640 1 -- 172.21.15.37:0/4226551630 shutdown_connections 2023-12-19T17:49:57.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.824+0000 7f4373b6d640 1 --2- 172.21.15.37:0/4226551630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f436c0b3ab0 0x7f436c156450 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:57.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.824+0000 7f4373b6d640 1 -- 172.21.15.37:0/4226551630 >> 172.21.15.37:0/4226551630 conn(0x7f436c0c0420 msgr2=0x7f436c0c0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:57.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.824+0000 7f4373b6d640 1 -- 172.21.15.37:0/4226551630 shutdown_connections 2023-12-19T17:49:57.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.824+0000 7f4373b6d640 1 -- 172.21.15.37:0/4226551630 wait complete. 2023-12-19T17:49:57.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.826+0000 7f4373b6d640 1 Processor -- start 2023-12-19T17:49:57.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.826+0000 7f4373b6d640 1 -- start start 2023-12-19T17:49:57.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.827+0000 7f4373b6d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f436c0b3ab0 0x7f436c149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:57.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.827+0000 7f4373b6d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f436c0b9f00 0x7f436c0a5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:57.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.827+0000 7f4373b6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436c0c0f40 0x7f436c1e4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:57.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.827+0000 7f4373b6d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c1e1270 con 0x7f436c0c0f40 2023-12-19T17:49:57.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.827+0000 7f4373b6d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c1e38f0 con 0x7f436c0b9f00 2023-12-19T17:49:57.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.827+0000 7f4373b6d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436c14a300 con 0x7f436c0b3ab0 2023-12-19T17:49:57.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.827+0000 7f437210a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436c0c0f40 0x7f436c1e4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:57.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.827+0000 7f437210a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436c0c0f40 0x7f436c1e4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55230/0 (socket says 172.21.15.37:55230) 2023-12-19T17:49:57.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.827+0000 7f437210a640 1 -- 172.21.15.37:0/3939690170 learned_addr learned my addr 172.21.15.37:0/3939690170 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:57.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.827+0000 7f4371909640 1 --2- 172.21.15.37:0/3939690170 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f436c0b3ab0 0x7f436c149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:57.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.827+0000 7f4371108640 1 --2- 172.21.15.37:0/3939690170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f436c0b9f00 0x7f436c0a5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:57.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.827+0000 7f437210a640 1 -- 172.21.15.37:0/3939690170 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f436c0b3ab0 msgr2=0x7f436c149c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:57.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.827+0000 7f437210a640 1 --2- 172.21.15.37:0/3939690170 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f436c0b3ab0 0x7f436c149c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:57.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.827+0000 7f437210a640 1 -- 172.21.15.37:0/3939690170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f436c0b9f00 msgr2=0x7f436c0a5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:57.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.827+0000 7f437210a640 1 --2- 172.21.15.37:0/3939690170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f436c0b9f00 0x7f436c0a5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:57.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.827+0000 7f437210a640 1 -- 172.21.15.37:0/3939690170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4364009a70 con 0x7f436c0c0f40 2023-12-19T17:49:57.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.827+0000 7f4371108640 1 --2- 172.21.15.37:0/3939690170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f436c0b9f00 0x7f436c0a5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:49:57.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.828+0000 7f437210a640 1 --2- 172.21.15.37:0/3939690170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436c0c0f40 0x7f436c1e4080 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f4364037040 tx=0x7f4364004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:57.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.828+0000 7f43627fc640 1 -- 172.21.15.37:0/3939690170 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364040650 con 0x7f436c0c0f40 2023-12-19T17:49:57.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.828+0000 7f43627fc640 1 -- 172.21.15.37:0/3939690170 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43640407b0 con 0x7f436c0c0f40 2023-12-19T17:49:57.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.828+0000 7f43627fc640 1 -- 172.21.15.37:0/3939690170 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364040b60 con 0x7f436c0c0f40 2023-12-19T17:49:57.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.828+0000 7f4373b6d640 1 -- 172.21.15.37:0/3939690170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436c1e3b60 con 0x7f436c0c0f40 2023-12-19T17:49:57.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.828+0000 7f4373b6d640 1 -- 172.21.15.37:0/3939690170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436c0a60f0 con 0x7f436c0c0f40 2023-12-19T17:49:57.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.830+0000 7f4373b6d640 1 -- 172.21.15.37:0/3939690170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436c0740a0 con 0x7f436c0c0f40 2023-12-19T17:49:57.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.830+0000 7f43627fc640 1 -- 172.21.15.37:0/3939690170 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4364040cc0 con 0x7f436c0c0f40 2023-12-19T17:49:57.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.831+0000 7f43627fc640 1 --2- 172.21.15.37:0/3939690170 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f435006a430 0x7f435006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:57.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.831+0000 7f43627fc640 1 -- 172.21.15.37:0/3939690170 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f43640ab3d0 con 0x7f436c0c0f40 2023-12-19T17:49:57.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.831+0000 7f4371909640 1 --2- 172.21.15.37:0/3939690170 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f435006a430 0x7f435006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:57.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.831+0000 7f4371909640 1 --2- 172.21.15.37:0/3939690170 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f435006a430 0x7f435006c8f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f43680011e0 tx=0x7f4368007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:57.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:57.836+0000 7f43627fc640 1 -- 172.21.15.37:0/3939690170 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4364076c40 con 0x7f436c0c0f40 2023-12-19T17:49:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.092+0000 7f4373b6d640 1 -- 172.21.15.37:0/3939690170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f436c0bf3d0 con 0x7f436c0c0f40 2023-12-19T17:49:58.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.095+0000 7f43627fc640 1 -- 172.21.15.37:0/3939690170 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4364009450 con 0x7f436c0c0f40 2023-12-19T17:49:58.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.097+0000 7f4373b6d640 1 -- 172.21.15.37:0/3939690170 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f435006a430 msgr2=0x7f435006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:58.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.097+0000 7f4373b6d640 1 --2- 172.21.15.37:0/3939690170 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f435006a430 0x7f435006c8f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f43680011e0 tx=0x7f4368007d30 comp rx=0 tx=0).stop 2023-12-19T17:49:58.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.097+0000 7f4373b6d640 1 -- 172.21.15.37:0/3939690170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436c0c0f40 msgr2=0x7f436c1e4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:58.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.097+0000 7f4373b6d640 1 --2- 172.21.15.37:0/3939690170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436c0c0f40 0x7f436c1e4080 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f4364037040 tx=0x7f4364004a40 comp rx=0 tx=0).stop 2023-12-19T17:49:58.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.097+0000 7f4373b6d640 1 -- 172.21.15.37:0/3939690170 shutdown_connections 2023-12-19T17:49:58.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.097+0000 7f4373b6d640 1 --2- 172.21.15.37:0/3939690170 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f435006a430 0x7f435006c8f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:58.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.097+0000 7f4373b6d640 1 --2- 172.21.15.37:0/3939690170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436c0c0f40 0x7f436c1e4080 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:58.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.097+0000 7f4373b6d640 1 --2- 172.21.15.37:0/3939690170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f436c0b9f00 0x7f436c0a5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:58.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.097+0000 7f4373b6d640 1 --2- 172.21.15.37:0/3939690170 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f436c0b3ab0 0x7f436c149c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:58.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.097+0000 7f4373b6d640 1 -- 172.21.15.37:0/3939690170 >> 172.21.15.37:0/3939690170 conn(0x7f436c0c0420 msgr2=0x7f436c0b8680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:58.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.097+0000 7f4373b6d640 1 -- 172.21.15.37:0/3939690170 shutdown_connections 2023-12-19T17:49:58.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.097+0000 7f4373b6d640 1 -- 172.21.15.37:0/3939690170 wait complete. 2023-12-19T17:49:58.109 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2023-12-19T17:49:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.220+0000 7fd84a5a2640 1 Processor -- start 2023-12-19T17:49:58.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.220+0000 7fd84a5a2640 1 -- start start 2023-12-19T17:49:58.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.221+0000 7fd84a5a2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd8440b6910 0x7fd8441480d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:58.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.221+0000 7fd84a5a2640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8440b76d0 0x7fd844070e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:58.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.221+0000 7fd84a5a2640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd844147c40 con 0x7fd8440b3c70 2023-12-19T17:49:58.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.221+0000 7fd84a5a2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd844141cf0 con 0x7fd8440b6910 2023-12-19T17:49:58.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.221+0000 7fd84a5a2640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8441475f0 con 0x7fd8440b76d0 2023-12-19T17:49:58.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.221+0000 7fd8495a0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd8440b6910 0x7fd8441480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:58.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.221+0000 7fd8495a0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd8440b6910 0x7fd8441480d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55240/0 (socket says 172.21.15.37:55240) 2023-12-19T17:49:58.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.221+0000 7fd8495a0640 1 -- 172.21.15.37:0/2819499677 learned_addr learned my addr 172.21.15.37:0/2819499677 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:58.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.221+0000 7fd849da1640 1 --2- 172.21.15.37:0/2819499677 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8440b76d0 0x7fd844070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:58.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.221+0000 7fd8495a0640 1 -- 172.21.15.37:0/2819499677 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8440b76d0 msgr2=0x7fd844070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:58.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.221+0000 7fd8495a0640 1 --2- 172.21.15.37:0/2819499677 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8440b76d0 0x7fd844070e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:58.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.221+0000 7fd8495a0640 1 -- 172.21.15.37:0/2819499677 >> v1:172.21.15.78:6789/0 conn(0x7fd8440b3c70 legacy=0x7fd844070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:58.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.221+0000 7fd8495a0640 1 -- 172.21.15.37:0/2819499677 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8441478d0 con 0x7fd8440b6910 2023-12-19T17:49:58.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.221+0000 7fd849da1640 1 --2- 172.21.15.37:0/2819499677 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8440b76d0 0x7fd844070e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:49:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.222+0000 7fd8495a0640 1 --2- 172.21.15.37:0/2819499677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8440b6910 0x7fd8441480d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fd834009870 tx=0x7fd83402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dad30b013fb7926 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.222+0000 7fd83bfff640 1 -- 172.21.15.37:0/2819499677 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834030840 con 0x7fd8440b6910 2023-12-19T17:49:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.222+0000 7fd83bfff640 1 -- 172.21.15.37:0/2819499677 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8340309a0 con 0x7fd8440b6910 2023-12-19T17:49:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.222+0000 7fd83bfff640 1 -- 172.21.15.37:0/2819499677 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834030d30 con 0x7fd8440b6910 2023-12-19T17:49:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.223+0000 7fd84a5a2640 1 -- 172.21.15.37:0/2819499677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8440b6910 msgr2=0x7fd8441480d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.223+0000 7fd84a5a2640 1 --2- 172.21.15.37:0/2819499677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8440b6910 0x7fd8441480d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fd834009870 tx=0x7fd83402b980 comp rx=0 tx=0).stop 2023-12-19T17:49:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.223+0000 7fd84a5a2640 1 -- 172.21.15.37:0/2819499677 shutdown_connections 2023-12-19T17:49:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.223+0000 7fd84a5a2640 1 --2- 172.21.15.37:0/2819499677 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8440b76d0 0x7fd844070e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:58.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.223+0000 7fd84a5a2640 1 --2- 172.21.15.37:0/2819499677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8440b6910 0x7fd8441480d0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.223+0000 7fd84a5a2640 1 -- 172.21.15.37:0/2819499677 >> 172.21.15.37:0/2819499677 conn(0x7fd84406acb0 msgr2=0x7fd84406b090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.223+0000 7fd84a5a2640 1 -- 172.21.15.37:0/2819499677 shutdown_connections 2023-12-19T17:49:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.223+0000 7fd84a5a2640 1 -- 172.21.15.37:0/2819499677 wait complete. 2023-12-19T17:49:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.224+0000 7fd84a5a2640 1 Processor -- start 2023-12-19T17:49:58.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.224+0000 7fd84a5a2640 1 -- start start 2023-12-19T17:49:58.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.224+0000 7fd84a5a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8440b3c70 0x7fd8441d4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:58.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.224+0000 7fd84a5a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8440b6910 0x7fd8440bbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:58.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.224+0000 7fd84a5a2640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8440b76d0 0x7fd844143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:58.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.224+0000 7fd84a5a2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8441d5450 con 0x7fd8440b6910 2023-12-19T17:49:58.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.224+0000 7fd84a5a2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd844142060 con 0x7fd8440b3c70 2023-12-19T17:49:58.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.224+0000 7fd84a5a2640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd844144c40 con 0x7fd8440b76d0 2023-12-19T17:49:58.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.225+0000 7fd848d9f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8440b6910 0x7fd8440bbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:58.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.225+0000 7fd848d9f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8440b6910 0x7fd8440bbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55252/0 (socket says 172.21.15.37:55252) 2023-12-19T17:49:58.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.225+0000 7fd8495a0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8440b3c70 0x7fd8441d4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.225+0000 7fd848d9f640 1 -- 172.21.15.37:0/3962055073 learned_addr learned my addr 172.21.15.37:0/3962055073 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.225+0000 7fd849da1640 1 --2- 172.21.15.37:0/3962055073 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8440b76d0 0x7fd844143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.225+0000 7fd848d9f640 1 -- 172.21.15.37:0/3962055073 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8440b76d0 msgr2=0x7fd844143600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.225+0000 7fd848d9f640 1 --2- 172.21.15.37:0/3962055073 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8440b76d0 0x7fd844143600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.225+0000 7fd848d9f640 1 -- 172.21.15.37:0/3962055073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8440b3c70 msgr2=0x7fd8441d4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.225+0000 7fd848d9f640 1 --2- 172.21.15.37:0/3962055073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8440b3c70 0x7fd8441d4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.225+0000 7fd848d9f640 1 -- 172.21.15.37:0/3962055073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340094d0 con 0x7fd8440b6910 2023-12-19T17:49:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.225+0000 7fd848d9f640 1 --2- 172.21.15.37:0/3962055073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8440b6910 0x7fd8440bbba0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fd84000c450 tx=0x7fd84000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.225+0000 7fd839ffb640 1 -- 172.21.15.37:0/3962055073 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8400052d0 con 0x7fd8440b6910 2023-12-19T17:49:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.225+0000 7fd839ffb640 1 -- 172.21.15.37:0/3962055073 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd840005430 con 0x7fd8440b6910 2023-12-19T17:49:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.225+0000 7fd84a5a2640 1 -- 172.21.15.37:0/3962055073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8441422b0 con 0x7fd8440b6910 2023-12-19T17:49:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.225+0000 7fd839ffb640 1 -- 172.21.15.37:0/3962055073 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840012870 con 0x7fd8440b6910 2023-12-19T17:49:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.226+0000 7fd84a5a2640 1 -- 172.21.15.37:0/3962055073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8440bc0e0 con 0x7fd8440b6910 2023-12-19T17:49:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.227+0000 7fd84a5a2640 1 -- 172.21.15.37:0/3962055073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd844144e10 con 0x7fd8440b6910 2023-12-19T17:49:58.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.227+0000 7fd839ffb640 1 -- 172.21.15.37:0/3962055073 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd8400129d0 con 0x7fd8440b6910 2023-12-19T17:49:58.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.227+0000 7fd839ffb640 1 --2- 172.21.15.37:0/3962055073 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd82806a430 0x7fd82806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:58.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.227+0000 7fd839ffb640 1 -- 172.21.15.37:0/3962055073 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd8400880b0 con 0x7fd8440b6910 2023-12-19T17:49:58.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.228+0000 7fd8495a0640 1 --2- 172.21.15.37:0/3962055073 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd82806a430 0x7fd82806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:58.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.228+0000 7fd8495a0640 1 --2- 172.21.15.37:0/3962055073 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd82806a430 0x7fd82806c8f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd834036000 tx=0x7fd834008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.232+0000 7fd839ffb640 1 -- 172.21.15.37:0/3962055073 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd8400539b0 con 0x7fd8440b6910 2023-12-19T17:49:58.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.476+0000 7fd84a5a2640 1 -- 172.21.15.37:0/3962055073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7fd844061880 con 0x7fd8440b6910 2023-12-19T17:49:58.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.656+0000 7fd839ffb640 1 -- 172.21.15.37:0/3962055073 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v3147) v1 ==== 163+0+0 (secure 0 0 0) 0x7fd840056fd0 con 0x7fd8440b6910 2023-12-19T17:49:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.660+0000 7fd84a5a2640 1 -- 172.21.15.37:0/3962055073 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd82806a430 msgr2=0x7fd82806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.660+0000 7fd84a5a2640 1 --2- 172.21.15.37:0/3962055073 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd82806a430 0x7fd82806c8f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd834036000 tx=0x7fd834008030 comp rx=0 tx=0).stop 2023-12-19T17:49:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.660+0000 7fd84a5a2640 1 -- 172.21.15.37:0/3962055073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8440b6910 msgr2=0x7fd8440bbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.660+0000 7fd84a5a2640 1 --2- 172.21.15.37:0/3962055073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8440b6910 0x7fd8440bbba0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fd84000c450 tx=0x7fd84000c910 comp rx=0 tx=0).stop 2023-12-19T17:49:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.660+0000 7fd84a5a2640 1 -- 172.21.15.37:0/3962055073 shutdown_connections 2023-12-19T17:49:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.660+0000 7fd84a5a2640 1 --2- 172.21.15.37:0/3962055073 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd82806a430 0x7fd82806c8f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.660+0000 7fd84a5a2640 1 --2- 172.21.15.37:0/3962055073 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8440b76d0 0x7fd844143600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.660+0000 7fd84a5a2640 1 --2- 172.21.15.37:0/3962055073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8440b6910 0x7fd8440bbba0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.660+0000 7fd84a5a2640 1 --2- 172.21.15.37:0/3962055073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8440b3c70 0x7fd8441d4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.660+0000 7fd84a5a2640 1 -- 172.21.15.37:0/3962055073 >> 172.21.15.37:0/3962055073 conn(0x7fd84406acb0 msgr2=0x7fd8440b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.660+0000 7fd84a5a2640 1 -- 172.21.15.37:0/3962055073 shutdown_connections 2023-12-19T17:49:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:58.660+0000 7fd84a5a2640 1 -- 172.21.15.37:0/3962055073 wait complete. 2023-12-19T17:49:58.693 INFO:tasks.cephfs_test_runner:test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) ... FAIL 2023-12-19T17:49:58.693 INFO:tasks.cephfs_test_runner: 2023-12-19T17:49:58.693 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-19T17:49:58.693 INFO:tasks.cephfs_test_runner:FAIL: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-19T17:49:58.694 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-19T17:49:58.694 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-19T17:49:58.694 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs/test_fscrypt.py", line 76, in test_fscrypt_dummy_encryption_with_quick_group 2023-12-19T17:49:58.694 INFO:tasks.cephfs_test_runner: self.assertEqual(proc.returncode, 0) 2023-12-19T17:49:58.694 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2023-12-19T17:49:58.694 INFO:tasks.cephfs_test_runner: 2023-12-19T17:49:58.694 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-19T17:49:58.694 INFO:tasks.cephfs_test_runner:Ran 1 test in 6153.720s 2023-12-19T17:49:58.694 INFO:tasks.cephfs_test_runner: 2023-12-19T17:49:58.694 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-12-19T17:49:58.695 INFO:tasks.cephfs_test_runner: 2023-12-19T17:49:58.695 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-19T17:49:58.695 INFO:tasks.cephfs_test_runner:FAIL: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-19T17:49:58.695 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-19T17:49:58.695 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-19T17:49:58.695 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs/test_fscrypt.py", line 76, in test_fscrypt_dummy_encryption_with_quick_group 2023-12-19T17:49:58.695 INFO:tasks.cephfs_test_runner: self.assertEqual(proc.returncode, 0) 2023-12-19T17:49:58.695 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2023-12-19T17:49:58.695 INFO:tasks.cephfs_test_runner: 2023-12-19T17:49:58.696 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-19T17:49:58.769 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=de2d72adc8b3497ba4725a1bfe67dd59 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-19T17:49:58.770 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-19T17:49:58.781 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-19T17:49:58.798 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-19T17:49:58.799 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-19T17:49:58.799 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:49:58.875 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-19T17:49:58.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:49:58.875 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-19T17:49:58.969 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T17:49:58.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:49:58.970 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T17:49:59.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:49:59.074 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-12-19T17:49:59.196 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-19T17:49:59.206 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-19T17:49:59.206 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T17:49:59.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.312+0000 7fd1c53ae640 1 Processor -- start 2023-12-19T17:49:59.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.312+0000 7fd1c53ae640 1 -- start start 2023-12-19T17:49:59.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.313+0000 7fd1c53ae640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd1c00b6690 0x7fd1c0144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:59.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.313+0000 7fd1c53ae640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1c0144cd0 0x7fd1c0155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:59.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.313+0000 7fd1c53ae640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c00bc6b0 con 0x7fd1c00bcdd0 2023-12-19T17:49:59.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.313+0000 7fd1c53ae640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c00a59f0 con 0x7fd1c0144cd0 2023-12-19T17:49:59.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.313+0000 7fd1c53ae640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c00bc0a0 con 0x7fd1c00b6690 2023-12-19T17:49:59.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.313+0000 7fd1bf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1c0144cd0 0x7fd1c0155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:59.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.313+0000 7fd1beffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd1c00bcdd0 0x7fd1c00b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33342/0 (socket says 172.21.15.37:33342) 2023-12-19T17:49:59.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.313+0000 7fd1beffd640 1 -- 172.21.15.37:0/3685994666 learned_addr learned my addr 172.21.15.37:0/3685994666 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:49:59.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.313+0000 7fd1be7fc640 1 --2- 172.21.15.37:0/3685994666 >> v2:172.21.15.78:3300/0 conn(0x7fd1c00b6690 0x7fd1c0144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:59.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.313+0000 7fd1bdffb640 1 -- 172.21.15.37:0/3685994666 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534178896 0 0) 0x7fd1c00bc6b0 con 0x7fd1c00bcdd0 2023-12-19T17:49:59.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.313+0000 7fd1bdffb640 1 -- 172.21.15.37:0/3685994666 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a8003520 con 0x7fd1c00bcdd0 2023-12-19T17:49:59.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.313+0000 7fd1bf7fe640 1 -- 172.21.15.37:0/3685994666 >> v2:172.21.15.78:3300/0 conn(0x7fd1c00b6690 msgr2=0x7fd1c0144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:49:59.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.313+0000 7fd1bf7fe640 1 --2- 172.21.15.37:0/3685994666 >> v2:172.21.15.78:3300/0 conn(0x7fd1c00b6690 0x7fd1c0144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:59.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.313+0000 7fd1bf7fe640 1 -- 172.21.15.37:0/3685994666 >> v1:172.21.15.37:6789/0 conn(0x7fd1c00bcdd0 legacy=0x7fd1c00b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:59.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.313+0000 7fd1bf7fe640 1 -- 172.21.15.37:0/3685994666 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c00bc340 con 0x7fd1c0144cd0 2023-12-19T17:49:59.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.314+0000 7fd1bf7fe640 1 --2- 172.21.15.37:0/3685994666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c0144cd0 0x7fd1c0155340 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00b72e0 tx=0x7fd1b802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a01252f125bffe0c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:59.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.314+0000 7fd1bdffb640 1 -- 172.21.15.37:0/3685994666 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b802cd10 con 0x7fd1c0144cd0 2023-12-19T17:49:59.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.314+0000 7fd1bdffb640 1 -- 172.21.15.37:0/3685994666 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b802ce70 con 0x7fd1c0144cd0 2023-12-19T17:49:59.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.314+0000 7fd1bdffb640 1 -- 172.21.15.37:0/3685994666 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8034640 con 0x7fd1c0144cd0 2023-12-19T17:49:59.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.315+0000 7fd1c53ae640 1 -- 172.21.15.37:0/3685994666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c0144cd0 msgr2=0x7fd1c0155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:59.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.315+0000 7fd1c53ae640 1 --2- 172.21.15.37:0/3685994666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c0144cd0 0x7fd1c0155340 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00b72e0 tx=0x7fd1b802bf60 comp rx=0 tx=0).stop 2023-12-19T17:49:59.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.315+0000 7fd1c53ae640 1 -- 172.21.15.37:0/3685994666 shutdown_connections 2023-12-19T17:49:59.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.315+0000 7fd1c53ae640 1 --2- 172.21.15.37:0/3685994666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c0144cd0 0x7fd1c0155340 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:59.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.315+0000 7fd1c53ae640 1 --2- 172.21.15.37:0/3685994666 >> v2:172.21.15.78:3300/0 conn(0x7fd1c00b6690 0x7fd1c0144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:59.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.315+0000 7fd1c53ae640 1 -- 172.21.15.37:0/3685994666 >> 172.21.15.37:0/3685994666 conn(0x7fd1c0071e60 msgr2=0x7fd1c00c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:59.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.315+0000 7fd1c53ae640 1 -- 172.21.15.37:0/3685994666 shutdown_connections 2023-12-19T17:49:59.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.315+0000 7fd1c53ae640 1 -- 172.21.15.37:0/3685994666 wait complete. 2023-12-19T17:49:59.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.317+0000 7fd1c53ae640 1 Processor -- start 2023-12-19T17:49:59.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.317+0000 7fd1c53ae640 1 -- start start 2023-12-19T17:49:59.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1c53ae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c00b6690 0x7fd1c01e2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:59.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1c53ae640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1c00bcdd0 0x7fd1c0137ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:59.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1c53ae640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1c0144cd0 0x7fd1c00be640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:59.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1c53ae640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c00be220 con 0x7fd1c00b6690 2023-12-19T17:49:59.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1c53ae640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c00beb80 con 0x7fd1c0144cd0 2023-12-19T17:49:59.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1c53ae640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c01d1a90 con 0x7fd1c00bcdd0 2023-12-19T17:49:59.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1beffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c00b6690 0x7fd1c01e2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:59.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1beffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c00b6690 0x7fd1c01e2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55266/0 (socket says 172.21.15.37:55266) 2023-12-19T17:49:59.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1beffd640 1 -- 172.21.15.37:0/2458525225 learned_addr learned my addr 172.21.15.37:0/2458525225 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:59.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1bf7fe640 1 --2- 172.21.15.37:0/2458525225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1c0144cd0 0x7fd1c00be640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:59.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1be7fc640 1 --2- 172.21.15.37:0/2458525225 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1c00bcdd0 0x7fd1c0137ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:59.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1beffd640 1 -- 172.21.15.37:0/2458525225 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1c00bcdd0 msgr2=0x7fd1c0137ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:59.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1beffd640 1 --2- 172.21.15.37:0/2458525225 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1c00bcdd0 0x7fd1c0137ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:59.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1beffd640 1 -- 172.21.15.37:0/2458525225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1c0144cd0 msgr2=0x7fd1c00be640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:59.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1beffd640 1 --2- 172.21.15.37:0/2458525225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1c0144cd0 0x7fd1c00be640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:59.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1beffd640 1 -- 172.21.15.37:0/2458525225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b8009a70 con 0x7fd1c00b6690 2023-12-19T17:49:59.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1beffd640 1 --2- 172.21.15.37:0/2458525225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c00b6690 0x7fd1c01e2a30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000c430 tx=0x7fd1b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:59.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1a77fe640 1 -- 172.21.15.37:0/2458525225 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b0005ce0 con 0x7fd1c00b6690 2023-12-19T17:49:59.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1a77fe640 1 -- 172.21.15.37:0/2458525225 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b0005e40 con 0x7fd1c00b6690 2023-12-19T17:49:59.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1c53ae640 1 -- 172.21.15.37:0/2458525225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c01d14d0 con 0x7fd1c00b6690 2023-12-19T17:49:59.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.318+0000 7fd1a77fe640 1 -- 172.21.15.37:0/2458525225 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b00072f0 con 0x7fd1c00b6690 2023-12-19T17:49:59.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.319+0000 7fd1c53ae640 1 -- 172.21.15.37:0/2458525225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c0138170 con 0x7fd1c00b6690 2023-12-19T17:49:59.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.320+0000 7fd1c53ae640 1 -- 172.21.15.37:0/2458525225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c0138330 con 0x7fd1c00b6690 2023-12-19T17:49:59.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.320+0000 7fd1a77fe640 1 -- 172.21.15.37:0/2458525225 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd1b0007450 con 0x7fd1c00b6690 2023-12-19T17:49:59.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.320+0000 7fd1a77fe640 1 --2- 172.21.15.37:0/2458525225 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd1ac06a430 0x7fd1ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:59.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.321+0000 7fd1a77fe640 1 -- 172.21.15.37:0/2458525225 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd1b0087ba0 con 0x7fd1c00b6690 2023-12-19T17:49:59.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.321+0000 7fd1be7fc640 1 --2- 172.21.15.37:0/2458525225 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd1ac06a430 0x7fd1ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:59.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.321+0000 7fd1be7fc640 1 --2- 172.21.15.37:0/2458525225 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd1ac06a430 0x7fd1ac06c8f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd1c01d60c0 tx=0x7fd1b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:59.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.325+0000 7fd1a77fe640 1 -- 172.21.15.37:0/2458525225 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd1b00535d0 con 0x7fd1c00b6690 2023-12-19T17:49:59.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.602+0000 7fd1c53ae640 1 -- 172.21.15.37:0/2458525225 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd1c00bd1b0 con 0x7fd1ac06a430 2023-12-19T17:49:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.606+0000 7fd1a77fe640 1 -- 172.21.15.37:0/2458525225 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50682 (secure 0 0 0) 0x7fd1b4011970 con 0x7fd1ac06a430 2023-12-19T17:49:59.607 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T17:49:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-19T17:49:59.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.609+0000 7fd1c53ae640 1 -- 172.21.15.37:0/2458525225 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd1ac06a430 msgr2=0x7fd1ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:59.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.609+0000 7fd1c53ae640 1 --2- 172.21.15.37:0/2458525225 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd1ac06a430 0x7fd1ac06c8f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd1c01d60c0 tx=0x7fd1b4008040 comp rx=0 tx=0).stop 2023-12-19T17:49:59.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.609+0000 7fd1c53ae640 1 -- 172.21.15.37:0/2458525225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c00b6690 msgr2=0x7fd1c01e2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:59.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.609+0000 7fd1c53ae640 1 --2- 172.21.15.37:0/2458525225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c00b6690 0x7fd1c01e2a30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000c430 tx=0x7fd1b000c8f0 comp rx=0 tx=0).stop 2023-12-19T17:49:59.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.609+0000 7fd1c53ae640 1 -- 172.21.15.37:0/2458525225 shutdown_connections 2023-12-19T17:49:59.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.609+0000 7fd1c53ae640 1 --2- 172.21.15.37:0/2458525225 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fd1ac06a430 0x7fd1ac06c8f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:59.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.609+0000 7fd1c53ae640 1 --2- 172.21.15.37:0/2458525225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1c0144cd0 0x7fd1c00be640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:59.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.609+0000 7fd1c53ae640 1 --2- 172.21.15.37:0/2458525225 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd1c00bcdd0 0x7fd1c0137ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:59.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.609+0000 7fd1c53ae640 1 --2- 172.21.15.37:0/2458525225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c00b6690 0x7fd1c01e2a30 secure :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000c430 tx=0x7fd1b000c8f0 comp rx=0 tx=0).stop 2023-12-19T17:49:59.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.609+0000 7fd1c53ae640 1 -- 172.21.15.37:0/2458525225 >> 172.21.15.37:0/2458525225 conn(0x7fd1c0071e60 msgr2=0x7fd1c0140500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:59.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.612+0000 7fd1c53ae640 1 -- 172.21.15.37:0/2458525225 shutdown_connections 2023-12-19T17:49:59.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.612+0000 7fd1c53ae640 1 -- 172.21.15.37:0/2458525225 wait complete. 2023-12-19T17:49:59.628 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":3122,"stamp":"2023-12-19T17:49:58.137276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":9940680,"kb_used_data":1441032,"kb_used_omap":557,"kb_used_meta":8499026,"kb_avail":745034040,"statfs":{"total":773094113280,"available":762914856960,"internally_reserved":0,"allocated":1475616768,"data_stored":1473777105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":571312,"internal_metadata":8703002704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-754628659,"num_objects":-1361,"num_object_clones":0,"num_object_copies":-2722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1361,"num_whiteouts":0,"num_read":-66376,"num_read_kb":-54118090,"num_write":-2163525,"num_write_kb":-61026211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001577"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":227,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T17:49:26.785958+0000","last_change":"2023-12-19T16:06:47.761389+0000","last_active":"2023-12-19T17:49:26.785958+0000","last_peered":"2023-12-19T17:49:26.785958+0000","last_clean":"2023-12-19T17:49:26.785958+0000","last_became_active":"2023-12-19T16:06:47.760252+0000","last_became_peered":"2023-12-19T16:06:47.760252+0000","last_unstale":"2023-12-19T17:49:26.785958+0000","last_undegraded":"2023-12-19T17:49:26.785958+0000","last_fullsized":"2023-12-19T17:49:26.785958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_clean_scrub_stamp":"2023-12-19T16:06:46.706871+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:09.167979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576086,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1928700,"kb_used_data":155700,"kb_used_omap":0,"kb_used_meta":1772992,"kb_avail":92443140,"statfs":{"total":96636764160,"available":94661775360,"internally_reserved":0,"allocated":159436800,"data_stored":159208820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1815543808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.46200000000000002,"15min":0.57399999999999995},"min":{"1min":0.29999999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.61299999999999999,"5min":0.70099999999999996,"15min":19.341000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.47099999999999997,"15min":0.52200000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.255},"max":{"1min":0.46700000000000003,"5min":0.78800000000000003,"15min":5.524},"last":0.43099999999999999}]},{"osd":1,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.46400000000000002,"15min":0.59899999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":18.707999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.497,"15min":0.65500000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.60399999999999998,"5min":0.72899999999999998,"15min":18.146999999999998},"last":0.54500000000000004}]},{"osd":2,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.497,"15min":0.58799999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.64800000000000002,"5min":0.76300000000000001,"15min":19.300999999999998},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51800000000000002,"15min":0.55100000000000005},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.751,"5min":0.81799999999999995,"15min":5.1699999999999999},"last":0.64100000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.55800000000000005,"15min":0.57699999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.29999999999999999},"max":{"1min":3.9630000000000001,"5min":3.9630000000000001,"15min":10.005000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.56100000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":5.8209999999999997},"last":0.70299999999999996}]},{"osd":4,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.58599999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.22500000000000001},"max":{"1min":1.044,"5min":1.044,"15min":16.125},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51700000000000002,"15min":0.56000000000000005},"min":{"1min":0.31,"5min":0.30499999999999999,"15min":0.247},"max":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":9.9659999999999993},"last":0.78500000000000003}]},{"osd":5,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.498,"15min":0.61799999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28299999999999997},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":36.665999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.55600000000000005,"15min":0.66100000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.31},"max":{"1min":0.69399999999999995,"5min":0.78300000000000003,"15min":19.366},"last":0.92900000000000005}]},{"osd":6,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57999999999999996,"15min":0.67500000000000004},"min":{"1min":0.39200000000000002,"5min":0.36799999999999999,"15min":0.33000000000000002},"max":{"1min":0.751,"5min":0.80400000000000005,"15min":22.800000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.60099999999999998},"min":{"1min":0.38700000000000001,"5min":0.35999999999999999,"15min":0.33500000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":5.1120000000000001},"last":0.82799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834576089,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1606940,"kb_used_data":127380,"kb_used_omap":0,"kb_used_meta":1479552,"kb_avail":92764900,"statfs":{"total":96636764160,"available":94991257600,"internally_reserved":0,"allocated":130437120,"data_stored":130209439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1515061248},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.58499999999999996,"15min":0.54500000000000004},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":9.5589999999999993,"5min":9.5589999999999993,"15min":10.109},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.88,"5min":0.59899999999999998,"15min":0.56299999999999994},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":9.6069999999999993,"5min":9.6069999999999993,"15min":10.172000000000001},"last":0.51600000000000001}]},{"osd":1,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.58599999999999997,"15min":0.51400000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27100000000000002},"max":{"1min":8.0579999999999998,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.52500000000000002,"15min":0.51500000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27500000000000002},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.57999999999999996}]},{"osd":2,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":9.5830000000000002,"5min":9.5830000000000002,"15min":18.135000000000002},"last":0.628},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.61099999999999999,"15min":0.55600000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.316},"max":{"1min":7.069,"5min":7.069,"15min":7.069},"last":0.60199999999999998}]},{"osd":3,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56000000000000005,"15min":0.54100000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":3.3519999999999999,"5min":3.3519999999999999,"15min":3.3519999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.64700000000000002,"15min":0.59399999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":9.6289999999999996,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.67900000000000005}]},{"osd":4,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.252},"max":{"1min":3.3900000000000001,"5min":3.3900000000000001,"15min":8.4309999999999992},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.26100000000000001},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":10.231},"last":0.74399999999999999}]},{"osd":5,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":3.2959999999999998,"5min":3.2959999999999998,"15min":10.198},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59899999999999998,"15min":0.56100000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":0.69199999999999995}]},{"osd":7,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.27,"5min":3.27,"15min":10.257999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.68100000000000005,"15min":0.61799999999999999},"min":{"1min":0.32300000000000001,"5min":0.315,"15min":0.30299999999999999},"max":{"1min":9.5039999999999996,"5min":9.5039999999999996,"15min":9.5039999999999996},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834576087,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":539616,"kb_used_data":185560,"kb_used_omap":7,"kb_used_meta":354040,"kb_avail":93832224,"statfs":{"total":96636764160,"available":96084197376,"internally_reserved":0,"allocated":190013440,"data_stored":189785815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7169,"internal_metadata":362537983},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":5.0069999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":8.5549999999999997},"last":0.622}]},{"osd":1,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.55100000000000005},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.7919999999999998,"5min":2.7919999999999998,"15min":16.27},"last":0.44},{"interface":"front","average":{"1min":0.872,"5min":0.58199999999999996,"15min":0.54400000000000004},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":6.2670000000000003,"5min":6.2670000000000003,"15min":6.2670000000000003},"last":0.46600000000000003}]},{"osd":2,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.56399999999999995,"15min":0.629},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":21.789000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.58699999999999997,"15min":0.65300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":16.474},"last":0.48699999999999999}]},{"osd":3,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.59399999999999997,"15min":0.623},"min":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.32100000000000001},"max":{"1min":3.8929999999999998,"5min":3.8929999999999998,"15min":12.544},"last":0.501},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.54100000000000004,"15min":0.58799999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":4.8739999999999997},"last":0.51900000000000002}]},{"osd":4,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.49199999999999999,"15min":0.56399999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.22},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":19.652000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56899999999999995,"15min":0.67800000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.252},"max":{"1min":2.589,"5min":2.589,"15min":26.648},"last":0.57499999999999996}]},{"osd":6,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.51400000000000001,"15min":0.55300000000000005},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26300000000000001},"max":{"1min":0.627,"5min":0.746,"15min":5.9119999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.54400000000000004,"15min":0.56000000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.25800000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":2.2130000000000001},"last":0.55300000000000005}]},{"osd":7,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.60899999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.27100000000000002},"max":{"1min":2.5659999999999998,"5min":2.5659999999999998,"15min":8.7360000000000007},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.57799999999999996,"15min":0.64900000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.30299999999999999},"max":{"1min":0.69399999999999995,"5min":0.79200000000000004,"15min":16.315000000000001},"last":0.60799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834576088,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":770332,"kb_used_data":225236,"kb_used_omap":9,"kb_used_meta":545078,"kb_avail":93601508,"statfs":{"total":96636764160,"available":95847944192,"internally_reserved":0,"allocated":230641664,"data_stored":230410321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9755,"internal_metadata":558160357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.53800000000000003,"15min":0.53000000000000003},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":6.5389999999999997,"5min":6.5389999999999997,"15min":6.5389999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.54800000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.246},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":4.657},"last":0.57799999999999996}]},{"osd":1,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.56599999999999995,"15min":0.54300000000000004},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.6970000000000001,"5min":6.6970000000000001,"15min":6.6970000000000001},"last":0.499},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48699999999999999,"15min":0.51400000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.722,"5min":1.722,"15min":4.4809999999999999},"last":0.47799999999999998}]},{"osd":2,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.50800000000000001,"15min":0.53700000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.379,"5min":2.379,"15min":8.3729999999999993},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.52000000000000002,"15min":0.56299999999999994},"min":{"1min":0.32300000000000001,"5min":0.318,"15min":0.28899999999999998},"max":{"1min":0.64400000000000002,"5min":0.73599999999999999,"15min":8.3840000000000003},"last":0.63600000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":4.548},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.61099999999999999,"15min":0.58999999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":4.3440000000000003,"5min":4.3440000000000003,"15min":4.7850000000000001},"last":0.52600000000000002}]},{"osd":5,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.48499999999999999,"15min":0.54400000000000004},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66100000000000003,"5min":0.78200000000000003,"15min":14.387},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.50800000000000001,"15min":0.55500000000000005},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.68799999999999994,"5min":0.85499999999999998,"15min":14.430999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.51300000000000001,"15min":0.52300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63200000000000001,"5min":0.77000000000000002,"15min":4.399},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.54900000000000004,"15min":0.56999999999999995},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68500000000000005,"5min":0.82099999999999995,"15min":4.5910000000000002},"last":0.67600000000000005}]},{"osd":7,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.32700000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63700000000000001,"5min":0.89300000000000002,"15min":8.5139999999999993},"last":0.625},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.59099999999999997,"15min":0.61299999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66900000000000004,"5min":0.83399999999999996,"15min":6.4169999999999998},"last":0.68999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834576085,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":838516,"kb_used_data":212652,"kb_used_omap":71,"kb_used_meta":625784,"kb_avail":93533324,"statfs":{"total":96636764160,"available":95778123776,"internally_reserved":0,"allocated":217755648,"data_stored":217523632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":72831,"internal_metadata":640803713},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.39000000000000001,"15min":0.41499999999999998},"min":{"1min":0.224,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":4.7350000000000003,"5min":4.7350000000000003,"15min":11.298},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.40699999999999997,"15min":0.39700000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":3.657,"5min":3.657,"15min":10.164999999999999},"last":0.28999999999999998}]},{"osd":1,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.42499999999999999,"15min":0.40600000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":5.6100000000000003,"5min":5.6100000000000003,"15min":5.6100000000000003},"last":0.222},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.26300000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":3.899,"5min":3.899,"15min":8.8879999999999999},"last":0.27700000000000002}]},{"osd":2,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.45000000000000001,"15min":0.42099999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25700000000000001},"max":{"1min":4.8460000000000001,"5min":4.8460000000000001,"15min":5.4870000000000001},"last":0.314},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.435,"15min":0.46500000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":8.8079999999999998},"last":0.33000000000000002}]},{"osd":4,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.65100000000000002,"15min":0.63},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.6899999999999999,"5min":3.6899999999999999,"15min":3.702},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.66100000000000003,"15min":0.624},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.29999999999999999},"max":{"1min":4.8799999999999999,"5min":4.8799999999999999,"15min":4.8799999999999999},"last":0.48099999999999998}]},{"osd":5,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.63100000000000001,"15min":0.65000000000000002},"min":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":4.4880000000000004,"5min":4.4880000000000004,"15min":5.5199999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.67400000000000004,"15min":0.64600000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":4.3630000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":0.55000000000000004}]},{"osd":6,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.67900000000000005,"15min":0.63600000000000001},"min":{"1min":0.41899999999999998,"5min":0.40500000000000003,"15min":0.33000000000000002},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.64200000000000002,"15min":0.68799999999999994},"min":{"1min":0.45500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":3.46,"5min":3.46,"15min":11.099},"last":0.501}]},{"osd":7,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":3.7400000000000002,"5min":3.7400000000000002,"15min":3.7669999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.70499999999999996,"15min":0.67100000000000004},"min":{"1min":0.47099999999999997,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":4.9219999999999997,"5min":4.9219999999999997,"15min":4.9219999999999997},"last":0.53000000000000003}]}]},{"osd":2,"up_from":13,"seq":55834576088,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1701212,"kb_used_data":167828,"kb_used_omap":0,"kb_used_meta":1533376,"kb_avail":92670628,"statfs":{"total":96636764160,"available":94894723072,"internally_reserved":0,"allocated":171855872,"data_stored":171628591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1570177024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.223,"5min":0.20200000000000001,"15min":0.185},"max":{"1min":8.9529999999999994,"5min":8.9529999999999994,"15min":17.652999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":1.139,"5min":0.48999999999999999,"15min":0.54600000000000004},"min":{"1min":0.23300000000000001,"5min":0.218,"15min":0.155},"max":{"1min":9.8699999999999992,"5min":9.8699999999999992,"15min":22.620000000000001},"last":0.23599999999999999}]},{"osd":1,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":0.56699999999999995,"15min":0.61099999999999999},"min":{"1min":0.26200000000000001,"5min":0.22900000000000001,"15min":0.20899999999999999},"max":{"1min":11.515000000000001,"5min":11.515000000000001,"15min":23.327999999999999},"last":0.25800000000000001},{"interface":"front","average":{"1min":2.9209999999999998,"5min":0.86899999999999999,"15min":0.68100000000000005},"min":{"1min":0.254,"5min":0.247,"15min":0.23899999999999999},"max":{"1min":30.975000000000001,"5min":30.975000000000001,"15min":30.975000000000001},"last":0.29199999999999998}]},{"osd":3,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.46999999999999997,"15min":0.57199999999999995},"min":{"1min":0.318,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":5.6280000000000001,"5min":5.6280000000000001,"15min":33.106000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":1.847,"5min":0.68799999999999994,"15min":0.69799999999999995},"min":{"1min":0.32000000000000001,"5min":0.28399999999999997,"15min":0.221},"max":{"1min":10.458,"5min":10.458,"15min":22.576000000000001},"last":0.378}]},{"osd":4,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":0.73799999999999999,"15min":0.82499999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.34300000000000003},"max":{"1min":9.0350000000000001,"5min":9.0350000000000001,"15min":27.885999999999999},"last":0.498},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.64800000000000002,"15min":0.80100000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.309},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":39.417000000000002},"last":0.59599999999999997}]},{"osd":5,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.68999999999999995,"15min":0.73999999999999999},"min":{"1min":0.45400000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.6989999999999998,"5min":5.6989999999999998,"15min":23.238},"last":0.48599999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":0.77500000000000002,"15min":0.66900000000000004},"min":{"1min":0.41799999999999998,"5min":0.40899999999999997,"15min":0.379},"max":{"1min":9.0920000000000005,"5min":9.0920000000000005,"15min":9.0920000000000005},"last":0.57199999999999995}]},{"osd":6,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.625,"15min":0.69399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":22.675999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.71299999999999997,"15min":0.76900000000000002},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":5.6689999999999996,"5min":5.6689999999999996,"15min":23.164999999999999},"last":0.54500000000000004}]},{"osd":7,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.66000000000000003,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":3.3980000000000001,"5min":3.3980000000000001,"15min":22.824999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":1.0669999999999999,"5min":0.72899999999999998,"15min":0.76700000000000002},"min":{"1min":0.50700000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":5.726,"5min":5.726,"15min":23.207999999999998},"last":0.52000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834576087,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1071880,"kb_used_data":258496,"kb_used_omap":470,"kb_used_meta":812905,"kb_avail":93299960,"statfs":{"total":96636764160,"available":95539159040,"internally_reserved":0,"allocated":264699904,"data_stored":264468205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":481557,"internal_metadata":832415467},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.33800000000000002,"15min":0.374},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":5.7869999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.34699999999999998,"15min":0.376},"min":{"1min":0.23000000000000001,"5min":0.22,"15min":0.22},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":6.6379999999999999},"last":0.28899999999999998}]},{"osd":2,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.32900000000000001,"15min":0.34499999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":4.3929999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.40400000000000003,"15min":0.436},"min":{"1min":0.26500000000000001,"5min":0.252,"15min":0.21099999999999999},"max":{"1min":2.895,"5min":2.895,"15min":12.276999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.43099999999999999,"15min":0.46400000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.221},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":13.153},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.40400000000000003,"15min":0.45300000000000001},"min":{"1min":0.28399999999999997,"5min":0.248,"15min":0.216},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":6.0910000000000002},"last":0.36599999999999999}]},{"osd":4,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.34699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.099,"5min":1.099,"15min":2.222},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.435,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.9710000000000001,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":0.55000000000000004}]},{"osd":5,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.60599999999999998,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":2.984,"5min":2.984,"15min":11.009},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60599999999999998,"15min":0.64400000000000002},"min":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.35499999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":10.813000000000001},"last":0.59499999999999997}]},{"osd":6,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.61899999999999999,"15min":0.64400000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.35799999999999998},"max":{"1min":3.0720000000000001,"5min":3.0720000000000001,"15min":11.055},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60599999999999998,"15min":0.61499999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.125,"5min":1.125,"15min":3.2469999999999999},"last":0.56100000000000005}]},{"osd":7,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.63800000000000001,"15min":0.65300000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":6.1349999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.63200000000000001,"15min":0.65500000000000003},"min":{"1min":0.42699999999999999,"5min":0.38100000000000001,"15min":0.36499999999999999},"max":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":6.431},"last":0.57799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834576089,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1483484,"kb_used_data":108180,"kb_used_omap":0,"kb_used_meta":1375296,"kb_avail":92888356,"statfs":{"total":96636764160,"available":95117676544,"internally_reserved":0,"allocated":110776320,"data_stored":110542282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1408303104},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.40899999999999997,"15min":0.44500000000000001},"min":{"1min":0.21299999999999999,"5min":0.19400000000000001,"15min":0.189},"max":{"1min":5.351,"5min":5.351,"15min":22.059000000000001},"last":0.25900000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.47499999999999998,"15min":0.42899999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":6.4269999999999996,"5min":6.4269999999999996,"15min":6.4269999999999996},"last":0.27900000000000003}]},{"osd":2,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.432,"15min":0.495},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23000000000000001},"max":{"1min":5.3739999999999997,"5min":5.3739999999999997,"15min":17.870999999999999},"last":0.317},{"interface":"front","average":{"1min":1.016,"5min":0.47699999999999998,"15min":0.41899999999999998},"min":{"1min":0.23599999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":6.3419999999999996,"5min":6.3419999999999996,"15min":6.3419999999999996},"last":0.35899999999999999}]},{"osd":3,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.40699999999999997,"15min":0.46800000000000003},"min":{"1min":0.23499999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":10.585000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":1.4670000000000001,"5min":0.60799999999999998,"15min":0.50900000000000001},"min":{"1min":0.29599999999999999,"5min":0.29099999999999998,"15min":0.27800000000000002},"max":{"1min":9.5139999999999993,"5min":9.5139999999999993,"15min":11.077},"last":0.34799999999999998}]},{"osd":4,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":0.68799999999999994,"15min":0.67500000000000004},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":6.4889999999999999,"5min":6.4889999999999999,"15min":6.4889999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.58699999999999997,"15min":0.63400000000000001},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.28699999999999998},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":6.1669999999999998},"last":0.83599999999999997}]},{"osd":5,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.58399999999999996,"15min":0.64200000000000002},"min":{"1min":0.379,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":9.8019999999999996},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40200000000000002},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.4080000000000004},"last":0.70099999999999996}]},{"osd":6,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":5.2990000000000004,"5min":5.2990000000000004,"15min":5.2990000000000004},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.1319999999999999,"5min":0.69699999999999995,"15min":0.65800000000000003},"min":{"1min":0.432,"5min":0.41699999999999998,"15min":0.36199999999999999},"max":{"1min":6.3860000000000001,"5min":6.3860000000000001,"15min":6.3860000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":0.71999999999999997,"15min":0.78600000000000003},"min":{"1min":0.45000000000000001,"5min":0.42999999999999999,"15min":0.38700000000000001},"max":{"1min":6.4619999999999997,"5min":6.4619999999999997,"15min":31.004999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.59999999999999998,"15min":0.71799999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":27.370999999999999},"last":0.85499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T17:49:59.630 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T17:49:59.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.795+0000 7f2b00973640 1 Processor -- start 2023-12-19T17:49:59.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.795+0000 7f2b00973640 1 -- start start 2023-12-19T17:49:59.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.796+0000 7f2b00973640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2afc069e10 0x7f2afc071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:59.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.796+0000 7f2b00973640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2afc14fb50 con 0x7f2afc0717a0 2023-12-19T17:49:59.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.796+0000 7f2b00973640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2afc071c90 con 0x7f2afc06ba70 2023-12-19T17:49:59.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.796+0000 7f2b00973640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0b7240 con 0x7f2afc069e10 2023-12-19T17:49:59.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.796+0000 7f2afad9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2afc0717a0 0x7f2afc159780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50424/0 (socket says 172.21.15.37:50424) 2023-12-19T17:49:59.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.796+0000 7f2afad9d640 1 -- 172.21.15.37:0/1678331935 learned_addr learned my addr 172.21.15.37:0/1678331935 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:49:59.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.797+0000 7f2afa59c640 1 --2- 172.21.15.37:0/1678331935 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2afc069e10 0x7f2afc071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:59.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.797+0000 7f2af959a640 1 -- 172.21.15.37:0/1678331935 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832372967 0 0) 0x7f2afc14fb50 con 0x7f2afc0717a0 2023-12-19T17:49:59.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.797+0000 7f2af959a640 1 -- 172.21.15.37:0/1678331935 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ae4003520 con 0x7f2afc0717a0 2023-12-19T17:49:59.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.797+0000 7f2af959a640 1 -- 172.21.15.37:0/1678331935 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171733670 0 0) 0x7f2afc071c90 con 0x7f2afc06ba70 2023-12-19T17:49:59.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.797+0000 7f2af959a640 1 -- 172.21.15.37:0/1678331935 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2afc14fb50 con 0x7f2afc06ba70 2023-12-19T17:49:59.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.797+0000 7f2afa59c640 1 -- 172.21.15.37:0/1678331935 >> v1:172.21.15.78:6789/0 conn(0x7f2afc06ba70 legacy=0x7f2afc070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:59.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.797+0000 7f2afa59c640 1 -- 172.21.15.37:0/1678331935 >> v1:172.21.15.37:6789/0 conn(0x7f2afc0717a0 legacy=0x7f2afc159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:59.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.797+0000 7f2afa59c640 1 -- 172.21.15.37:0/1678331935 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc14f500 con 0x7f2afc069e10 2023-12-19T17:49:59.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.798+0000 7f2afa59c640 1 --2- 172.21.15.37:0/1678331935 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2afc069e10 0x7f2afc071260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0097d0 tx=0x7f2aec02b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bf05bc49272c172 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:59.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.798+0000 7f2af959a640 1 -- 172.21.15.37:0/1678331935 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec030880 con 0x7f2afc069e10 2023-12-19T17:49:59.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.798+0000 7f2af959a640 1 -- 172.21.15.37:0/1678331935 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec0309e0 con 0x7f2afc069e10 2023-12-19T17:49:59.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.798+0000 7f2af959a640 1 -- 172.21.15.37:0/1678331935 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec030d70 con 0x7f2afc069e10 2023-12-19T17:49:59.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.799+0000 7f2b00973640 1 -- 172.21.15.37:0/1678331935 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2afc069e10 msgr2=0x7f2afc071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:59.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.799+0000 7f2b00973640 1 --2- 172.21.15.37:0/1678331935 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2afc069e10 0x7f2afc071260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0097d0 tx=0x7f2aec02b9c0 comp rx=0 tx=0).stop 2023-12-19T17:49:59.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.799+0000 7f2b00973640 1 -- 172.21.15.37:0/1678331935 shutdown_connections 2023-12-19T17:49:59.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.799+0000 7f2b00973640 1 --2- 172.21.15.37:0/1678331935 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2afc069e10 0x7f2afc071260 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:59.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.799+0000 7f2b00973640 1 -- 172.21.15.37:0/1678331935 >> 172.21.15.37:0/1678331935 conn(0x7f2afc0b9c30 msgr2=0x7f2afc0ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:49:59.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.799+0000 7f2b00973640 1 -- 172.21.15.37:0/1678331935 shutdown_connections 2023-12-19T17:49:59.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.799+0000 7f2b00973640 1 -- 172.21.15.37:0/1678331935 wait complete. 2023-12-19T17:49:59.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.801+0000 7f2b00973640 1 Processor -- start 2023-12-19T17:49:59.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.801+0000 7f2b00973640 1 -- start start 2023-12-19T17:49:59.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.801+0000 7f2b00973640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2afc069e10 0x7f2afc14e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:59.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.801+0000 7f2b00973640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2afc06ba70 0x7f2afc151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:59.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.801+0000 7f2b00973640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2afc0717a0 0x7f2afc149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:59.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.801+0000 7f2b00973640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc14e930 con 0x7f2afc069e10 2023-12-19T17:49:59.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.801+0000 7f2b00973640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc1520f0 con 0x7f2afc06ba70 2023-12-19T17:49:59.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.801+0000 7f2b00973640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc152690 con 0x7f2afc0717a0 2023-12-19T17:49:59.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.802+0000 7f2afa59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2afc069e10 0x7f2afc14e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:59.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.802+0000 7f2afa59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2afc069e10 0x7f2afc14e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45732/0 (socket says 172.21.15.37:45732) 2023-12-19T17:49:59.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.802+0000 7f2afa59c640 1 -- 172.21.15.37:0/2639413315 learned_addr learned my addr 172.21.15.37:0/2639413315 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:49:59.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.802+0000 7f2af9d9b640 1 --2- 172.21.15.37:0/2639413315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2afc06ba70 0x7f2afc151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:59.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.802+0000 7f2afad9d640 1 --2- 172.21.15.37:0/2639413315 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2afc0717a0 0x7f2afc149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:59.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.802+0000 7f2afa59c640 1 -- 172.21.15.37:0/2639413315 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2afc0717a0 msgr2=0x7f2afc149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:59.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.802+0000 7f2afa59c640 1 --2- 172.21.15.37:0/2639413315 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2afc0717a0 0x7f2afc149990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:59.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.802+0000 7f2afa59c640 1 -- 172.21.15.37:0/2639413315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2afc06ba70 msgr2=0x7f2afc151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:49:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.802+0000 7f2afa59c640 1 --2- 172.21.15.37:0/2639413315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2afc06ba70 0x7f2afc151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:49:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.802+0000 7f2afa59c640 1 -- 172.21.15.37:0/2639413315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec009400 con 0x7f2afc069e10 2023-12-19T17:49:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.802+0000 7f2af9d9b640 1 --2- 172.21.15.37:0/2639413315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2afc06ba70 0x7f2afc151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:49:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.802+0000 7f2afad9d640 1 --2- 172.21.15.37:0/2639413315 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2afc0717a0 0x7f2afc149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:49:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.802+0000 7f2afa59c640 1 --2- 172.21.15.37:0/2639413315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2afc069e10 0x7f2afc14e3f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0098f0 tx=0x7f2aec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.803+0000 7f2aeaffd640 1 -- 172.21.15.37:0/2639413315 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec03e040 con 0x7f2afc069e10 2023-12-19T17:49:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.803+0000 7f2aeaffd640 1 -- 172.21.15.37:0/2639413315 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec039c90 con 0x7f2afc069e10 2023-12-19T17:49:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.803+0000 7f2b00973640 1 -- 172.21.15.37:0/2639413315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2afc152970 con 0x7f2afc069e10 2023-12-19T17:49:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.803+0000 7f2aeaffd640 1 -- 172.21.15.37:0/2639413315 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec03e040 con 0x7f2afc069e10 2023-12-19T17:49:59.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.803+0000 7f2b00973640 1 -- 172.21.15.37:0/2639413315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2afc151d30 con 0x7f2afc069e10 2023-12-19T17:49:59.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.804+0000 7f2b00973640 1 -- 172.21.15.37:0/2639413315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2afc06ab80 con 0x7f2afc069e10 2023-12-19T17:49:59.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.806+0000 7f2aeaffd640 1 -- 172.21.15.37:0/2639413315 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2aec0443f0 con 0x7f2afc069e10 2023-12-19T17:49:59.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.806+0000 7f2aeaffd640 1 --2- 172.21.15.37:0/2639413315 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2adc06a490 0x7f2adc06c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:49:59.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.806+0000 7f2aeaffd640 1 -- 172.21.15.37:0/2639413315 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2aec0aae00 con 0x7f2afc069e10 2023-12-19T17:49:59.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.807+0000 7f2af9d9b640 1 --2- 172.21.15.37:0/2639413315 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2adc06a490 0x7f2adc06c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:49:59.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.807+0000 7f2af9d9b640 1 --2- 172.21.15.37:0/2639413315 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2adc06a490 0x7f2adc06c950 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2af0007fd0 tx=0x7f2af0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:49:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:49:59.813+0000 7f2aeaffd640 1 -- 172.21.15.37:0/2639413315 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2aec076830 con 0x7f2afc069e10 2023-12-19T17:50:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.047+0000 7f2b00973640 1 -- 172.21.15.37:0/2639413315 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2afc06fc10 con 0x7f2adc06a490 2023-12-19T17:50:00.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.049+0000 7f2aeaffd640 1 -- 172.21.15.37:0/2639413315 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50682 (secure 0 0 0) 0x7f2af0001900 con 0x7f2adc06a490 2023-12-19T17:50:00.050 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T17:50:00.051 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-19T17:50:00.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.051+0000 7f2b00973640 1 -- 172.21.15.37:0/2639413315 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2adc06a490 msgr2=0x7f2adc06c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:00.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.051+0000 7f2b00973640 1 --2- 172.21.15.37:0/2639413315 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2adc06a490 0x7f2adc06c950 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2af0007fd0 tx=0x7f2af0009040 comp rx=0 tx=0).stop 2023-12-19T17:50:00.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.051+0000 7f2b00973640 1 -- 172.21.15.37:0/2639413315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2afc069e10 msgr2=0x7f2afc14e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:00.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.051+0000 7f2b00973640 1 --2- 172.21.15.37:0/2639413315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2afc069e10 0x7f2afc14e3f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0098f0 tx=0x7f2aec004730 comp rx=0 tx=0).stop 2023-12-19T17:50:00.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.051+0000 7f2b00973640 1 -- 172.21.15.37:0/2639413315 shutdown_connections 2023-12-19T17:50:00.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.051+0000 7f2b00973640 1 --2- 172.21.15.37:0/2639413315 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f2adc06a490 0x7f2adc06c950 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.051+0000 7f2b00973640 1 --2- 172.21.15.37:0/2639413315 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2afc0717a0 0x7f2afc149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.051+0000 7f2b00973640 1 --2- 172.21.15.37:0/2639413315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2afc06ba70 0x7f2afc151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.051+0000 7f2b00973640 1 --2- 172.21.15.37:0/2639413315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2afc069e10 0x7f2afc14e3f0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.051+0000 7f2b00973640 1 -- 172.21.15.37:0/2639413315 >> 172.21.15.37:0/2639413315 conn(0x7f2afc0b9c30 msgr2=0x7f2afc0bc180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:00.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.051+0000 7f2b00973640 1 -- 172.21.15.37:0/2639413315 shutdown_connections 2023-12-19T17:50:00.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.051+0000 7f2b00973640 1 -- 172.21.15.37:0/2639413315 wait complete. 2023-12-19T17:50:00.062 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":3122,"stamp":"2023-12-19T17:49:58.137276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":9940680,"kb_used_data":1441032,"kb_used_omap":557,"kb_used_meta":8499026,"kb_avail":745034040,"statfs":{"total":773094113280,"available":762914856960,"internally_reserved":0,"allocated":1475616768,"data_stored":1473777105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":571312,"internal_metadata":8703002704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-754628659,"num_objects":-1361,"num_object_clones":0,"num_object_copies":-2722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1361,"num_whiteouts":0,"num_read":-66376,"num_read_kb":-54118090,"num_write":-2163525,"num_write_kb":-61026211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001577"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":227,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T17:49:26.785958+0000","last_change":"2023-12-19T16:06:47.761389+0000","last_active":"2023-12-19T17:49:26.785958+0000","last_peered":"2023-12-19T17:49:26.785958+0000","last_clean":"2023-12-19T17:49:26.785958+0000","last_became_active":"2023-12-19T16:06:47.760252+0000","last_became_peered":"2023-12-19T16:06:47.760252+0000","last_unstale":"2023-12-19T17:49:26.785958+0000","last_undegraded":"2023-12-19T17:49:26.785958+0000","last_fullsized":"2023-12-19T17:49:26.785958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_clean_scrub_stamp":"2023-12-19T16:06:46.706871+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:09.167979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576086,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1928700,"kb_used_data":155700,"kb_used_omap":0,"kb_used_meta":1772992,"kb_avail":92443140,"statfs":{"total":96636764160,"available":94661775360,"internally_reserved":0,"allocated":159436800,"data_stored":159208820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1815543808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.46200000000000002,"15min":0.57399999999999995},"min":{"1min":0.29999999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.61299999999999999,"5min":0.70099999999999996,"15min":19.341000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.47099999999999997,"15min":0.52200000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.255},"max":{"1min":0.46700000000000003,"5min":0.78800000000000003,"15min":5.524},"last":0.43099999999999999}]},{"osd":1,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.46400000000000002,"15min":0.59899999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":18.707999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.497,"15min":0.65500000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.60399999999999998,"5min":0.72899999999999998,"15min":18.146999999999998},"last":0.54500000000000004}]},{"osd":2,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.497,"15min":0.58799999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.64800000000000002,"5min":0.76300000000000001,"15min":19.300999999999998},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51800000000000002,"15min":0.55100000000000005},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.751,"5min":0.81799999999999995,"15min":5.1699999999999999},"last":0.64100000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.55800000000000005,"15min":0.57699999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.29999999999999999},"max":{"1min":3.9630000000000001,"5min":3.9630000000000001,"15min":10.005000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.56100000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":5.8209999999999997},"last":0.70299999999999996}]},{"osd":4,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.58599999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.22500000000000001},"max":{"1min":1.044,"5min":1.044,"15min":16.125},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51700000000000002,"15min":0.56000000000000005},"min":{"1min":0.31,"5min":0.30499999999999999,"15min":0.247},"max":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":9.9659999999999993},"last":0.78500000000000003}]},{"osd":5,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.498,"15min":0.61799999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28299999999999997},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":36.665999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.55600000000000005,"15min":0.66100000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.31},"max":{"1min":0.69399999999999995,"5min":0.78300000000000003,"15min":19.366},"last":0.92900000000000005}]},{"osd":6,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57999999999999996,"15min":0.67500000000000004},"min":{"1min":0.39200000000000002,"5min":0.36799999999999999,"15min":0.33000000000000002},"max":{"1min":0.751,"5min":0.80400000000000005,"15min":22.800000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.60099999999999998},"min":{"1min":0.38700000000000001,"5min":0.35999999999999999,"15min":0.33500000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":5.1120000000000001},"last":0.82799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834576089,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1606940,"kb_used_data":127380,"kb_used_omap":0,"kb_used_meta":1479552,"kb_avail":92764900,"statfs":{"total":96636764160,"available":94991257600,"internally_reserved":0,"allocated":130437120,"data_stored":130209439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1515061248},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.58499999999999996,"15min":0.54500000000000004},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":9.5589999999999993,"5min":9.5589999999999993,"15min":10.109},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.88,"5min":0.59899999999999998,"15min":0.56299999999999994},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":9.6069999999999993,"5min":9.6069999999999993,"15min":10.172000000000001},"last":0.51600000000000001}]},{"osd":1,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.58599999999999997,"15min":0.51400000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27100000000000002},"max":{"1min":8.0579999999999998,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.52500000000000002,"15min":0.51500000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27500000000000002},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.57999999999999996}]},{"osd":2,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":9.5830000000000002,"5min":9.5830000000000002,"15min":18.135000000000002},"last":0.628},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.61099999999999999,"15min":0.55600000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.316},"max":{"1min":7.069,"5min":7.069,"15min":7.069},"last":0.60199999999999998}]},{"osd":3,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56000000000000005,"15min":0.54100000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":3.3519999999999999,"5min":3.3519999999999999,"15min":3.3519999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.64700000000000002,"15min":0.59399999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":9.6289999999999996,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.67900000000000005}]},{"osd":4,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.252},"max":{"1min":3.3900000000000001,"5min":3.3900000000000001,"15min":8.4309999999999992},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.26100000000000001},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":10.231},"last":0.74399999999999999}]},{"osd":5,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":3.2959999999999998,"5min":3.2959999999999998,"15min":10.198},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59899999999999998,"15min":0.56100000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":0.69199999999999995}]},{"osd":7,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.27,"5min":3.27,"15min":10.257999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.68100000000000005,"15min":0.61799999999999999},"min":{"1min":0.32300000000000001,"5min":0.315,"15min":0.30299999999999999},"max":{"1min":9.5039999999999996,"5min":9.5039999999999996,"15min":9.5039999999999996},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834576087,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":539616,"kb_used_data":185560,"kb_used_omap":7,"kb_used_meta":354040,"kb_avail":93832224,"statfs":{"total":96636764160,"available":96084197376,"internally_reserved":0,"allocated":190013440,"data_stored":189785815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7169,"internal_metadata":362537983},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":5.0069999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":8.5549999999999997},"last":0.622}]},{"osd":1,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.55100000000000005},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.7919999999999998,"5min":2.7919999999999998,"15min":16.27},"last":0.44},{"interface":"front","average":{"1min":0.872,"5min":0.58199999999999996,"15min":0.54400000000000004},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":6.2670000000000003,"5min":6.2670000000000003,"15min":6.2670000000000003},"last":0.46600000000000003}]},{"osd":2,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.56399999999999995,"15min":0.629},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":21.789000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.58699999999999997,"15min":0.65300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":16.474},"last":0.48699999999999999}]},{"osd":3,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.59399999999999997,"15min":0.623},"min":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.32100000000000001},"max":{"1min":3.8929999999999998,"5min":3.8929999999999998,"15min":12.544},"last":0.501},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.54100000000000004,"15min":0.58799999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":4.8739999999999997},"last":0.51900000000000002}]},{"osd":4,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.49199999999999999,"15min":0.56399999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.22},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":19.652000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56899999999999995,"15min":0.67800000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.252},"max":{"1min":2.589,"5min":2.589,"15min":26.648},"last":0.57499999999999996}]},{"osd":6,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.51400000000000001,"15min":0.55300000000000005},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26300000000000001},"max":{"1min":0.627,"5min":0.746,"15min":5.9119999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.54400000000000004,"15min":0.56000000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.25800000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":2.2130000000000001},"last":0.55300000000000005}]},{"osd":7,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.60899999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.27100000000000002},"max":{"1min":2.5659999999999998,"5min":2.5659999999999998,"15min":8.7360000000000007},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.57799999999999996,"15min":0.64900000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.30299999999999999},"max":{"1min":0.69399999999999995,"5min":0.79200000000000004,"15min":16.315000000000001},"last":0.60799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834576088,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":770332,"kb_used_data":225236,"kb_used_omap":9,"kb_used_meta":545078,"kb_avail":93601508,"statfs":{"total":96636764160,"available":95847944192,"internally_reserved":0,"allocated":230641664,"data_stored":230410321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9755,"internal_metadata":558160357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.53800000000000003,"15min":0.53000000000000003},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":6.5389999999999997,"5min":6.5389999999999997,"15min":6.5389999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.54800000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.246},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":4.657},"last":0.57799999999999996}]},{"osd":1,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.56599999999999995,"15min":0.54300000000000004},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.6970000000000001,"5min":6.6970000000000001,"15min":6.6970000000000001},"last":0.499},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48699999999999999,"15min":0.51400000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.722,"5min":1.722,"15min":4.4809999999999999},"last":0.47799999999999998}]},{"osd":2,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.50800000000000001,"15min":0.53700000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.379,"5min":2.379,"15min":8.3729999999999993},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.52000000000000002,"15min":0.56299999999999994},"min":{"1min":0.32300000000000001,"5min":0.318,"15min":0.28899999999999998},"max":{"1min":0.64400000000000002,"5min":0.73599999999999999,"15min":8.3840000000000003},"last":0.63600000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":4.548},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.61099999999999999,"15min":0.58999999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":4.3440000000000003,"5min":4.3440000000000003,"15min":4.7850000000000001},"last":0.52600000000000002}]},{"osd":5,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.48499999999999999,"15min":0.54400000000000004},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66100000000000003,"5min":0.78200000000000003,"15min":14.387},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.50800000000000001,"15min":0.55500000000000005},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.68799999999999994,"5min":0.85499999999999998,"15min":14.430999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.51300000000000001,"15min":0.52300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63200000000000001,"5min":0.77000000000000002,"15min":4.399},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.54900000000000004,"15min":0.56999999999999995},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68500000000000005,"5min":0.82099999999999995,"15min":4.5910000000000002},"last":0.67600000000000005}]},{"osd":7,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.32700000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63700000000000001,"5min":0.89300000000000002,"15min":8.5139999999999993},"last":0.625},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.59099999999999997,"15min":0.61299999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66900000000000004,"5min":0.83399999999999996,"15min":6.4169999999999998},"last":0.68999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834576085,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":838516,"kb_used_data":212652,"kb_used_omap":71,"kb_used_meta":625784,"kb_avail":93533324,"statfs":{"total":96636764160,"available":95778123776,"internally_reserved":0,"allocated":217755648,"data_stored":217523632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":72831,"internal_metadata":640803713},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.39000000000000001,"15min":0.41499999999999998},"min":{"1min":0.224,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":4.7350000000000003,"5min":4.7350000000000003,"15min":11.298},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.40699999999999997,"15min":0.39700000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":3.657,"5min":3.657,"15min":10.164999999999999},"last":0.28999999999999998}]},{"osd":1,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.42499999999999999,"15min":0.40600000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":5.6100000000000003,"5min":5.6100000000000003,"15min":5.6100000000000003},"last":0.222},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.26300000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":3.899,"5min":3.899,"15min":8.8879999999999999},"last":0.27700000000000002}]},{"osd":2,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.45000000000000001,"15min":0.42099999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25700000000000001},"max":{"1min":4.8460000000000001,"5min":4.8460000000000001,"15min":5.4870000000000001},"last":0.314},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.435,"15min":0.46500000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":8.8079999999999998},"last":0.33000000000000002}]},{"osd":4,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.65100000000000002,"15min":0.63},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.6899999999999999,"5min":3.6899999999999999,"15min":3.702},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.66100000000000003,"15min":0.624},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.29999999999999999},"max":{"1min":4.8799999999999999,"5min":4.8799999999999999,"15min":4.8799999999999999},"last":0.48099999999999998}]},{"osd":5,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.63100000000000001,"15min":0.65000000000000002},"min":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":4.4880000000000004,"5min":4.4880000000000004,"15min":5.5199999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.67400000000000004,"15min":0.64600000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":4.3630000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":0.55000000000000004}]},{"osd":6,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.67900000000000005,"15min":0.63600000000000001},"min":{"1min":0.41899999999999998,"5min":0.40500000000000003,"15min":0.33000000000000002},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.64200000000000002,"15min":0.68799999999999994},"min":{"1min":0.45500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":3.46,"5min":3.46,"15min":11.099},"last":0.501}]},{"osd":7,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":3.7400000000000002,"5min":3.7400000000000002,"15min":3.7669999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.70499999999999996,"15min":0.67100000000000004},"min":{"1min":0.47099999999999997,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":4.9219999999999997,"5min":4.9219999999999997,"15min":4.9219999999999997},"last":0.53000000000000003}]}]},{"osd":2,"up_from":13,"seq":55834576088,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1701212,"kb_used_data":167828,"kb_used_omap":0,"kb_used_meta":1533376,"kb_avail":92670628,"statfs":{"total":96636764160,"available":94894723072,"internally_reserved":0,"allocated":171855872,"data_stored":171628591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1570177024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.223,"5min":0.20200000000000001,"15min":0.185},"max":{"1min":8.9529999999999994,"5min":8.9529999999999994,"15min":17.652999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":1.139,"5min":0.48999999999999999,"15min":0.54600000000000004},"min":{"1min":0.23300000000000001,"5min":0.218,"15min":0.155},"max":{"1min":9.8699999999999992,"5min":9.8699999999999992,"15min":22.620000000000001},"last":0.23599999999999999}]},{"osd":1,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":0.56699999999999995,"15min":0.61099999999999999},"min":{"1min":0.26200000000000001,"5min":0.22900000000000001,"15min":0.20899999999999999},"max":{"1min":11.515000000000001,"5min":11.515000000000001,"15min":23.327999999999999},"last":0.25800000000000001},{"interface":"front","average":{"1min":2.9209999999999998,"5min":0.86899999999999999,"15min":0.68100000000000005},"min":{"1min":0.254,"5min":0.247,"15min":0.23899999999999999},"max":{"1min":30.975000000000001,"5min":30.975000000000001,"15min":30.975000000000001},"last":0.29199999999999998}]},{"osd":3,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.46999999999999997,"15min":0.57199999999999995},"min":{"1min":0.318,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":5.6280000000000001,"5min":5.6280000000000001,"15min":33.106000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":1.847,"5min":0.68799999999999994,"15min":0.69799999999999995},"min":{"1min":0.32000000000000001,"5min":0.28399999999999997,"15min":0.221},"max":{"1min":10.458,"5min":10.458,"15min":22.576000000000001},"last":0.378}]},{"osd":4,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":0.73799999999999999,"15min":0.82499999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.34300000000000003},"max":{"1min":9.0350000000000001,"5min":9.0350000000000001,"15min":27.885999999999999},"last":0.498},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.64800000000000002,"15min":0.80100000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.309},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":39.417000000000002},"last":0.59599999999999997}]},{"osd":5,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.68999999999999995,"15min":0.73999999999999999},"min":{"1min":0.45400000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.6989999999999998,"5min":5.6989999999999998,"15min":23.238},"last":0.48599999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":0.77500000000000002,"15min":0.66900000000000004},"min":{"1min":0.41799999999999998,"5min":0.40899999999999997,"15min":0.379},"max":{"1min":9.0920000000000005,"5min":9.0920000000000005,"15min":9.0920000000000005},"last":0.57199999999999995}]},{"osd":6,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.625,"15min":0.69399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":22.675999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.71299999999999997,"15min":0.76900000000000002},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":5.6689999999999996,"5min":5.6689999999999996,"15min":23.164999999999999},"last":0.54500000000000004}]},{"osd":7,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.66000000000000003,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":3.3980000000000001,"5min":3.3980000000000001,"15min":22.824999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":1.0669999999999999,"5min":0.72899999999999998,"15min":0.76700000000000002},"min":{"1min":0.50700000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":5.726,"5min":5.726,"15min":23.207999999999998},"last":0.52000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834576087,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1071880,"kb_used_data":258496,"kb_used_omap":470,"kb_used_meta":812905,"kb_avail":93299960,"statfs":{"total":96636764160,"available":95539159040,"internally_reserved":0,"allocated":264699904,"data_stored":264468205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":481557,"internal_metadata":832415467},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.33800000000000002,"15min":0.374},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":5.7869999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.34699999999999998,"15min":0.376},"min":{"1min":0.23000000000000001,"5min":0.22,"15min":0.22},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":6.6379999999999999},"last":0.28899999999999998}]},{"osd":2,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.32900000000000001,"15min":0.34499999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":4.3929999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.40400000000000003,"15min":0.436},"min":{"1min":0.26500000000000001,"5min":0.252,"15min":0.21099999999999999},"max":{"1min":2.895,"5min":2.895,"15min":12.276999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.43099999999999999,"15min":0.46400000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.221},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":13.153},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.40400000000000003,"15min":0.45300000000000001},"min":{"1min":0.28399999999999997,"5min":0.248,"15min":0.216},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":6.0910000000000002},"last":0.36599999999999999}]},{"osd":4,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.34699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.099,"5min":1.099,"15min":2.222},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.435,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.9710000000000001,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":0.55000000000000004}]},{"osd":5,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.60599999999999998,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":2.984,"5min":2.984,"15min":11.009},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60599999999999998,"15min":0.64400000000000002},"min":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.35499999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":10.813000000000001},"last":0.59499999999999997}]},{"osd":6,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.61899999999999999,"15min":0.64400000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.35799999999999998},"max":{"1min":3.0720000000000001,"5min":3.0720000000000001,"15min":11.055},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60599999999999998,"15min":0.61499999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.125,"5min":1.125,"15min":3.2469999999999999},"last":0.56100000000000005}]},{"osd":7,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.63800000000000001,"15min":0.65300000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":6.1349999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.63200000000000001,"15min":0.65500000000000003},"min":{"1min":0.42699999999999999,"5min":0.38100000000000001,"15min":0.36499999999999999},"max":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":6.431},"last":0.57799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834576089,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1483484,"kb_used_data":108180,"kb_used_omap":0,"kb_used_meta":1375296,"kb_avail":92888356,"statfs":{"total":96636764160,"available":95117676544,"internally_reserved":0,"allocated":110776320,"data_stored":110542282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1408303104},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.40899999999999997,"15min":0.44500000000000001},"min":{"1min":0.21299999999999999,"5min":0.19400000000000001,"15min":0.189},"max":{"1min":5.351,"5min":5.351,"15min":22.059000000000001},"last":0.25900000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.47499999999999998,"15min":0.42899999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":6.4269999999999996,"5min":6.4269999999999996,"15min":6.4269999999999996},"last":0.27900000000000003}]},{"osd":2,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.432,"15min":0.495},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23000000000000001},"max":{"1min":5.3739999999999997,"5min":5.3739999999999997,"15min":17.870999999999999},"last":0.317},{"interface":"front","average":{"1min":1.016,"5min":0.47699999999999998,"15min":0.41899999999999998},"min":{"1min":0.23599999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":6.3419999999999996,"5min":6.3419999999999996,"15min":6.3419999999999996},"last":0.35899999999999999}]},{"osd":3,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.40699999999999997,"15min":0.46800000000000003},"min":{"1min":0.23499999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":10.585000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":1.4670000000000001,"5min":0.60799999999999998,"15min":0.50900000000000001},"min":{"1min":0.29599999999999999,"5min":0.29099999999999998,"15min":0.27800000000000002},"max":{"1min":9.5139999999999993,"5min":9.5139999999999993,"15min":11.077},"last":0.34799999999999998}]},{"osd":4,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":0.68799999999999994,"15min":0.67500000000000004},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":6.4889999999999999,"5min":6.4889999999999999,"15min":6.4889999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.58699999999999997,"15min":0.63400000000000001},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.28699999999999998},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":6.1669999999999998},"last":0.83599999999999997}]},{"osd":5,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.58399999999999996,"15min":0.64200000000000002},"min":{"1min":0.379,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":9.8019999999999996},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40200000000000002},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.4080000000000004},"last":0.70099999999999996}]},{"osd":6,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":5.2990000000000004,"5min":5.2990000000000004,"15min":5.2990000000000004},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.1319999999999999,"5min":0.69699999999999995,"15min":0.65800000000000003},"min":{"1min":0.432,"5min":0.41699999999999998,"15min":0.36199999999999999},"max":{"1min":6.3860000000000001,"5min":6.3860000000000001,"15min":6.3860000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":0.71999999999999997,"15min":0.78600000000000003},"min":{"1min":0.45000000000000001,"5min":0.42999999999999999,"15min":0.38700000000000001},"max":{"1min":6.4619999999999997,"5min":6.4619999999999997,"15min":31.004999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.59999999999999998,"15min":0.71799999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":27.370999999999999},"last":0.85499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T17:50:00.064 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-19T17:50:00.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T17:50:00.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.171+0000 7f6fe8ea1640 1 Processor -- start 2023-12-19T17:50:00.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.171+0000 7f6fe8ea1640 1 -- start start 2023-12-19T17:50:00.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.172+0000 7f6fe8ea1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6fe414b450 0x7f6fe41569a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:00.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.172+0000 7f6fe8ea1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe406a2b0 con 0x7f6fe4144d10 2023-12-19T17:50:00.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.172+0000 7f6fe8ea1640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe414b8a0 con 0x7f6fe414afc0 2023-12-19T17:50:00.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.172+0000 7f6fe8ea1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe4070ef0 con 0x7f6fe414b450 2023-12-19T17:50:00.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.172+0000 7f6fe259c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6fe4144d10 0x7f6fe4069ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50440/0 (socket says 172.21.15.37:50440) 2023-12-19T17:50:00.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.172+0000 7f6fe259c640 1 -- 172.21.15.37:0/506587362 learned_addr learned my addr 172.21.15.37:0/506587362 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:50:00.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe159a640 1 -- 172.21.15.37:0/506587362 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887085114 0 0) 0x7f6fe406a2b0 con 0x7f6fe4144d10 2023-12-19T17:50:00.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe2d9d640 1 --2- 172.21.15.37:0/506587362 >> v2:172.21.15.78:3300/0 conn(0x7f6fe414b450 0x7f6fe41569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:00.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe159a640 1 -- 172.21.15.37:0/506587362 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fcc003520 con 0x7f6fe4144d10 2023-12-19T17:50:00.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe159a640 1 -- 172.21.15.37:0/506587362 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1230270589 0 0) 0x7f6fcc003520 con 0x7f6fe4144d10 2023-12-19T17:50:00.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe159a640 1 -- 172.21.15.37:0/506587362 >> v2:172.21.15.78:3300/0 conn(0x7f6fe414b450 msgr2=0x7f6fe41569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:00.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe159a640 1 --2- 172.21.15.37:0/506587362 >> v2:172.21.15.78:3300/0 conn(0x7f6fe414b450 0x7f6fe41569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe159a640 1 -- 172.21.15.37:0/506587362 >> v1:172.21.15.78:6789/0 conn(0x7f6fe414afc0 legacy=0x7f6fe4153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:00.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe159a640 1 -- 172.21.15.37:0/506587362 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe40704d0 con 0x7f6fe4144d10 2023-12-19T17:50:00.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe159a640 1 -- 172.21.15.37:0/506587362 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f6fd4001b70 con 0x7f6fe4144d10 2023-12-19T17:50:00.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe159a640 1 -- 172.21.15.37:0/506587362 >> v1:172.21.15.37:6789/0 conn(0x7f6fe4144d10 legacy=0x7f6fe4069ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:00.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe159a640 1 --2- 172.21.15.37:0/506587362 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6fcc003970 0x7f6fcc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:00.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe159a640 1 --2- 172.21.15.37:0/506587362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fcc0047c0 0x7f6fcc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:00.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe159a640 1 --2- 172.21.15.37:0/506587362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fcc005180 0x7f6fcc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:00.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe159a640 1 -- 172.21.15.37:0/506587362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe4070ef0 con 0x7f6fcc005180 2023-12-19T17:50:00.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe159a640 1 -- 172.21.15.37:0/506587362 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc00c020 con 0x7f6fcc0047c0 2023-12-19T17:50:00.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe159a640 1 -- 172.21.15.37:0/506587362 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc00c1e0 con 0x7f6fcc003970 2023-12-19T17:50:00.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe2d9d640 1 --2- 172.21.15.37:0/506587362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fcc005180 0x7f6fcc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:00.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe1d9b640 1 --2- 172.21.15.37:0/506587362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fcc0047c0 0x7f6fcc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:00.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe259c640 1 --2- 172.21.15.37:0/506587362 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6fcc003970 0x7f6fcc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:00.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe2d9d640 1 -- 172.21.15.37:0/506587362 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6fcc003970 msgr2=0x7f6fcc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:00.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe2d9d640 1 --2- 172.21.15.37:0/506587362 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6fcc003970 0x7f6fcc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.173+0000 7f6fe2d9d640 1 -- 172.21.15.37:0/506587362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fcc0047c0 msgr2=0x7f6fcc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:00.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.174+0000 7f6fe2d9d640 1 --2- 172.21.15.37:0/506587362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fcc0047c0 0x7f6fcc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.174+0000 7f6fe2d9d640 1 -- 172.21.15.37:0/506587362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc003520 con 0x7f6fcc005180 2023-12-19T17:50:00.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.174+0000 7f6fe1d9b640 1 --2- 172.21.15.37:0/506587362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fcc0047c0 0x7f6fcc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:50:00.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.174+0000 7f6fe2d9d640 1 -- 172.21.15.37:0/506587362 reap_dead start 2023-12-19T17:50:00.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.175+0000 7f6fe2d9d640 1 --2- 172.21.15.37:0/506587362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fcc005180 0x7f6fcc00b980 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009ac0 tx=0x7f6fcc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5902ac3598e689dd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:00.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.175+0000 7f6fe159a640 1 -- 172.21.15.37:0/506587362 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc004020 con 0x7f6fcc005180 2023-12-19T17:50:00.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.175+0000 7f6fe159a640 1 -- 172.21.15.37:0/506587362 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc004180 con 0x7f6fcc005180 2023-12-19T17:50:00.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.175+0000 7f6fe159a640 1 -- 172.21.15.37:0/506587362 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc0044f0 con 0x7f6fcc005180 2023-12-19T17:50:00.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.175+0000 7f6fe8ea1640 1 -- 172.21.15.37:0/506587362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fcc005180 msgr2=0x7f6fcc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:00.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.175+0000 7f6fe8ea1640 1 --2- 172.21.15.37:0/506587362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fcc005180 0x7f6fcc00b980 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009ac0 tx=0x7f6fcc0057f0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.175+0000 7f6fe8ea1640 1 -- 172.21.15.37:0/506587362 shutdown_connections 2023-12-19T17:50:00.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.175+0000 7f6fe8ea1640 1 --2- 172.21.15.37:0/506587362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fcc005180 0x7f6fcc00b980 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.175+0000 7f6fe8ea1640 1 -- 172.21.15.37:0/506587362 >> 172.21.15.37:0/506587362 conn(0x7f6fe40b99b0 msgr2=0x7f6fe40b9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:00.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.175+0000 7f6fe8ea1640 1 -- 172.21.15.37:0/506587362 shutdown_connections 2023-12-19T17:50:00.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.175+0000 7f6fe8ea1640 1 -- 172.21.15.37:0/506587362 wait complete. 2023-12-19T17:50:00.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.177+0000 7f6fe8ea1640 1 Processor -- start 2023-12-19T17:50:00.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.177+0000 7f6fe8ea1640 1 -- start start 2023-12-19T17:50:00.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.178+0000 7f6fe8ea1640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6fcc005180 0x7f6fe40bb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:00.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.178+0000 7f6fe8ea1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fe413ece0 0x7f6fe4140750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:00.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.178+0000 7f6fe8ea1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fe40bbaa0 0x7f6fe4140c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:00.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.178+0000 7f6fe8ea1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe413fd90 con 0x7f6fe413ece0 2023-12-19T17:50:00.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.178+0000 7f6fe8ea1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe40bc190 con 0x7f6fe40bbaa0 2023-12-19T17:50:00.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.178+0000 7f6fe8ea1640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe40bc470 con 0x7f6fcc005180 2023-12-19T17:50:00.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.178+0000 7f6fe1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fe413ece0 0x7f6fe4140750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:00.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.178+0000 7f6fe1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fe413ece0 0x7f6fe4140750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45738/0 (socket says 172.21.15.37:45738) 2023-12-19T17:50:00.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.178+0000 7f6fe1d9b640 1 -- 172.21.15.37:0/2803469942 learned_addr learned my addr 172.21.15.37:0/2803469942 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:00.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.178+0000 7f6fe259c640 1 --2- 172.21.15.37:0/2803469942 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6fcc005180 0x7f6fe40bb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:00.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.178+0000 7f6fe2d9d640 1 --2- 172.21.15.37:0/2803469942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fe40bbaa0 0x7f6fe4140c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:00.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.179+0000 7f6fe1d9b640 1 -- 172.21.15.37:0/2803469942 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6fcc005180 msgr2=0x7f6fe40bb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:00.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.179+0000 7f6fe1d9b640 1 --2- 172.21.15.37:0/2803469942 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6fcc005180 0x7f6fe40bb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.179+0000 7f6fe1d9b640 1 -- 172.21.15.37:0/2803469942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fe40bbaa0 msgr2=0x7f6fe4140c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:00.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.179+0000 7f6fe1d9b640 1 --2- 172.21.15.37:0/2803469942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fe40bbaa0 0x7f6fe4140c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.179+0000 7f6fe1d9b640 1 -- 172.21.15.37:0/2803469942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe40bc750 con 0x7f6fe413ece0 2023-12-19T17:50:00.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.179+0000 7f6fe1d9b640 1 --2- 172.21.15.37:0/2803469942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fe413ece0 0x7f6fe4140750 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f6fd800f820 tx=0x7f6fd800fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:00.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.179+0000 7f6fd2ffd640 1 -- 172.21.15.37:0/2803469942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd800fe70 con 0x7f6fe413ece0 2023-12-19T17:50:00.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.179+0000 7f6fd2ffd640 1 -- 172.21.15.37:0/2803469942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd80052e0 con 0x7f6fe413ece0 2023-12-19T17:50:00.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.179+0000 7f6fe8ea1640 1 -- 172.21.15.37:0/2803469942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe413ffe0 con 0x7f6fe413ece0 2023-12-19T17:50:00.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.179+0000 7f6fd2ffd640 1 -- 172.21.15.37:0/2803469942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd800d970 con 0x7f6fe413ece0 2023-12-19T17:50:00.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.179+0000 7f6fe8ea1640 1 -- 172.21.15.37:0/2803469942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe41372f0 con 0x7f6fe413ece0 2023-12-19T17:50:00.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.180+0000 7f6fe8ea1640 1 -- 172.21.15.37:0/2803469942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe404e840 con 0x7f6fe413ece0 2023-12-19T17:50:00.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.180+0000 7f6fd2ffd640 1 -- 172.21.15.37:0/2803469942 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6fd800dad0 con 0x7f6fe413ece0 2023-12-19T17:50:00.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.181+0000 7f6fd2ffd640 1 --2- 172.21.15.37:0/2803469942 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6fc406a430 0x7f6fc406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:00.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.181+0000 7f6fd2ffd640 1 -- 172.21.15.37:0/2803469942 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6fd80885d0 con 0x7f6fe413ece0 2023-12-19T17:50:00.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.181+0000 7f6fe259c640 1 --2- 172.21.15.37:0/2803469942 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6fc406a430 0x7f6fc406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:00.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.181+0000 7f6fe259c640 1 --2- 172.21.15.37:0/2803469942 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6fc406a430 0x7f6fc406c8f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4001270 tx=0x7f6fd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:00.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.185+0000 7f6fd2ffd640 1 -- 172.21.15.37:0/2803469942 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6fd8053ec0 con 0x7f6fe413ece0 2023-12-19T17:50:00.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.362+0000 7f6fe8ea1640 1 -- 172.21.15.37:0/2803469942 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6fe40bc300 con 0x7f6fc406a430 2023-12-19T17:50:00.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.364+0000 7f6fd2ffd640 1 -- 172.21.15.37:0/2803469942 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50682 (secure 0 0 0) 0x7f6fe40bc300 con 0x7f6fc406a430 2023-12-19T17:50:00.365 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T17:50:00.365 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-19T17:50:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.366+0000 7f6fe8ea1640 1 -- 172.21.15.37:0/2803469942 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6fc406a430 msgr2=0x7f6fc406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.366+0000 7f6fe8ea1640 1 --2- 172.21.15.37:0/2803469942 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6fc406a430 0x7f6fc406c8f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4001270 tx=0x7f6fd4009040 comp rx=0 tx=0).stop 2023-12-19T17:50:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.366+0000 7f6fe8ea1640 1 -- 172.21.15.37:0/2803469942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fe413ece0 msgr2=0x7f6fe4140750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.366+0000 7f6fe8ea1640 1 --2- 172.21.15.37:0/2803469942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fe413ece0 0x7f6fe4140750 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f6fd800f820 tx=0x7f6fd800fc20 comp rx=0 tx=0).stop 2023-12-19T17:50:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.366+0000 7f6fe8ea1640 1 -- 172.21.15.37:0/2803469942 shutdown_connections 2023-12-19T17:50:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.366+0000 7f6fe8ea1640 1 --2- 172.21.15.37:0/2803469942 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f6fc406a430 0x7f6fc406c8f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.366+0000 7f6fe8ea1640 1 --2- 172.21.15.37:0/2803469942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fe40bbaa0 0x7f6fe4140c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.366+0000 7f6fe8ea1640 1 --2- 172.21.15.37:0/2803469942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fe413ece0 0x7f6fe4140750 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.366+0000 7f6fe8ea1640 1 --2- 172.21.15.37:0/2803469942 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6fcc005180 0x7f6fe40bb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.366+0000 7f6fe8ea1640 1 -- 172.21.15.37:0/2803469942 >> 172.21.15.37:0/2803469942 conn(0x7f6fe40b99b0 msgr2=0x7f6fe4142710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.366+0000 7f6fe8ea1640 1 -- 172.21.15.37:0/2803469942 shutdown_connections 2023-12-19T17:50:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.366+0000 7f6fe8ea1640 1 -- 172.21.15.37:0/2803469942 wait complete. 2023-12-19T17:50:00.378 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":3123,"stamp":"2023-12-19T17:50:00.137557+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":9940680,"kb_used_data":1441032,"kb_used_omap":557,"kb_used_meta":8499026,"kb_avail":745034040,"statfs":{"total":773094113280,"available":762914856960,"internally_reserved":0,"allocated":1475616768,"data_stored":1473777105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":571312,"internal_metadata":8703002704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-754628659,"num_objects":-1361,"num_object_clones":0,"num_object_copies":-2722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1361,"num_whiteouts":0,"num_read":-66376,"num_read_kb":-54118090,"num_write":-2163525,"num_write_kb":-61026211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001222"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":227,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T17:49:26.785958+0000","last_change":"2023-12-19T16:06:47.761389+0000","last_active":"2023-12-19T17:49:26.785958+0000","last_peered":"2023-12-19T17:49:26.785958+0000","last_clean":"2023-12-19T17:49:26.785958+0000","last_became_active":"2023-12-19T16:06:47.760252+0000","last_became_peered":"2023-12-19T16:06:47.760252+0000","last_unstale":"2023-12-19T17:49:26.785958+0000","last_undegraded":"2023-12-19T17:49:26.785958+0000","last_fullsized":"2023-12-19T17:49:26.785958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_clean_scrub_stamp":"2023-12-19T16:06:46.706871+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:09.167979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576086,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1928700,"kb_used_data":155700,"kb_used_omap":0,"kb_used_meta":1772992,"kb_avail":92443140,"statfs":{"total":96636764160,"available":94661775360,"internally_reserved":0,"allocated":159436800,"data_stored":159208820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1815543808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.46200000000000002,"15min":0.57399999999999995},"min":{"1min":0.29999999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.61299999999999999,"5min":0.70099999999999996,"15min":19.341000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.47099999999999997,"15min":0.52200000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.255},"max":{"1min":0.46700000000000003,"5min":0.78800000000000003,"15min":5.524},"last":0.43099999999999999}]},{"osd":1,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.46400000000000002,"15min":0.59899999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":18.707999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.497,"15min":0.65500000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.60399999999999998,"5min":0.72899999999999998,"15min":18.146999999999998},"last":0.54500000000000004}]},{"osd":2,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.497,"15min":0.58799999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.64800000000000002,"5min":0.76300000000000001,"15min":19.300999999999998},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51800000000000002,"15min":0.55100000000000005},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.751,"5min":0.81799999999999995,"15min":5.1699999999999999},"last":0.64100000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.55800000000000005,"15min":0.57699999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.29999999999999999},"max":{"1min":3.9630000000000001,"5min":3.9630000000000001,"15min":10.005000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.56100000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":5.8209999999999997},"last":0.70299999999999996}]},{"osd":4,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.58599999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.22500000000000001},"max":{"1min":1.044,"5min":1.044,"15min":16.125},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51700000000000002,"15min":0.56000000000000005},"min":{"1min":0.31,"5min":0.30499999999999999,"15min":0.247},"max":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":9.9659999999999993},"last":0.78500000000000003}]},{"osd":5,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.498,"15min":0.61799999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28299999999999997},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":36.665999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.55600000000000005,"15min":0.66100000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.31},"max":{"1min":0.69399999999999995,"5min":0.78300000000000003,"15min":19.366},"last":0.92900000000000005}]},{"osd":6,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57999999999999996,"15min":0.67500000000000004},"min":{"1min":0.39200000000000002,"5min":0.36799999999999999,"15min":0.33000000000000002},"max":{"1min":0.751,"5min":0.80400000000000005,"15min":22.800000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.60099999999999998},"min":{"1min":0.38700000000000001,"5min":0.35999999999999999,"15min":0.33500000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":5.1120000000000001},"last":0.82799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834576089,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1606940,"kb_used_data":127380,"kb_used_omap":0,"kb_used_meta":1479552,"kb_avail":92764900,"statfs":{"total":96636764160,"available":94991257600,"internally_reserved":0,"allocated":130437120,"data_stored":130209439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1515061248},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.58499999999999996,"15min":0.54500000000000004},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":9.5589999999999993,"5min":9.5589999999999993,"15min":10.109},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.88,"5min":0.59899999999999998,"15min":0.56299999999999994},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":9.6069999999999993,"5min":9.6069999999999993,"15min":10.172000000000001},"last":0.51600000000000001}]},{"osd":1,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.58599999999999997,"15min":0.51400000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27100000000000002},"max":{"1min":8.0579999999999998,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.52500000000000002,"15min":0.51500000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27500000000000002},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.57999999999999996}]},{"osd":2,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":9.5830000000000002,"5min":9.5830000000000002,"15min":18.135000000000002},"last":0.628},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.61099999999999999,"15min":0.55600000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.316},"max":{"1min":7.069,"5min":7.069,"15min":7.069},"last":0.60199999999999998}]},{"osd":3,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56000000000000005,"15min":0.54100000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":3.3519999999999999,"5min":3.3519999999999999,"15min":3.3519999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.64700000000000002,"15min":0.59399999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":9.6289999999999996,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.67900000000000005}]},{"osd":4,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.252},"max":{"1min":3.3900000000000001,"5min":3.3900000000000001,"15min":8.4309999999999992},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.26100000000000001},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":10.231},"last":0.74399999999999999}]},{"osd":5,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":3.2959999999999998,"5min":3.2959999999999998,"15min":10.198},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59899999999999998,"15min":0.56100000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":0.69199999999999995}]},{"osd":7,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.27,"5min":3.27,"15min":10.257999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.68100000000000005,"15min":0.61799999999999999},"min":{"1min":0.32300000000000001,"5min":0.315,"15min":0.30299999999999999},"max":{"1min":9.5039999999999996,"5min":9.5039999999999996,"15min":9.5039999999999996},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834576087,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":539616,"kb_used_data":185560,"kb_used_omap":7,"kb_used_meta":354040,"kb_avail":93832224,"statfs":{"total":96636764160,"available":96084197376,"internally_reserved":0,"allocated":190013440,"data_stored":189785815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7169,"internal_metadata":362537983},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":5.0069999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":8.5549999999999997},"last":0.622}]},{"osd":1,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.55100000000000005},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.7919999999999998,"5min":2.7919999999999998,"15min":16.27},"last":0.44},{"interface":"front","average":{"1min":0.872,"5min":0.58199999999999996,"15min":0.54400000000000004},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":6.2670000000000003,"5min":6.2670000000000003,"15min":6.2670000000000003},"last":0.46600000000000003}]},{"osd":2,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.56399999999999995,"15min":0.629},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":21.789000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.58699999999999997,"15min":0.65300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":16.474},"last":0.48699999999999999}]},{"osd":3,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.59399999999999997,"15min":0.623},"min":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.32100000000000001},"max":{"1min":3.8929999999999998,"5min":3.8929999999999998,"15min":12.544},"last":0.501},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.54100000000000004,"15min":0.58799999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":4.8739999999999997},"last":0.51900000000000002}]},{"osd":4,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.49199999999999999,"15min":0.56399999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.22},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":19.652000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56899999999999995,"15min":0.67800000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.252},"max":{"1min":2.589,"5min":2.589,"15min":26.648},"last":0.57499999999999996}]},{"osd":6,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.51400000000000001,"15min":0.55300000000000005},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26300000000000001},"max":{"1min":0.627,"5min":0.746,"15min":5.9119999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.54400000000000004,"15min":0.56000000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.25800000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":2.2130000000000001},"last":0.55300000000000005}]},{"osd":7,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.60899999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.27100000000000002},"max":{"1min":2.5659999999999998,"5min":2.5659999999999998,"15min":8.7360000000000007},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.57799999999999996,"15min":0.64900000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.30299999999999999},"max":{"1min":0.69399999999999995,"5min":0.79200000000000004,"15min":16.315000000000001},"last":0.60799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834576088,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":770332,"kb_used_data":225236,"kb_used_omap":9,"kb_used_meta":545078,"kb_avail":93601508,"statfs":{"total":96636764160,"available":95847944192,"internally_reserved":0,"allocated":230641664,"data_stored":230410321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9755,"internal_metadata":558160357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.53800000000000003,"15min":0.53000000000000003},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":6.5389999999999997,"5min":6.5389999999999997,"15min":6.5389999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.54800000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.246},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":4.657},"last":0.57799999999999996}]},{"osd":1,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.56599999999999995,"15min":0.54300000000000004},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.6970000000000001,"5min":6.6970000000000001,"15min":6.6970000000000001},"last":0.499},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48699999999999999,"15min":0.51400000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.722,"5min":1.722,"15min":4.4809999999999999},"last":0.47799999999999998}]},{"osd":2,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.50800000000000001,"15min":0.53700000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.379,"5min":2.379,"15min":8.3729999999999993},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.52000000000000002,"15min":0.56299999999999994},"min":{"1min":0.32300000000000001,"5min":0.318,"15min":0.28899999999999998},"max":{"1min":0.64400000000000002,"5min":0.73599999999999999,"15min":8.3840000000000003},"last":0.63600000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":4.548},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.61099999999999999,"15min":0.58999999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":4.3440000000000003,"5min":4.3440000000000003,"15min":4.7850000000000001},"last":0.52600000000000002}]},{"osd":5,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.48499999999999999,"15min":0.54400000000000004},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66100000000000003,"5min":0.78200000000000003,"15min":14.387},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.50800000000000001,"15min":0.55500000000000005},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.68799999999999994,"5min":0.85499999999999998,"15min":14.430999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.51300000000000001,"15min":0.52300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63200000000000001,"5min":0.77000000000000002,"15min":4.399},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.54900000000000004,"15min":0.56999999999999995},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68500000000000005,"5min":0.82099999999999995,"15min":4.5910000000000002},"last":0.67600000000000005}]},{"osd":7,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.32700000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63700000000000001,"5min":0.89300000000000002,"15min":8.5139999999999993},"last":0.625},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.59099999999999997,"15min":0.61299999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66900000000000004,"5min":0.83399999999999996,"15min":6.4169999999999998},"last":0.68999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834576085,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":838516,"kb_used_data":212652,"kb_used_omap":71,"kb_used_meta":625784,"kb_avail":93533324,"statfs":{"total":96636764160,"available":95778123776,"internally_reserved":0,"allocated":217755648,"data_stored":217523632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":72831,"internal_metadata":640803713},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.39000000000000001,"15min":0.41499999999999998},"min":{"1min":0.224,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":4.7350000000000003,"5min":4.7350000000000003,"15min":11.298},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.40699999999999997,"15min":0.39700000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":3.657,"5min":3.657,"15min":10.164999999999999},"last":0.28999999999999998}]},{"osd":1,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.42499999999999999,"15min":0.40600000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":5.6100000000000003,"5min":5.6100000000000003,"15min":5.6100000000000003},"last":0.222},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.26300000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":3.899,"5min":3.899,"15min":8.8879999999999999},"last":0.27700000000000002}]},{"osd":2,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.45000000000000001,"15min":0.42099999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25700000000000001},"max":{"1min":4.8460000000000001,"5min":4.8460000000000001,"15min":5.4870000000000001},"last":0.314},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.435,"15min":0.46500000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":8.8079999999999998},"last":0.33000000000000002}]},{"osd":4,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.65100000000000002,"15min":0.63},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.6899999999999999,"5min":3.6899999999999999,"15min":3.702},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.66100000000000003,"15min":0.624},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.29999999999999999},"max":{"1min":4.8799999999999999,"5min":4.8799999999999999,"15min":4.8799999999999999},"last":0.48099999999999998}]},{"osd":5,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.63100000000000001,"15min":0.65000000000000002},"min":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":4.4880000000000004,"5min":4.4880000000000004,"15min":5.5199999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.67400000000000004,"15min":0.64600000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":4.3630000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":0.55000000000000004}]},{"osd":6,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.67900000000000005,"15min":0.63600000000000001},"min":{"1min":0.41899999999999998,"5min":0.40500000000000003,"15min":0.33000000000000002},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.64200000000000002,"15min":0.68799999999999994},"min":{"1min":0.45500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":3.46,"5min":3.46,"15min":11.099},"last":0.501}]},{"osd":7,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":3.7400000000000002,"5min":3.7400000000000002,"15min":3.7669999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.70499999999999996,"15min":0.67100000000000004},"min":{"1min":0.47099999999999997,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":4.9219999999999997,"5min":4.9219999999999997,"15min":4.9219999999999997},"last":0.53000000000000003}]}]},{"osd":2,"up_from":13,"seq":55834576088,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1701212,"kb_used_data":167828,"kb_used_omap":0,"kb_used_meta":1533376,"kb_avail":92670628,"statfs":{"total":96636764160,"available":94894723072,"internally_reserved":0,"allocated":171855872,"data_stored":171628591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1570177024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.223,"5min":0.20200000000000001,"15min":0.185},"max":{"1min":8.9529999999999994,"5min":8.9529999999999994,"15min":17.652999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":1.139,"5min":0.48999999999999999,"15min":0.54600000000000004},"min":{"1min":0.23300000000000001,"5min":0.218,"15min":0.155},"max":{"1min":9.8699999999999992,"5min":9.8699999999999992,"15min":22.620000000000001},"last":0.23599999999999999}]},{"osd":1,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":0.56699999999999995,"15min":0.61099999999999999},"min":{"1min":0.26200000000000001,"5min":0.22900000000000001,"15min":0.20899999999999999},"max":{"1min":11.515000000000001,"5min":11.515000000000001,"15min":23.327999999999999},"last":0.25800000000000001},{"interface":"front","average":{"1min":2.9209999999999998,"5min":0.86899999999999999,"15min":0.68100000000000005},"min":{"1min":0.254,"5min":0.247,"15min":0.23899999999999999},"max":{"1min":30.975000000000001,"5min":30.975000000000001,"15min":30.975000000000001},"last":0.29199999999999998}]},{"osd":3,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.46999999999999997,"15min":0.57199999999999995},"min":{"1min":0.318,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":5.6280000000000001,"5min":5.6280000000000001,"15min":33.106000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":1.847,"5min":0.68799999999999994,"15min":0.69799999999999995},"min":{"1min":0.32000000000000001,"5min":0.28399999999999997,"15min":0.221},"max":{"1min":10.458,"5min":10.458,"15min":22.576000000000001},"last":0.378}]},{"osd":4,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":0.73799999999999999,"15min":0.82499999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.34300000000000003},"max":{"1min":9.0350000000000001,"5min":9.0350000000000001,"15min":27.885999999999999},"last":0.498},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.64800000000000002,"15min":0.80100000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.309},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":39.417000000000002},"last":0.59599999999999997}]},{"osd":5,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.68999999999999995,"15min":0.73999999999999999},"min":{"1min":0.45400000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.6989999999999998,"5min":5.6989999999999998,"15min":23.238},"last":0.48599999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":0.77500000000000002,"15min":0.66900000000000004},"min":{"1min":0.41799999999999998,"5min":0.40899999999999997,"15min":0.379},"max":{"1min":9.0920000000000005,"5min":9.0920000000000005,"15min":9.0920000000000005},"last":0.57199999999999995}]},{"osd":6,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.625,"15min":0.69399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":22.675999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.71299999999999997,"15min":0.76900000000000002},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":5.6689999999999996,"5min":5.6689999999999996,"15min":23.164999999999999},"last":0.54500000000000004}]},{"osd":7,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.66000000000000003,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":3.3980000000000001,"5min":3.3980000000000001,"15min":22.824999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":1.0669999999999999,"5min":0.72899999999999998,"15min":0.76700000000000002},"min":{"1min":0.50700000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":5.726,"5min":5.726,"15min":23.207999999999998},"last":0.52000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834576087,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1071880,"kb_used_data":258496,"kb_used_omap":470,"kb_used_meta":812905,"kb_avail":93299960,"statfs":{"total":96636764160,"available":95539159040,"internally_reserved":0,"allocated":264699904,"data_stored":264468205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":481557,"internal_metadata":832415467},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.33800000000000002,"15min":0.374},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":5.7869999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.34699999999999998,"15min":0.376},"min":{"1min":0.23000000000000001,"5min":0.22,"15min":0.22},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":6.6379999999999999},"last":0.28899999999999998}]},{"osd":2,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.32900000000000001,"15min":0.34499999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":4.3929999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.40400000000000003,"15min":0.436},"min":{"1min":0.26500000000000001,"5min":0.252,"15min":0.21099999999999999},"max":{"1min":2.895,"5min":2.895,"15min":12.276999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.43099999999999999,"15min":0.46400000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.221},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":13.153},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.40400000000000003,"15min":0.45300000000000001},"min":{"1min":0.28399999999999997,"5min":0.248,"15min":0.216},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":6.0910000000000002},"last":0.36599999999999999}]},{"osd":4,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.34699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.099,"5min":1.099,"15min":2.222},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.435,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":2.9710000000000001,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":0.55000000000000004}]},{"osd":5,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.60599999999999998,"15min":0.66700000000000004},"min":{"1min":0.38500000000000001,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":2.984,"5min":2.984,"15min":11.009},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60599999999999998,"15min":0.64400000000000002},"min":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.35499999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":10.813000000000001},"last":0.59499999999999997}]},{"osd":6,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.61899999999999999,"15min":0.64400000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.35799999999999998},"max":{"1min":3.0720000000000001,"5min":3.0720000000000001,"15min":11.055},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.60599999999999998,"15min":0.61499999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.125,"5min":1.125,"15min":3.2469999999999999},"last":0.56100000000000005}]},{"osd":7,"last update":"Tue Dec 19 17:48:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.63800000000000001,"15min":0.65300000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":6.1349999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.63200000000000001,"15min":0.65500000000000003},"min":{"1min":0.42699999999999999,"5min":0.38100000000000001,"15min":0.36499999999999999},"max":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":6.431},"last":0.57799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834576089,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1483484,"kb_used_data":108180,"kb_used_omap":0,"kb_used_meta":1375296,"kb_avail":92888356,"statfs":{"total":96636764160,"available":95117676544,"internally_reserved":0,"allocated":110776320,"data_stored":110542282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1408303104},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.40899999999999997,"15min":0.44500000000000001},"min":{"1min":0.21299999999999999,"5min":0.19400000000000001,"15min":0.189},"max":{"1min":5.351,"5min":5.351,"15min":22.059000000000001},"last":0.25900000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.47499999999999998,"15min":0.42899999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":6.4269999999999996,"5min":6.4269999999999996,"15min":6.4269999999999996},"last":0.27900000000000003}]},{"osd":2,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.432,"15min":0.495},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23000000000000001},"max":{"1min":5.3739999999999997,"5min":5.3739999999999997,"15min":17.870999999999999},"last":0.317},{"interface":"front","average":{"1min":1.016,"5min":0.47699999999999998,"15min":0.41899999999999998},"min":{"1min":0.23599999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":6.3419999999999996,"5min":6.3419999999999996,"15min":6.3419999999999996},"last":0.35899999999999999}]},{"osd":3,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.40699999999999997,"15min":0.46800000000000003},"min":{"1min":0.23499999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":10.585000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":1.4670000000000001,"5min":0.60799999999999998,"15min":0.50900000000000001},"min":{"1min":0.29599999999999999,"5min":0.29099999999999998,"15min":0.27800000000000002},"max":{"1min":9.5139999999999993,"5min":9.5139999999999993,"15min":11.077},"last":0.34799999999999998}]},{"osd":4,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":0.68799999999999994,"15min":0.67500000000000004},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":6.4889999999999999,"5min":6.4889999999999999,"15min":6.4889999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.58699999999999997,"15min":0.63400000000000001},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.28699999999999998},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":6.1669999999999998},"last":0.83599999999999997}]},{"osd":5,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.58399999999999996,"15min":0.64200000000000002},"min":{"1min":0.379,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":9.8019999999999996},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40200000000000002},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.4080000000000004},"last":0.70099999999999996}]},{"osd":6,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":5.2990000000000004,"5min":5.2990000000000004,"15min":5.2990000000000004},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.1319999999999999,"5min":0.69699999999999995,"15min":0.65800000000000003},"min":{"1min":0.432,"5min":0.41699999999999998,"15min":0.36199999999999999},"max":{"1min":6.3860000000000001,"5min":6.3860000000000001,"15min":6.3860000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":0.71999999999999997,"15min":0.78600000000000003},"min":{"1min":0.45000000000000001,"5min":0.42999999999999999,"15min":0.38700000000000001},"max":{"1min":6.4619999999999997,"5min":6.4619999999999997,"15min":31.004999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.59999999999999998,"15min":0.71799999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":27.370999999999999},"last":0.85499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T17:50:00.379 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:50:00.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.486+0000 7fa6af773640 1 Processor -- start 2023-12-19T17:50:00.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.486+0000 7fa6af773640 1 -- start start 2023-12-19T17:50:00.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.487+0000 7fa6af773640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa6a80b4f90 0x7fa6a80b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:00.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.487+0000 7fa6af773640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa6a80b7e00 0x7fa6a81531a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:00.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.487+0000 7fa6af773640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a80b8270 con 0x7fa6a8070ff0 2023-12-19T17:50:00.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.487+0000 7fa6af773640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a80b6d70 con 0x7fa6a80b4f90 2023-12-19T17:50:00.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.487+0000 7fa6af773640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a80b56e0 con 0x7fa6a80b7e00 2023-12-19T17:50:00.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.487+0000 7fa6acd0e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa6a80b4f90 0x7fa6a80b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:00.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.487+0000 7fa6acd0e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa6a80b4f90 0x7fa6a80b78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45742/0 (socket says 172.21.15.37:45742) 2023-12-19T17:50:00.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.487+0000 7fa6acd0e640 1 -- 172.21.15.37:0/1495437093 learned_addr learned my addr 172.21.15.37:0/1495437093 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:00.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.487+0000 7fa6add10640 1 --2- 172.21.15.37:0/1495437093 >> v2:172.21.15.78:3300/0 conn(0x7fa6a80b7e00 0x7fa6a81531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:00.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.487+0000 7fa6acd0e640 1 -- 172.21.15.37:0/1495437093 >> v2:172.21.15.78:3300/0 conn(0x7fa6a80b7e00 msgr2=0x7fa6a81531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:00.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.487+0000 7fa6acd0e640 1 --2- 172.21.15.37:0/1495437093 >> v2:172.21.15.78:3300/0 conn(0x7fa6a80b7e00 0x7fa6a81531a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.487+0000 7fa6acd0e640 1 -- 172.21.15.37:0/1495437093 >> v1:172.21.15.78:6789/0 conn(0x7fa6a8070ff0 legacy=0x7fa6a8142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.487+0000 7fa6acd0e640 1 -- 172.21.15.37:0/1495437093 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a80b59c0 con 0x7fa6a80b4f90 2023-12-19T17:50:00.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.488+0000 7fa6acd0e640 1 --2- 172.21.15.37:0/1495437093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6a80b4f90 0x7fa6a80b78c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80b65b0 tx=0x7fa69802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52cc52277d1b5172 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:00.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.488+0000 7fa69ffff640 1 -- 172.21.15.37:0/1495437093 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa698030860 con 0x7fa6a80b4f90 2023-12-19T17:50:00.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.488+0000 7fa69ffff640 1 -- 172.21.15.37:0/1495437093 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6980309c0 con 0x7fa6a80b4f90 2023-12-19T17:50:00.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.488+0000 7fa69ffff640 1 -- 172.21.15.37:0/1495437093 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa698030d50 con 0x7fa6a80b4f90 2023-12-19T17:50:00.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.488+0000 7fa6af773640 1 -- 172.21.15.37:0/1495437093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6a80b4f90 msgr2=0x7fa6a80b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:00.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.488+0000 7fa6af773640 1 --2- 172.21.15.37:0/1495437093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6a80b4f90 0x7fa6a80b78c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80b65b0 tx=0x7fa69802b9a0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.488+0000 7fa6af773640 1 -- 172.21.15.37:0/1495437093 shutdown_connections 2023-12-19T17:50:00.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.488+0000 7fa6af773640 1 --2- 172.21.15.37:0/1495437093 >> v2:172.21.15.78:3300/0 conn(0x7fa6a80b7e00 0x7fa6a81531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.488+0000 7fa6af773640 1 --2- 172.21.15.37:0/1495437093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6a80b4f90 0x7fa6a80b78c0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.488+0000 7fa6af773640 1 -- 172.21.15.37:0/1495437093 >> 172.21.15.37:0/1495437093 conn(0x7fa6a80be120 msgr2=0x7fa6a80be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:00.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.489+0000 7fa6af773640 1 -- 172.21.15.37:0/1495437093 shutdown_connections 2023-12-19T17:50:00.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.489+0000 7fa6af773640 1 -- 172.21.15.37:0/1495437093 wait complete. 2023-12-19T17:50:00.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.490+0000 7fa6af773640 1 Processor -- start 2023-12-19T17:50:00.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.490+0000 7fa6af773640 1 -- start start 2023-12-19T17:50:00.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.490+0000 7fa6af773640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6a8070ff0 0x7fa6a8139af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:00.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.490+0000 7fa6af773640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6a80b4f90 0x7fa6a8146800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:00.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.490+0000 7fa6af773640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6a80b7e00 0x7fa6a8148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:00.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.490+0000 7fa6af773640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a813a030 con 0x7fa6a8070ff0 2023-12-19T17:50:00.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.490+0000 7fa6af773640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a8141d70 con 0x7fa6a80b7e00 2023-12-19T17:50:00.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.490+0000 7fa6af773640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a8138270 con 0x7fa6a80b4f90 2023-12-19T17:50:00.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.490+0000 7fa6ad50f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6a8070ff0 0x7fa6a8139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:00.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.491+0000 7fa6ad50f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6a8070ff0 0x7fa6a8139af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45744/0 (socket says 172.21.15.37:45744) 2023-12-19T17:50:00.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.491+0000 7fa6ad50f640 1 -- 172.21.15.37:0/4225084369 learned_addr learned my addr 172.21.15.37:0/4225084369 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:00.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.491+0000 7fa6add10640 1 --2- 172.21.15.37:0/4225084369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6a80b7e00 0x7fa6a8148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:00.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.491+0000 7fa6acd0e640 1 --2- 172.21.15.37:0/4225084369 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6a80b4f90 0x7fa6a8146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:00.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.491+0000 7fa6ad50f640 1 -- 172.21.15.37:0/4225084369 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6a80b4f90 msgr2=0x7fa6a8146800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:00.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.491+0000 7fa6ad50f640 1 --2- 172.21.15.37:0/4225084369 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6a80b4f90 0x7fa6a8146800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.491+0000 7fa6ad50f640 1 -- 172.21.15.37:0/4225084369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6a80b7e00 msgr2=0x7fa6a8148b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:00.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.491+0000 7fa6ad50f640 1 --2- 172.21.15.37:0/4225084369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6a80b7e00 0x7fa6a8148b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.491+0000 7fa6ad50f640 1 -- 172.21.15.37:0/4225084369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6980094d0 con 0x7fa6a8070ff0 2023-12-19T17:50:00.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.491+0000 7fa6ad50f640 1 --2- 172.21.15.37:0/4225084369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6a8070ff0 0x7fa6a8139af0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa6a400b3f0 tx=0x7fa6a400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:00.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.491+0000 7fa69dffb640 1 -- 172.21.15.37:0/4225084369 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4011830 con 0x7fa6a8070ff0 2023-12-19T17:50:00.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.491+0000 7fa69dffb640 1 -- 172.21.15.37:0/4225084369 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a4011990 con 0x7fa6a8070ff0 2023-12-19T17:50:00.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.491+0000 7fa69dffb640 1 -- 172.21.15.37:0/4225084369 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4011d40 con 0x7fa6a8070ff0 2023-12-19T17:50:00.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.491+0000 7fa6af773640 1 -- 172.21.15.37:0/4225084369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a81352b0 con 0x7fa6a8070ff0 2023-12-19T17:50:00.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.491+0000 7fa6af773640 1 -- 172.21.15.37:0/4225084369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a8147f30 con 0x7fa6a8070ff0 2023-12-19T17:50:00.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.493+0000 7fa6af773640 1 -- 172.21.15.37:0/4225084369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a804e840 con 0x7fa6a8070ff0 2023-12-19T17:50:00.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.493+0000 7fa69dffb640 1 -- 172.21.15.37:0/4225084369 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa6a401a400 con 0x7fa6a8070ff0 2023-12-19T17:50:00.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.494+0000 7fa69dffb640 1 --2- 172.21.15.37:0/4225084369 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa68c06a430 0x7fa68c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:00.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.494+0000 7fa69dffb640 1 -- 172.21.15.37:0/4225084369 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa6a40882d0 con 0x7fa6a8070ff0 2023-12-19T17:50:00.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.494+0000 7fa6acd0e640 1 --2- 172.21.15.37:0/4225084369 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa68c06a430 0x7fa68c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:00.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.494+0000 7fa6acd0e640 1 --2- 172.21.15.37:0/4225084369 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa68c06a430 0x7fa68c06c8f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa698036000 tx=0x7fa698008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:00.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.498+0000 7fa69dffb640 1 -- 172.21.15.37:0/4225084369 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa6a4053d00 con 0x7fa6a8070ff0 2023-12-19T17:50:00.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.677+0000 7fa6af773640 1 -- 172.21.15.37:0/4225084369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6a80b5f50 con 0x7fa6a8070ff0 2023-12-19T17:50:00.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.678+0000 7fa69dffb640 1 -- 172.21.15.37:0/4225084369 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+12470 (secure 0 0 0) 0x7fa6a4057320 con 0x7fa6a8070ff0 2023-12-19T17:50:00.678 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T17:50:00.678 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":34,"fsid":"aca5bcef-3944-4b9f-a6d7-30bb0dde7aa2","created":"2023-12-19T16:06:34.512275+0000","modified":"2023-12-19T17:49:57.650897+0000","last_up_change":"2023-12-19T16:06:45.705024+0000","last_in_change":"2023-12-19T16:06:36.696773+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:06:46.684027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4687a5c4-7def-4ade-b067-ffa35f54f414","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":89452},{"type":"v1","addr":"172.21.15.37:6801","nonce":89452}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":89452},{"type":"v1","addr":"172.21.15.37:6803","nonce":89452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":89452},{"type":"v1","addr":"172.21.15.37:6807","nonce":89452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":89452},{"type":"v1","addr":"172.21.15.37:6805","nonce":89452}]},"public_addr":"172.21.15.37:6801/89452","cluster_addr":"172.21.15.37:6803/89452","heartbeat_back_addr":"172.21.15.37:6807/89452","heartbeat_front_addr":"172.21.15.37:6805/89452","state":["exists","up"]},{"osd":1,"uuid":"1151a5ea-542d-4c1b-b047-9b99a1308257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":89453},{"type":"v1","addr":"172.21.15.37:6809","nonce":89453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":89453},{"type":"v1","addr":"172.21.15.37:6811","nonce":89453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":89453},{"type":"v1","addr":"172.21.15.37:6815","nonce":89453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":89453},{"type":"v1","addr":"172.21.15.37:6813","nonce":89453}]},"public_addr":"172.21.15.37:6809/89453","cluster_addr":"172.21.15.37:6811/89453","heartbeat_back_addr":"172.21.15.37:6815/89453","heartbeat_front_addr":"172.21.15.37:6813/89453","state":["exists","up"]},{"osd":2,"uuid":"58273304-6bf0-4f88-a97f-73cda58509bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":89456},{"type":"v1","addr":"172.21.15.37:6825","nonce":89456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":89456},{"type":"v1","addr":"172.21.15.37:6827","nonce":89456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":89456},{"type":"v1","addr":"172.21.15.37:6831","nonce":89456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":89456},{"type":"v1","addr":"172.21.15.37:6829","nonce":89456}]},"public_addr":"172.21.15.37:6825/89456","cluster_addr":"172.21.15.37:6827/89456","heartbeat_back_addr":"172.21.15.37:6831/89456","heartbeat_front_addr":"172.21.15.37:6829/89456","state":["exists","up"]},{"osd":3,"uuid":"7f241bf4-8b56-480f-9922-d2a453ce5e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":89455},{"type":"v1","addr":"172.21.15.37:6817","nonce":89455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":89455},{"type":"v1","addr":"172.21.15.37:6819","nonce":89455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":89455},{"type":"v1","addr":"172.21.15.37:6823","nonce":89455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":89455},{"type":"v1","addr":"172.21.15.37:6821","nonce":89455}]},"public_addr":"172.21.15.37:6817/89455","cluster_addr":"172.21.15.37:6819/89455","heartbeat_back_addr":"172.21.15.37:6823/89455","heartbeat_front_addr":"172.21.15.37:6821/89455","state":["exists","up"]},{"osd":4,"uuid":"59a4c9b9-1339-4f72-9c0c-092183afe07b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":89462},{"type":"v1","addr":"172.21.15.78:6823","nonce":89462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":89462},{"type":"v1","addr":"172.21.15.78:6826","nonce":89462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":89462},{"type":"v1","addr":"172.21.15.78:6831","nonce":89462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":89462},{"type":"v1","addr":"172.21.15.78:6829","nonce":89462}]},"public_addr":"172.21.15.78:6823/89462","cluster_addr":"172.21.15.78:6826/89462","heartbeat_back_addr":"172.21.15.78:6831/89462","heartbeat_front_addr":"172.21.15.78:6829/89462","state":["exists","up"]},{"osd":5,"uuid":"ec31af19-7c5a-4e7a-a44f-4cde91cd0b0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":89459},{"type":"v1","addr":"172.21.15.78:6809","nonce":89459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":89459},{"type":"v1","addr":"172.21.15.78:6811","nonce":89459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":89459},{"type":"v1","addr":"172.21.15.78:6815","nonce":89459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":89459},{"type":"v1","addr":"172.21.15.78:6813","nonce":89459}]},"public_addr":"172.21.15.78:6809/89459","cluster_addr":"172.21.15.78:6811/89459","heartbeat_back_addr":"172.21.15.78:6815/89459","heartbeat_front_addr":"172.21.15.78:6813/89459","state":["exists","up"]},{"osd":6,"uuid":"b2ff7b91-f3bb-48ab-8e2a-36c31f7f3f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":89460},{"type":"v1","addr":"172.21.15.78:6817","nonce":89460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":89460},{"type":"v1","addr":"172.21.15.78:6819","nonce":89460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":89460},{"type":"v1","addr":"172.21.15.78:6827","nonce":89460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":89460},{"type":"v1","addr":"172.21.15.78:6822","nonce":89460}]},"public_addr":"172.21.15.78:6817/89460","cluster_addr":"172.21.15.78:6819/89460","heartbeat_back_addr":"172.21.15.78:6827/89460","heartbeat_front_addr":"172.21.15.78:6822/89460","state":["exists","up"]},{"osd":7,"uuid":"3c606e1d-1356-455e-b592-b1787e696b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":89461},{"type":"v1","addr":"172.21.15.78:6801","nonce":89461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":89461},{"type":"v1","addr":"172.21.15.78:6803","nonce":89461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":89461},{"type":"v1","addr":"172.21.15.78:6807","nonce":89461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":89461},{"type":"v1","addr":"172.21.15.78:6805","nonce":89461}]},"public_addr":"172.21.15.78:6801/89461","cluster_addr":"172.21.15.78:6803/89461","heartbeat_back_addr":"172.21.15.78:6807/89461","heartbeat_front_addr":"172.21.15.78:6805/89461","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.904291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.855686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.911180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.778400+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.927635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.860207+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.862569+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:06:41.797123+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/1604445250":"2023-12-20T17:49:54.528898+0000","172.21.15.37:6833/1604445250":"2023-12-20T17:49:54.528898+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:50:00.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.680+0000 7fa6af773640 1 -- 172.21.15.37:0/4225084369 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa68c06a430 msgr2=0x7fa68c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:00.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.680+0000 7fa6af773640 1 --2- 172.21.15.37:0/4225084369 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa68c06a430 0x7fa68c06c8f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa698036000 tx=0x7fa698008030 comp rx=0 tx=0).stop 2023-12-19T17:50:00.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.680+0000 7fa6af773640 1 -- 172.21.15.37:0/4225084369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6a8070ff0 msgr2=0x7fa6a8139af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:00.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.680+0000 7fa6af773640 1 --2- 172.21.15.37:0/4225084369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6a8070ff0 0x7fa6a8139af0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa6a400b3f0 tx=0x7fa6a400b8b0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.680+0000 7fa6af773640 1 -- 172.21.15.37:0/4225084369 shutdown_connections 2023-12-19T17:50:00.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.680+0000 7fa6af773640 1 --2- 172.21.15.37:0/4225084369 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa68c06a430 0x7fa68c06c8f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.680+0000 7fa6af773640 1 --2- 172.21.15.37:0/4225084369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6a80b7e00 0x7fa6a8148b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.680+0000 7fa6af773640 1 --2- 172.21.15.37:0/4225084369 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6a80b4f90 0x7fa6a8146800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.680+0000 7fa6af773640 1 --2- 172.21.15.37:0/4225084369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6a8070ff0 0x7fa6a8139af0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:00.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.680+0000 7fa6af773640 1 -- 172.21.15.37:0/4225084369 >> 172.21.15.37:0/4225084369 conn(0x7fa6a80be120 msgr2=0x7fa6a80be500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:00.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.680+0000 7fa6af773640 1 -- 172.21.15.37:0/4225084369 shutdown_connections 2023-12-19T17:50:00.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:00.680+0000 7fa6af773640 1 -- 172.21.15.37:0/4225084369 wait complete. 2023-12-19T17:50:01.692 INFO:tasks.ceph:Scrubbing osd.0 2023-12-19T17:50:01.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-19T17:50:01.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.803+0000 7f3b833ab640 1 Processor -- start 2023-12-19T17:50:01.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.803+0000 7f3b833ab640 1 -- start start 2023-12-19T17:50:01.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.804+0000 7f3b833ab640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b7c0bad70 0x7f3b7c0b2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:01.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.804+0000 7f3b833ab640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b7c1428f0 0x7f3b7c142d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:01.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.804+0000 7f3b833ab640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b7c14c2f0 0x7f3b7c14c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:01.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.804+0000 7f3b833ab640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7c14cca0 con 0x7f3b7c0bad70 2023-12-19T17:50:01.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.804+0000 7f3b833ab640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7c0b9050 con 0x7f3b7c1428f0 2023-12-19T17:50:01.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.804+0000 7f3b833ab640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c0b9330 con 0x7f3b7c14c2f0 2023-12-19T17:50:01.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.804+0000 7f3b81147640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b7c0bad70 0x7f3b7c0b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:01.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.804+0000 7f3b81147640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b7c0bad70 0x7f3b7c0b2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45758/0 (socket says 172.21.15.37:45758) 2023-12-19T17:50:01.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.804+0000 7f3b81147640 1 -- 172.21.15.37:0/731280408 learned_addr learned my addr 172.21.15.37:0/731280408 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:01.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.804+0000 7f3b81948640 1 --2- 172.21.15.37:0/731280408 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b7c14c2f0 0x7f3b7c14c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:01.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.804+0000 7f3b80946640 1 --2- 172.21.15.37:0/731280408 >> v2:172.21.15.78:3300/0 conn(0x7f3b7c1428f0 0x7f3b7c142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:01.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.804+0000 7f3b81147640 1 -- 172.21.15.37:0/731280408 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b7c14c2f0 msgr2=0x7f3b7c14c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:01.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.804+0000 7f3b81147640 1 --2- 172.21.15.37:0/731280408 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b7c14c2f0 0x7f3b7c14c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:01.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.804+0000 7f3b81147640 1 -- 172.21.15.37:0/731280408 >> v2:172.21.15.78:3300/0 conn(0x7f3b7c1428f0 msgr2=0x7f3b7c142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:01.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.804+0000 7f3b81147640 1 --2- 172.21.15.37:0/731280408 >> v2:172.21.15.78:3300/0 conn(0x7f3b7c1428f0 0x7f3b7c142d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:01.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.804+0000 7f3b81147640 1 -- 172.21.15.37:0/731280408 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c0b9610 con 0x7f3b7c0bad70 2023-12-19T17:50:01.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.805+0000 7f3b81147640 1 --2- 172.21.15.37:0/731280408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0bad70 0x7f3b7c0b2440 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0b3110 tx=0x7f3b6c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99f64693878d52f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:01.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.805+0000 7f3b73fff640 1 -- 172.21.15.37:0/731280408 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c031870 con 0x7f3b7c0bad70 2023-12-19T17:50:01.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.805+0000 7f3b73fff640 1 -- 172.21.15.37:0/731280408 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c0319d0 con 0x7f3b7c0bad70 2023-12-19T17:50:01.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.805+0000 7f3b73fff640 1 -- 172.21.15.37:0/731280408 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c031d60 con 0x7f3b7c0bad70 2023-12-19T17:50:01.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.806+0000 7f3b833ab640 1 -- 172.21.15.37:0/731280408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0bad70 msgr2=0x7f3b7c0b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:01.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.806+0000 7f3b833ab640 1 --2- 172.21.15.37:0/731280408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0bad70 0x7f3b7c0b2440 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0b3110 tx=0x7f3b6c02b910 comp rx=0 tx=0).stop 2023-12-19T17:50:01.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.806+0000 7f3b833ab640 1 -- 172.21.15.37:0/731280408 shutdown_connections 2023-12-19T17:50:01.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.806+0000 7f3b833ab640 1 --2- 172.21.15.37:0/731280408 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b7c14c2f0 0x7f3b7c14c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:01.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.806+0000 7f3b833ab640 1 --2- 172.21.15.37:0/731280408 >> v2:172.21.15.78:3300/0 conn(0x7f3b7c1428f0 0x7f3b7c142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:01.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.806+0000 7f3b833ab640 1 --2- 172.21.15.37:0/731280408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0bad70 0x7f3b7c0b2440 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:01.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.806+0000 7f3b833ab640 1 -- 172.21.15.37:0/731280408 >> 172.21.15.37:0/731280408 conn(0x7f3b7c0be0c0 msgr2=0x7f3b7c0be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:01.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.806+0000 7f3b833ab640 1 -- 172.21.15.37:0/731280408 shutdown_connections 2023-12-19T17:50:01.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.806+0000 7f3b833ab640 1 -- 172.21.15.37:0/731280408 wait complete. 2023-12-19T17:50:01.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.807+0000 7f3b833ab640 1 Processor -- start 2023-12-19T17:50:01.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.807+0000 7f3b833ab640 1 -- start start 2023-12-19T17:50:01.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.807+0000 7f3b833ab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0bad70 0x7f3b7c13ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:01.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.807+0000 7f3b833ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b7c1428f0 0x7f3b7c139870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:01.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.807+0000 7f3b833ab640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b7c14c2f0 0x7f3b7c139db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:01.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.807+0000 7f3b833ab640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c13b320 con 0x7f3b7c0bad70 2023-12-19T17:50:01.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.807+0000 7f3b833ab640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c1e1010 con 0x7f3b7c1428f0 2023-12-19T17:50:01.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.807+0000 7f3b833ab640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c145b50 con 0x7f3b7c14c2f0 2023-12-19T17:50:01.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.808+0000 7f3b81147640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0bad70 0x7f3b7c13ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:01.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.808+0000 7f3b81147640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0bad70 0x7f3b7c13ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45774/0 (socket says 172.21.15.37:45774) 2023-12-19T17:50:01.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.808+0000 7f3b81147640 1 -- 172.21.15.37:0/3797016136 learned_addr learned my addr 172.21.15.37:0/3797016136 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:01.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.808+0000 7f3b81948640 1 --2- 172.21.15.37:0/3797016136 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b7c14c2f0 0x7f3b7c139db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:01.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.808+0000 7f3b80946640 1 --2- 172.21.15.37:0/3797016136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b7c1428f0 0x7f3b7c139870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:01.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.808+0000 7f3b81147640 1 -- 172.21.15.37:0/3797016136 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b7c14c2f0 msgr2=0x7f3b7c139db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:01.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.808+0000 7f3b81147640 1 --2- 172.21.15.37:0/3797016136 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b7c14c2f0 0x7f3b7c139db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:01.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.808+0000 7f3b81147640 1 -- 172.21.15.37:0/3797016136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b7c1428f0 msgr2=0x7f3b7c139870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:01.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.808+0000 7f3b81147640 1 --2- 172.21.15.37:0/3797016136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b7c1428f0 0x7f3b7c139870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:01.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.808+0000 7f3b81147640 1 -- 172.21.15.37:0/3797016136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c0094d0 con 0x7f3b7c0bad70 2023-12-19T17:50:01.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.808+0000 7f3b80946640 1 --2- 172.21.15.37:0/3797016136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b7c1428f0 0x7f3b7c139870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:50:01.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.808+0000 7f3b81147640 1 --2- 172.21.15.37:0/3797016136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0bad70 0x7f3b7c13ade0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c02b950 tx=0x7f3b6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:01.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.808+0000 7f3b71ffb640 1 -- 172.21.15.37:0/3797016136 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c03ac60 con 0x7f3b7c0bad70 2023-12-19T17:50:01.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.808+0000 7f3b71ffb640 1 -- 172.21.15.37:0/3797016136 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c03adc0 con 0x7f3b7c0bad70 2023-12-19T17:50:01.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.808+0000 7f3b833ab640 1 -- 172.21.15.37:0/3797016136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7c1e1220 con 0x7f3b7c0bad70 2023-12-19T17:50:01.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.808+0000 7f3b71ffb640 1 -- 172.21.15.37:0/3797016136 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c044630 con 0x7f3b7c0bad70 2023-12-19T17:50:01.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.809+0000 7f3b833ab640 1 -- 172.21.15.37:0/3797016136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7c1e17e0 con 0x7f3b7c0bad70 2023-12-19T17:50:01.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.809+0000 7f3b833ab640 1 -- 172.21.15.37:0/3797016136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b7c0b9d10 con 0x7f3b7c0bad70 2023-12-19T17:50:01.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.810+0000 7f3b71ffb640 1 -- 172.21.15.37:0/3797016136 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3b6c04d450 con 0x7f3b7c0bad70 2023-12-19T17:50:01.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.810+0000 7f3b71ffb640 1 --2- 172.21.15.37:0/3797016136 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3b6006a430 0x7f3b6006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:01.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.810+0000 7f3b71ffb640 1 -- 172.21.15.37:0/3797016136 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3b6c02d040 con 0x7f3b7c0bad70 2023-12-19T17:50:01.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.810+0000 7f3b71ffb640 1 --2- 172.21.15.37:0/3797016136 >> [v2:172.21.15.37:6800/89452,v1:172.21.15.37:6801/89452] conn(0x7f3b60070290 0x7f3b600726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:01.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.810+0000 7f3b71ffb640 1 -- 172.21.15.37:0/3797016136 --> [v2:172.21.15.37:6800/89452,v1:172.21.15.37:6801/89452] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b60072d60 con 0x7f3b60070290 2023-12-19T17:50:01.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.810+0000 7f3b71ffb640 1 -- 172.21.15.37:0/3797016136 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b6c0af2c0 con 0x7f3b7c0bad70 2023-12-19T17:50:01.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.811+0000 7f3b80946640 1 --2- 172.21.15.37:0/3797016136 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3b6006a430 0x7f3b6006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:01.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.811+0000 7f3b81948640 1 --2- 172.21.15.37:0/3797016136 >> [v2:172.21.15.37:6800/89452,v1:172.21.15.37:6801/89452] conn(0x7f3b60070290 0x7f3b600726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:01.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.811+0000 7f3b81948640 1 --2- 172.21.15.37:0/3797016136 >> [v2:172.21.15.37:6800/89452,v1:172.21.15.37:6801/89452] conn(0x7f3b60070290 0x7f3b600726b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:01.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.811+0000 7f3b80946640 1 --2- 172.21.15.37:0/3797016136 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3b6006a430 0x7f3b6006c8f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0b24d0 tx=0x7f3b78008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:01.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.812+0000 7f3b71ffb640 1 -- 172.21.15.37:0/3797016136 <== osd.0 v2:172.21.15.37:6800/89452 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3b60072d60 con 0x7f3b60070290 2023-12-19T17:50:01.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.824+0000 7f3b833ab640 1 -- 172.21.15.37:0/3797016136 --> [v2:172.21.15.37:6800/89452,v1:172.21.15.37:6801/89452] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3b7c0b98f0 con 0x7f3b60070290 2023-12-19T17:50:01.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.824+0000 7f3b71ffb640 1 -- 172.21.15.37:0/3797016136 <== osd.0 v2:172.21.15.37:6800/89452 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3b74011040 con 0x7f3b60070290 2023-12-19T17:50:01.825 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-12-19T17:50:01.825 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T17:50:01.825 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-12-19T17:50:01.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.824+0000 7f3b833ab640 1 -- 172.21.15.37:0/3797016136 >> [v2:172.21.15.37:6800/89452,v1:172.21.15.37:6801/89452] conn(0x7f3b60070290 msgr2=0x7f3b600726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:01.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.825+0000 7f3b833ab640 1 --2- 172.21.15.37:0/3797016136 >> [v2:172.21.15.37:6800/89452,v1:172.21.15.37:6801/89452] conn(0x7f3b60070290 0x7f3b600726b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:01.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.825+0000 7f3b833ab640 1 -- 172.21.15.37:0/3797016136 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3b6006a430 msgr2=0x7f3b6006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:01.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.825+0000 7f3b833ab640 1 --2- 172.21.15.37:0/3797016136 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3b6006a430 0x7f3b6006c8f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0b24d0 tx=0x7f3b78008040 comp rx=0 tx=0).stop 2023-12-19T17:50:01.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.825+0000 7f3b833ab640 1 -- 172.21.15.37:0/3797016136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0bad70 msgr2=0x7f3b7c13ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:01.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.825+0000 7f3b833ab640 1 --2- 172.21.15.37:0/3797016136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0bad70 0x7f3b7c13ade0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c02b950 tx=0x7f3b6c0046c0 comp rx=0 tx=0).stop 2023-12-19T17:50:01.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.825+0000 7f3b81948640 1 -- 172.21.15.37:0/3797016136 reap_dead start 2023-12-19T17:50:01.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.825+0000 7f3b833ab640 1 -- 172.21.15.37:0/3797016136 shutdown_connections 2023-12-19T17:50:01.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.825+0000 7f3b833ab640 1 -- 172.21.15.37:0/3797016136 >> 172.21.15.37:0/3797016136 conn(0x7f3b7c0be0c0 msgr2=0x7f3b7c13c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:01.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.825+0000 7f3b833ab640 1 -- 172.21.15.37:0/3797016136 shutdown_connections 2023-12-19T17:50:01.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.825+0000 7f3b833ab640 1 -- 172.21.15.37:0/3797016136 wait complete. 2023-12-19T17:50:01.835 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-19T17:50:01.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.942+0000 7fa579c28640 1 Processor -- start 2023-12-19T17:50:01.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.942+0000 7fa579c28640 1 -- start start 2023-12-19T17:50:01.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.943+0000 7fa579c28640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa574070340 0x7fa5740bc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:01.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.943+0000 7fa579c28640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5740710d0 con 0x7fa57406b0c0 2023-12-19T17:50:01.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.943+0000 7fa579c28640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5740713b0 con 0x7fa5740b6860 2023-12-19T17:50:01.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.943+0000 7fa579c28640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa574069f50 con 0x7fa574070340 2023-12-19T17:50:01.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.943+0000 7fa573fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa57406b0c0 0x7fa57406b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50452/0 (socket says 172.21.15.37:50452) 2023-12-19T17:50:01.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.943+0000 7fa573fff640 1 -- 172.21.15.37:0/650974948 learned_addr learned my addr 172.21.15.37:0/650974948 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:50:01.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.943+0000 7fa5727fc640 1 -- 172.21.15.37:0/650974948 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685488868 0 0) 0x7fa5740710d0 con 0x7fa57406b0c0 2023-12-19T17:50:01.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.943+0000 7fa5727fc640 1 -- 172.21.15.37:0/650974948 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa55c003520 con 0x7fa57406b0c0 2023-12-19T17:50:01.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.943+0000 7fa572ffd640 1 --2- 172.21.15.37:0/650974948 >> v2:172.21.15.78:3300/0 conn(0x7fa574070340 0x7fa5740bc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:01.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa5727fc640 1 -- 172.21.15.37:0/650974948 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2351647714 0 0) 0x7fa55c003520 con 0x7fa57406b0c0 2023-12-19T17:50:01.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa5727fc640 1 -- 172.21.15.37:0/650974948 >> v2:172.21.15.78:3300/0 conn(0x7fa574070340 msgr2=0x7fa5740bc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:01.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa5727fc640 1 --2- 172.21.15.37:0/650974948 >> v2:172.21.15.78:3300/0 conn(0x7fa574070340 0x7fa5740bc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:01.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa5727fc640 1 -- 172.21.15.37:0/650974948 >> v1:172.21.15.78:6789/0 conn(0x7fa5740b6860 legacy=0x7fa5741427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:01.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa5727fc640 1 -- 172.21.15.37:0/650974948 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa574071690 con 0x7fa57406b0c0 2023-12-19T17:50:01.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa5727fc640 1 -- 172.21.15.37:0/650974948 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7fa56c0019f0 con 0x7fa57406b0c0 2023-12-19T17:50:01.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa5727fc640 1 -- 172.21.15.37:0/650974948 >> v1:172.21.15.37:6789/0 conn(0x7fa57406b0c0 legacy=0x7fa57406b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:01.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa5727fc640 1 --2- 172.21.15.37:0/650974948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa55c003970 0x7fa55c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:01.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa5727fc640 1 --2- 172.21.15.37:0/650974948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa55c0047c0 0x7fa55c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:01.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa5727fc640 1 --2- 172.21.15.37:0/650974948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa55c005180 0x7fa55c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:01.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa5727fc640 1 -- 172.21.15.37:0/650974948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa574069f50 con 0x7fa55c005180 2023-12-19T17:50:01.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa5727fc640 1 -- 172.21.15.37:0/650974948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c00c030 con 0x7fa55c003970 2023-12-19T17:50:01.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa5727fc640 1 -- 172.21.15.37:0/650974948 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c00c1f0 con 0x7fa55c0047c0 2023-12-19T17:50:01.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa5737fe640 1 --2- 172.21.15.37:0/650974948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa55c003970 0x7fa55c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:01.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa573fff640 1 --2- 172.21.15.37:0/650974948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa55c005180 0x7fa55c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:01.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa572ffd640 1 --2- 172.21.15.37:0/650974948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa55c0047c0 0x7fa55c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:01.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa573fff640 1 -- 172.21.15.37:0/650974948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa55c0047c0 msgr2=0x7fa55c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:01.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa573fff640 1 --2- 172.21.15.37:0/650974948 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa55c0047c0 0x7fa55c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:01.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa573fff640 1 -- 172.21.15.37:0/650974948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa55c003970 msgr2=0x7fa55c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:01.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa573fff640 1 --2- 172.21.15.37:0/650974948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa55c003970 0x7fa55c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:01.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.944+0000 7fa573fff640 1 -- 172.21.15.37:0/650974948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c003520 con 0x7fa55c005180 2023-12-19T17:50:01.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.945+0000 7fa573fff640 1 -- 172.21.15.37:0/650974948 reap_dead start 2023-12-19T17:50:01.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.945+0000 7fa573fff640 1 --2- 172.21.15.37:0/650974948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa55c005180 0x7fa55c00b980 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00a830 tx=0x7fa55c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fbbb13fb7f6654c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:01.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.945+0000 7fa5727fc640 1 -- 172.21.15.37:0/650974948 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c0072d0 con 0x7fa55c005180 2023-12-19T17:50:01.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.945+0000 7fa5727fc640 1 -- 172.21.15.37:0/650974948 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c02f070 con 0x7fa55c005180 2023-12-19T17:50:01.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.945+0000 7fa5727fc640 1 -- 172.21.15.37:0/650974948 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c0076b0 con 0x7fa55c005180 2023-12-19T17:50:01.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.946+0000 7fa579c28640 1 -- 172.21.15.37:0/650974948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa55c005180 msgr2=0x7fa55c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:01.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.946+0000 7fa579c28640 1 --2- 172.21.15.37:0/650974948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa55c005180 0x7fa55c00b980 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00a830 tx=0x7fa55c0057f0 comp rx=0 tx=0).stop 2023-12-19T17:50:01.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.946+0000 7fa579c28640 1 -- 172.21.15.37:0/650974948 shutdown_connections 2023-12-19T17:50:01.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.946+0000 7fa579c28640 1 --2- 172.21.15.37:0/650974948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa55c005180 0x7fa55c00b980 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:01.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.946+0000 7fa579c28640 1 -- 172.21.15.37:0/650974948 >> 172.21.15.37:0/650974948 conn(0x7fa5740bcf60 msgr2=0x7fa5740bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:01.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.946+0000 7fa579c28640 1 -- 172.21.15.37:0/650974948 shutdown_connections 2023-12-19T17:50:01.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.946+0000 7fa579c28640 1 -- 172.21.15.37:0/650974948 wait complete. 2023-12-19T17:50:01.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.947+0000 7fa579c28640 1 Processor -- start 2023-12-19T17:50:01.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.947+0000 7fa579c28640 1 -- start start 2023-12-19T17:50:01.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa579c28640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa55c005180 0x7fa57413e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:01.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa579c28640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa57413d4d0 0x7fa5741e1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:01.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa579c28640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa57413d910 0x7fa5741e15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:01.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa579c28640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5740bcd50 con 0x7fa57413d4d0 2023-12-19T17:50:01.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa579c28640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57413d040 con 0x7fa57413d910 2023-12-19T17:50:01.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa579c28640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa57413fa50 con 0x7fa55c005180 2023-12-19T17:50:01.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa572ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa57413d4d0 0x7fa5741e1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:01.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa572ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa57413d4d0 0x7fa5741e1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45796/0 (socket says 172.21.15.37:45796) 2023-12-19T17:50:01.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa572ffd640 1 -- 172.21.15.37:0/14290070 learned_addr learned my addr 172.21.15.37:0/14290070 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:01.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa573fff640 1 --2- 172.21.15.37:0/14290070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa57413d910 0x7fa5741e15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:01.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa5737fe640 1 --2- 172.21.15.37:0/14290070 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa55c005180 0x7fa57413e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:01.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa572ffd640 1 -- 172.21.15.37:0/14290070 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa55c005180 msgr2=0x7fa57413e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:01.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa572ffd640 1 --2- 172.21.15.37:0/14290070 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa55c005180 0x7fa57413e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:01.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa572ffd640 1 -- 172.21.15.37:0/14290070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa57413d910 msgr2=0x7fa5741e15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:01.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa572ffd640 1 --2- 172.21.15.37:0/14290070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa57413d910 0x7fa5741e15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:01.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa572ffd640 1 -- 172.21.15.37:0/14290070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57413ccd0 con 0x7fa57413d4d0 2023-12-19T17:50:01.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa5737fe640 1 --2- 172.21.15.37:0/14290070 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa55c005180 0x7fa57413e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:50:01.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa573fff640 1 --2- 172.21.15.37:0/14290070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa57413d910 0x7fa5741e15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:50:01.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa572ffd640 1 --2- 172.21.15.37:0/14290070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa57413d4d0 0x7fa5741e1060 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fa568011940 tx=0x7fa568011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:01.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa55bfff640 1 -- 172.21.15.37:0/14290070 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56800faf0 con 0x7fa57413d4d0 2023-12-19T17:50:01.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa55bfff640 1 -- 172.21.15.37:0/14290070 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56800fc50 con 0x7fa57413d4d0 2023-12-19T17:50:01.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa55bfff640 1 -- 172.21.15.37:0/14290070 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa568014440 con 0x7fa57413d4d0 2023-12-19T17:50:01.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.948+0000 7fa579c28640 1 -- 172.21.15.37:0/14290070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa57413fca0 con 0x7fa57413d4d0 2023-12-19T17:50:01.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.949+0000 7fa579c28640 1 -- 172.21.15.37:0/14290070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa574147710 con 0x7fa57413d4d0 2023-12-19T17:50:01.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.950+0000 7fa579c28640 1 -- 172.21.15.37:0/14290070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa57413d1f0 con 0x7fa57413d4d0 2023-12-19T17:50:01.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.950+0000 7fa55bfff640 1 -- 172.21.15.37:0/14290070 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa5680145a0 con 0x7fa57413d4d0 2023-12-19T17:50:01.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.950+0000 7fa55bfff640 1 --2- 172.21.15.37:0/14290070 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa56006a430 0x7fa56006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:01.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.950+0000 7fa55bfff640 1 -- 172.21.15.37:0/14290070 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa568088db0 con 0x7fa57413d4d0 2023-12-19T17:50:01.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.951+0000 7fa5737fe640 1 --2- 172.21.15.37:0/14290070 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa56006a430 0x7fa56006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:01.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.951+0000 7fa5737fe640 1 --2- 172.21.15.37:0/14290070 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa56006a430 0x7fa56006c8f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa564000c00 tx=0x7fa564009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:01.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:01.955+0000 7fa55bfff640 1 -- 172.21.15.37:0/14290070 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa57413d1f0 con 0x7fa57413d4d0 2023-12-19T17:50:02.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.132+0000 7fa579c28640 1 -- 172.21.15.37:0/14290070 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fa574070760 con 0x7fa56006a430 2023-12-19T17:50:02.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.132+0000 7fa55bfff640 1 -- 172.21.15.37:0/14290070 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa564001510 con 0x7fa56006a430 2023-12-19T17:50:02.133 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 0 to deep-scrub 2023-12-19T17:50:02.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.134+0000 7fa579c28640 1 -- 172.21.15.37:0/14290070 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa56006a430 msgr2=0x7fa56006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.134+0000 7fa579c28640 1 --2- 172.21.15.37:0/14290070 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa56006a430 0x7fa56006c8f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa564000c00 tx=0x7fa564009040 comp rx=0 tx=0).stop 2023-12-19T17:50:02.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.134+0000 7fa579c28640 1 -- 172.21.15.37:0/14290070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa57413d4d0 msgr2=0x7fa5741e1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.134+0000 7fa579c28640 1 --2- 172.21.15.37:0/14290070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa57413d4d0 0x7fa5741e1060 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fa568011940 tx=0x7fa568011e00 comp rx=0 tx=0).stop 2023-12-19T17:50:02.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.134+0000 7fa579c28640 1 -- 172.21.15.37:0/14290070 shutdown_connections 2023-12-19T17:50:02.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.134+0000 7fa579c28640 1 --2- 172.21.15.37:0/14290070 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fa56006a430 0x7fa56006c8f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.134+0000 7fa579c28640 1 --2- 172.21.15.37:0/14290070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa57413d910 0x7fa5741e15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.134+0000 7fa579c28640 1 --2- 172.21.15.37:0/14290070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa57413d4d0 0x7fa5741e1060 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.134+0000 7fa579c28640 1 --2- 172.21.15.37:0/14290070 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa55c005180 0x7fa57413e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.134+0000 7fa579c28640 1 -- 172.21.15.37:0/14290070 >> 172.21.15.37:0/14290070 conn(0x7fa5740bcf60 msgr2=0x7fa5741425c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:02.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.135+0000 7fa579c28640 1 -- 172.21.15.37:0/14290070 shutdown_connections 2023-12-19T17:50:02.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.135+0000 7fa579c28640 1 -- 172.21.15.37:0/14290070 wait complete. 2023-12-19T17:50:02.146 INFO:tasks.ceph:Scrubbing osd.1 2023-12-19T17:50:02.146 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-19T17:50:02.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.256+0000 7f96b4bd2640 1 Processor -- start 2023-12-19T17:50:02.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.256+0000 7f96b4bd2640 1 -- start start 2023-12-19T17:50:02.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.257+0000 7f96b4bd2640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96b00bad70 0x7f96b00b2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.257+0000 7f96b4bd2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96b01428f0 0x7f96b0142d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.257+0000 7f96b4bd2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b00b9050 con 0x7f96b014c2f0 2023-12-19T17:50:02.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.257+0000 7f96b4bd2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b00b9330 con 0x7f96b01428f0 2023-12-19T17:50:02.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.257+0000 7f96b4bd2640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b00b9610 con 0x7f96b00bad70 2023-12-19T17:50:02.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.257+0000 7f96add9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96b01428f0 0x7f96b0142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.257+0000 7f96aed9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f96b014c2f0 0x7f96b014c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50468/0 (socket says 172.21.15.37:50468) 2023-12-19T17:50:02.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.257+0000 7f96aed9d640 1 -- 172.21.15.37:0/3178033316 learned_addr learned my addr 172.21.15.37:0/3178033316 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:50:02.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.257+0000 7f96ae59c640 1 --2- 172.21.15.37:0/3178033316 >> v2:172.21.15.78:3300/0 conn(0x7f96b00bad70 0x7f96b00b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.257+0000 7f96add9b640 1 -- 172.21.15.37:0/3178033316 >> v2:172.21.15.78:3300/0 conn(0x7f96b00bad70 msgr2=0x7f96b00b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:02.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.257+0000 7f96add9b640 1 --2- 172.21.15.37:0/3178033316 >> v2:172.21.15.78:3300/0 conn(0x7f96b00bad70 0x7f96b00b2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.257+0000 7f96add9b640 1 -- 172.21.15.37:0/3178033316 >> v1:172.21.15.37:6789/0 conn(0x7f96b014c2f0 legacy=0x7f96b014c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.257+0000 7f96add9b640 1 -- 172.21.15.37:0/3178033316 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b00b98f0 con 0x7f96b01428f0 2023-12-19T17:50:02.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.257+0000 7f96ad59a640 1 -- 172.21.15.37:0/3178033316 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803636325 0 0) 0x7f96b00b9050 con 0x7f96b014c2f0 2023-12-19T17:50:02.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.258+0000 7f96add9b640 1 --2- 172.21.15.37:0/3178033316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b01428f0 0x7f96b0142d10 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f96b00b5330 tx=0x7f96a402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2882d686a999833b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:02.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.258+0000 7f96ad59a640 1 -- 172.21.15.37:0/3178033316 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a4031830 con 0x7f96b01428f0 2023-12-19T17:50:02.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.258+0000 7f96ad59a640 1 -- 172.21.15.37:0/3178033316 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a4031990 con 0x7f96b01428f0 2023-12-19T17:50:02.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.258+0000 7f96ad59a640 1 -- 172.21.15.37:0/3178033316 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a4031d20 con 0x7f96b01428f0 2023-12-19T17:50:02.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.259+0000 7f96b4bd2640 1 -- 172.21.15.37:0/3178033316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b01428f0 msgr2=0x7f96b0142d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.259+0000 7f96b4bd2640 1 --2- 172.21.15.37:0/3178033316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b01428f0 0x7f96b0142d10 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f96b00b5330 tx=0x7f96a402b8d0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.259+0000 7f96b4bd2640 1 -- 172.21.15.37:0/3178033316 shutdown_connections 2023-12-19T17:50:02.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.259+0000 7f96b4bd2640 1 --2- 172.21.15.37:0/3178033316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b01428f0 0x7f96b0142d10 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.259+0000 7f96b4bd2640 1 --2- 172.21.15.37:0/3178033316 >> v2:172.21.15.78:3300/0 conn(0x7f96b00bad70 0x7f96b00b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.259+0000 7f96b4bd2640 1 -- 172.21.15.37:0/3178033316 >> 172.21.15.37:0/3178033316 conn(0x7f96b00be0c0 msgr2=0x7f96b00be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:02.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.259+0000 7f96b4bd2640 1 -- 172.21.15.37:0/3178033316 shutdown_connections 2023-12-19T17:50:02.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.259+0000 7f96b4bd2640 1 -- 172.21.15.37:0/3178033316 wait complete. 2023-12-19T17:50:02.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.260+0000 7f96b4bd2640 1 Processor -- start 2023-12-19T17:50:02.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.260+0000 7f96b4bd2640 1 -- start start 2023-12-19T17:50:02.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.261+0000 7f96b4bd2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96b00bad70 0x7f96b00bd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.261+0000 7f96b4bd2640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96b01428f0 0x7f96b01dd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.261+0000 7f96b4bd2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b014c2f0 0x7f96b0138410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.261+0000 7f96b4bd2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b0140e00 con 0x7f96b014c2f0 2023-12-19T17:50:02.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.261+0000 7f96b4bd2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00bd6a0 con 0x7f96b00bad70 2023-12-19T17:50:02.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.261+0000 7f96b4bd2640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b01401a0 con 0x7f96b01428f0 2023-12-19T17:50:02.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.261+0000 7f96aed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b014c2f0 0x7f96b0138410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.261+0000 7f96aed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b014c2f0 0x7f96b0138410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45820/0 (socket says 172.21.15.37:45820) 2023-12-19T17:50:02.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.261+0000 7f96aed9d640 1 -- 172.21.15.37:0/2515818331 learned_addr learned my addr 172.21.15.37:0/2515818331 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:02.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.261+0000 7f96ae59c640 1 --2- 172.21.15.37:0/2515818331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96b00bad70 0x7f96b00bd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.261+0000 7f96add9b640 1 --2- 172.21.15.37:0/2515818331 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96b01428f0 0x7f96b01dd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.261+0000 7f96aed9d640 1 -- 172.21.15.37:0/2515818331 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96b01428f0 msgr2=0x7f96b01dd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.261+0000 7f96aed9d640 1 --2- 172.21.15.37:0/2515818331 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f96b01428f0 0x7f96b01dd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.261+0000 7f96aed9d640 1 -- 172.21.15.37:0/2515818331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96b00bad70 msgr2=0x7f96b00bd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.261+0000 7f96aed9d640 1 --2- 172.21.15.37:0/2515818331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96b00bad70 0x7f96b00bd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.261+0000 7f96aed9d640 1 -- 172.21.15.37:0/2515818331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a4009400 con 0x7f96b014c2f0 2023-12-19T17:50:02.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.261+0000 7f96ae59c640 1 --2- 172.21.15.37:0/2515818331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96b00bad70 0x7f96b00bd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:50:02.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.261+0000 7f96aed9d640 1 --2- 172.21.15.37:0/2515818331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b014c2f0 0x7f96b0138410 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f96a800c7b0 tx=0x7f96a800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:02.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.262+0000 7f969effd640 1 -- 172.21.15.37:0/2515818331 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a800a640 con 0x7f96b014c2f0 2023-12-19T17:50:02.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.262+0000 7f969effd640 1 -- 172.21.15.37:0/2515818331 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a800a7c0 con 0x7f96b014c2f0 2023-12-19T17:50:02.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.262+0000 7f96b4bd2640 1 -- 172.21.15.37:0/2515818331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b0141220 con 0x7f96b014c2f0 2023-12-19T17:50:02.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.262+0000 7f969effd640 1 -- 172.21.15.37:0/2515818331 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a800ab70 con 0x7f96b014c2f0 2023-12-19T17:50:02.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.262+0000 7f96b4bd2640 1 -- 172.21.15.37:0/2515818331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b0143570 con 0x7f96b014c2f0 2023-12-19T17:50:02.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.263+0000 7f96b4bd2640 1 -- 172.21.15.37:0/2515818331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f96b00b8940 con 0x7f96b014c2f0 2023-12-19T17:50:02.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.263+0000 7f969effd640 1 -- 172.21.15.37:0/2515818331 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f96a800acd0 con 0x7f96b014c2f0 2023-12-19T17:50:02.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.264+0000 7f969effd640 1 --2- 172.21.15.37:0/2515818331 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f969006a430 0x7f969006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.264+0000 7f969effd640 1 -- 172.21.15.37:0/2515818331 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f96a8087d20 con 0x7f96b014c2f0 2023-12-19T17:50:02.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.264+0000 7f969effd640 1 --2- 172.21.15.37:0/2515818331 >> [v2:172.21.15.37:6808/89453,v1:172.21.15.37:6809/89453] conn(0x7f9690070290 0x7f96900726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.264+0000 7f969effd640 1 -- 172.21.15.37:0/2515818331 --> [v2:172.21.15.37:6808/89453,v1:172.21.15.37:6809/89453] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9690072d60 con 0x7f9690070290 2023-12-19T17:50:02.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.264+0000 7f969effd640 1 -- 172.21.15.37:0/2515818331 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96a808a3e0 con 0x7f96b014c2f0 2023-12-19T17:50:02.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.264+0000 7f96ae59c640 1 --2- 172.21.15.37:0/2515818331 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f969006a430 0x7f969006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.264+0000 7f96add9b640 1 --2- 172.21.15.37:0/2515818331 >> [v2:172.21.15.37:6808/89453,v1:172.21.15.37:6809/89453] conn(0x7f9690070290 0x7f96900726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.264+0000 7f96add9b640 1 --2- 172.21.15.37:0/2515818331 >> [v2:172.21.15.37:6808/89453,v1:172.21.15.37:6809/89453] conn(0x7f9690070290 0x7f96900726b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:02.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.264+0000 7f96ae59c640 1 --2- 172.21.15.37:0/2515818331 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f969006a430 0x7f969006c8f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f96a0006fd0 tx=0x7f96a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:02.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.265+0000 7f969effd640 1 -- 172.21.15.37:0/2515818331 <== osd.1 v2:172.21.15.37:6808/89453 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9690072d60 con 0x7f9690070290 2023-12-19T17:50:02.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.277+0000 7f96b4bd2640 1 -- 172.21.15.37:0/2515818331 --> [v2:172.21.15.37:6808/89453,v1:172.21.15.37:6809/89453] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f96b00b9d10 con 0x7f9690070290 2023-12-19T17:50:02.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.278+0000 7f969effd640 1 -- 172.21.15.37:0/2515818331 <== osd.1 v2:172.21.15.37:6808/89453 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f96a4031b00 con 0x7f9690070290 2023-12-19T17:50:02.278 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-12-19T17:50:02.278 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T17:50:02.279 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-12-19T17:50:02.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.278+0000 7f96b4bd2640 1 -- 172.21.15.37:0/2515818331 >> [v2:172.21.15.37:6808/89453,v1:172.21.15.37:6809/89453] conn(0x7f9690070290 msgr2=0x7f96900726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.278+0000 7f96b4bd2640 1 --2- 172.21.15.37:0/2515818331 >> [v2:172.21.15.37:6808/89453,v1:172.21.15.37:6809/89453] conn(0x7f9690070290 0x7f96900726b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.278+0000 7f96b4bd2640 1 -- 172.21.15.37:0/2515818331 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f969006a430 msgr2=0x7f969006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.278+0000 7f96b4bd2640 1 --2- 172.21.15.37:0/2515818331 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f969006a430 0x7f969006c8f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f96a0006fd0 tx=0x7f96a0008040 comp rx=0 tx=0).stop 2023-12-19T17:50:02.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.278+0000 7f96b4bd2640 1 -- 172.21.15.37:0/2515818331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b014c2f0 msgr2=0x7f96b0138410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.278+0000 7f96b4bd2640 1 --2- 172.21.15.37:0/2515818331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b014c2f0 0x7f96b0138410 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f96a800c7b0 tx=0x7f96a800cc70 comp rx=0 tx=0).stop 2023-12-19T17:50:02.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.278+0000 7f96aed9d640 1 -- 172.21.15.37:0/2515818331 reap_dead start 2023-12-19T17:50:02.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.278+0000 7f96b4bd2640 1 -- 172.21.15.37:0/2515818331 shutdown_connections 2023-12-19T17:50:02.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.278+0000 7f96b4bd2640 1 -- 172.21.15.37:0/2515818331 >> 172.21.15.37:0/2515818331 conn(0x7f96b00be0c0 msgr2=0x7f96b00b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:02.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.278+0000 7f96b4bd2640 1 -- 172.21.15.37:0/2515818331 shutdown_connections 2023-12-19T17:50:02.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.278+0000 7f96b4bd2640 1 -- 172.21.15.37:0/2515818331 wait complete. 2023-12-19T17:50:02.289 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-19T17:50:02.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.396+0000 7fea9e3a7640 1 Processor -- start 2023-12-19T17:50:02.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.396+0000 7fea9e3a7640 1 -- start start 2023-12-19T17:50:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.396+0000 7fea9e3a7640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea980b6860 0x7fea98070340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.396+0000 7fea9e3a7640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea980710d0 con 0x7fea980bc810 2023-12-19T17:50:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.396+0000 7fea9e3a7640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea980713b0 con 0x7fea9806b0c0 2023-12-19T17:50:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.396+0000 7fea9e3a7640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea98069f50 con 0x7fea980b6860 2023-12-19T17:50:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea977fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fea980bc810 0x7fea981427f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50484/0 (socket says 172.21.15.37:50484) 2023-12-19T17:50:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea977fe640 1 -- 172.21.15.37:0/290344875 learned_addr learned my addr 172.21.15.37:0/290344875 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:50:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea97fff640 1 --2- 172.21.15.37:0/290344875 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea980b6860 0x7fea98070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea96ffd640 1 -- 172.21.15.37:0/290344875 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650513699 0 0) 0x7fea980710d0 con 0x7fea980bc810 2023-12-19T17:50:02.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea96ffd640 1 -- 172.21.15.37:0/290344875 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea80003520 con 0x7fea980bc810 2023-12-19T17:50:02.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea96ffd640 1 -- 172.21.15.37:0/290344875 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335081646 0 0) 0x7fea980713b0 con 0x7fea9806b0c0 2023-12-19T17:50:02.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea96ffd640 1 -- 172.21.15.37:0/290344875 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea980710d0 con 0x7fea9806b0c0 2023-12-19T17:50:02.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea96ffd640 1 -- 172.21.15.37:0/290344875 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1893634725 0 0) 0x7fea80003520 con 0x7fea980bc810 2023-12-19T17:50:02.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea96ffd640 1 -- 172.21.15.37:0/290344875 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea980b6860 msgr2=0x7fea98070340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:02.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea96ffd640 1 --2- 172.21.15.37:0/290344875 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea980b6860 0x7fea98070340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea96ffd640 1 -- 172.21.15.37:0/290344875 >> v1:172.21.15.78:6789/0 conn(0x7fea9806b0c0 legacy=0x7fea9806b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea96ffd640 1 -- 172.21.15.37:0/290344875 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea98071690 con 0x7fea980bc810 2023-12-19T17:50:02.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea96ffd640 1 -- 172.21.15.37:0/290344875 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7fea8c001670 con 0x7fea980bc810 2023-12-19T17:50:02.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea97fff640 1 --2- 172.21.15.37:0/290344875 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea980b6860 0x7fea98070340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:50:02.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea96ffd640 1 -- 172.21.15.37:0/290344875 >> v1:172.21.15.37:6789/0 conn(0x7fea980bc810 legacy=0x7fea981427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea96ffd640 1 --2- 172.21.15.37:0/290344875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea80003b30 0x7fea80003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea96ffd640 1 --2- 172.21.15.37:0/290344875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea800047c0 0x7fea80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea96ffd640 1 --2- 172.21.15.37:0/290344875 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea980b6860 0x7fea80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea96ffd640 1 -- 172.21.15.37:0/290344875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea98069f50 con 0x7fea80003b30 2023-12-19T17:50:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea96ffd640 1 -- 172.21.15.37:0/290344875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8000ba30 con 0x7fea800047c0 2023-12-19T17:50:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea96ffd640 1 -- 172.21.15.37:0/290344875 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8000bbc0 con 0x7fea980b6860 2023-12-19T17:50:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea97fff640 1 --2- 172.21.15.37:0/290344875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea80003b30 0x7fea80003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea977fe640 1 --2- 172.21.15.37:0/290344875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea800047c0 0x7fea80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.397+0000 7fea9c944640 1 --2- 172.21.15.37:0/290344875 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea980b6860 0x7fea80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.398+0000 7fea97fff640 1 -- 172.21.15.37:0/290344875 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea980b6860 msgr2=0x7fea80005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.398+0000 7fea97fff640 1 --2- 172.21.15.37:0/290344875 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea980b6860 0x7fea80005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.398+0000 7fea97fff640 1 -- 172.21.15.37:0/290344875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea800047c0 msgr2=0x7fea80004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.398+0000 7fea97fff640 1 --2- 172.21.15.37:0/290344875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea800047c0 0x7fea80004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.398+0000 7fea97fff640 1 -- 172.21.15.37:0/290344875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea88009400 con 0x7fea80003b30 2023-12-19T17:50:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.398+0000 7fea97fff640 1 --2- 172.21.15.37:0/290344875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea80003b30 0x7fea80003f30 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fea88009c60 tx=0x7fea800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9256c67db4a9fa6d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.398+0000 7fea96ffd640 1 -- 172.21.15.37:0/290344875 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8802c8a0 con 0x7fea80003b30 2023-12-19T17:50:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.398+0000 7fea96ffd640 1 -- 172.21.15.37:0/290344875 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8802ca00 con 0x7fea80003b30 2023-12-19T17:50:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.399+0000 7fea96ffd640 1 -- 172.21.15.37:0/290344875 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8802cdb0 con 0x7fea80003b30 2023-12-19T17:50:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.399+0000 7fea9e3a7640 1 -- 172.21.15.37:0/290344875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea80003b30 msgr2=0x7fea80003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.399+0000 7fea9e3a7640 1 --2- 172.21.15.37:0/290344875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea80003b30 0x7fea80003f30 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fea88009c60 tx=0x7fea800057f0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.399+0000 7fea9c944640 1 -- 172.21.15.37:0/290344875 reap_dead start 2023-12-19T17:50:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.399+0000 7fea9e3a7640 1 -- 172.21.15.37:0/290344875 shutdown_connections 2023-12-19T17:50:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.399+0000 7fea9e3a7640 1 -- 172.21.15.37:0/290344875 >> 172.21.15.37:0/290344875 conn(0x7fea980bcf60 msgr2=0x7fea980bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.399+0000 7fea9e3a7640 1 -- 172.21.15.37:0/290344875 shutdown_connections 2023-12-19T17:50:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.399+0000 7fea9e3a7640 1 -- 172.21.15.37:0/290344875 wait complete. 2023-12-19T17:50:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.400+0000 7fea9e3a7640 1 Processor -- start 2023-12-19T17:50:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.401+0000 7fea9e3a7640 1 -- start start 2023-12-19T17:50:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.401+0000 7fea9e3a7640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea80003b30 0x7fea981483b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.401+0000 7fea9e3a7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea9813d7b0 0x7fea981e1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.401+0000 7fea9e3a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea9813dc30 0x7fea981e1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.401+0000 7fea9e3a7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea981488f0 con 0x7fea9813dc30 2023-12-19T17:50:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.401+0000 7fea9e3a7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea98149200 con 0x7fea9813d7b0 2023-12-19T17:50:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.401+0000 7fea9e3a7640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9813e130 con 0x7fea80003b30 2023-12-19T17:50:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.401+0000 7fea9c944640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea9813dc30 0x7fea981e1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.401+0000 7fea9c944640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea9813dc30 0x7fea981e1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45846/0 (socket says 172.21.15.37:45846) 2023-12-19T17:50:02.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.401+0000 7fea9c944640 1 -- 172.21.15.37:0/1096060851 learned_addr learned my addr 172.21.15.37:0/1096060851 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:02.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.401+0000 7fea97fff640 1 --2- 172.21.15.37:0/1096060851 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea80003b30 0x7fea981483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.401+0000 7fea977fe640 1 --2- 172.21.15.37:0/1096060851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea9813d7b0 0x7fea981e1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.402+0000 7fea9c944640 1 -- 172.21.15.37:0/1096060851 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea80003b30 msgr2=0x7fea981483b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.402+0000 7fea9c944640 1 --2- 172.21.15.37:0/1096060851 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea80003b30 0x7fea981483b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.402+0000 7fea9c944640 1 -- 172.21.15.37:0/1096060851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea9813d7b0 msgr2=0x7fea981e1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.402+0000 7fea9c944640 1 --2- 172.21.15.37:0/1096060851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea9813d7b0 0x7fea981e1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.402+0000 7fea9c944640 1 -- 172.21.15.37:0/1096060851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea98145d70 con 0x7fea9813dc30 2023-12-19T17:50:02.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.402+0000 7fea97fff640 1 --2- 172.21.15.37:0/1096060851 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea80003b30 0x7fea981483b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:50:02.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.402+0000 7fea977fe640 1 --2- 172.21.15.37:0/1096060851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea9813d7b0 0x7fea981e1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:50:02.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.402+0000 7fea9c944640 1 --2- 172.21.15.37:0/1096060851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea9813dc30 0x7fea981e1ad0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fea9806a1b0 tx=0x7fea9000ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:02.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.402+0000 7fea94ff9640 1 -- 172.21.15.37:0/1096060851 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90006e20 con 0x7fea9813dc30 2023-12-19T17:50:02.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.402+0000 7fea94ff9640 1 -- 172.21.15.37:0/1096060851 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea90003970 con 0x7fea9813dc30 2023-12-19T17:50:02.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.402+0000 7fea9e3a7640 1 -- 172.21.15.37:0/1096060851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea98146050 con 0x7fea9813dc30 2023-12-19T17:50:02.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.402+0000 7fea94ff9640 1 -- 172.21.15.37:0/1096060851 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea90003d20 con 0x7fea9813dc30 2023-12-19T17:50:02.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.402+0000 7fea9e3a7640 1 -- 172.21.15.37:0/1096060851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea980b3900 con 0x7fea9813dc30 2023-12-19T17:50:02.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.403+0000 7fea9e3a7640 1 -- 172.21.15.37:0/1096060851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9804e840 con 0x7fea9813dc30 2023-12-19T17:50:02.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.403+0000 7fea94ff9640 1 -- 172.21.15.37:0/1096060851 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fea900050d0 con 0x7fea9813dc30 2023-12-19T17:50:02.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.404+0000 7fea94ff9640 1 --2- 172.21.15.37:0/1096060851 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fea8406a430 0x7fea8406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.404+0000 7fea94ff9640 1 -- 172.21.15.37:0/1096060851 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fea900875f0 con 0x7fea9813dc30 2023-12-19T17:50:02.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.404+0000 7fea97fff640 1 --2- 172.21.15.37:0/1096060851 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fea8406a430 0x7fea8406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.405+0000 7fea97fff640 1 --2- 172.21.15.37:0/1096060851 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fea8406a430 0x7fea8406c8f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fea88036000 tx=0x7fea88030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:02.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.408+0000 7fea94ff9640 1 -- 172.21.15.37:0/1096060851 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fea90052f70 con 0x7fea9813dc30 2023-12-19T17:50:02.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.587+0000 7fea9e3a7640 1 -- 172.21.15.37:0/1096060851 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fea980bcc30 con 0x7fea8406a430 2023-12-19T17:50:02.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.587+0000 7fea94ff9640 1 -- 172.21.15.37:0/1096060851 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fea88044090 con 0x7fea8406a430 2023-12-19T17:50:02.588 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 1 to deep-scrub 2023-12-19T17:50:02.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.589+0000 7fea9e3a7640 1 -- 172.21.15.37:0/1096060851 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fea8406a430 msgr2=0x7fea8406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.589+0000 7fea9e3a7640 1 --2- 172.21.15.37:0/1096060851 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fea8406a430 0x7fea8406c8f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fea88036000 tx=0x7fea88030000 comp rx=0 tx=0).stop 2023-12-19T17:50:02.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.589+0000 7fea9e3a7640 1 -- 172.21.15.37:0/1096060851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea9813dc30 msgr2=0x7fea981e1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.589+0000 7fea9e3a7640 1 --2- 172.21.15.37:0/1096060851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea9813dc30 0x7fea981e1ad0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fea9806a1b0 tx=0x7fea9000ff70 comp rx=0 tx=0).stop 2023-12-19T17:50:02.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.589+0000 7fea9e3a7640 1 -- 172.21.15.37:0/1096060851 shutdown_connections 2023-12-19T17:50:02.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.589+0000 7fea9e3a7640 1 --2- 172.21.15.37:0/1096060851 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fea8406a430 0x7fea8406c8f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.589+0000 7fea9e3a7640 1 --2- 172.21.15.37:0/1096060851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea9813dc30 0x7fea981e1ad0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.589+0000 7fea9e3a7640 1 --2- 172.21.15.37:0/1096060851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea9813d7b0 0x7fea981e1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.589+0000 7fea9e3a7640 1 --2- 172.21.15.37:0/1096060851 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fea80003b30 0x7fea981483b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.589+0000 7fea9e3a7640 1 -- 172.21.15.37:0/1096060851 >> 172.21.15.37:0/1096060851 conn(0x7fea980bcf60 msgr2=0x7fea981425c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:02.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.589+0000 7fea9e3a7640 1 -- 172.21.15.37:0/1096060851 shutdown_connections 2023-12-19T17:50:02.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.589+0000 7fea9e3a7640 1 -- 172.21.15.37:0/1096060851 wait complete. 2023-12-19T17:50:02.600 INFO:tasks.ceph:Scrubbing osd.2 2023-12-19T17:50:02.600 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-19T17:50:02.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.711+0000 7f03c63fd640 1 Processor -- start 2023-12-19T17:50:02.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.711+0000 7f03c63fd640 1 -- start start 2023-12-19T17:50:02.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.712+0000 7f03c63fd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f03c0069e10 0x7f03c006fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.712+0000 7f03c63fd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f03c00b8d80 0x7f03c01554f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.712+0000 7f03c63fd640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c014e160 con 0x7f03c00b8920 2023-12-19T17:50:02.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.712+0000 7f03c63fd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c00704c0 con 0x7f03c00b8d80 2023-12-19T17:50:02.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.712+0000 7f03c63fd640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c00707a0 con 0x7f03c0069e10 2023-12-19T17:50:02.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.712+0000 7f03c499a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f03c00b8d80 0x7f03c01554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.712+0000 7f03c499a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f03c00b8d80 0x7f03c01554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45862/0 (socket says 172.21.15.37:45862) 2023-12-19T17:50:02.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.712+0000 7f03c499a640 1 -- 172.21.15.37:0/2803438019 learned_addr learned my addr 172.21.15.37:0/2803438019 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:02.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.712+0000 7f03bffff640 1 --2- 172.21.15.37:0/2803438019 >> v2:172.21.15.78:3300/0 conn(0x7f03c0069e10 0x7f03c006fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.712+0000 7f03c499a640 1 -- 172.21.15.37:0/2803438019 >> v2:172.21.15.78:3300/0 conn(0x7f03c0069e10 msgr2=0x7f03c006fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:02.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.712+0000 7f03c499a640 1 --2- 172.21.15.37:0/2803438019 >> v2:172.21.15.78:3300/0 conn(0x7f03c0069e10 0x7f03c006fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.712+0000 7f03c499a640 1 -- 172.21.15.37:0/2803438019 >> v1:172.21.15.78:6789/0 conn(0x7f03c00b8920 legacy=0x7f03c0144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:02.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.712+0000 7f03c499a640 1 -- 172.21.15.37:0/2803438019 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c00b8400 con 0x7f03c00b8d80 2023-12-19T17:50:02.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.712+0000 7f03bffff640 1 --2- 172.21.15.37:0/2803438019 >> v2:172.21.15.78:3300/0 conn(0x7f03c0069e10 0x7f03c006fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:50:02.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.713+0000 7f03c499a640 1 --2- 172.21.15.37:0/2803438019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03c00b8d80 0x7f03c01554f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f03c0071f70 tx=0x7f03b802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2545e7540b9583d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:02.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.713+0000 7f03beffd640 1 -- 172.21.15.37:0/2803438019 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b802ca80 con 0x7f03c00b8d80 2023-12-19T17:50:02.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.713+0000 7f03beffd640 1 -- 172.21.15.37:0/2803438019 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b802cbe0 con 0x7f03c00b8d80 2023-12-19T17:50:02.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.713+0000 7f03beffd640 1 -- 172.21.15.37:0/2803438019 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b80343f0 con 0x7f03c00b8d80 2023-12-19T17:50:02.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.714+0000 7f03c63fd640 1 -- 172.21.15.37:0/2803438019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03c00b8d80 msgr2=0x7f03c01554f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.714+0000 7f03c63fd640 1 --2- 172.21.15.37:0/2803438019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03c00b8d80 0x7f03c01554f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f03c0071f70 tx=0x7f03b802bee0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.714+0000 7f03c63fd640 1 -- 172.21.15.37:0/2803438019 shutdown_connections 2023-12-19T17:50:02.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.714+0000 7f03c63fd640 1 --2- 172.21.15.37:0/2803438019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03c00b8d80 0x7f03c01554f0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.714+0000 7f03c63fd640 1 --2- 172.21.15.37:0/2803438019 >> v2:172.21.15.78:3300/0 conn(0x7f03c0069e10 0x7f03c006fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.714+0000 7f03c63fd640 1 -- 172.21.15.37:0/2803438019 >> 172.21.15.37:0/2803438019 conn(0x7f03c006ae90 msgr2=0x7f03c006b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:02.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.714+0000 7f03c63fd640 1 -- 172.21.15.37:0/2803438019 shutdown_connections 2023-12-19T17:50:02.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.714+0000 7f03c63fd640 1 -- 172.21.15.37:0/2803438019 wait complete. 2023-12-19T17:50:02.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.715+0000 7f03c63fd640 1 Processor -- start 2023-12-19T17:50:02.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.715+0000 7f03c63fd640 1 -- start start 2023-12-19T17:50:02.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.716+0000 7f03c63fd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03c0069e10 0x7f03c01e0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.716+0000 7f03c63fd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03c00b8920 0x7f03c00b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.716+0000 7f03c63fd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c00b8d80 0x7f03c01e2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.716+0000 7f03c63fd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00b4d00 con 0x7f03c0069e10 2023-12-19T17:50:02.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.716+0000 7f03c63fd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c00b4f50 con 0x7f03c00b8d80 2023-12-19T17:50:02.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.716+0000 7f03c63fd640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c01dfc60 con 0x7f03c00b8920 2023-12-19T17:50:02.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.716+0000 7f03bffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03c0069e10 0x7f03c01e0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.716+0000 7f03bffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03c0069e10 0x7f03c01e0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45872/0 (socket says 172.21.15.37:45872) 2023-12-19T17:50:02.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.716+0000 7f03bffff640 1 -- 172.21.15.37:0/143170050 learned_addr learned my addr 172.21.15.37:0/143170050 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:02.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.716+0000 7f03c499a640 1 --2- 172.21.15.37:0/143170050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c00b8d80 0x7f03c01e2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.716+0000 7f03bf7fe640 1 --2- 172.21.15.37:0/143170050 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03c00b8920 0x7f03c00b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.716+0000 7f03bffff640 1 -- 172.21.15.37:0/143170050 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03c00b8920 msgr2=0x7f03c00b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.716+0000 7f03bffff640 1 --2- 172.21.15.37:0/143170050 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f03c00b8920 0x7f03c00b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.716+0000 7f03bffff640 1 -- 172.21.15.37:0/143170050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c00b8d80 msgr2=0x7f03c01e2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.716+0000 7f03bffff640 1 --2- 172.21.15.37:0/143170050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03c00b8d80 0x7f03c01e2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.716+0000 7f03bffff640 1 -- 172.21.15.37:0/143170050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b8009b30 con 0x7f03c0069e10 2023-12-19T17:50:02.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.716+0000 7f03bffff640 1 --2- 172.21.15.37:0/143170050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03c0069e10 0x7f03c01e0180 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f03b400c7f0 tx=0x7f03b400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:02.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.716+0000 7f03bcff9640 1 -- 172.21.15.37:0/143170050 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b4005b90 con 0x7f03c0069e10 2023-12-19T17:50:02.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.716+0000 7f03bcff9640 1 -- 172.21.15.37:0/143170050 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b4005cf0 con 0x7f03c0069e10 2023-12-19T17:50:02.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.717+0000 7f03c63fd640 1 -- 172.21.15.37:0/143170050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c00b57a0 con 0x7f03c0069e10 2023-12-19T17:50:02.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.717+0000 7f03bcff9640 1 -- 172.21.15.37:0/143170050 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b4007a30 con 0x7f03c0069e10 2023-12-19T17:50:02.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.717+0000 7f03c63fd640 1 -- 172.21.15.37:0/143170050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c01464d0 con 0x7f03c0069e10 2023-12-19T17:50:02.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.717+0000 7f03c63fd640 1 -- 172.21.15.37:0/143170050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f03c006a1f0 con 0x7f03c0069e10 2023-12-19T17:50:02.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.718+0000 7f03bcff9640 1 -- 172.21.15.37:0/143170050 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f03b4007b90 con 0x7f03c0069e10 2023-12-19T17:50:02.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.718+0000 7f03bcff9640 1 --2- 172.21.15.37:0/143170050 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f03ac06a430 0x7f03ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.718+0000 7f03bcff9640 1 -- 172.21.15.37:0/143170050 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f03b40885a0 con 0x7f03c0069e10 2023-12-19T17:50:02.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.718+0000 7f03bcff9640 1 --2- 172.21.15.37:0/143170050 >> [v2:172.21.15.37:6824/89456,v1:172.21.15.37:6825/89456] conn(0x7f03ac070290 0x7f03ac0726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.718+0000 7f03bcff9640 1 -- 172.21.15.37:0/143170050 --> [v2:172.21.15.37:6824/89456,v1:172.21.15.37:6825/89456] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f03ac072d60 con 0x7f03ac070290 2023-12-19T17:50:02.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.719+0000 7f03bcff9640 1 -- 172.21.15.37:0/143170050 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03b408ac60 con 0x7f03c0069e10 2023-12-19T17:50:02.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.719+0000 7f03c499a640 1 --2- 172.21.15.37:0/143170050 >> [v2:172.21.15.37:6824/89456,v1:172.21.15.37:6825/89456] conn(0x7f03ac070290 0x7f03ac0726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.719+0000 7f03bf7fe640 1 --2- 172.21.15.37:0/143170050 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f03ac06a430 0x7f03ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.719+0000 7f03c499a640 1 --2- 172.21.15.37:0/143170050 >> [v2:172.21.15.37:6824/89456,v1:172.21.15.37:6825/89456] conn(0x7f03ac070290 0x7f03ac0726b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:02.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.719+0000 7f03bf7fe640 1 --2- 172.21.15.37:0/143170050 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f03ac06a430 0x7f03ac06c8f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f03c00b7c20 tx=0x7f03b0007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:02.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.720+0000 7f03bcff9640 1 -- 172.21.15.37:0/143170050 <== osd.2 v2:172.21.15.37:6824/89456 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f03ac072d60 con 0x7f03ac070290 2023-12-19T17:50:02.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.732+0000 7f03c63fd640 1 -- 172.21.15.37:0/143170050 --> [v2:172.21.15.37:6824/89456,v1:172.21.15.37:6825/89456] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f03c0071ae0 con 0x7f03ac070290 2023-12-19T17:50:02.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.732+0000 7f03bcff9640 1 -- 172.21.15.37:0/143170050 <== osd.2 v2:172.21.15.37:6824/89456 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f03b803f410 con 0x7f03ac070290 2023-12-19T17:50:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-12-19T17:50:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T17:50:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-12-19T17:50:02.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.733+0000 7f03c63fd640 1 -- 172.21.15.37:0/143170050 >> [v2:172.21.15.37:6824/89456,v1:172.21.15.37:6825/89456] conn(0x7f03ac070290 msgr2=0x7f03ac0726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.733+0000 7f03c63fd640 1 --2- 172.21.15.37:0/143170050 >> [v2:172.21.15.37:6824/89456,v1:172.21.15.37:6825/89456] conn(0x7f03ac070290 0x7f03ac0726b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.733+0000 7f03c63fd640 1 -- 172.21.15.37:0/143170050 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f03ac06a430 msgr2=0x7f03ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.733+0000 7f03c63fd640 1 --2- 172.21.15.37:0/143170050 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f03ac06a430 0x7f03ac06c8f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f03c00b7c20 tx=0x7f03b0007e30 comp rx=0 tx=0).stop 2023-12-19T17:50:02.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.733+0000 7f03c63fd640 1 -- 172.21.15.37:0/143170050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03c0069e10 msgr2=0x7f03c01e0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.733+0000 7f03c63fd640 1 --2- 172.21.15.37:0/143170050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03c0069e10 0x7f03c01e0180 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f03b400c7f0 tx=0x7f03b400cbf0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.733+0000 7f03c499a640 1 -- 172.21.15.37:0/143170050 reap_dead start 2023-12-19T17:50:02.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.733+0000 7f03c63fd640 1 -- 172.21.15.37:0/143170050 shutdown_connections 2023-12-19T17:50:02.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.733+0000 7f03c63fd640 1 -- 172.21.15.37:0/143170050 >> 172.21.15.37:0/143170050 conn(0x7f03c006ae90 msgr2=0x7f03c0140600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:02.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.733+0000 7f03c63fd640 1 -- 172.21.15.37:0/143170050 shutdown_connections 2023-12-19T17:50:02.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.733+0000 7f03c63fd640 1 -- 172.21.15.37:0/143170050 wait complete. 2023-12-19T17:50:02.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-19T17:50:02.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.851+0000 7f3e9c177640 1 Processor -- start 2023-12-19T17:50:02.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.851+0000 7f3e9c177640 1 -- start start 2023-12-19T17:50:02.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.852+0000 7f3e9c177640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e940b68d0 0x7f3e94071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.852+0000 7f3e9c177640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e94070660 con 0x7f3e9406aca0 2023-12-19T17:50:02.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.852+0000 7f3e9c177640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e9406fc10 con 0x7f3e94142cc0 2023-12-19T17:50:02.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.852+0000 7f3e9c177640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9406a8f0 con 0x7f3e940b68d0 2023-12-19T17:50:02.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.852+0000 7f3e99712640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3e9406aca0 0x7f3e941425b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50490/0 (socket says 172.21.15.37:50490) 2023-12-19T17:50:02.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.852+0000 7f3e99712640 1 -- 172.21.15.37:0/1881711732 learned_addr learned my addr 172.21.15.37:0/1881711732 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:50:02.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.852+0000 7f3e99f13640 1 --2- 172.21.15.37:0/1881711732 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e940b68d0 0x7f3e94071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.852+0000 7f3e98f11640 1 -- 172.21.15.37:0/1881711732 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81557621 0 0) 0x7f3e90001110 con 0x7f3e9406aca0 2023-12-19T17:50:02.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.852+0000 7f3e98f11640 1 -- 172.21.15.37:0/1881711732 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e80003520 con 0x7f3e9406aca0 2023-12-19T17:50:02.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.852+0000 7f3e98f11640 1 -- 172.21.15.37:0/1881711732 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507419393 0 0) 0x7f3e9406fc10 con 0x7f3e94142cc0 2023-12-19T17:50:02.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.852+0000 7f3e98f11640 1 -- 172.21.15.37:0/1881711732 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e90001110 con 0x7f3e94142cc0 2023-12-19T17:50:02.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.852+0000 7f3e99f13640 1 -- 172.21.15.37:0/1881711732 >> v1:172.21.15.78:6789/0 conn(0x7f3e94142cc0 legacy=0x7f3e94153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.852+0000 7f3e99f13640 1 -- 172.21.15.37:0/1881711732 >> v1:172.21.15.37:6789/0 conn(0x7f3e9406aca0 legacy=0x7f3e941425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.852+0000 7f3e98f11640 1 -- 172.21.15.37:0/1881711732 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1654380658 0 0) 0x7f3e80003520 con 0x7f3e9406aca0 2023-12-19T17:50:02.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.852+0000 7f3e99f13640 1 -- 172.21.15.37:0/1881711732 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e94071640 con 0x7f3e940b68d0 2023-12-19T17:50:02.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.853+0000 7f3e99f13640 1 --2- 172.21.15.37:0/1881711732 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e940b68d0 0x7f3e94071100 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3e840097d0 tx=0x7f3e8402b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14aad10f625bb3d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:02.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.853+0000 7f3e98f11640 1 -- 172.21.15.37:0/1881711732 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e90001800 con 0x7f3e940b68d0 2023-12-19T17:50:02.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.853+0000 7f3e98f11640 1 -- 172.21.15.37:0/1881711732 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8402e050 con 0x7f3e940b68d0 2023-12-19T17:50:02.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.853+0000 7f3e98f11640 1 -- 172.21.15.37:0/1881711732 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84030730 con 0x7f3e940b68d0 2023-12-19T17:50:02.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.854+0000 7f3e9c177640 1 -- 172.21.15.37:0/1881711732 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e940b68d0 msgr2=0x7f3e94071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.854+0000 7f3e9c177640 1 --2- 172.21.15.37:0/1881711732 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e940b68d0 0x7f3e94071100 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3e840097d0 tx=0x7f3e8402b800 comp rx=0 tx=0).stop 2023-12-19T17:50:02.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.854+0000 7f3e9c177640 1 -- 172.21.15.37:0/1881711732 shutdown_connections 2023-12-19T17:50:02.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.854+0000 7f3e9c177640 1 --2- 172.21.15.37:0/1881711732 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e940b68d0 0x7f3e94071100 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.854+0000 7f3e9c177640 1 -- 172.21.15.37:0/1881711732 >> 172.21.15.37:0/1881711732 conn(0x7f3e940b9c30 msgr2=0x7f3e940ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:02.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.854+0000 7f3e9c177640 1 -- 172.21.15.37:0/1881711732 shutdown_connections 2023-12-19T17:50:02.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.854+0000 7f3e9c177640 1 -- 172.21.15.37:0/1881711732 wait complete. 2023-12-19T17:50:02.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.855+0000 7f3e9c177640 1 Processor -- start 2023-12-19T17:50:02.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.855+0000 7f3e9c177640 1 -- start start 2023-12-19T17:50:02.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.856+0000 7f3e9c177640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e9406aca0 0x7f3e941487d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.856+0000 7f3e9c177640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e940b68d0 0x7f3e94146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.856+0000 7f3e9c177640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e94142cc0 0x7f3e94147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.856+0000 7f3e9c177640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e94148d10 con 0x7f3e9406aca0 2023-12-19T17:50:02.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.856+0000 7f3e9c177640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e940b5bd0 con 0x7f3e94142cc0 2023-12-19T17:50:02.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.856+0000 7f3e9c177640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e941496a0 con 0x7f3e940b68d0 2023-12-19T17:50:02.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.856+0000 7f3e99f13640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e9406aca0 0x7f3e941487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.856+0000 7f3e99f13640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e9406aca0 0x7f3e941487d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45880/0 (socket says 172.21.15.37:45880) 2023-12-19T17:50:02.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.856+0000 7f3e99f13640 1 -- 172.21.15.37:0/481842661 learned_addr learned my addr 172.21.15.37:0/481842661 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:02.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.856+0000 7f3e99712640 1 --2- 172.21.15.37:0/481842661 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e940b68d0 0x7f3e94146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.856+0000 7f3e9a714640 1 --2- 172.21.15.37:0/481842661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e94142cc0 0x7f3e94147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.856+0000 7f3e99f13640 1 -- 172.21.15.37:0/481842661 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e940b68d0 msgr2=0x7f3e94146b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.856+0000 7f3e99f13640 1 --2- 172.21.15.37:0/481842661 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e940b68d0 0x7f3e94146b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.856+0000 7f3e99f13640 1 -- 172.21.15.37:0/481842661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e94142cc0 msgr2=0x7f3e94147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:02.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.856+0000 7f3e99f13640 1 --2- 172.21.15.37:0/481842661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e94142cc0 0x7f3e94147050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:02.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.856+0000 7f3e99f13640 1 -- 172.21.15.37:0/481842661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e84009400 con 0x7f3e9406aca0 2023-12-19T17:50:02.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.856+0000 7f3e99f13640 1 --2- 172.21.15.37:0/481842661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e9406aca0 0x7f3e941487d0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3e84000c00 tx=0x7f3e840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:02.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.856+0000 7f3e8a7fc640 1 -- 172.21.15.37:0/481842661 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84004230 con 0x7f3e9406aca0 2023-12-19T17:50:02.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.857+0000 7f3e8a7fc640 1 -- 172.21.15.37:0/481842661 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e840043b0 con 0x7f3e9406aca0 2023-12-19T17:50:02.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.857+0000 7f3e9c177640 1 -- 172.21.15.37:0/481842661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e940abdf0 con 0x7f3e9406aca0 2023-12-19T17:50:02.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.857+0000 7f3e8a7fc640 1 -- 172.21.15.37:0/481842661 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84004520 con 0x7f3e9406aca0 2023-12-19T17:50:02.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.857+0000 7f3e9c177640 1 -- 172.21.15.37:0/481842661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e941dff20 con 0x7f3e9406aca0 2023-12-19T17:50:02.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.858+0000 7f3e9c177640 1 -- 172.21.15.37:0/481842661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9406fe40 con 0x7f3e9406aca0 2023-12-19T17:50:02.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.858+0000 7f3e8a7fc640 1 -- 172.21.15.37:0/481842661 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3e84039040 con 0x7f3e9406aca0 2023-12-19T17:50:02.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.858+0000 7f3e8a7fc640 1 --2- 172.21.15.37:0/481842661 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3e7806a430 0x7f3e7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:02.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.858+0000 7f3e8a7fc640 1 -- 172.21.15.37:0/481842661 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3e840a9f60 con 0x7f3e9406aca0 2023-12-19T17:50:02.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.859+0000 7f3e99712640 1 --2- 172.21.15.37:0/481842661 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3e7806a430 0x7f3e7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:02.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.859+0000 7f3e99712640 1 --2- 172.21.15.37:0/481842661 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3e7806a430 0x7f3e7806c8f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3e94147c30 tx=0x7f3e90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:02.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:02.863+0000 7f3e8a7fc640 1 -- 172.21.15.37:0/481842661 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3e9406fe40 con 0x7f3e9406aca0 2023-12-19T17:50:03.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.039+0000 7f3e9c177640 1 -- 172.21.15.37:0/481842661 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e940718e0 con 0x7f3e7806a430 2023-12-19T17:50:03.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.040+0000 7f3e8a7fc640 1 -- 172.21.15.37:0/481842661 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3e90005980 con 0x7f3e7806a430 2023-12-19T17:50:03.040 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 2 to deep-scrub 2023-12-19T17:50:03.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.042+0000 7f3e9c177640 1 -- 172.21.15.37:0/481842661 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3e7806a430 msgr2=0x7f3e7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.042+0000 7f3e9c177640 1 --2- 172.21.15.37:0/481842661 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3e7806a430 0x7f3e7806c8f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3e94147c30 tx=0x7f3e90009040 comp rx=0 tx=0).stop 2023-12-19T17:50:03.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.042+0000 7f3e9c177640 1 -- 172.21.15.37:0/481842661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e9406aca0 msgr2=0x7f3e941487d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.042+0000 7f3e9c177640 1 --2- 172.21.15.37:0/481842661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e9406aca0 0x7f3e941487d0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3e84000c00 tx=0x7f3e840046c0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.042+0000 7f3e9c177640 1 -- 172.21.15.37:0/481842661 shutdown_connections 2023-12-19T17:50:03.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.042+0000 7f3e9c177640 1 --2- 172.21.15.37:0/481842661 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f3e7806a430 0x7f3e7806c8f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.042+0000 7f3e9c177640 1 --2- 172.21.15.37:0/481842661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e94142cc0 0x7f3e94147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.042+0000 7f3e9c177640 1 --2- 172.21.15.37:0/481842661 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3e940b68d0 0x7f3e94146b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.042+0000 7f3e9c177640 1 --2- 172.21.15.37:0/481842661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e9406aca0 0x7f3e941487d0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.042+0000 7f3e9c177640 1 -- 172.21.15.37:0/481842661 >> 172.21.15.37:0/481842661 conn(0x7f3e940b9c30 msgr2=0x7f3e941406e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:03.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.042+0000 7f3e9c177640 1 -- 172.21.15.37:0/481842661 shutdown_connections 2023-12-19T17:50:03.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.042+0000 7f3e9c177640 1 -- 172.21.15.37:0/481842661 wait complete. 2023-12-19T17:50:03.053 INFO:tasks.ceph:Scrubbing osd.3 2023-12-19T17:50:03.053 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-19T17:50:03.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.163+0000 7f9850547640 1 Processor -- start 2023-12-19T17:50:03.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.163+0000 7f9850547640 1 -- start start 2023-12-19T17:50:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.164+0000 7f9850547640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f984806fe10 0x7f9848144a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.164+0000 7f9850547640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9848070270 con 0x7f9848144f80 2023-12-19T17:50:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.164+0000 7f9850547640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f984814e160 con 0x7f9848069e10 2023-12-19T17:50:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.164+0000 7f9850547640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98480704c0 con 0x7f984806fe10 2023-12-19T17:50:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.164+0000 7f984eae4640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9848144f80 0x7f98481554f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50494/0 (socket says 172.21.15.37:50494) 2023-12-19T17:50:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.164+0000 7f984eae4640 1 -- 172.21.15.37:0/2838467065 learned_addr learned my addr 172.21.15.37:0/2838467065 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:50:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.164+0000 7f984dae2640 1 --2- 172.21.15.37:0/2838467065 >> v2:172.21.15.78:3300/0 conn(0x7f984806fe10 0x7f9848144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.164+0000 7f984d2e1640 1 -- 172.21.15.37:0/2838467065 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949761960 0 0) 0x7f9848070270 con 0x7f9848144f80 2023-12-19T17:50:03.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.164+0000 7f984d2e1640 1 -- 172.21.15.37:0/2838467065 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9834003520 con 0x7f9848144f80 2023-12-19T17:50:03.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.164+0000 7f984dae2640 1 -- 172.21.15.37:0/2838467065 >> v1:172.21.15.78:6789/0 conn(0x7f9848069e10 legacy=0x7f98480b8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.164+0000 7f984d2e1640 1 -- 172.21.15.37:0/2838467065 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2125319748 0 0) 0x7f984814e160 con 0x7f9848069e10 2023-12-19T17:50:03.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.164+0000 7f984dae2640 1 -- 172.21.15.37:0/2838467065 >> v1:172.21.15.37:6789/0 conn(0x7f9848144f80 legacy=0x7f98481554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.165+0000 7f984dae2640 1 -- 172.21.15.37:0/2838467065 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98480707a0 con 0x7f984806fe10 2023-12-19T17:50:03.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.166+0000 7f984dae2640 1 --2- 172.21.15.37:0/2838467065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984806fe10 0x7f9848144a40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f98380097a0 tx=0x7f983802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=185bcb4d8391c78a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:03.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.166+0000 7f984d2e1640 1 -- 172.21.15.37:0/2838467065 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838030840 con 0x7f984806fe10 2023-12-19T17:50:03.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.166+0000 7f984d2e1640 1 -- 172.21.15.37:0/2838467065 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98380309a0 con 0x7f984806fe10 2023-12-19T17:50:03.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.166+0000 7f984d2e1640 1 -- 172.21.15.37:0/2838467065 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838030d10 con 0x7f984806fe10 2023-12-19T17:50:03.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.166+0000 7f9850547640 1 -- 172.21.15.37:0/2838467065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984806fe10 msgr2=0x7f9848144a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.166+0000 7f9850547640 1 --2- 172.21.15.37:0/2838467065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984806fe10 0x7f9848144a40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f98380097a0 tx=0x7f983802b980 comp rx=0 tx=0).stop 2023-12-19T17:50:03.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.167+0000 7f9850547640 1 -- 172.21.15.37:0/2838467065 shutdown_connections 2023-12-19T17:50:03.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.167+0000 7f9850547640 1 --2- 172.21.15.37:0/2838467065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984806fe10 0x7f9848144a40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.167+0000 7f9850547640 1 -- 172.21.15.37:0/2838467065 >> 172.21.15.37:0/2838467065 conn(0x7f984806ae90 msgr2=0x7f984806b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:03.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.167+0000 7f9850547640 1 -- 172.21.15.37:0/2838467065 shutdown_connections 2023-12-19T17:50:03.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.167+0000 7f9850547640 1 -- 172.21.15.37:0/2838467065 wait complete. 2023-12-19T17:50:03.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.168+0000 7f9850547640 1 Processor -- start 2023-12-19T17:50:03.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.168+0000 7f9850547640 1 -- start start 2023-12-19T17:50:03.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.168+0000 7f9850547640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9848069e10 0x7f98480bd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.168+0000 7f9850547640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984806fe10 0x7f98481e2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.168+0000 7f9850547640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9848144f80 0x7f98481e3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.168+0000 7f9850547640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98480bd8b0 con 0x7f9848069e10 2023-12-19T17:50:03.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.168+0000 7f9850547640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98481df890 con 0x7f984806fe10 2023-12-19T17:50:03.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.168+0000 7f9850547640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984814b940 con 0x7f9848144f80 2023-12-19T17:50:03.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.168+0000 7f984e2e3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9848069e10 0x7f98480bd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.168+0000 7f984e2e3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9848069e10 0x7f98480bd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45884/0 (socket says 172.21.15.37:45884) 2023-12-19T17:50:03.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.168+0000 7f984e2e3640 1 -- 172.21.15.37:0/2377643337 learned_addr learned my addr 172.21.15.37:0/2377643337 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:03.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.168+0000 7f984dae2640 1 --2- 172.21.15.37:0/2377643337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984806fe10 0x7f98481e2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.168+0000 7f984eae4640 1 --2- 172.21.15.37:0/2377643337 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9848144f80 0x7f98481e3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.169+0000 7f984e2e3640 1 -- 172.21.15.37:0/2377643337 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9848144f80 msgr2=0x7f98481e3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.169+0000 7f984e2e3640 1 --2- 172.21.15.37:0/2377643337 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9848144f80 0x7f98481e3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.169+0000 7f984e2e3640 1 -- 172.21.15.37:0/2377643337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984806fe10 msgr2=0x7f98481e2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.169+0000 7f984e2e3640 1 --2- 172.21.15.37:0/2377643337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984806fe10 0x7f98481e2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.169+0000 7f984e2e3640 1 -- 172.21.15.37:0/2377643337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9838009400 con 0x7f9848069e10 2023-12-19T17:50:03.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.169+0000 7f984e2e3640 1 --2- 172.21.15.37:0/2377643337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9848069e10 0x7f98480bd370 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f984400c480 tx=0x7f984400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:03.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.169+0000 7f983effd640 1 -- 172.21.15.37:0/2377643337 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9844005480 con 0x7f9848069e10 2023-12-19T17:50:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.169+0000 7f983effd640 1 -- 172.21.15.37:0/2377643337 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9844003640 con 0x7f9848069e10 2023-12-19T17:50:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.169+0000 7f9850547640 1 -- 172.21.15.37:0/2377643337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98481dfb30 con 0x7f9848069e10 2023-12-19T17:50:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.169+0000 7f983effd640 1 -- 172.21.15.37:0/2377643337 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98440039f0 con 0x7f9848069e10 2023-12-19T17:50:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.169+0000 7f9850547640 1 -- 172.21.15.37:0/2377643337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98481e00f0 con 0x7f9848069e10 2023-12-19T17:50:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.170+0000 7f9850547640 1 -- 172.21.15.37:0/2377643337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9848071ae0 con 0x7f9848069e10 2023-12-19T17:50:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.171+0000 7f983effd640 1 -- 172.21.15.37:0/2377643337 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9844003b50 con 0x7f9848069e10 2023-12-19T17:50:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.171+0000 7f983effd640 1 --2- 172.21.15.37:0/2377643337 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f982c06a460 0x7f982c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.171+0000 7f983effd640 1 -- 172.21.15.37:0/2377643337 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9844087b20 con 0x7f9848069e10 2023-12-19T17:50:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.171+0000 7f983effd640 1 --2- 172.21.15.37:0/2377643337 >> [v2:172.21.15.37:6816/89455,v1:172.21.15.37:6817/89455] conn(0x7f982c0702c0 0x7f982c0726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.171+0000 7f983effd640 1 -- 172.21.15.37:0/2377643337 --> [v2:172.21.15.37:6816/89455,v1:172.21.15.37:6817/89455] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f982c072d90 con 0x7f982c0702c0 2023-12-19T17:50:03.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.171+0000 7f983effd640 1 -- 172.21.15.37:0/2377643337 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f984408c2c0 con 0x7f9848069e10 2023-12-19T17:50:03.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.171+0000 7f984dae2640 1 --2- 172.21.15.37:0/2377643337 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f982c06a460 0x7f982c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.171+0000 7f984eae4640 1 --2- 172.21.15.37:0/2377643337 >> [v2:172.21.15.37:6816/89455,v1:172.21.15.37:6817/89455] conn(0x7f982c0702c0 0x7f982c0726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.172+0000 7f984eae4640 1 --2- 172.21.15.37:0/2377643337 >> [v2:172.21.15.37:6816/89455,v1:172.21.15.37:6817/89455] conn(0x7f982c0702c0 0x7f982c0726e0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:03.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.172+0000 7f984dae2640 1 --2- 172.21.15.37:0/2377643337 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f982c06a460 0x7f982c06c920 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9838036000 tx=0x7f9838008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:03.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.172+0000 7f983effd640 1 -- 172.21.15.37:0/2377643337 <== osd.3 v2:172.21.15.37:6816/89455 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f982c072d90 con 0x7f982c0702c0 2023-12-19T17:50:03.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.185+0000 7f9850547640 1 -- 172.21.15.37:0/2377643337 --> [v2:172.21.15.37:6816/89455,v1:172.21.15.37:6817/89455] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9848066da0 con 0x7f982c0702c0 2023-12-19T17:50:03.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.185+0000 7f983effd640 1 -- 172.21.15.37:0/2377643337 <== osd.3 v2:172.21.15.37:6816/89455 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9848066da0 con 0x7f982c0702c0 2023-12-19T17:50:03.186 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-12-19T17:50:03.186 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T17:50:03.186 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-12-19T17:50:03.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.185+0000 7f9850547640 1 -- 172.21.15.37:0/2377643337 >> [v2:172.21.15.37:6816/89455,v1:172.21.15.37:6817/89455] conn(0x7f982c0702c0 msgr2=0x7f982c0726e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.185+0000 7f9850547640 1 --2- 172.21.15.37:0/2377643337 >> [v2:172.21.15.37:6816/89455,v1:172.21.15.37:6817/89455] conn(0x7f982c0702c0 0x7f982c0726e0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.185+0000 7f9850547640 1 -- 172.21.15.37:0/2377643337 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f982c06a460 msgr2=0x7f982c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.185+0000 7f9850547640 1 --2- 172.21.15.37:0/2377643337 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f982c06a460 0x7f982c06c920 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9838036000 tx=0x7f9838008030 comp rx=0 tx=0).stop 2023-12-19T17:50:03.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.185+0000 7f9850547640 1 -- 172.21.15.37:0/2377643337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9848069e10 msgr2=0x7f98480bd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.185+0000 7f9850547640 1 --2- 172.21.15.37:0/2377643337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9848069e10 0x7f98480bd370 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f984400c480 tx=0x7f984400c940 comp rx=0 tx=0).stop 2023-12-19T17:50:03.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.185+0000 7f984eae4640 1 -- 172.21.15.37:0/2377643337 reap_dead start 2023-12-19T17:50:03.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.185+0000 7f9850547640 1 -- 172.21.15.37:0/2377643337 shutdown_connections 2023-12-19T17:50:03.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.185+0000 7f9850547640 1 -- 172.21.15.37:0/2377643337 >> 172.21.15.37:0/2377643337 conn(0x7f984806ae90 msgr2=0x7f98481428b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:03.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.186+0000 7f9850547640 1 -- 172.21.15.37:0/2377643337 shutdown_connections 2023-12-19T17:50:03.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.186+0000 7f9850547640 1 -- 172.21.15.37:0/2377643337 wait complete. 2023-12-19T17:50:03.196 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-19T17:50:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.303+0000 7fda87205640 1 Processor -- start 2023-12-19T17:50:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.303+0000 7fda87205640 1 -- start start 2023-12-19T17:50:03.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.304+0000 7fda87205640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda80070ff0 0x7fda8014aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.304+0000 7fda87205640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fda800ba700 0x7fda80155390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.304+0000 7fda87205640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda8014af90 con 0x7fda800ba0e0 2023-12-19T17:50:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.304+0000 7fda87205640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda800b8630 con 0x7fda800ba700 2023-12-19T17:50:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.304+0000 7fda87205640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8006b090 con 0x7fda80070ff0 2023-12-19T17:50:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.304+0000 7fda857a2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fda800ba700 0x7fda80155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.304+0000 7fda7ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fda800ba0e0 0x7fda800b7820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50510/0 (socket says 172.21.15.37:50510) 2023-12-19T17:50:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.304+0000 7fda7ffff640 1 -- 172.21.15.37:0/2519155405 learned_addr learned my addr 172.21.15.37:0/2519155405 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:50:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.304+0000 7fda84fa1640 1 --2- 172.21.15.37:0/2519155405 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda80070ff0 0x7fda8014aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.304+0000 7fda857a2640 1 -- 172.21.15.37:0/2519155405 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda80070ff0 msgr2=0x7fda8014aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.304+0000 7fda857a2640 1 --2- 172.21.15.37:0/2519155405 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda80070ff0 0x7fda8014aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.305+0000 7fda857a2640 1 -- 172.21.15.37:0/2519155405 >> v1:172.21.15.37:6789/0 conn(0x7fda800ba0e0 legacy=0x7fda800b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.305+0000 7fda857a2640 1 -- 172.21.15.37:0/2519155405 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda80071d10 con 0x7fda800ba700 2023-12-19T17:50:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.305+0000 7fda7f7fe640 1 -- 172.21.15.37:0/2519155405 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474961574 0 0) 0x7fda8014af90 con 0x7fda800ba0e0 2023-12-19T17:50:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.305+0000 7fda84fa1640 1 --2- 172.21.15.37:0/2519155405 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda80070ff0 0x7fda8014aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:50:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.305+0000 7fda857a2640 1 --2- 172.21.15.37:0/2519155405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda800ba700 0x7fda80155390 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fda78009dc0 tx=0x7fda7802be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f8facfc0526266 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.305+0000 7fda7f7fe640 1 -- 172.21.15.37:0/2519155405 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7802cc40 con 0x7fda800ba700 2023-12-19T17:50:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.305+0000 7fda7f7fe640 1 -- 172.21.15.37:0/2519155405 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7802cda0 con 0x7fda800ba700 2023-12-19T17:50:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.305+0000 7fda7f7fe640 1 -- 172.21.15.37:0/2519155405 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78034660 con 0x7fda800ba700 2023-12-19T17:50:03.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.306+0000 7fda87205640 1 -- 172.21.15.37:0/2519155405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda800ba700 msgr2=0x7fda80155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.306+0000 7fda87205640 1 --2- 172.21.15.37:0/2519155405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda800ba700 0x7fda80155390 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fda78009dc0 tx=0x7fda7802be90 comp rx=0 tx=0).stop 2023-12-19T17:50:03.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.306+0000 7fda87205640 1 -- 172.21.15.37:0/2519155405 shutdown_connections 2023-12-19T17:50:03.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.306+0000 7fda87205640 1 --2- 172.21.15.37:0/2519155405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda800ba700 0x7fda80155390 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.306+0000 7fda87205640 1 --2- 172.21.15.37:0/2519155405 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda80070ff0 0x7fda8014aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.306+0000 7fda87205640 1 -- 172.21.15.37:0/2519155405 >> 172.21.15.37:0/2519155405 conn(0x7fda800be120 msgr2=0x7fda800be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:03.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.306+0000 7fda87205640 1 -- 172.21.15.37:0/2519155405 shutdown_connections 2023-12-19T17:50:03.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.306+0000 7fda87205640 1 -- 172.21.15.37:0/2519155405 wait complete. 2023-12-19T17:50:03.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.307+0000 7fda87205640 1 Processor -- start 2023-12-19T17:50:03.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.307+0000 7fda87205640 1 -- start start 2023-12-19T17:50:03.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.308+0000 7fda87205640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda80070ff0 0x7fda8014c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.308+0000 7fda87205640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda800ba0e0 0x7fda800b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.308+0000 7fda87205640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda800ba700 0x7fda8014bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.308+0000 7fda87205640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda80147190 con 0x7fda800ba0e0 2023-12-19T17:50:03.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.308+0000 7fda87205640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda80148000 con 0x7fda80070ff0 2023-12-19T17:50:03.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.308+0000 7fda87205640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda801e0210 con 0x7fda800ba700 2023-12-19T17:50:03.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.308+0000 7fda7ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda800ba0e0 0x7fda800b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.308+0000 7fda7ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda800ba0e0 0x7fda800b3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45898/0 (socket says 172.21.15.37:45898) 2023-12-19T17:50:03.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.308+0000 7fda7ffff640 1 -- 172.21.15.37:0/3640806387 learned_addr learned my addr 172.21.15.37:0/3640806387 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:03.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.308+0000 7fda84fa1640 1 --2- 172.21.15.37:0/3640806387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda80070ff0 0x7fda8014c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.308+0000 7fda857a2640 1 --2- 172.21.15.37:0/3640806387 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda800ba700 0x7fda8014bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.308+0000 7fda7ffff640 1 -- 172.21.15.37:0/3640806387 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda800ba700 msgr2=0x7fda8014bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.308+0000 7fda7ffff640 1 --2- 172.21.15.37:0/3640806387 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda800ba700 0x7fda8014bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.308+0000 7fda7ffff640 1 -- 172.21.15.37:0/3640806387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda80070ff0 msgr2=0x7fda8014c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.308+0000 7fda7ffff640 1 --2- 172.21.15.37:0/3640806387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda80070ff0 0x7fda8014c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.308+0000 7fda7ffff640 1 -- 172.21.15.37:0/3640806387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda78009a70 con 0x7fda800ba0e0 2023-12-19T17:50:03.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.308+0000 7fda7ffff640 1 --2- 172.21.15.37:0/3640806387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda800ba0e0 0x7fda800b3b70 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00c4b0 tx=0x7fda6c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:03.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.309+0000 7fda7d7fa640 1 -- 172.21.15.37:0/3640806387 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c0074e0 con 0x7fda800ba0e0 2023-12-19T17:50:03.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.309+0000 7fda7d7fa640 1 -- 172.21.15.37:0/3640806387 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6c007660 con 0x7fda800ba0e0 2023-12-19T17:50:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.309+0000 7fda7d7fa640 1 -- 172.21.15.37:0/3640806387 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c004a20 con 0x7fda800ba0e0 2023-12-19T17:50:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.309+0000 7fda87205640 1 -- 172.21.15.37:0/3640806387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda801e04f0 con 0x7fda800ba0e0 2023-12-19T17:50:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.309+0000 7fda87205640 1 -- 172.21.15.37:0/3640806387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8014eac0 con 0x7fda800ba0e0 2023-12-19T17:50:03.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.310+0000 7fda87205640 1 -- 172.21.15.37:0/3640806387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda80147e60 con 0x7fda800ba0e0 2023-12-19T17:50:03.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.310+0000 7fda7d7fa640 1 -- 172.21.15.37:0/3640806387 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fda6c004b80 con 0x7fda800ba0e0 2023-12-19T17:50:03.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.310+0000 7fda7d7fa640 1 --2- 172.21.15.37:0/3640806387 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fda6406a430 0x7fda6406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.311+0000 7fda7d7fa640 1 -- 172.21.15.37:0/3640806387 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fda6c0878d0 con 0x7fda800ba0e0 2023-12-19T17:50:03.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.311+0000 7fda84fa1640 1 --2- 172.21.15.37:0/3640806387 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fda6406a430 0x7fda6406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.311+0000 7fda84fa1640 1 --2- 172.21.15.37:0/3640806387 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fda6406a430 0x7fda6406c8f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fda74008850 tx=0x7fda74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:03.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.315+0000 7fda7d7fa640 1 -- 172.21.15.37:0/3640806387 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fda80147e60 con 0x7fda800ba0e0 2023-12-19T17:50:03.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.516+0000 7fda87205640 1 -- 172.21.15.37:0/3640806387 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fda801e0380 con 0x7fda6406a430 2023-12-19T17:50:03.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.517+0000 7fda7d7fa640 1 -- 172.21.15.37:0/3640806387 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fda801e0380 con 0x7fda6406a430 2023-12-19T17:50:03.517 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 3 to deep-scrub 2023-12-19T17:50:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.519+0000 7fda87205640 1 -- 172.21.15.37:0/3640806387 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fda6406a430 msgr2=0x7fda6406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.519+0000 7fda87205640 1 --2- 172.21.15.37:0/3640806387 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fda6406a430 0x7fda6406c8f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fda74008850 tx=0x7fda74008040 comp rx=0 tx=0).stop 2023-12-19T17:50:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.519+0000 7fda87205640 1 -- 172.21.15.37:0/3640806387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda800ba0e0 msgr2=0x7fda800b3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.519+0000 7fda87205640 1 --2- 172.21.15.37:0/3640806387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda800ba0e0 0x7fda800b3b70 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00c4b0 tx=0x7fda6c00c970 comp rx=0 tx=0).stop 2023-12-19T17:50:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.519+0000 7fda87205640 1 -- 172.21.15.37:0/3640806387 shutdown_connections 2023-12-19T17:50:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.519+0000 7fda87205640 1 --2- 172.21.15.37:0/3640806387 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fda6406a430 0x7fda6406c8f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.519+0000 7fda87205640 1 --2- 172.21.15.37:0/3640806387 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fda800ba700 0x7fda8014bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.519+0000 7fda87205640 1 --2- 172.21.15.37:0/3640806387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda800ba0e0 0x7fda800b3b70 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.519+0000 7fda87205640 1 --2- 172.21.15.37:0/3640806387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda80070ff0 0x7fda8014c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.519+0000 7fda87205640 1 -- 172.21.15.37:0/3640806387 >> 172.21.15.37:0/3640806387 conn(0x7fda800be120 msgr2=0x7fda800b7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.519+0000 7fda87205640 1 -- 172.21.15.37:0/3640806387 shutdown_connections 2023-12-19T17:50:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.519+0000 7fda87205640 1 -- 172.21.15.37:0/3640806387 wait complete. 2023-12-19T17:50:03.530 INFO:tasks.ceph:Scrubbing osd.4 2023-12-19T17:50:03.530 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-19T17:50:03.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.640+0000 7f61aaca0640 1 Processor -- start 2023-12-19T17:50:03.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.640+0000 7f61aaca0640 1 -- start start 2023-12-19T17:50:03.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.641+0000 7f61aaca0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61a4070080 0x7f61a40b9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.641+0000 7f61aaca0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61a40b3f80 0x7f61a4141650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.641+0000 7f61aaca0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f61a4141b90 0x7f61a4147880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.641+0000 7f61aaca0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a4141fc0 con 0x7f61a40b3f80 2023-12-19T17:50:03.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.641+0000 7f61aaca0640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a40717a0 con 0x7f61a4141b90 2023-12-19T17:50:03.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.641+0000 7f61aaca0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a40b51c0 con 0x7f61a4070080 2023-12-19T17:50:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.641+0000 7f61a3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61a40b3f80 0x7f61a4141650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.641+0000 7f61a3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61a40b3f80 0x7f61a4141650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45910/0 (socket says 172.21.15.37:45910) 2023-12-19T17:50:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.641+0000 7f61a3fff640 1 -- 172.21.15.37:0/1939133967 learned_addr learned my addr 172.21.15.37:0/1939133967 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.641+0000 7f61a923d640 1 --2- 172.21.15.37:0/1939133967 >> v2:172.21.15.78:3300/0 conn(0x7f61a4141b90 0x7f61a4147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.641+0000 7f61a8a3c640 1 --2- 172.21.15.37:0/1939133967 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61a4070080 0x7f61a40b9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.641+0000 7f61a3fff640 1 -- 172.21.15.37:0/1939133967 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61a4070080 msgr2=0x7f61a40b9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.641+0000 7f61a3fff640 1 --2- 172.21.15.37:0/1939133967 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61a4070080 0x7f61a40b9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.641+0000 7f61a3fff640 1 -- 172.21.15.37:0/1939133967 >> v2:172.21.15.78:3300/0 conn(0x7f61a4141b90 msgr2=0x7f61a4147880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.641+0000 7f61a3fff640 1 --2- 172.21.15.37:0/1939133967 >> v2:172.21.15.78:3300/0 conn(0x7f61a4141b90 0x7f61a4147880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.641+0000 7f61a3fff640 1 -- 172.21.15.37:0/1939133967 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a40b9e90 con 0x7f61a40b3f80 2023-12-19T17:50:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.642+0000 7f61a3fff640 1 --2- 172.21.15.37:0/1939133967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a40b3f80 0x7f61a4141650 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f61a40ba770 tx=0x7f619002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9850ae1f506edb63 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:03.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.643+0000 7f61a37fe640 1 -- 172.21.15.37:0/1939133967 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190030860 con 0x7f61a40b3f80 2023-12-19T17:50:03.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.643+0000 7f61a37fe640 1 -- 172.21.15.37:0/1939133967 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61900309c0 con 0x7f61a40b3f80 2023-12-19T17:50:03.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.643+0000 7f61a37fe640 1 -- 172.21.15.37:0/1939133967 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190030d50 con 0x7f61a40b3f80 2023-12-19T17:50:03.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.643+0000 7f61aaca0640 1 -- 172.21.15.37:0/1939133967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a40b3f80 msgr2=0x7f61a4141650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.643+0000 7f61aaca0640 1 --2- 172.21.15.37:0/1939133967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a40b3f80 0x7f61a4141650 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f61a40ba770 tx=0x7f619002b9a0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.643+0000 7f61aaca0640 1 -- 172.21.15.37:0/1939133967 shutdown_connections 2023-12-19T17:50:03.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.643+0000 7f61aaca0640 1 --2- 172.21.15.37:0/1939133967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a40b3f80 0x7f61a4141650 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.643+0000 7f61aaca0640 1 --2- 172.21.15.37:0/1939133967 >> v2:172.21.15.78:3300/0 conn(0x7f61a4141b90 0x7f61a4147880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.643+0000 7f61aaca0640 1 --2- 172.21.15.37:0/1939133967 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61a4070080 0x7f61a40b9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.643+0000 7f61aaca0640 1 -- 172.21.15.37:0/1939133967 >> 172.21.15.37:0/1939133967 conn(0x7f61a406ae90 msgr2=0x7f61a406b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:03.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.643+0000 7f61aaca0640 1 -- 172.21.15.37:0/1939133967 shutdown_connections 2023-12-19T17:50:03.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.643+0000 7f61aaca0640 1 -- 172.21.15.37:0/1939133967 wait complete. 2023-12-19T17:50:03.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.644+0000 7f61aaca0640 1 Processor -- start 2023-12-19T17:50:03.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.644+0000 7f61aaca0640 1 -- start start 2023-12-19T17:50:03.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.645+0000 7f61aaca0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61a4070080 0x7f61a41dfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.645+0000 7f61aaca0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61a40b3f80 0x7f61a40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.645+0000 7f61aaca0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4141b90 0x7f61a413b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.645+0000 7f61aaca0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a4142160 con 0x7f61a4141b90 2023-12-19T17:50:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.645+0000 7f61aaca0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a4142620 con 0x7f61a40b3f80 2023-12-19T17:50:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.645+0000 7f61aaca0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a41436a0 con 0x7f61a4070080 2023-12-19T17:50:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.645+0000 7f61a923d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4141b90 0x7f61a413b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.645+0000 7f61a923d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4141b90 0x7f61a413b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45922/0 (socket says 172.21.15.37:45922) 2023-12-19T17:50:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.645+0000 7f61a923d640 1 -- 172.21.15.37:0/3391267428 learned_addr learned my addr 172.21.15.37:0/3391267428 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.646+0000 7f61a3fff640 1 --2- 172.21.15.37:0/3391267428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61a40b3f80 0x7f61a40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.646+0000 7f61a8a3c640 1 --2- 172.21.15.37:0/3391267428 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61a4070080 0x7f61a41dfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.646+0000 7f61a923d640 1 -- 172.21.15.37:0/3391267428 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61a4070080 msgr2=0x7f61a41dfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.646+0000 7f61a923d640 1 --2- 172.21.15.37:0/3391267428 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f61a4070080 0x7f61a41dfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.646+0000 7f61a923d640 1 -- 172.21.15.37:0/3391267428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61a40b3f80 msgr2=0x7f61a40b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.646+0000 7f61a923d640 1 --2- 172.21.15.37:0/3391267428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61a40b3f80 0x7f61a40b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.646+0000 7f61a923d640 1 -- 172.21.15.37:0/3391267428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61900094d0 con 0x7f61a4141b90 2023-12-19T17:50:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.646+0000 7f61a3fff640 1 --2- 172.21.15.37:0/3391267428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61a40b3f80 0x7f61a40b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:50:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.646+0000 7f61a923d640 1 --2- 172.21.15.37:0/3391267428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4141b90 0x7f61a413b310 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f619c009d30 tx=0x7f619c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.646+0000 7f61a17fa640 1 -- 172.21.15.37:0/3391267428 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c009ba0 con 0x7f61a4141b90 2023-12-19T17:50:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.646+0000 7f61a17fa640 1 -- 172.21.15.37:0/3391267428 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619c00f040 con 0x7f61a4141b90 2023-12-19T17:50:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.646+0000 7f61aaca0640 1 -- 172.21.15.37:0/3391267428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a4142340 con 0x7f61a4141b90 2023-12-19T17:50:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.646+0000 7f61a17fa640 1 -- 172.21.15.37:0/3391267428 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619c0146c0 con 0x7f61a4141b90 2023-12-19T17:50:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.646+0000 7f61aaca0640 1 -- 172.21.15.37:0/3391267428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a41e0310 con 0x7f61a4141b90 2023-12-19T17:50:03.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.647+0000 7f61aaca0640 1 -- 172.21.15.37:0/3391267428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f61a4071150 con 0x7f61a4141b90 2023-12-19T17:50:03.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.648+0000 7f61a17fa640 1 -- 172.21.15.37:0/3391267428 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f619c014820 con 0x7f61a4141b90 2023-12-19T17:50:03.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.648+0000 7f61a17fa640 1 --2- 172.21.15.37:0/3391267428 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f618806a460 0x7f618806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.648+0000 7f61a17fa640 1 -- 172.21.15.37:0/3391267428 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f619c0893c0 con 0x7f61a4141b90 2023-12-19T17:50:03.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.648+0000 7f61a8a3c640 1 --2- 172.21.15.37:0/3391267428 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f618806a460 0x7f618806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.648+0000 7f61a17fa640 1 --2- 172.21.15.37:0/3391267428 >> [v2:172.21.15.78:6821/89462,v1:172.21.15.78:6823/89462] conn(0x7f61880702c0 0x7f61880726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.648+0000 7f61a17fa640 1 -- 172.21.15.37:0/3391267428 --> [v2:172.21.15.78:6821/89462,v1:172.21.15.78:6823/89462] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6188072d90 con 0x7f61880702c0 2023-12-19T17:50:03.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.648+0000 7f61a17fa640 1 -- 172.21.15.37:0/3391267428 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f619c08ba80 con 0x7f61a4141b90 2023-12-19T17:50:03.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.648+0000 7f61a3fff640 1 --2- 172.21.15.37:0/3391267428 >> [v2:172.21.15.78:6821/89462,v1:172.21.15.78:6823/89462] conn(0x7f61880702c0 0x7f61880726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.649+0000 7f61a8a3c640 1 --2- 172.21.15.37:0/3391267428 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f618806a460 0x7f618806c920 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6198009a40 tx=0x7f6198008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:03.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.649+0000 7f61a3fff640 1 --2- 172.21.15.37:0/3391267428 >> [v2:172.21.15.78:6821/89462,v1:172.21.15.78:6823/89462] conn(0x7f61880702c0 0x7f61880726e0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:03.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.650+0000 7f61a17fa640 1 -- 172.21.15.37:0/3391267428 <== osd.4 v2:172.21.15.78:6821/89462 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6188072d90 con 0x7f61880702c0 2023-12-19T17:50:03.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.662+0000 7f61aaca0640 1 -- 172.21.15.37:0/3391267428 --> [v2:172.21.15.78:6821/89462,v1:172.21.15.78:6823/89462] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f61a40ba160 con 0x7f61880702c0 2023-12-19T17:50:03.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.663+0000 7f61a17fa640 1 -- 172.21.15.37:0/3391267428 <== osd.4 v2:172.21.15.78:6821/89462 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6190039450 con 0x7f61880702c0 2023-12-19T17:50:03.663 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-12-19T17:50:03.663 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T17:50:03.664 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-12-19T17:50:03.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.663+0000 7f61aaca0640 1 -- 172.21.15.37:0/3391267428 >> [v2:172.21.15.78:6821/89462,v1:172.21.15.78:6823/89462] conn(0x7f61880702c0 msgr2=0x7f61880726e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.663+0000 7f61aaca0640 1 --2- 172.21.15.37:0/3391267428 >> [v2:172.21.15.78:6821/89462,v1:172.21.15.78:6823/89462] conn(0x7f61880702c0 0x7f61880726e0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.663+0000 7f61aaca0640 1 -- 172.21.15.37:0/3391267428 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f618806a460 msgr2=0x7f618806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.663+0000 7f61aaca0640 1 --2- 172.21.15.37:0/3391267428 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f618806a460 0x7f618806c920 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6198009a40 tx=0x7f6198008040 comp rx=0 tx=0).stop 2023-12-19T17:50:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.663+0000 7f61aaca0640 1 -- 172.21.15.37:0/3391267428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4141b90 msgr2=0x7f61a413b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.663+0000 7f61aaca0640 1 --2- 172.21.15.37:0/3391267428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4141b90 0x7f61a413b310 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f619c009d30 tx=0x7f619c00c490 comp rx=0 tx=0).stop 2023-12-19T17:50:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.663+0000 7f61a923d640 1 -- 172.21.15.37:0/3391267428 reap_dead start 2023-12-19T17:50:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.663+0000 7f61aaca0640 1 -- 172.21.15.37:0/3391267428 shutdown_connections 2023-12-19T17:50:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.663+0000 7f61aaca0640 1 -- 172.21.15.37:0/3391267428 >> 172.21.15.37:0/3391267428 conn(0x7f61a406ae90 msgr2=0x7f61a413f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:03.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.663+0000 7f61aaca0640 1 -- 172.21.15.37:0/3391267428 shutdown_connections 2023-12-19T17:50:03.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.663+0000 7f61aaca0640 1 -- 172.21.15.37:0/3391267428 wait complete. 2023-12-19T17:50:03.674 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-19T17:50:03.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.781+0000 7f43d8db1640 1 Processor -- start 2023-12-19T17:50:03.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.781+0000 7f43d8db1640 1 -- start start 2023-12-19T17:50:03.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.782+0000 7f43d8db1640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43d40b7fd0 0x7f43d41541b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.782+0000 7f43d8db1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d40b56e0 con 0x7f43d4070ff0 2023-12-19T17:50:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.782+0000 7f43d8db1640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d40b59c0 con 0x7f43d40b4f90 2023-12-19T17:50:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.782+0000 7f43d8db1640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d40b6d70 con 0x7f43d40b7fd0 2023-12-19T17:50:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.782+0000 7f43d259c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f43d4070ff0 0x7f43d4142850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50518/0 (socket says 172.21.15.37:50518) 2023-12-19T17:50:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.782+0000 7f43d259c640 1 -- 172.21.15.37:0/2266649176 learned_addr learned my addr 172.21.15.37:0/2266649176 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:50:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.782+0000 7f43d159a640 1 -- 172.21.15.37:0/2266649176 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460400313 0 0) 0x7f43d40b56e0 con 0x7f43d4070ff0 2023-12-19T17:50:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.782+0000 7f43d159a640 1 -- 172.21.15.37:0/2266649176 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43c0003520 con 0x7f43d4070ff0 2023-12-19T17:50:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.782+0000 7f43d2d9d640 1 --2- 172.21.15.37:0/2266649176 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43d40b7fd0 0x7f43d41541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d159a640 1 -- 172.21.15.37:0/2266649176 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1952013594 0 0) 0x7f43c0003520 con 0x7f43d4070ff0 2023-12-19T17:50:03.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d159a640 1 -- 172.21.15.37:0/2266649176 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43d40b7fd0 msgr2=0x7f43d41541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:03.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d159a640 1 --2- 172.21.15.37:0/2266649176 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43d40b7fd0 0x7f43d41541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d159a640 1 -- 172.21.15.37:0/2266649176 >> v1:172.21.15.78:6789/0 conn(0x7f43d40b4f90 legacy=0x7f43d40b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d159a640 1 -- 172.21.15.37:0/2266649176 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d40b5ca0 con 0x7f43d4070ff0 2023-12-19T17:50:03.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d159a640 1 -- 172.21.15.37:0/2266649176 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f43c4001670 con 0x7f43d4070ff0 2023-12-19T17:50:03.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d159a640 1 -- 172.21.15.37:0/2266649176 >> v1:172.21.15.37:6789/0 conn(0x7f43d4070ff0 legacy=0x7f43d4142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d159a640 1 --2- 172.21.15.37:0/2266649176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43c00039a0 0x7f43c0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d159a640 1 --2- 172.21.15.37:0/2266649176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43c00047c0 0x7f43c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d159a640 1 --2- 172.21.15.37:0/2266649176 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43d40b7fd0 0x7f43c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d159a640 1 -- 172.21.15.37:0/2266649176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c000ba30 con 0x7f43c00039a0 2023-12-19T17:50:03.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d159a640 1 -- 172.21.15.37:0/2266649176 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c000bb70 con 0x7f43c00047c0 2023-12-19T17:50:03.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d159a640 1 -- 172.21.15.37:0/2266649176 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c000bd30 con 0x7f43d40b7fd0 2023-12-19T17:50:03.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d259c640 1 --2- 172.21.15.37:0/2266649176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43c00039a0 0x7f43c0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d1d9b640 1 --2- 172.21.15.37:0/2266649176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43c00047c0 0x7f43c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d2d9d640 1 --2- 172.21.15.37:0/2266649176 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43d40b7fd0 0x7f43c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d259c640 1 -- 172.21.15.37:0/2266649176 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43d40b7fd0 msgr2=0x7f43c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:03.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d259c640 1 --2- 172.21.15.37:0/2266649176 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43d40b7fd0 0x7f43c0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d259c640 1 -- 172.21.15.37:0/2266649176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43c00047c0 msgr2=0x7f43c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:03.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d259c640 1 --2- 172.21.15.37:0/2266649176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43c00047c0 0x7f43c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.783+0000 7f43d259c640 1 -- 172.21.15.37:0/2266649176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c0003520 con 0x7f43c00039a0 2023-12-19T17:50:03.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.784+0000 7f43d259c640 1 --2- 172.21.15.37:0/2266649176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43c00039a0 0x7f43c0003d80 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f43c4001eb0 tx=0x7f43c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c49f31b0501abb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:03.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.784+0000 7f43d159a640 1 -- 172.21.15.37:0/2266649176 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4005ad0 con 0x7f43c00039a0 2023-12-19T17:50:03.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.784+0000 7f43d159a640 1 -- 172.21.15.37:0/2266649176 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c4005c50 con 0x7f43c00039a0 2023-12-19T17:50:03.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.784+0000 7f43d159a640 1 -- 172.21.15.37:0/2266649176 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c402c890 con 0x7f43c00039a0 2023-12-19T17:50:03.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.785+0000 7f43d8db1640 1 -- 172.21.15.37:0/2266649176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43c00039a0 msgr2=0x7f43c0003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.785+0000 7f43d8db1640 1 --2- 172.21.15.37:0/2266649176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43c00039a0 0x7f43c0003d80 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f43c4001eb0 tx=0x7f43c00057f0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.785+0000 7f43d2d9d640 1 -- 172.21.15.37:0/2266649176 reap_dead start 2023-12-19T17:50:03.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.785+0000 7f43d8db1640 1 -- 172.21.15.37:0/2266649176 shutdown_connections 2023-12-19T17:50:03.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.785+0000 7f43d8db1640 1 -- 172.21.15.37:0/2266649176 >> 172.21.15.37:0/2266649176 conn(0x7f43d40be120 msgr2=0x7f43d40be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:03.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.785+0000 7f43d8db1640 1 -- 172.21.15.37:0/2266649176 shutdown_connections 2023-12-19T17:50:03.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.785+0000 7f43d8db1640 1 -- 172.21.15.37:0/2266649176 wait complete. 2023-12-19T17:50:03.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.786+0000 7f43d8db1640 1 Processor -- start 2023-12-19T17:50:03.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.786+0000 7f43d8db1640 1 -- start start 2023-12-19T17:50:03.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.787+0000 7f43d8db1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43c00039a0 0x7f43d4141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.787+0000 7f43d8db1640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43d41e0260 0x7f43d41e06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.787+0000 7f43d8db1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43d414c000 0x7f43d414c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.787+0000 7f43d8db1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d414a670 con 0x7f43c00039a0 2023-12-19T17:50:03.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.787+0000 7f43d8db1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d41401b0 con 0x7f43d414c000 2023-12-19T17:50:03.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.787+0000 7f43d8db1640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d41e0c20 con 0x7f43d41e0260 2023-12-19T17:50:03.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.787+0000 7f43d259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43c00039a0 0x7f43d4141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.787+0000 7f43d259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43c00039a0 0x7f43d4141520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45942/0 (socket says 172.21.15.37:45942) 2023-12-19T17:50:03.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.787+0000 7f43d259c640 1 -- 172.21.15.37:0/3485211422 learned_addr learned my addr 172.21.15.37:0/3485211422 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:03.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.787+0000 7f43d1d9b640 1 --2- 172.21.15.37:0/3485211422 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43d41e0260 0x7f43d41e06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.787+0000 7f43d2d9d640 1 --2- 172.21.15.37:0/3485211422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43d414c000 0x7f43d414c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.787+0000 7f43d259c640 1 -- 172.21.15.37:0/3485211422 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43d41e0260 msgr2=0x7f43d41e06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.787+0000 7f43d259c640 1 --2- 172.21.15.37:0/3485211422 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43d41e0260 0x7f43d41e06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.787+0000 7f43d259c640 1 -- 172.21.15.37:0/3485211422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43d414c000 msgr2=0x7f43d414c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.787+0000 7f43d259c640 1 --2- 172.21.15.37:0/3485211422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43d414c000 0x7f43d414c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.787+0000 7f43d259c640 1 -- 172.21.15.37:0/3485211422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d4141d40 con 0x7f43c00039a0 2023-12-19T17:50:03.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.787+0000 7f43d1d9b640 1 --2- 172.21.15.37:0/3485211422 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43d41e0260 0x7f43d41e06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:50:03.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.787+0000 7f43d2d9d640 1 --2- 172.21.15.37:0/3485211422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43d414c000 0x7f43d414c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:50:03.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.788+0000 7f43d259c640 1 --2- 172.21.15.37:0/3485211422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43c00039a0 0x7f43d4141520 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f43c402c430 tx=0x7f43c4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:03.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.788+0000 7f43caffd640 1 -- 172.21.15.37:0/3485211422 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4039030 con 0x7f43c00039a0 2023-12-19T17:50:03.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.788+0000 7f43caffd640 1 -- 172.21.15.37:0/3485211422 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c402cca0 con 0x7f43c00039a0 2023-12-19T17:50:03.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.788+0000 7f43caffd640 1 -- 172.21.15.37:0/3485211422 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c403c040 con 0x7f43c00039a0 2023-12-19T17:50:03.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.788+0000 7f43d8db1640 1 -- 172.21.15.37:0/3485211422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d413fe40 con 0x7f43c00039a0 2023-12-19T17:50:03.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.788+0000 7f43d8db1640 1 -- 172.21.15.37:0/3485211422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d4141a60 con 0x7f43c00039a0 2023-12-19T17:50:03.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.789+0000 7f43d8db1640 1 -- 172.21.15.37:0/3485211422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d404e840 con 0x7f43c00039a0 2023-12-19T17:50:03.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.789+0000 7f43caffd640 1 -- 172.21.15.37:0/3485211422 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f43c4032070 con 0x7f43c00039a0 2023-12-19T17:50:03.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.790+0000 7f43caffd640 1 --2- 172.21.15.37:0/3485211422 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f43b406a430 0x7f43b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:03.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.790+0000 7f43caffd640 1 -- 172.21.15.37:0/3485211422 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f43c40a9890 con 0x7f43c00039a0 2023-12-19T17:50:03.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.790+0000 7f43d1d9b640 1 --2- 172.21.15.37:0/3485211422 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f43b406a430 0x7f43b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:03.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.790+0000 7f43d1d9b640 1 --2- 172.21.15.37:0/3485211422 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f43b406a430 0x7f43b406c8f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f43d413e010 tx=0x7f43bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:03.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.794+0000 7f43caffd640 1 -- 172.21.15.37:0/3485211422 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f43c4075210 con 0x7f43c00039a0 2023-12-19T17:50:03.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.970+0000 7f43d8db1640 1 -- 172.21.15.37:0/3485211422 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f43d4142f60 con 0x7f43b406a430 2023-12-19T17:50:03.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.971+0000 7f43caffd640 1 -- 172.21.15.37:0/3485211422 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f43bc001630 con 0x7f43b406a430 2023-12-19T17:50:03.971 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 4 to deep-scrub 2023-12-19T17:50:03.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.973+0000 7f43d8db1640 1 -- 172.21.15.37:0/3485211422 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f43b406a430 msgr2=0x7f43b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.973+0000 7f43d8db1640 1 --2- 172.21.15.37:0/3485211422 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f43b406a430 0x7f43b406c8f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f43d413e010 tx=0x7f43bc009040 comp rx=0 tx=0).stop 2023-12-19T17:50:03.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.973+0000 7f43d8db1640 1 -- 172.21.15.37:0/3485211422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43c00039a0 msgr2=0x7f43d4141520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:03.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.973+0000 7f43d8db1640 1 --2- 172.21.15.37:0/3485211422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43c00039a0 0x7f43d4141520 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f43c402c430 tx=0x7f43c4001a00 comp rx=0 tx=0).stop 2023-12-19T17:50:03.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.973+0000 7f43d8db1640 1 -- 172.21.15.37:0/3485211422 shutdown_connections 2023-12-19T17:50:03.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.973+0000 7f43d8db1640 1 --2- 172.21.15.37:0/3485211422 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f43b406a430 0x7f43b406c8f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.973+0000 7f43d8db1640 1 --2- 172.21.15.37:0/3485211422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43d414c000 0x7f43d414c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.973+0000 7f43d8db1640 1 --2- 172.21.15.37:0/3485211422 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f43d41e0260 0x7f43d41e06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.973+0000 7f43d8db1640 1 --2- 172.21.15.37:0/3485211422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43c00039a0 0x7f43d4141520 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:03.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.973+0000 7f43d8db1640 1 -- 172.21.15.37:0/3485211422 >> 172.21.15.37:0/3485211422 conn(0x7f43d40be120 msgr2=0x7f43d40bc090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:03.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.973+0000 7f43d8db1640 1 -- 172.21.15.37:0/3485211422 shutdown_connections 2023-12-19T17:50:03.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:03.973+0000 7f43d8db1640 1 -- 172.21.15.37:0/3485211422 wait complete. 2023-12-19T17:50:03.984 INFO:tasks.ceph:Scrubbing osd.5 2023-12-19T17:50:03.985 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-19T17:50:04.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.095+0000 7f07fc927640 1 Processor -- start 2023-12-19T17:50:04.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.095+0000 7f07fc927640 1 -- start start 2023-12-19T17:50:04.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.096+0000 7f07fc927640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f8144ef0 0x7f07f80ba670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.096+0000 7f07fc927640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07f806c990 0x7f07f80b9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.096+0000 7f07fc927640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f80bad00 con 0x7f07f806acb0 2023-12-19T17:50:04.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.096+0000 7f07fc927640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f80bb2c0 con 0x7f07f806c990 2023-12-19T17:50:04.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.096+0000 7f07fc927640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80bafe0 con 0x7f07f8144ef0 2023-12-19T17:50:04.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.096+0000 7f07f5d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07f806c990 0x7f07f80b9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.096+0000 7f07f5d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07f806c990 0x7f07f80b9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45956/0 (socket says 172.21.15.37:45956) 2023-12-19T17:50:04.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.096+0000 7f07f5d9b640 1 -- 172.21.15.37:0/3298192407 learned_addr learned my addr 172.21.15.37:0/3298192407 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:04.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.096+0000 7f07f659c640 1 --2- 172.21.15.37:0/3298192407 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f8144ef0 0x7f07f80ba670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.096+0000 7f07f5d9b640 1 -- 172.21.15.37:0/3298192407 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f8144ef0 msgr2=0x7f07f80ba670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:04.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.096+0000 7f07f5d9b640 1 --2- 172.21.15.37:0/3298192407 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f8144ef0 0x7f07f80ba670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.096+0000 7f07f5d9b640 1 -- 172.21.15.37:0/3298192407 >> v1:172.21.15.78:6789/0 conn(0x7f07f806acb0 legacy=0x7f07f806e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.096+0000 7f07f5d9b640 1 -- 172.21.15.37:0/3298192407 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f80b91f0 con 0x7f07f806c990 2023-12-19T17:50:04.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.097+0000 7f07f5d9b640 1 --2- 172.21.15.37:0/3298192407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f806c990 0x7f07f80b9710 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009870 tx=0x7f07ec02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6795d8889f202374 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:04.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.097+0000 7f07f559a640 1 -- 172.21.15.37:0/3298192407 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec031640 con 0x7f07f806c990 2023-12-19T17:50:04.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.097+0000 7f07f559a640 1 -- 172.21.15.37:0/3298192407 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec0317a0 con 0x7f07f806c990 2023-12-19T17:50:04.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.097+0000 7f07f559a640 1 -- 172.21.15.37:0/3298192407 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec031b30 con 0x7f07f806c990 2023-12-19T17:50:04.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.098+0000 7f07fc927640 1 -- 172.21.15.37:0/3298192407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f806c990 msgr2=0x7f07f80b9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.098+0000 7f07fc927640 1 --2- 172.21.15.37:0/3298192407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f806c990 0x7f07f80b9710 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009870 tx=0x7f07ec02b8f0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.098+0000 7f07fc927640 1 -- 172.21.15.37:0/3298192407 shutdown_connections 2023-12-19T17:50:04.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.098+0000 7f07fc927640 1 --2- 172.21.15.37:0/3298192407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f806c990 0x7f07f80b9710 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.098+0000 7f07fc927640 1 --2- 172.21.15.37:0/3298192407 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f8144ef0 0x7f07f80ba670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.098+0000 7f07fc927640 1 -- 172.21.15.37:0/3298192407 >> 172.21.15.37:0/3298192407 conn(0x7f07f80be0c0 msgr2=0x7f07f80be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:04.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.098+0000 7f07fc927640 1 -- 172.21.15.37:0/3298192407 shutdown_connections 2023-12-19T17:50:04.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.098+0000 7f07fc927640 1 -- 172.21.15.37:0/3298192407 wait complete. 2023-12-19T17:50:04.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.099+0000 7f07fc927640 1 Processor -- start 2023-12-19T17:50:04.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.099+0000 7f07fc927640 1 -- start start 2023-12-19T17:50:04.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.100+0000 7f07fc927640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f806acb0 0x7f07f81dfef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.100+0000 7f07fc927640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f806c990 0x7f07f81e3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.100+0000 7f07fc927640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f8144ef0 0x7f07f80ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.100+0000 7f07fc927640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80ae730 con 0x7f07f806c990 2023-12-19T17:50:04.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.100+0000 7f07fc927640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f81e3440 con 0x7f07f8144ef0 2023-12-19T17:50:04.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.100+0000 7f07fc927640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80ae910 con 0x7f07f806acb0 2023-12-19T17:50:04.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.100+0000 7f07f5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f806c990 0x7f07f81e3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.100+0000 7f07f5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f806c990 0x7f07f81e3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45958/0 (socket says 172.21.15.37:45958) 2023-12-19T17:50:04.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.100+0000 7f07f5d9b640 1 -- 172.21.15.37:0/87592894 learned_addr learned my addr 172.21.15.37:0/87592894 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:04.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.100+0000 7f07f659c640 1 --2- 172.21.15.37:0/87592894 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f806acb0 0x7f07f81dfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.100+0000 7f07f6d9d640 1 --2- 172.21.15.37:0/87592894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f8144ef0 0x7f07f80ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.100+0000 7f07f5d9b640 1 -- 172.21.15.37:0/87592894 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f806acb0 msgr2=0x7f07f81dfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.100+0000 7f07f5d9b640 1 --2- 172.21.15.37:0/87592894 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f806acb0 0x7f07f81dfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.100+0000 7f07f5d9b640 1 -- 172.21.15.37:0/87592894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f8144ef0 msgr2=0x7f07f80ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.100+0000 7f07f5d9b640 1 --2- 172.21.15.37:0/87592894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f8144ef0 0x7f07f80ae1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.100+0000 7f07f5d9b640 1 -- 172.21.15.37:0/87592894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec0094d0 con 0x7f07f806c990 2023-12-19T17:50:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.100+0000 7f07f5d9b640 1 --2- 172.21.15.37:0/87592894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f806c990 0x7f07f81e3f00 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f07ec000c00 tx=0x7f07ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.100+0000 7f07e6ffd640 1 -- 172.21.15.37:0/87592894 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec03ac60 con 0x7f07f806c990 2023-12-19T17:50:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.101+0000 7f07e6ffd640 1 -- 172.21.15.37:0/87592894 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec03adc0 con 0x7f07f806c990 2023-12-19T17:50:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.101+0000 7f07fc927640 1 -- 172.21.15.37:0/87592894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f81e3700 con 0x7f07f806c990 2023-12-19T17:50:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.101+0000 7f07e6ffd640 1 -- 172.21.15.37:0/87592894 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec044630 con 0x7f07f806c990 2023-12-19T17:50:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.101+0000 7f07fc927640 1 -- 172.21.15.37:0/87592894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f80afb10 con 0x7f07f806c990 2023-12-19T17:50:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.101+0000 7f07fc927640 1 -- 172.21.15.37:0/87592894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f07f814e1d0 con 0x7f07f806c990 2023-12-19T17:50:04.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.102+0000 7f07e6ffd640 1 -- 172.21.15.37:0/87592894 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f07ec02f050 con 0x7f07f806c990 2023-12-19T17:50:04.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.102+0000 7f07e6ffd640 1 --2- 172.21.15.37:0/87592894 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f07d806a430 0x7f07d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.102+0000 7f07e6ffd640 1 -- 172.21.15.37:0/87592894 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f07ec0aab70 con 0x7f07f806c990 2023-12-19T17:50:04.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.103+0000 7f07e6ffd640 1 --2- 172.21.15.37:0/87592894 >> [v2:172.21.15.78:6808/89459,v1:172.21.15.78:6809/89459] conn(0x7f07d8070290 0x7f07d80726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.103+0000 7f07e6ffd640 1 -- 172.21.15.37:0/87592894 --> [v2:172.21.15.78:6808/89459,v1:172.21.15.78:6809/89459] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f07d8072d60 con 0x7f07d8070290 2023-12-19T17:50:04.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.103+0000 7f07e6ffd640 1 -- 172.21.15.37:0/87592894 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07ec0aafc0 con 0x7f07f806c990 2023-12-19T17:50:04.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.103+0000 7f07f659c640 1 --2- 172.21.15.37:0/87592894 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f07d806a430 0x7f07d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.103+0000 7f07f6d9d640 1 --2- 172.21.15.37:0/87592894 >> [v2:172.21.15.78:6808/89459,v1:172.21.15.78:6809/89459] conn(0x7f07d8070290 0x7f07d80726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.103+0000 7f07f6d9d640 1 --2- 172.21.15.37:0/87592894 >> [v2:172.21.15.78:6808/89459,v1:172.21.15.78:6809/89459] conn(0x7f07d8070290 0x7f07d80726b0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:04.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.103+0000 7f07f659c640 1 --2- 172.21.15.37:0/87592894 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f07d806a430 0x7f07d806c8f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f07e8006fd0 tx=0x7f07e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:04.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.104+0000 7f07e6ffd640 1 -- 172.21.15.37:0/87592894 <== osd.5 v2:172.21.15.78:6808/89459 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f07d8072d60 con 0x7f07d8070290 2023-12-19T17:50:04.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.116+0000 7f07fc927640 1 -- 172.21.15.37:0/87592894 --> [v2:172.21.15.78:6808/89459,v1:172.21.15.78:6809/89459] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f07f81e3c20 con 0x7f07d8070290 2023-12-19T17:50:04.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.117+0000 7f07e6ffd640 1 -- 172.21.15.37:0/87592894 <== osd.5 v2:172.21.15.78:6808/89459 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f07f81e3c20 con 0x7f07d8070290 2023-12-19T17:50:04.117 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-12-19T17:50:04.117 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T17:50:04.118 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-12-19T17:50:04.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.117+0000 7f07fc927640 1 -- 172.21.15.37:0/87592894 >> [v2:172.21.15.78:6808/89459,v1:172.21.15.78:6809/89459] conn(0x7f07d8070290 msgr2=0x7f07d80726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.117+0000 7f07fc927640 1 --2- 172.21.15.37:0/87592894 >> [v2:172.21.15.78:6808/89459,v1:172.21.15.78:6809/89459] conn(0x7f07d8070290 0x7f07d80726b0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.117+0000 7f07fc927640 1 -- 172.21.15.37:0/87592894 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f07d806a430 msgr2=0x7f07d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.117+0000 7f07fc927640 1 --2- 172.21.15.37:0/87592894 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f07d806a430 0x7f07d806c8f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f07e8006fd0 tx=0x7f07e8008040 comp rx=0 tx=0).stop 2023-12-19T17:50:04.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.117+0000 7f07fc927640 1 -- 172.21.15.37:0/87592894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f806c990 msgr2=0x7f07f81e3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.117+0000 7f07fc927640 1 --2- 172.21.15.37:0/87592894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07f806c990 0x7f07f81e3f00 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f07ec000c00 tx=0x7f07ec0046c0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.117+0000 7f07f6d9d640 1 -- 172.21.15.37:0/87592894 reap_dead start 2023-12-19T17:50:04.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.117+0000 7f07fc927640 1 -- 172.21.15.37:0/87592894 shutdown_connections 2023-12-19T17:50:04.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.117+0000 7f07fc927640 1 -- 172.21.15.37:0/87592894 >> 172.21.15.37:0/87592894 conn(0x7f07f80be0c0 msgr2=0x7f07f80b9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:04.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.117+0000 7f07fc927640 1 -- 172.21.15.37:0/87592894 shutdown_connections 2023-12-19T17:50:04.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.117+0000 7f07fc927640 1 -- 172.21.15.37:0/87592894 wait complete. 2023-12-19T17:50:04.128 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-19T17:50:04.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.236+0000 7f4b2f0bd640 1 Processor -- start 2023-12-19T17:50:04.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.236+0000 7f4b2f0bd640 1 -- start start 2023-12-19T17:50:04.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.237+0000 7f4b2f0bd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4b28070ff0 0x7f4b2814aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.237+0000 7f4b2f0bd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4b280ba0e0 0x7f4b280b7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.237+0000 7f4b2f0bd640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2814af90 con 0x7f4b280b7d60 2023-12-19T17:50:04.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.237+0000 7f4b2f0bd640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b280b8630 con 0x7f4b28070ff0 2023-12-19T17:50:04.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.237+0000 7f4b2f0bd640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2806b090 con 0x7f4b280ba0e0 2023-12-19T17:50:04.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.237+0000 7f4b27fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4b280ba0e0 0x7f4b280b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.237+0000 7f4b2ce59640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4b28070ff0 0x7f4b2814aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.237+0000 7f4b2ce59640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4b28070ff0 0x7f4b2814aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.37:40274/0 (socket says 172.21.15.37:40274) 2023-12-19T17:50:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.237+0000 7f4b27fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4b280ba0e0 0x7f4b280b7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.37:48482/0 (socket says 172.21.15.37:48482) 2023-12-19T17:50:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.237+0000 7f4b2ce59640 1 -- 172.21.15.37:0/807040540 learned_addr learned my addr 172.21.15.37:0/807040540 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.237+0000 7f4b2d65a640 1 --1- 172.21.15.37:0/807040540 >> v1:172.21.15.78:6789/0 conn(0x7f4b280b7d60 0x7f4b2814e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.37:56320/0 (socket says 172.21.15.37:56320) 2023-12-19T17:50:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.237+0000 7f4b2ce59640 1 -- 172.21.15.37:0/807040540 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4b280ba0e0 msgr2=0x7f4b280b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.237+0000 7f4b2ce59640 1 --2- 172.21.15.37:0/807040540 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4b280ba0e0 0x7f4b280b7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.237+0000 7f4b2ce59640 1 -- 172.21.15.37:0/807040540 >> v1:172.21.15.78:6789/0 conn(0x7f4b280b7d60 legacy=0x7f4b2814e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.237+0000 7f4b277fe640 1 -- 172.21.15.37:0/807040540 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195546300 0 0) 0x7f4b2814af90 con 0x7f4b280b7d60 2023-12-19T17:50:04.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.237+0000 7f4b2ce59640 1 -- 172.21.15.37:0/807040540 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b28071d10 con 0x7f4b28070ff0 2023-12-19T17:50:04.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.238+0000 7f4b2ce59640 1 --2- 172.21.15.37:0/807040540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b28070ff0 0x7f4b2814aa50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0098a0 tx=0x7f4b1c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e96a6973ecbc9918 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:04.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.238+0000 7f4b277fe640 1 -- 172.21.15.37:0/807040540 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c030840 con 0x7f4b28070ff0 2023-12-19T17:50:04.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.238+0000 7f4b277fe640 1 -- 172.21.15.37:0/807040540 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c0309a0 con 0x7f4b28070ff0 2023-12-19T17:50:04.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.238+0000 7f4b277fe640 1 -- 172.21.15.37:0/807040540 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c030d30 con 0x7f4b28070ff0 2023-12-19T17:50:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.239+0000 7f4b2f0bd640 1 -- 172.21.15.37:0/807040540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b28070ff0 msgr2=0x7f4b2814aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.239+0000 7f4b2f0bd640 1 --2- 172.21.15.37:0/807040540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b28070ff0 0x7f4b2814aa50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0098a0 tx=0x7f4b1c02b980 comp rx=0 tx=0).stop 2023-12-19T17:50:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.239+0000 7f4b2f0bd640 1 -- 172.21.15.37:0/807040540 shutdown_connections 2023-12-19T17:50:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.239+0000 7f4b2f0bd640 1 --2- 172.21.15.37:0/807040540 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4b280ba0e0 0x7f4b280b7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.239+0000 7f4b2f0bd640 1 --2- 172.21.15.37:0/807040540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b28070ff0 0x7f4b2814aa50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.239+0000 7f4b2f0bd640 1 -- 172.21.15.37:0/807040540 >> 172.21.15.37:0/807040540 conn(0x7f4b280be120 msgr2=0x7f4b280be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.239+0000 7f4b2f0bd640 1 -- 172.21.15.37:0/807040540 shutdown_connections 2023-12-19T17:50:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.239+0000 7f4b2f0bd640 1 -- 172.21.15.37:0/807040540 wait complete. 2023-12-19T17:50:04.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.240+0000 7f4b2f0bd640 1 Processor -- start 2023-12-19T17:50:04.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.240+0000 7f4b2f0bd640 1 -- start start 2023-12-19T17:50:04.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.241+0000 7f4b2f0bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b28070ff0 0x7f4b281e3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.241+0000 7f4b2f0bd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b280b7d60 0x7f4b281d6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.241+0000 7f4b2f0bd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4b280ba0e0 0x7f4b281d6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.241+0000 7f4b2f0bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b281e3d70 con 0x7f4b28070ff0 2023-12-19T17:50:04.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.241+0000 7f4b2f0bd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b281d6570 con 0x7f4b280b7d60 2023-12-19T17:50:04.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.241+0000 7f4b2f0bd640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b28142150 con 0x7f4b280ba0e0 2023-12-19T17:50:04.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.241+0000 7f4b2ce59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b28070ff0 0x7f4b281e3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.241+0000 7f4b2ce59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b28070ff0 0x7f4b281e3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45966/0 (socket says 172.21.15.37:45966) 2023-12-19T17:50:04.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.241+0000 7f4b2ce59640 1 -- 172.21.15.37:0/106195575 learned_addr learned my addr 172.21.15.37:0/106195575 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:04.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.241+0000 7f4b27fff640 1 --2- 172.21.15.37:0/106195575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b280b7d60 0x7f4b281d6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.241+0000 7f4b2d65a640 1 --2- 172.21.15.37:0/106195575 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4b280ba0e0 0x7f4b281d6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.241+0000 7f4b2ce59640 1 -- 172.21.15.37:0/106195575 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4b280ba0e0 msgr2=0x7f4b281d6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.241+0000 7f4b2ce59640 1 --2- 172.21.15.37:0/106195575 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4b280ba0e0 0x7f4b281d6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.241+0000 7f4b2ce59640 1 -- 172.21.15.37:0/106195575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b280b7d60 msgr2=0x7f4b281d6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.241+0000 7f4b2ce59640 1 --2- 172.21.15.37:0/106195575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b280b7d60 0x7f4b281d6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.241+0000 7f4b2ce59640 1 -- 172.21.15.37:0/106195575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c0094d0 con 0x7f4b28070ff0 2023-12-19T17:50:04.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.241+0000 7f4b2ce59640 1 --2- 172.21.15.37:0/106195575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b28070ff0 0x7f4b281e3830 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0098a0 tx=0x7f4b1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:04.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.242+0000 7f4b257fa640 1 -- 172.21.15.37:0/106195575 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c03e040 con 0x7f4b28070ff0 2023-12-19T17:50:04.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.242+0000 7f4b257fa640 1 -- 172.21.15.37:0/106195575 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c039c90 con 0x7f4b28070ff0 2023-12-19T17:50:04.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.242+0000 7f4b2f0bd640 1 -- 172.21.15.37:0/106195575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b281d6150 con 0x7f4b28070ff0 2023-12-19T17:50:04.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.242+0000 7f4b257fa640 1 -- 172.21.15.37:0/106195575 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c004030 con 0x7f4b28070ff0 2023-12-19T17:50:04.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.242+0000 7f4b2f0bd640 1 -- 172.21.15.37:0/106195575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b281e4280 con 0x7f4b28070ff0 2023-12-19T17:50:04.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.243+0000 7f4b2f0bd640 1 -- 172.21.15.37:0/106195575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2804e840 con 0x7f4b28070ff0 2023-12-19T17:50:04.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.243+0000 7f4b257fa640 1 -- 172.21.15.37:0/106195575 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4b1c0041b0 con 0x7f4b28070ff0 2023-12-19T17:50:04.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.244+0000 7f4b257fa640 1 --2- 172.21.15.37:0/106195575 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4b0c06a430 0x7f4b0c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.244+0000 7f4b257fa640 1 -- 172.21.15.37:0/106195575 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4b1c0aac50 con 0x7f4b28070ff0 2023-12-19T17:50:04.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.244+0000 7f4b27fff640 1 --2- 172.21.15.37:0/106195575 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4b0c06a430 0x7f4b0c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.244+0000 7f4b27fff640 1 --2- 172.21.15.37:0/106195575 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4b0c06a430 0x7f4b0c06c8f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4b281e11d0 tx=0x7f4b14009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:04.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.252+0000 7f4b257fa640 1 -- 172.21.15.37:0/106195575 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4b1c0b0020 con 0x7f4b28070ff0 2023-12-19T17:50:04.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.428+0000 7f4b2f0bd640 1 -- 172.21.15.37:0/106195575 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b28071a30 con 0x7f4b0c06a430 2023-12-19T17:50:04.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.429+0000 7f4b257fa640 1 -- 172.21.15.37:0/106195575 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4b14004020 con 0x7f4b0c06a430 2023-12-19T17:50:04.429 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 5 to deep-scrub 2023-12-19T17:50:04.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.431+0000 7f4b2f0bd640 1 -- 172.21.15.37:0/106195575 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4b0c06a430 msgr2=0x7f4b0c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.431+0000 7f4b2f0bd640 1 --2- 172.21.15.37:0/106195575 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4b0c06a430 0x7f4b0c06c8f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4b281e11d0 tx=0x7f4b14009190 comp rx=0 tx=0).stop 2023-12-19T17:50:04.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.431+0000 7f4b2f0bd640 1 -- 172.21.15.37:0/106195575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b28070ff0 msgr2=0x7f4b281e3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.431+0000 7f4b2f0bd640 1 --2- 172.21.15.37:0/106195575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b28070ff0 0x7f4b281e3830 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0098a0 tx=0x7f4b1c004730 comp rx=0 tx=0).stop 2023-12-19T17:50:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.431+0000 7f4b2f0bd640 1 -- 172.21.15.37:0/106195575 shutdown_connections 2023-12-19T17:50:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.431+0000 7f4b2f0bd640 1 --2- 172.21.15.37:0/106195575 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f4b0c06a430 0x7f4b0c06c8f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.431+0000 7f4b2f0bd640 1 --2- 172.21.15.37:0/106195575 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4b280ba0e0 0x7f4b281d6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.431+0000 7f4b2f0bd640 1 --2- 172.21.15.37:0/106195575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b280b7d60 0x7f4b281d6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.431+0000 7f4b2f0bd640 1 --2- 172.21.15.37:0/106195575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b28070ff0 0x7f4b281e3830 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.431+0000 7f4b2f0bd640 1 -- 172.21.15.37:0/106195575 >> 172.21.15.37:0/106195575 conn(0x7f4b280be120 msgr2=0x7f4b280b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.431+0000 7f4b2f0bd640 1 -- 172.21.15.37:0/106195575 shutdown_connections 2023-12-19T17:50:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.431+0000 7f4b2f0bd640 1 -- 172.21.15.37:0/106195575 wait complete. 2023-12-19T17:50:04.442 INFO:tasks.ceph:Scrubbing osd.6 2023-12-19T17:50:04.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-19T17:50:04.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.552+0000 7f2503c96640 1 Processor -- start 2023-12-19T17:50:04.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.552+0000 7f2503c96640 1 -- start start 2023-12-19T17:50:04.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.553+0000 7f2503c96640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24fc0bad70 0x7f24fc0b2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.553+0000 7f2503c96640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f24fc1428f0 0x7f24fc142d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.553+0000 7f2503c96640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f24fc14c2f0 0x7f24fc14c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.553+0000 7f2503c96640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24fc14ccc0 con 0x7f24fc14c2f0 2023-12-19T17:50:04.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.553+0000 7f2503c96640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24fc0b9050 con 0x7f24fc1428f0 2023-12-19T17:50:04.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.553+0000 7f2503c96640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc0b9330 con 0x7f24fc0bad70 2023-12-19T17:50:04.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.553+0000 7f2502233640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f24fc14c2f0 0x7f24fc14c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.553+0000 7f2502233640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f24fc14c2f0 0x7f24fc14c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45968/0 (socket says 172.21.15.37:45968) 2023-12-19T17:50:04.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.553+0000 7f2502233640 1 -- 172.21.15.37:0/3744523794 learned_addr learned my addr 172.21.15.37:0/3744523794 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:04.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.553+0000 7f2501231640 1 --2- 172.21.15.37:0/3744523794 >> v2:172.21.15.78:3300/0 conn(0x7f24fc1428f0 0x7f24fc142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.553+0000 7f2501a32640 1 --2- 172.21.15.37:0/3744523794 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24fc0bad70 0x7f24fc0b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.553+0000 7f2502233640 1 -- 172.21.15.37:0/3744523794 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24fc0bad70 msgr2=0x7f24fc0b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:04.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.553+0000 7f2502233640 1 --2- 172.21.15.37:0/3744523794 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24fc0bad70 0x7f24fc0b2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.553+0000 7f2502233640 1 -- 172.21.15.37:0/3744523794 >> v2:172.21.15.78:3300/0 conn(0x7f24fc1428f0 msgr2=0x7f24fc142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:04.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.553+0000 7f2502233640 1 --2- 172.21.15.37:0/3744523794 >> v2:172.21.15.78:3300/0 conn(0x7f24fc1428f0 0x7f24fc142d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.553+0000 7f2502233640 1 -- 172.21.15.37:0/3744523794 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc0b9610 con 0x7f24fc14c2f0 2023-12-19T17:50:04.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.553+0000 7f2501231640 1 --2- 172.21.15.37:0/3744523794 >> v2:172.21.15.78:3300/0 conn(0x7f24fc1428f0 0x7f24fc142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:50:04.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.554+0000 7f2502233640 1 --2- 172.21.15.37:0/3744523794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24fc14c2f0 0x7f24fc14c780 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f24fc0bf130 tx=0x7f24f402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30bdb30ca975dc68 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:04.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.555+0000 7f2500a30640 1 -- 172.21.15.37:0/3744523794 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f402ca70 con 0x7f24fc14c2f0 2023-12-19T17:50:04.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.555+0000 7f2500a30640 1 -- 172.21.15.37:0/3744523794 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f402cbd0 con 0x7f24fc14c2f0 2023-12-19T17:50:04.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.555+0000 7f2500a30640 1 -- 172.21.15.37:0/3744523794 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f40343f0 con 0x7f24fc14c2f0 2023-12-19T17:50:04.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.555+0000 7f2503c96640 1 -- 172.21.15.37:0/3744523794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24fc14c2f0 msgr2=0x7f24fc14c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.555+0000 7f2503c96640 1 --2- 172.21.15.37:0/3744523794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24fc14c2f0 0x7f24fc14c780 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f24fc0bf130 tx=0x7f24f402bed0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.555+0000 7f2503c96640 1 -- 172.21.15.37:0/3744523794 shutdown_connections 2023-12-19T17:50:04.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.555+0000 7f2503c96640 1 --2- 172.21.15.37:0/3744523794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24fc14c2f0 0x7f24fc14c780 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.555+0000 7f2503c96640 1 --2- 172.21.15.37:0/3744523794 >> v2:172.21.15.78:3300/0 conn(0x7f24fc1428f0 0x7f24fc142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.555+0000 7f2503c96640 1 --2- 172.21.15.37:0/3744523794 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24fc0bad70 0x7f24fc0b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.555+0000 7f2503c96640 1 -- 172.21.15.37:0/3744523794 >> 172.21.15.37:0/3744523794 conn(0x7f24fc0be0c0 msgr2=0x7f24fc0be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:04.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.555+0000 7f2503c96640 1 -- 172.21.15.37:0/3744523794 shutdown_connections 2023-12-19T17:50:04.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.555+0000 7f2503c96640 1 -- 172.21.15.37:0/3744523794 wait complete. 2023-12-19T17:50:04.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.556+0000 7f2503c96640 1 Processor -- start 2023-12-19T17:50:04.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.556+0000 7f2503c96640 1 -- start start 2023-12-19T17:50:04.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.557+0000 7f2503c96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24fc0bad70 0x7f24fc143e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.557+0000 7f2503c96640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24fc1428f0 0x7f24fc14ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.557+0000 7f2503c96640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24fc14c2f0 0x7f24fc13b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.557+0000 7f2503c96640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc144360 con 0x7f24fc1428f0 2023-12-19T17:50:04.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.557+0000 7f2503c96640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc145960 con 0x7f24fc0bad70 2023-12-19T17:50:04.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.557+0000 7f2503c96640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc1460e0 con 0x7f24fc14c2f0 2023-12-19T17:50:04.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.557+0000 7f2501231640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24fc1428f0 0x7f24fc14ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.557+0000 7f2501231640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24fc1428f0 0x7f24fc14ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45976/0 (socket says 172.21.15.37:45976) 2023-12-19T17:50:04.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.557+0000 7f2501231640 1 -- 172.21.15.37:0/3313784110 learned_addr learned my addr 172.21.15.37:0/3313784110 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:04.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.557+0000 7f2501a32640 1 --2- 172.21.15.37:0/3313784110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24fc0bad70 0x7f24fc143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.557+0000 7f2502233640 1 --2- 172.21.15.37:0/3313784110 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24fc14c2f0 0x7f24fc13b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.557+0000 7f2501231640 1 -- 172.21.15.37:0/3313784110 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24fc14c2f0 msgr2=0x7f24fc13b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.557+0000 7f2501231640 1 --2- 172.21.15.37:0/3313784110 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f24fc14c2f0 0x7f24fc13b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.557+0000 7f2501231640 1 -- 172.21.15.37:0/3313784110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24fc0bad70 msgr2=0x7f24fc143e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.557+0000 7f2501231640 1 --2- 172.21.15.37:0/3313784110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24fc0bad70 0x7f24fc143e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.557+0000 7f2501231640 1 -- 172.21.15.37:0/3313784110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f4009b30 con 0x7f24fc1428f0 2023-12-19T17:50:04.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.557+0000 7f2501a32640 1 --2- 172.21.15.37:0/3313784110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24fc0bad70 0x7f24fc143e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:50:04.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.558+0000 7f2501231640 1 --2- 172.21.15.37:0/3313784110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24fc1428f0 0x7f24fc14ad80 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f24f800c7f0 tx=0x7f24f800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:04.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.558+0000 7f24f27fc640 1 -- 172.21.15.37:0/3313784110 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8007a30 con 0x7f24fc1428f0 2023-12-19T17:50:04.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.558+0000 7f24f27fc640 1 -- 172.21.15.37:0/3313784110 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f8007b90 con 0x7f24fc1428f0 2023-12-19T17:50:04.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.558+0000 7f24f27fc640 1 -- 172.21.15.37:0/3313784110 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f800ce40 con 0x7f24fc1428f0 2023-12-19T17:50:04.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.558+0000 7f2503c96640 1 -- 172.21.15.37:0/3313784110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24fc145be0 con 0x7f24fc1428f0 2023-12-19T17:50:04.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.558+0000 7f2503c96640 1 -- 172.21.15.37:0/3313784110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24fc06be20 con 0x7f24fc1428f0 2023-12-19T17:50:04.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.558+0000 7f2503c96640 1 -- 172.21.15.37:0/3313784110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f24fc0b9d10 con 0x7f24fc1428f0 2023-12-19T17:50:04.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.559+0000 7f24f27fc640 1 -- 172.21.15.37:0/3313784110 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f24f80113f0 con 0x7f24fc1428f0 2023-12-19T17:50:04.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.559+0000 7f24f27fc640 1 --2- 172.21.15.37:0/3313784110 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f24e006a430 0x7f24e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.560+0000 7f24f27fc640 1 -- 172.21.15.37:0/3313784110 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f24f8088800 con 0x7f24fc1428f0 2023-12-19T17:50:04.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.560+0000 7f2501a32640 1 --2- 172.21.15.37:0/3313784110 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f24e006a430 0x7f24e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.560+0000 7f24f27fc640 1 --2- 172.21.15.37:0/3313784110 >> [v2:172.21.15.78:6816/89460,v1:172.21.15.78:6817/89460] conn(0x7f24e0070290 0x7f24e00726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.560+0000 7f24f27fc640 1 -- 172.21.15.37:0/3313784110 --> [v2:172.21.15.78:6816/89460,v1:172.21.15.78:6817/89460] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24e0072d60 con 0x7f24e0070290 2023-12-19T17:50:04.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.560+0000 7f24f27fc640 1 -- 172.21.15.37:0/3313784110 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24f808ad80 con 0x7f24fc1428f0 2023-12-19T17:50:04.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.560+0000 7f2502233640 1 --2- 172.21.15.37:0/3313784110 >> [v2:172.21.15.78:6816/89460,v1:172.21.15.78:6817/89460] conn(0x7f24e0070290 0x7f24e00726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.560+0000 7f2501a32640 1 --2- 172.21.15.37:0/3313784110 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f24e006a430 0x7f24e006c8f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f24ec006fd0 tx=0x7f24ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:04.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.560+0000 7f2502233640 1 --2- 172.21.15.37:0/3313784110 >> [v2:172.21.15.78:6816/89460,v1:172.21.15.78:6817/89460] conn(0x7f24e0070290 0x7f24e00726b0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:04.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.561+0000 7f24f27fc640 1 -- 172.21.15.37:0/3313784110 <== osd.6 v2:172.21.15.78:6816/89460 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f24e0072d60 con 0x7f24e0070290 2023-12-19T17:50:04.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.574+0000 7f2503c96640 1 -- 172.21.15.37:0/3313784110 --> [v2:172.21.15.78:6816/89460,v1:172.21.15.78:6817/89460] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f24fc0b98f0 con 0x7f24e0070290 2023-12-19T17:50:04.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.574+0000 7f24f27fc640 1 -- 172.21.15.37:0/3313784110 <== osd.6 v2:172.21.15.78:6816/89460 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f24f4040410 con 0x7f24e0070290 2023-12-19T17:50:04.575 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-12-19T17:50:04.575 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T17:50:04.575 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-12-19T17:50:04.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.575+0000 7f2503c96640 1 -- 172.21.15.37:0/3313784110 >> [v2:172.21.15.78:6816/89460,v1:172.21.15.78:6817/89460] conn(0x7f24e0070290 msgr2=0x7f24e00726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.575+0000 7f2503c96640 1 --2- 172.21.15.37:0/3313784110 >> [v2:172.21.15.78:6816/89460,v1:172.21.15.78:6817/89460] conn(0x7f24e0070290 0x7f24e00726b0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.575+0000 7f2503c96640 1 -- 172.21.15.37:0/3313784110 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f24e006a430 msgr2=0x7f24e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.575+0000 7f2503c96640 1 --2- 172.21.15.37:0/3313784110 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f24e006a430 0x7f24e006c8f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f24ec006fd0 tx=0x7f24ec008040 comp rx=0 tx=0).stop 2023-12-19T17:50:04.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.575+0000 7f2503c96640 1 -- 172.21.15.37:0/3313784110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24fc1428f0 msgr2=0x7f24fc14ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.575+0000 7f2503c96640 1 --2- 172.21.15.37:0/3313784110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24fc1428f0 0x7f24fc14ad80 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f24f800c7f0 tx=0x7f24f800cbf0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.575+0000 7f2502233640 1 -- 172.21.15.37:0/3313784110 reap_dead start 2023-12-19T17:50:04.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.575+0000 7f2503c96640 1 -- 172.21.15.37:0/3313784110 shutdown_connections 2023-12-19T17:50:04.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.575+0000 7f2503c96640 1 -- 172.21.15.37:0/3313784110 >> 172.21.15.37:0/3313784110 conn(0x7f24fc0be0c0 msgr2=0x7f24fc0b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:04.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.575+0000 7f2503c96640 1 -- 172.21.15.37:0/3313784110 shutdown_connections 2023-12-19T17:50:04.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.575+0000 7f2503c96640 1 -- 172.21.15.37:0/3313784110 wait complete. 2023-12-19T17:50:04.585 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-19T17:50:04.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.693+0000 7f3183139640 1 Processor -- start 2023-12-19T17:50:04.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.693+0000 7f3183139640 1 -- start start 2023-12-19T17:50:04.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.694+0000 7f3183139640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f317c0bcdd0 0x7f317c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.694+0000 7f3183139640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c0b64c0 0x7f317c144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.694+0000 7f3183139640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f317c0bc6b0 con 0x7f317c144cd0 2023-12-19T17:50:04.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.694+0000 7f3183139640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317c0b6900 con 0x7f317c0bcdd0 2023-12-19T17:50:04.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.694+0000 7f3183139640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317c0a59f0 con 0x7f317c0b64c0 2023-12-19T17:50:04.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.694+0000 7f31816d6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f317c144cd0 0x7f317c14e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50520/0 (socket says 172.21.15.37:50520) 2023-12-19T17:50:04.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.694+0000 7f31816d6640 1 -- 172.21.15.37:0/1606572892 learned_addr learned my addr 172.21.15.37:0/1606572892 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:50:04.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.694+0000 7f3180ed5640 1 --2- 172.21.15.37:0/1606572892 >> v2:172.21.15.78:3300/0 conn(0x7f317c0bcdd0 0x7f317c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.694+0000 7f317bfff640 1 --2- 172.21.15.37:0/1606572892 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c0b64c0 0x7f317c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.694+0000 7f317b7fe640 1 -- 172.21.15.37:0/1606572892 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161767384 0 0) 0x7f317c0bc6b0 con 0x7f317c144cd0 2023-12-19T17:50:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.694+0000 7f317b7fe640 1 -- 172.21.15.37:0/1606572892 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f316c003520 con 0x7f317c144cd0 2023-12-19T17:50:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.695+0000 7f317b7fe640 1 -- 172.21.15.37:0/1606572892 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3090610134 0 0) 0x7f316c003520 con 0x7f317c144cd0 2023-12-19T17:50:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.695+0000 7f317bfff640 1 -- 172.21.15.37:0/1606572892 >> v2:172.21.15.78:3300/0 conn(0x7f317c0bcdd0 msgr2=0x7f317c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.695+0000 7f317bfff640 1 --2- 172.21.15.37:0/1606572892 >> v2:172.21.15.78:3300/0 conn(0x7f317c0bcdd0 0x7f317c0b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.695+0000 7f317bfff640 1 -- 172.21.15.37:0/1606572892 >> v1:172.21.15.37:6789/0 conn(0x7f317c144cd0 legacy=0x7f317c14e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.695+0000 7f317bfff640 1 -- 172.21.15.37:0/1606572892 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c0bc0a0 con 0x7f317c0b64c0 2023-12-19T17:50:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.695+0000 7f317bfff640 1 --2- 172.21.15.37:0/1606572892 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c0b64c0 0x7f317c144790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f31680097a0 tx=0x7f316802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d658c751e3ac000f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.696+0000 7f317b7fe640 1 -- 172.21.15.37:0/1606572892 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316802f050 con 0x7f317c0b64c0 2023-12-19T17:50:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.696+0000 7f317b7fe640 1 -- 172.21.15.37:0/1606572892 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3168031500 con 0x7f317c0b64c0 2023-12-19T17:50:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.696+0000 7f317b7fe640 1 -- 172.21.15.37:0/1606572892 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31740019f0 con 0x7f317c0b64c0 2023-12-19T17:50:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.696+0000 7f3183139640 1 -- 172.21.15.37:0/1606572892 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c0b64c0 msgr2=0x7f317c144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.696+0000 7f3183139640 1 --2- 172.21.15.37:0/1606572892 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c0b64c0 0x7f317c144790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f31680097a0 tx=0x7f316802b820 comp rx=0 tx=0).stop 2023-12-19T17:50:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.696+0000 7f3183139640 1 -- 172.21.15.37:0/1606572892 shutdown_connections 2023-12-19T17:50:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.696+0000 7f3183139640 1 --2- 172.21.15.37:0/1606572892 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c0b64c0 0x7f317c144790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.696+0000 7f3183139640 1 --2- 172.21.15.37:0/1606572892 >> v2:172.21.15.78:3300/0 conn(0x7f317c0bcdd0 0x7f317c0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.696+0000 7f3183139640 1 -- 172.21.15.37:0/1606572892 >> 172.21.15.37:0/1606572892 conn(0x7f317c071e60 msgr2=0x7f317c0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.696+0000 7f3183139640 1 -- 172.21.15.37:0/1606572892 shutdown_connections 2023-12-19T17:50:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.696+0000 7f3183139640 1 -- 172.21.15.37:0/1606572892 wait complete. 2023-12-19T17:50:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.697+0000 7f3183139640 1 Processor -- start 2023-12-19T17:50:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.697+0000 7f3183139640 1 -- start start 2023-12-19T17:50:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.698+0000 7f3183139640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f317c0b64c0 0x7f317c14aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.698+0000 7f3183139640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f317c0bcdd0 0x7f317c1e3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.698+0000 7f3183139640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c144cd0 0x7f317c1dfe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.698+0000 7f3183139640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c14b530 con 0x7f317c0b64c0 2023-12-19T17:50:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.698+0000 7f3183139640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c09b100 con 0x7f317c0bcdd0 2023-12-19T17:50:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.698+0000 7f3183139640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317c09b370 con 0x7f317c144cd0 2023-12-19T17:50:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.698+0000 7f3180ed5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f317c0b64c0 0x7f317c14aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.698+0000 7f3180ed5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f317c0b64c0 0x7f317c14aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45990/0 (socket says 172.21.15.37:45990) 2023-12-19T17:50:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.698+0000 7f3180ed5640 1 -- 172.21.15.37:0/2433986096 learned_addr learned my addr 172.21.15.37:0/2433986096 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.698+0000 7f317bfff640 1 --2- 172.21.15.37:0/2433986096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f317c0bcdd0 0x7f317c1e3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.698+0000 7f31816d6640 1 --2- 172.21.15.37:0/2433986096 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c144cd0 0x7f317c1dfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.699+0000 7f3180ed5640 1 -- 172.21.15.37:0/2433986096 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c144cd0 msgr2=0x7f317c1dfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.699+0000 7f3180ed5640 1 --2- 172.21.15.37:0/2433986096 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c144cd0 0x7f317c1dfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.699+0000 7f3180ed5640 1 -- 172.21.15.37:0/2433986096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f317c0bcdd0 msgr2=0x7f317c1e3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.699+0000 7f3180ed5640 1 --2- 172.21.15.37:0/2433986096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f317c0bcdd0 0x7f317c1e3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.699+0000 7f3180ed5640 1 -- 172.21.15.37:0/2433986096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3168009400 con 0x7f317c0b64c0 2023-12-19T17:50:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.699+0000 7f3180ed5640 1 --2- 172.21.15.37:0/2433986096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f317c0b64c0 0x7f317c14aff0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f317000e9e0 tx=0x7f317000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.699+0000 7f31797fa640 1 -- 172.21.15.37:0/2433986096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3170009670 con 0x7f317c0b64c0 2023-12-19T17:50:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.699+0000 7f31797fa640 1 -- 172.21.15.37:0/2433986096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317000c9d0 con 0x7f317c0b64c0 2023-12-19T17:50:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.699+0000 7f31797fa640 1 -- 172.21.15.37:0/2433986096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317000cd80 con 0x7f317c0b64c0 2023-12-19T17:50:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.699+0000 7f3183139640 1 -- 172.21.15.37:0/2433986096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317c099f50 con 0x7f317c0b64c0 2023-12-19T17:50:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.699+0000 7f3183139640 1 -- 172.21.15.37:0/2433986096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317c1e32f0 con 0x7f317c0b64c0 2023-12-19T17:50:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.700+0000 7f3183139640 1 -- 172.21.15.37:0/2433986096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317c04e840 con 0x7f317c0b64c0 2023-12-19T17:50:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.701+0000 7f31797fa640 1 -- 172.21.15.37:0/2433986096 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3170013470 con 0x7f317c0b64c0 2023-12-19T17:50:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.701+0000 7f31797fa640 1 --2- 172.21.15.37:0/2433986096 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f316006a430 0x7f316006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.701+0000 7f31797fa640 1 -- 172.21.15.37:0/2433986096 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3170088770 con 0x7f317c0b64c0 2023-12-19T17:50:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.701+0000 7f317bfff640 1 --2- 172.21.15.37:0/2433986096 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f316006a430 0x7f316006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.702+0000 7f317bfff640 1 --2- 172.21.15.37:0/2433986096 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f316006a430 0x7f316006c8f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3168035000 tx=0x7f3168008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.705+0000 7f31797fa640 1 -- 172.21.15.37:0/2433986096 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f31700541a0 con 0x7f317c0b64c0 2023-12-19T17:50:04.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.883+0000 7f3183139640 1 -- 172.21.15.37:0/2433986096 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f317c0b5500 con 0x7f316006a430 2023-12-19T17:50:04.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.884+0000 7f31797fa640 1 -- 172.21.15.37:0/2433986096 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3168031910 con 0x7f316006a430 2023-12-19T17:50:04.884 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 6 to deep-scrub 2023-12-19T17:50:04.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.886+0000 7f3183139640 1 -- 172.21.15.37:0/2433986096 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f316006a430 msgr2=0x7f316006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.886+0000 7f3183139640 1 --2- 172.21.15.37:0/2433986096 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f316006a430 0x7f316006c8f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3168035000 tx=0x7f3168008030 comp rx=0 tx=0).stop 2023-12-19T17:50:04.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.886+0000 7f3183139640 1 -- 172.21.15.37:0/2433986096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f317c0b64c0 msgr2=0x7f317c14aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:04.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.886+0000 7f3183139640 1 --2- 172.21.15.37:0/2433986096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f317c0b64c0 0x7f317c14aff0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f317000e9e0 tx=0x7f317000eea0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.886+0000 7f3183139640 1 -- 172.21.15.37:0/2433986096 shutdown_connections 2023-12-19T17:50:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.886+0000 7f3183139640 1 --2- 172.21.15.37:0/2433986096 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f316006a430 0x7f316006c8f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.886+0000 7f3183139640 1 --2- 172.21.15.37:0/2433986096 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c144cd0 0x7f317c1dfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.886+0000 7f3183139640 1 --2- 172.21.15.37:0/2433986096 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f317c0bcdd0 0x7f317c1e3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.886+0000 7f3183139640 1 --2- 172.21.15.37:0/2433986096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f317c0b64c0 0x7f317c14aff0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.886+0000 7f3183139640 1 -- 172.21.15.37:0/2433986096 >> 172.21.15.37:0/2433986096 conn(0x7f317c071e60 msgr2=0x7f317c0b9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.886+0000 7f3183139640 1 -- 172.21.15.37:0/2433986096 shutdown_connections 2023-12-19T17:50:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:04.886+0000 7f3183139640 1 -- 172.21.15.37:0/2433986096 wait complete. 2023-12-19T17:50:04.897 INFO:tasks.ceph:Scrubbing osd.7 2023-12-19T17:50:04.897 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-19T17:50:05.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.007+0000 7f4360aab640 1 Processor -- start 2023-12-19T17:50:05.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.007+0000 7f4360aab640 1 -- start start 2023-12-19T17:50:05.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.008+0000 7f4360aab640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f435c0bad70 0x7f435c0b2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:05.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.008+0000 7f4360aab640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435c0b9050 con 0x7f435c1428f0 2023-12-19T17:50:05.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.008+0000 7f4360aab640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435c0b9330 con 0x7f435c14ca00 2023-12-19T17:50:05.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.008+0000 7f4360aab640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435c0b9610 con 0x7f435c0bad70 2023-12-19T17:50:05.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.008+0000 7f435a59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f435c0bad70 0x7f435c0b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:05.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.008+0000 7f4359d9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f435c1428f0 0x7f435c14c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50522/0 (socket says 172.21.15.37:50522) 2023-12-19T17:50:05.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.008+0000 7f4359d9b640 1 -- 172.21.15.37:0/3904150991 learned_addr learned my addr 172.21.15.37:0/3904150991 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:50:05.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.008+0000 7f435a59c640 1 -- 172.21.15.37:0/3904150991 >> v1:172.21.15.78:6789/0 conn(0x7f435c14ca00 legacy=0x7f435c1532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:05.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.008+0000 7f435a59c640 1 -- 172.21.15.37:0/3904150991 >> v1:172.21.15.37:6789/0 conn(0x7f435c1428f0 legacy=0x7f435c14c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:05.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.008+0000 7f435a59c640 1 -- 172.21.15.37:0/3904150991 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c0b98f0 con 0x7f435c0bad70 2023-12-19T17:50:05.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.008+0000 7f435959a640 1 -- 172.21.15.37:0/3904150991 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803374939 0 0) 0x7f435c0b9050 con 0x7f435c1428f0 2023-12-19T17:50:05.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.009+0000 7f435a59c640 1 --2- 172.21.15.37:0/3904150991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f435c0bad70 0x7f435c0b2440 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f434c0097a0 tx=0x7f434c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955f6022fbc617e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:05.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.009+0000 7f435959a640 1 -- 172.21.15.37:0/3904150991 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c030610 con 0x7f435c0bad70 2023-12-19T17:50:05.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.009+0000 7f435959a640 1 -- 172.21.15.37:0/3904150991 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c030770 con 0x7f435c0bad70 2023-12-19T17:50:05.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.009+0000 7f435959a640 1 -- 172.21.15.37:0/3904150991 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c030b00 con 0x7f435c0bad70 2023-12-19T17:50:05.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.010+0000 7f4360aab640 1 -- 172.21.15.37:0/3904150991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f435c0bad70 msgr2=0x7f435c0b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:05.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.010+0000 7f4360aab640 1 --2- 172.21.15.37:0/3904150991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f435c0bad70 0x7f435c0b2440 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f434c0097a0 tx=0x7f434c02b960 comp rx=0 tx=0).stop 2023-12-19T17:50:05.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.010+0000 7f4360aab640 1 -- 172.21.15.37:0/3904150991 shutdown_connections 2023-12-19T17:50:05.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.010+0000 7f4360aab640 1 --2- 172.21.15.37:0/3904150991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f435c0bad70 0x7f435c0b2440 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.010+0000 7f4360aab640 1 -- 172.21.15.37:0/3904150991 >> 172.21.15.37:0/3904150991 conn(0x7f435c0be0c0 msgr2=0x7f435c0be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:05.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.010+0000 7f4360aab640 1 -- 172.21.15.37:0/3904150991 shutdown_connections 2023-12-19T17:50:05.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.010+0000 7f4360aab640 1 -- 172.21.15.37:0/3904150991 wait complete. 2023-12-19T17:50:05.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.011+0000 7f4360aab640 1 Processor -- start 2023-12-19T17:50:05.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.011+0000 7f4360aab640 1 -- start start 2023-12-19T17:50:05.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.012+0000 7f4360aab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f435c0bad70 0x7f435c0bcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:05.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.012+0000 7f4360aab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f435c1428f0 0x7f435c0bbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:05.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.012+0000 7f4360aab640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f435c14ca00 0x7f435c0bd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:05.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.012+0000 7f4360aab640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0bd330 con 0x7f435c1428f0 2023-12-19T17:50:05.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.012+0000 7f4360aab640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0bc3e0 con 0x7f435c0bad70 2023-12-19T17:50:05.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.012+0000 7f4360aab640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0b83f0 con 0x7f435c14ca00 2023-12-19T17:50:05.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.012+0000 7f4359d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f435c1428f0 0x7f435c0bbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:05.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.012+0000 7f4359d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f435c1428f0 0x7f435c0bbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46008/0 (socket says 172.21.15.37:46008) 2023-12-19T17:50:05.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.012+0000 7f4359d9b640 1 -- 172.21.15.37:0/779382201 learned_addr learned my addr 172.21.15.37:0/779382201 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:05.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.012+0000 7f435a59c640 1 --2- 172.21.15.37:0/779382201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f435c0bad70 0x7f435c0bcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:05.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.012+0000 7f435ad9d640 1 --2- 172.21.15.37:0/779382201 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f435c14ca00 0x7f435c0bd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:05.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.012+0000 7f4359d9b640 1 -- 172.21.15.37:0/779382201 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f435c14ca00 msgr2=0x7f435c0bd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:05.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.012+0000 7f4359d9b640 1 --2- 172.21.15.37:0/779382201 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f435c14ca00 0x7f435c0bd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.012+0000 7f4359d9b640 1 -- 172.21.15.37:0/779382201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f435c0bad70 msgr2=0x7f435c0bcdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:05.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.012+0000 7f4359d9b640 1 --2- 172.21.15.37:0/779382201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f435c0bad70 0x7f435c0bcdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.012+0000 7f4359d9b640 1 -- 172.21.15.37:0/779382201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434c009400 con 0x7f435c1428f0 2023-12-19T17:50:05.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.012+0000 7f4359d9b640 1 --2- 172.21.15.37:0/779382201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f435c1428f0 0x7f435c0bbea0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f434400c4a0 tx=0x7f434400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:05.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.013+0000 7f4352ffd640 1 -- 172.21.15.37:0/779382201 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43440074e0 con 0x7f435c1428f0 2023-12-19T17:50:05.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.013+0000 7f4352ffd640 1 -- 172.21.15.37:0/779382201 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4344007640 con 0x7f435c1428f0 2023-12-19T17:50:05.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.013+0000 7f4352ffd640 1 -- 172.21.15.37:0/779382201 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4344004a00 con 0x7f435c1428f0 2023-12-19T17:50:05.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.013+0000 7f4360aab640 1 -- 172.21.15.37:0/779382201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435c1ddba0 con 0x7f435c1428f0 2023-12-19T17:50:05.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.013+0000 7f4360aab640 1 -- 172.21.15.37:0/779382201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435c1de160 con 0x7f435c1428f0 2023-12-19T17:50:05.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.014+0000 7f4360aab640 1 -- 172.21.15.37:0/779382201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f435c1dda20 con 0x7f435c1428f0 2023-12-19T17:50:05.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.014+0000 7f4352ffd640 1 -- 172.21.15.37:0/779382201 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4344004b60 con 0x7f435c1428f0 2023-12-19T17:50:05.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.014+0000 7f4352ffd640 1 --2- 172.21.15.37:0/779382201 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f433c06a460 0x7f433c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:05.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.015+0000 7f4352ffd640 1 -- 172.21.15.37:0/779382201 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4344087650 con 0x7f435c1428f0 2023-12-19T17:50:05.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.015+0000 7f4352ffd640 1 --2- 172.21.15.37:0/779382201 >> [v2:172.21.15.78:6800/89461,v1:172.21.15.78:6801/89461] conn(0x7f433c0702c0 0x7f433c0726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:05.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.015+0000 7f4352ffd640 1 -- 172.21.15.37:0/779382201 --> [v2:172.21.15.78:6800/89461,v1:172.21.15.78:6801/89461] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f433c072d90 con 0x7f433c0702c0 2023-12-19T17:50:05.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.015+0000 7f4352ffd640 1 -- 172.21.15.37:0/779382201 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4344089d10 con 0x7f435c1428f0 2023-12-19T17:50:05.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.015+0000 7f435a59c640 1 --2- 172.21.15.37:0/779382201 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f433c06a460 0x7f433c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:05.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.015+0000 7f435ad9d640 1 --2- 172.21.15.37:0/779382201 >> [v2:172.21.15.78:6800/89461,v1:172.21.15.78:6801/89461] conn(0x7f433c0702c0 0x7f433c0726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:05.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.015+0000 7f435a59c640 1 --2- 172.21.15.37:0/779382201 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f433c06a460 0x7f433c06c920 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f434c036000 tx=0x7f434c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:05.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.015+0000 7f435ad9d640 1 --2- 172.21.15.37:0/779382201 >> [v2:172.21.15.78:6800/89461,v1:172.21.15.78:6801/89461] conn(0x7f433c0702c0 0x7f433c0726e0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:05.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.016+0000 7f4352ffd640 1 -- 172.21.15.37:0/779382201 <== osd.7 v2:172.21.15.78:6800/89461 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f433c072d90 con 0x7f433c0702c0 2023-12-19T17:50:05.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.029+0000 7f4360aab640 1 -- 172.21.15.37:0/779382201 --> [v2:172.21.15.78:6800/89461,v1:172.21.15.78:6801/89461] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f435c0b8940 con 0x7f433c0702c0 2023-12-19T17:50:05.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.029+0000 7f4352ffd640 1 -- 172.21.15.37:0/779382201 <== osd.7 v2:172.21.15.78:6800/89461 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4354001df0 con 0x7f433c0702c0 2023-12-19T17:50:05.029 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-12-19T17:50:05.030 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T17:50:05.030 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-12-19T17:50:05.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.029+0000 7f4360aab640 1 -- 172.21.15.37:0/779382201 >> [v2:172.21.15.78:6800/89461,v1:172.21.15.78:6801/89461] conn(0x7f433c0702c0 msgr2=0x7f433c0726e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:05.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.029+0000 7f4360aab640 1 --2- 172.21.15.37:0/779382201 >> [v2:172.21.15.78:6800/89461,v1:172.21.15.78:6801/89461] conn(0x7f433c0702c0 0x7f433c0726e0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.030+0000 7f4360aab640 1 -- 172.21.15.37:0/779382201 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f433c06a460 msgr2=0x7f433c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:05.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.030+0000 7f4360aab640 1 --2- 172.21.15.37:0/779382201 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f433c06a460 0x7f433c06c920 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f434c036000 tx=0x7f434c008030 comp rx=0 tx=0).stop 2023-12-19T17:50:05.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.030+0000 7f4360aab640 1 -- 172.21.15.37:0/779382201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f435c1428f0 msgr2=0x7f435c0bbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:05.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.030+0000 7f4360aab640 1 --2- 172.21.15.37:0/779382201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f435c1428f0 0x7f435c0bbea0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f434400c4a0 tx=0x7f434400c960 comp rx=0 tx=0).stop 2023-12-19T17:50:05.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.030+0000 7f435ad9d640 1 -- 172.21.15.37:0/779382201 reap_dead start 2023-12-19T17:50:05.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.030+0000 7f4360aab640 1 -- 172.21.15.37:0/779382201 shutdown_connections 2023-12-19T17:50:05.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.030+0000 7f4360aab640 1 -- 172.21.15.37:0/779382201 >> 172.21.15.37:0/779382201 conn(0x7f435c0be0c0 msgr2=0x7f435c13efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:05.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.030+0000 7f4360aab640 1 -- 172.21.15.37:0/779382201 shutdown_connections 2023-12-19T17:50:05.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.030+0000 7f4360aab640 1 -- 172.21.15.37:0/779382201 wait complete. 2023-12-19T17:50:05.040 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-19T17:50:05.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.148+0000 7fb975e15640 1 Processor -- start 2023-12-19T17:50:05.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.148+0000 7fb975e15640 1 -- start start 2023-12-19T17:50:05.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.149+0000 7fb975e15640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb970069ba0 0x7fb9700711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:05.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.149+0000 7fb975e15640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb970070d30 con 0x7fb97014aab0 2023-12-19T17:50:05.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.149+0000 7fb975e15640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9700b6f60 con 0x7fb970069f80 2023-12-19T17:50:05.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.149+0000 7fb975e15640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb970071720 con 0x7fb970069ba0 2023-12-19T17:50:05.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.149+0000 7fb96f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb970069ba0 0x7fb9700711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:05.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.149+0000 7fb96effd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb97014aab0 0x7fb9700b6850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50534/0 (socket says 172.21.15.37:50534) 2023-12-19T17:50:05.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.149+0000 7fb96effd640 1 -- 172.21.15.37:0/599425861 learned_addr learned my addr 172.21.15.37:0/599425861 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:50:05.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.149+0000 7fb96f7fe640 1 -- 172.21.15.37:0/599425861 >> v1:172.21.15.78:6789/0 conn(0x7fb970069f80 legacy=0x7fb970155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:05.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.149+0000 7fb96f7fe640 1 -- 172.21.15.37:0/599425861 >> v1:172.21.15.37:6789/0 conn(0x7fb97014aab0 legacy=0x7fb9700b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:05.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.149+0000 7fb96e7fc640 1 -- 172.21.15.37:0/599425861 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397681646 0 0) 0x7fb970070d30 con 0x7fb97014aab0 2023-12-19T17:50:05.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.149+0000 7fb96f7fe640 1 -- 172.21.15.37:0/599425861 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9700706e0 con 0x7fb970069ba0 2023-12-19T17:50:05.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.150+0000 7fb96f7fe640 1 --2- 172.21.15.37:0/599425861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb970069ba0 0x7fb9700711c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fb9600097a0 tx=0x7fb96002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2197d7d9e9595720 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:05.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.150+0000 7fb96e7fc640 1 -- 172.21.15.37:0/599425861 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96002f810 con 0x7fb970069ba0 2023-12-19T17:50:05.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.150+0000 7fb96e7fc640 1 -- 172.21.15.37:0/599425861 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96002f970 con 0x7fb970069ba0 2023-12-19T17:50:05.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.150+0000 7fb96e7fc640 1 -- 172.21.15.37:0/599425861 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96002fd00 con 0x7fb970069ba0 2023-12-19T17:50:05.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.151+0000 7fb975e15640 1 -- 172.21.15.37:0/599425861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb970069ba0 msgr2=0x7fb9700711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:05.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.151+0000 7fb975e15640 1 --2- 172.21.15.37:0/599425861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb970069ba0 0x7fb9700711c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fb9600097a0 tx=0x7fb96002b9f0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.151+0000 7fb975e15640 1 -- 172.21.15.37:0/599425861 shutdown_connections 2023-12-19T17:50:05.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.151+0000 7fb975e15640 1 --2- 172.21.15.37:0/599425861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb970069ba0 0x7fb9700711c0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.151+0000 7fb975e15640 1 -- 172.21.15.37:0/599425861 >> 172.21.15.37:0/599425861 conn(0x7fb9700b9c30 msgr2=0x7fb9700ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:05.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.151+0000 7fb975e15640 1 -- 172.21.15.37:0/599425861 shutdown_connections 2023-12-19T17:50:05.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.151+0000 7fb975e15640 1 -- 172.21.15.37:0/599425861 wait complete. 2023-12-19T17:50:05.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.152+0000 7fb975e15640 1 Processor -- start 2023-12-19T17:50:05.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.152+0000 7fb975e15640 1 -- start start 2023-12-19T17:50:05.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.153+0000 7fb975e15640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb970069ba0 0x7fb97014de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:05.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.153+0000 7fb975e15640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb970069f80 0x7fb9701dfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:05.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.153+0000 7fb975e15640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb97014aab0 0x7fb9701dffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:05.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.153+0000 7fb975e15640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97014e340 con 0x7fb97014aab0 2023-12-19T17:50:05.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.153+0000 7fb975e15640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97014ee70 con 0x7fb970069ba0 2023-12-19T17:50:05.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.153+0000 7fb975e15640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97014cfc0 con 0x7fb970069f80 2023-12-19T17:50:05.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.153+0000 7fb96ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb97014aab0 0x7fb9701dffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:05.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.153+0000 7fb96ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb97014aab0 0x7fb9701dffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46036/0 (socket says 172.21.15.37:46036) 2023-12-19T17:50:05.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.153+0000 7fb96ffff640 1 -- 172.21.15.37:0/690908969 learned_addr learned my addr 172.21.15.37:0/690908969 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:05.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.153+0000 7fb96f7fe640 1 --2- 172.21.15.37:0/690908969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb970069ba0 0x7fb97014de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:05.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.153+0000 7fb96effd640 1 --2- 172.21.15.37:0/690908969 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb970069f80 0x7fb9701dfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:05.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.153+0000 7fb96ffff640 1 -- 172.21.15.37:0/690908969 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb970069f80 msgr2=0x7fb9701dfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:05.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.153+0000 7fb96ffff640 1 --2- 172.21.15.37:0/690908969 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb970069f80 0x7fb9701dfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.153+0000 7fb96ffff640 1 -- 172.21.15.37:0/690908969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb970069ba0 msgr2=0x7fb97014de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:05.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.153+0000 7fb96ffff640 1 --2- 172.21.15.37:0/690908969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb970069ba0 0x7fb97014de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.153+0000 7fb96ffff640 1 -- 172.21.15.37:0/690908969 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb960009400 con 0x7fb97014aab0 2023-12-19T17:50:05.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.153+0000 7fb96ffff640 1 --2- 172.21.15.37:0/690908969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb97014aab0 0x7fb9701dffc0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fb96800c7a0 tx=0x7fb96800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:05.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.154+0000 7fb967fff640 1 -- 172.21.15.37:0/690908969 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb968003b70 con 0x7fb97014aab0 2023-12-19T17:50:05.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.154+0000 7fb967fff640 1 -- 172.21.15.37:0/690908969 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb968003cf0 con 0x7fb97014aab0 2023-12-19T17:50:05.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.154+0000 7fb975e15640 1 -- 172.21.15.37:0/690908969 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97014d1d0 con 0x7fb97014aab0 2023-12-19T17:50:05.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.154+0000 7fb967fff640 1 -- 172.21.15.37:0/690908969 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb968003ea0 con 0x7fb97014aab0 2023-12-19T17:50:05.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.154+0000 7fb975e15640 1 -- 172.21.15.37:0/690908969 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97014cda0 con 0x7fb97014aab0 2023-12-19T17:50:05.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.155+0000 7fb975e15640 1 -- 172.21.15.37:0/690908969 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97014c650 con 0x7fb97014aab0 2023-12-19T17:50:05.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.155+0000 7fb967fff640 1 -- 172.21.15.37:0/690908969 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb96800aa90 con 0x7fb97014aab0 2023-12-19T17:50:05.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.155+0000 7fb967fff640 1 --2- 172.21.15.37:0/690908969 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fb95006a430 0x7fb95006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:05.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.156+0000 7fb967fff640 1 -- 172.21.15.37:0/690908969 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb968088250 con 0x7fb97014aab0 2023-12-19T17:50:05.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.156+0000 7fb96f7fe640 1 --2- 172.21.15.37:0/690908969 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fb95006a430 0x7fb95006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:05.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.156+0000 7fb96f7fe640 1 --2- 172.21.15.37:0/690908969 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fb95006a430 0x7fb95006c8f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb960036000 tx=0x7fb960008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:05.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.160+0000 7fb967fff640 1 -- 172.21.15.37:0/690908969 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb968053c80 con 0x7fb97014aab0 2023-12-19T17:50:05.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.350+0000 7fb975e15640 1 -- 172.21.15.37:0/690908969 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9700709c0 con 0x7fb95006a430 2023-12-19T17:50:05.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.350+0000 7fb967fff640 1 -- 172.21.15.37:0/690908969 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb96003d040 con 0x7fb95006a430 2023-12-19T17:50:05.351 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 7 to deep-scrub 2023-12-19T17:50:05.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.352+0000 7fb975e15640 1 -- 172.21.15.37:0/690908969 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fb95006a430 msgr2=0x7fb95006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:05.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.352+0000 7fb975e15640 1 --2- 172.21.15.37:0/690908969 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fb95006a430 0x7fb95006c8f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb960036000 tx=0x7fb960008030 comp rx=0 tx=0).stop 2023-12-19T17:50:05.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.352+0000 7fb975e15640 1 -- 172.21.15.37:0/690908969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb97014aab0 msgr2=0x7fb9701dffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:05.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.352+0000 7fb975e15640 1 --2- 172.21.15.37:0/690908969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb97014aab0 0x7fb9701dffc0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fb96800c7a0 tx=0x7fb96800cc60 comp rx=0 tx=0).stop 2023-12-19T17:50:05.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.352+0000 7fb975e15640 1 -- 172.21.15.37:0/690908969 shutdown_connections 2023-12-19T17:50:05.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.352+0000 7fb975e15640 1 --2- 172.21.15.37:0/690908969 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fb95006a430 0x7fb95006c8f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.352+0000 7fb975e15640 1 --2- 172.21.15.37:0/690908969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb97014aab0 0x7fb9701dffc0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.352+0000 7fb975e15640 1 --2- 172.21.15.37:0/690908969 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb970069f80 0x7fb9701dfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.352+0000 7fb975e15640 1 --2- 172.21.15.37:0/690908969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb970069ba0 0x7fb97014de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.352+0000 7fb975e15640 1 -- 172.21.15.37:0/690908969 >> 172.21.15.37:0/690908969 conn(0x7fb9700b9c30 msgr2=0x7fb970148c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:05.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.352+0000 7fb975e15640 1 -- 172.21.15.37:0/690908969 shutdown_connections 2023-12-19T17:50:05.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.352+0000 7fb975e15640 1 -- 172.21.15.37:0/690908969 wait complete. 2023-12-19T17:50:05.364 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T17:50:05.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.471+0000 7fcea1cf7640 1 Processor -- start 2023-12-19T17:50:05.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.471+0000 7fcea1cf7640 1 -- start start 2023-12-19T17:50:05.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.472+0000 7fcea1cf7640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce9c069ba0 0x7fce9c0711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:05.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.472+0000 7fcea1cf7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fce9c14aab0 0x7fce9c0b6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:05.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.472+0000 7fcea1cf7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fce9c069f80 0x7fce9c14dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:05.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.472+0000 7fcea1cf7640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9c070d30 con 0x7fce9c069f80 2023-12-19T17:50:05.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.472+0000 7fcea1cf7640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9c071720 con 0x7fce9c14aab0 2023-12-19T17:50:05.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.472+0000 7fcea1cf7640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c0706e0 con 0x7fce9c069ba0 2023-12-19T17:50:05.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.472+0000 7fce9bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fce9c069f80 0x7fce9c14dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:05.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.472+0000 7fce9bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fce9c069f80 0x7fce9c14dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46048/0 (socket says 172.21.15.37:46048) 2023-12-19T17:50:05.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.472+0000 7fce9bfff640 1 -- 172.21.15.37:0/4095648734 learned_addr learned my addr 172.21.15.37:0/4095648734 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:05.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.472+0000 7fce9affd640 1 --2- 172.21.15.37:0/4095648734 >> v2:172.21.15.78:3300/0 conn(0x7fce9c14aab0 0x7fce9c0b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:05.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.472+0000 7fce9b7fe640 1 --2- 172.21.15.37:0/4095648734 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce9c069ba0 0x7fce9c0711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:05.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.472+0000 7fce9bfff640 1 -- 172.21.15.37:0/4095648734 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce9c069ba0 msgr2=0x7fce9c0711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:05.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.472+0000 7fce9bfff640 1 --2- 172.21.15.37:0/4095648734 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce9c069ba0 0x7fce9c0711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.472+0000 7fce9bfff640 1 -- 172.21.15.37:0/4095648734 >> v2:172.21.15.78:3300/0 conn(0x7fce9c14aab0 msgr2=0x7fce9c0b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:05.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.472+0000 7fce9bfff640 1 --2- 172.21.15.37:0/4095648734 >> v2:172.21.15.78:3300/0 conn(0x7fce9c14aab0 0x7fce9c0b6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.472+0000 7fce9bfff640 1 -- 172.21.15.37:0/4095648734 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c0709c0 con 0x7fce9c069f80 2023-12-19T17:50:05.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.473+0000 7fce9bfff640 1 --2- 172.21.15.37:0/4095648734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce9c069f80 0x7fce9c14dff0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0b9300 tx=0x7fce9402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f303048cca50a66 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:05.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.473+0000 7fce9a7fc640 1 -- 172.21.15.37:0/4095648734 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9402cb00 con 0x7fce9c069f80 2023-12-19T17:50:05.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.473+0000 7fce9a7fc640 1 -- 172.21.15.37:0/4095648734 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9402cc60 con 0x7fce9c069f80 2023-12-19T17:50:05.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.473+0000 7fce9a7fc640 1 -- 172.21.15.37:0/4095648734 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce940343f0 con 0x7fce9c069f80 2023-12-19T17:50:05.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.474+0000 7fcea1cf7640 1 -- 172.21.15.37:0/4095648734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce9c069f80 msgr2=0x7fce9c14dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:05.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.474+0000 7fcea1cf7640 1 --2- 172.21.15.37:0/4095648734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce9c069f80 0x7fce9c14dff0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0b9300 tx=0x7fce9402bf60 comp rx=0 tx=0).stop 2023-12-19T17:50:05.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.474+0000 7fcea1cf7640 1 -- 172.21.15.37:0/4095648734 shutdown_connections 2023-12-19T17:50:05.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.474+0000 7fcea1cf7640 1 --2- 172.21.15.37:0/4095648734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce9c069f80 0x7fce9c14dff0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.474+0000 7fcea1cf7640 1 --2- 172.21.15.37:0/4095648734 >> v2:172.21.15.78:3300/0 conn(0x7fce9c14aab0 0x7fce9c0b6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.474+0000 7fcea1cf7640 1 --2- 172.21.15.37:0/4095648734 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce9c069ba0 0x7fce9c0711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.474+0000 7fcea1cf7640 1 -- 172.21.15.37:0/4095648734 >> 172.21.15.37:0/4095648734 conn(0x7fce9c0b9c30 msgr2=0x7fce9c0ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:05.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.474+0000 7fcea1cf7640 1 -- 172.21.15.37:0/4095648734 shutdown_connections 2023-12-19T17:50:05.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.474+0000 7fcea1cf7640 1 -- 172.21.15.37:0/4095648734 wait complete. 2023-12-19T17:50:05.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.475+0000 7fcea1cf7640 1 Processor -- start 2023-12-19T17:50:05.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.475+0000 7fcea1cf7640 1 -- start start 2023-12-19T17:50:05.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.476+0000 7fcea1cf7640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce9c069ba0 0x7fce9c0b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:05.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.476+0000 7fcea1cf7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce9c069f80 0x7fce9c14d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:05.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.476+0000 7fcea1cf7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce9c14aab0 0x7fce9c14dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:05.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.476+0000 7fcea1cf7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c14eb40 con 0x7fce9c069f80 2023-12-19T17:50:05.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.476+0000 7fcea1cf7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c0b5720 con 0x7fce9c14aab0 2023-12-19T17:50:05.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.476+0000 7fcea1cf7640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c14c790 con 0x7fce9c069ba0 2023-12-19T17:50:05.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.476+0000 7fce9affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce9c069f80 0x7fce9c14d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:05.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.476+0000 7fce9affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce9c069f80 0x7fce9c14d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46060/0 (socket says 172.21.15.37:46060) 2023-12-19T17:50:05.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.476+0000 7fce9affd640 1 -- 172.21.15.37:0/4118165198 learned_addr learned my addr 172.21.15.37:0/4118165198 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:05.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.476+0000 7fce9b7fe640 1 --2- 172.21.15.37:0/4118165198 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce9c069ba0 0x7fce9c0b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:05.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.476+0000 7fce9bfff640 1 --2- 172.21.15.37:0/4118165198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce9c14aab0 0x7fce9c14dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:05.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.476+0000 7fce9affd640 1 -- 172.21.15.37:0/4118165198 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce9c069ba0 msgr2=0x7fce9c0b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:05.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.476+0000 7fce9affd640 1 --2- 172.21.15.37:0/4118165198 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce9c069ba0 0x7fce9c0b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.476+0000 7fce9affd640 1 -- 172.21.15.37:0/4118165198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce9c14aab0 msgr2=0x7fce9c14dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:05.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.476+0000 7fce9affd640 1 --2- 172.21.15.37:0/4118165198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce9c14aab0 0x7fce9c14dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.476+0000 7fce9affd640 1 -- 172.21.15.37:0/4118165198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce94009b30 con 0x7fce9c069f80 2023-12-19T17:50:05.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.476+0000 7fce9b7fe640 1 --2- 172.21.15.37:0/4118165198 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce9c069ba0 0x7fce9c0b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:50:05.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.476+0000 7fce9affd640 1 --2- 172.21.15.37:0/4118165198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce9c069f80 0x7fce9c14d810 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00e9b0 tx=0x7fce8c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:05.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.477+0000 7fce93fff640 1 -- 172.21.15.37:0/4118165198 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c009670 con 0x7fce9c069f80 2023-12-19T17:50:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.477+0000 7fce93fff640 1 -- 172.21.15.37:0/4118165198 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8c00c9a0 con 0x7fce9c069f80 2023-12-19T17:50:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.477+0000 7fcea1cf7640 1 -- 172.21.15.37:0/4118165198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9c14bfa0 con 0x7fce9c069f80 2023-12-19T17:50:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.477+0000 7fce93fff640 1 -- 172.21.15.37:0/4118165198 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c00cd50 con 0x7fce9c069f80 2023-12-19T17:50:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.477+0000 7fcea1cf7640 1 -- 172.21.15.37:0/4118165198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9c14d3f0 con 0x7fce9c069f80 2023-12-19T17:50:05.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.478+0000 7fcea1cf7640 1 -- 172.21.15.37:0/4118165198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9c04e840 con 0x7fce9c069f80 2023-12-19T17:50:05.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.478+0000 7fce93fff640 1 -- 172.21.15.37:0/4118165198 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fce8c013470 con 0x7fce9c069f80 2023-12-19T17:50:05.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.479+0000 7fce93fff640 1 --2- 172.21.15.37:0/4118165198 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fce7c06a460 0x7fce7c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:05.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.479+0000 7fce93fff640 1 -- 172.21.15.37:0/4118165198 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fce8c088830 con 0x7fce9c069f80 2023-12-19T17:50:05.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.479+0000 7fce9b7fe640 1 --2- 172.21.15.37:0/4118165198 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fce7c06a460 0x7fce7c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:05.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.479+0000 7fce9b7fe640 1 --2- 172.21.15.37:0/4118165198 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fce7c06a460 0x7fce7c06c920 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fce84009a70 tx=0x7fce84008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:05.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.483+0000 7fce93fff640 1 -- 172.21.15.37:0/4118165198 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fce8c054120 con 0x7fce9c069f80 2023-12-19T17:50:05.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.655+0000 7fcea1cf7640 1 -- 172.21.15.37:0/4118165198 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce9c071a00 con 0x7fce7c06a460 2023-12-19T17:50:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.658+0000 7fce93fff640 1 -- 172.21.15.37:0/4118165198 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50668 (secure 0 0 0) 0x7fce840119a0 con 0x7fce7c06a460 2023-12-19T17:50:05.659 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T17:50:05.660 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-19T17:50:05.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.660+0000 7fcea1cf7640 1 -- 172.21.15.37:0/4118165198 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fce7c06a460 msgr2=0x7fce7c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:05.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.660+0000 7fcea1cf7640 1 --2- 172.21.15.37:0/4118165198 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fce7c06a460 0x7fce7c06c920 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fce84009a70 tx=0x7fce84008040 comp rx=0 tx=0).stop 2023-12-19T17:50:05.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.660+0000 7fcea1cf7640 1 -- 172.21.15.37:0/4118165198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce9c069f80 msgr2=0x7fce9c14d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:05.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.660+0000 7fcea1cf7640 1 --2- 172.21.15.37:0/4118165198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce9c069f80 0x7fce9c14d810 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00e9b0 tx=0x7fce8c00ee70 comp rx=0 tx=0).stop 2023-12-19T17:50:05.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.660+0000 7fcea1cf7640 1 -- 172.21.15.37:0/4118165198 shutdown_connections 2023-12-19T17:50:05.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.660+0000 7fcea1cf7640 1 --2- 172.21.15.37:0/4118165198 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fce7c06a460 0x7fce7c06c920 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.660+0000 7fcea1cf7640 1 --2- 172.21.15.37:0/4118165198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce9c14aab0 0x7fce9c14dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.660+0000 7fcea1cf7640 1 --2- 172.21.15.37:0/4118165198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce9c069f80 0x7fce9c14d810 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.660+0000 7fcea1cf7640 1 --2- 172.21.15.37:0/4118165198 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fce9c069ba0 0x7fce9c0b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:05.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.660+0000 7fcea1cf7640 1 -- 172.21.15.37:0/4118165198 >> 172.21.15.37:0/4118165198 conn(0x7fce9c0b9c30 msgr2=0x7fce9c0b81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:05.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.660+0000 7fcea1cf7640 1 -- 172.21.15.37:0/4118165198 shutdown_connections 2023-12-19T17:50:05.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:05.660+0000 7fcea1cf7640 1 -- 172.21.15.37:0/4118165198 wait complete. 2023-12-19T17:50:05.671 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":3125,"stamp":"2023-12-19T17:50:04.138387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":7672200,"kb_used_data":4232,"kb_used_omap":625,"kb_used_meta":7667278,"kb_avail":747302520,"statfs":{"total":773094113280,"available":765237780480,"internally_reserved":0,"allocated":4333568,"data_stored":2396024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":640065,"internal_metadata":7851293631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":210,"apply_latency_ms":210,"commit_latency_ns":210000000,"apply_latency_ns":210000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-754628659,"num_objects":-1361,"num_object_clones":0,"num_object_copies":-2722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1361,"num_whiteouts":0,"num_read":-66376,"num_read_kb":-54118090,"num_write":-2163525,"num_write_kb":-61026211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001493"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":229,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T17:49:57.521892+0000","last_change":"2023-12-19T16:06:47.761389+0000","last_active":"2023-12-19T17:49:57.521892+0000","last_peered":"2023-12-19T17:49:57.521892+0000","last_clean":"2023-12-19T17:49:57.521892+0000","last_became_active":"2023-12-19T16:06:47.760252+0000","last_became_peered":"2023-12-19T16:06:47.760252+0000","last_unstale":"2023-12-19T17:49:57.521892+0000","last_undegraded":"2023-12-19T17:49:57.521892+0000","last_fullsized":"2023-12-19T17:49:57.521892+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:06:46.706871+0000","last_clean_scrub_stamp":"2023-12-19T16:06:46.706871+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:54:09.167979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576087,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":775756,"kb_used_data":964,"kb_used_omap":67,"kb_used_meta":774716,"kb_avail":93596084,"statfs":{"total":96636764160,"available":95842390016,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68753,"internal_metadata":793310063},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.46200000000000002,"15min":0.57399999999999995},"min":{"1min":0.29999999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.61299999999999999,"5min":0.70099999999999996,"15min":19.341000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.47099999999999997,"15min":0.52200000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.255},"max":{"1min":0.46700000000000003,"5min":0.78800000000000003,"15min":5.524},"last":0.379}]},{"osd":1,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.46400000000000002,"15min":0.59899999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":18.707999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.497,"15min":0.65500000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28499999999999998},"max":{"1min":0.60399999999999998,"5min":0.72899999999999998,"15min":18.146999999999998},"last":0.44700000000000001}]},{"osd":2,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.497,"15min":0.58799999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.64800000000000002,"5min":0.76300000000000001,"15min":19.300999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51800000000000002,"15min":0.55100000000000005},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.751,"5min":0.81799999999999995,"15min":5.1699999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.55800000000000005,"15min":0.57699999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.29999999999999999},"max":{"1min":3.9630000000000001,"5min":3.9630000000000001,"15min":10.005000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.56100000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":5.8209999999999997},"last":0.54800000000000004}]},{"osd":4,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.58599999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.22500000000000001},"max":{"1min":1.044,"5min":1.044,"15min":16.125},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51700000000000002,"15min":0.56000000000000005},"min":{"1min":0.31,"5min":0.30499999999999999,"15min":0.247},"max":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":9.9659999999999993},"last":0.627}]},{"osd":5,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.498,"15min":0.61799999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28299999999999997},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":36.665999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.55600000000000005,"15min":0.66100000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.31},"max":{"1min":0.69399999999999995,"5min":0.78300000000000003,"15min":19.366},"last":0.58999999999999997}]},{"osd":6,"last update":"Tue Dec 19 17:49:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57999999999999996,"15min":0.67500000000000004},"min":{"1min":0.39200000000000002,"5min":0.36799999999999999,"15min":0.33000000000000002},"max":{"1min":0.751,"5min":0.80400000000000005,"15min":22.800000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57299999999999995,"15min":0.60099999999999998},"min":{"1min":0.38700000000000001,"5min":0.35999999999999999,"15min":0.33500000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":5.1120000000000001},"last":0.66200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834576090,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1516040,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":1515648,"kb_avail":92855800,"statfs":{"total":96636764160,"available":95084339200,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1552023552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.58499999999999996,"15min":0.54500000000000004},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":9.5589999999999993,"5min":9.5589999999999993,"15min":10.109},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.88,"5min":0.59899999999999998,"15min":0.56299999999999994},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":9.6069999999999993,"5min":9.6069999999999993,"15min":10.172000000000001},"last":0.36699999999999999}]},{"osd":1,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.58599999999999997,"15min":0.51400000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27100000000000002},"max":{"1min":8.0579999999999998,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.52500000000000002,"15min":0.51500000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27500000000000002},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.35699999999999998}]},{"osd":2,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":9.5830000000000002,"5min":9.5830000000000002,"15min":18.135000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.61099999999999999,"15min":0.55600000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.316},"max":{"1min":7.069,"5min":7.069,"15min":7.069},"last":0.34000000000000002}]},{"osd":3,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56000000000000005,"15min":0.54100000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":3.3519999999999999,"5min":3.3519999999999999,"15min":3.3519999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.64700000000000002,"15min":0.59399999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":9.6289999999999996,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.435}]},{"osd":4,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.252},"max":{"1min":3.3900000000000001,"5min":3.3900000000000001,"15min":8.4309999999999992},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.26100000000000001},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":10.231},"last":0.52300000000000002}]},{"osd":5,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":3.2959999999999998,"5min":3.2959999999999998,"15min":10.198},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59899999999999998,"15min":0.56100000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":0.50800000000000001}]},{"osd":7,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.27,"5min":3.27,"15min":10.257999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.68100000000000005,"15min":0.61799999999999999},"min":{"1min":0.32300000000000001,"5min":0.315,"15min":0.30299999999999999},"max":{"1min":9.5039999999999996,"5min":9.5039999999999996,"15min":9.5039999999999996},"last":0.48499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834576088,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":372488,"kb_used_data":384,"kb_used_omap":7,"kb_used_meta":372088,"kb_avail":93999352,"statfs":{"total":96636764160,"available":96255336448,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7169,"internal_metadata":381019135},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":5.0069999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":8.5549999999999997},"last":0.5}]},{"osd":1,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.55100000000000005},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":2.7919999999999998,"5min":2.7919999999999998,"15min":16.27},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.872,"5min":0.58199999999999996,"15min":0.54400000000000004},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":6.2670000000000003,"5min":6.2670000000000003,"15min":6.2670000000000003},"last":0.45900000000000002}]},{"osd":2,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.56399999999999995,"15min":0.629},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.0049999999999999,"5min":4.0049999999999999,"15min":21.789000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.58699999999999997,"15min":0.65300000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":16.474},"last":0.47999999999999998}]},{"osd":3,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.59399999999999997,"15min":0.623},"min":{"1min":0.38600000000000001,"5min":0.34899999999999998,"15min":0.32100000000000001},"max":{"1min":3.8929999999999998,"5min":3.8929999999999998,"15min":12.544},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.54100000000000004,"15min":0.58799999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":4.8739999999999997},"last":0.621}]},{"osd":4,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.49199999999999999,"15min":0.56399999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.22},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":19.652000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56899999999999995,"15min":0.67800000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.252},"max":{"1min":2.589,"5min":2.589,"15min":26.648},"last":0.58199999999999996}]},{"osd":6,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.51400000000000001,"15min":0.55300000000000005},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26300000000000001},"max":{"1min":0.627,"5min":0.746,"15min":5.9119999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.54400000000000004,"15min":0.56000000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.25800000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":2.2130000000000001},"last":0.60099999999999998}]},{"osd":7,"last update":"Tue Dec 19 17:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.60899999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.27100000000000002},"max":{"1min":2.5659999999999998,"5min":2.5659999999999998,"15min":8.7360000000000007},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.57799999999999996,"15min":0.64900000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.30299999999999999},"max":{"1min":0.69399999999999995,"5min":0.79200000000000004,"15min":16.315000000000001},"last":0.65400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834576089,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":581576,"kb_used_data":384,"kb_used_omap":9,"kb_used_meta":581174,"kb_avail":93790264,"statfs":{"total":96636764160,"available":96041230336,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9755,"internal_metadata":595122661},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.53800000000000003,"15min":0.53000000000000003},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":6.5389999999999997,"5min":6.5389999999999997,"15min":6.5389999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.54800000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.246},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":4.657},"last":0.55100000000000005}]},{"osd":1,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.56599999999999995,"15min":0.54300000000000004},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.6970000000000001,"5min":6.6970000000000001,"15min":6.6970000000000001},"last":0.379},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48699999999999999,"15min":0.51400000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.722,"5min":1.722,"15min":4.4809999999999999},"last":0.435}]},{"osd":2,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.50800000000000001,"15min":0.53700000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.379,"5min":2.379,"15min":8.3729999999999993},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.52000000000000002,"15min":0.56299999999999994},"min":{"1min":0.32300000000000001,"5min":0.318,"15min":0.28899999999999998},"max":{"1min":0.64400000000000002,"5min":0.73599999999999999,"15min":8.3840000000000003},"last":0.502}]},{"osd":3,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":4.548},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.61099999999999999,"15min":0.58999999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":4.3440000000000003,"5min":4.3440000000000003,"15min":4.7850000000000001},"last":0.44600000000000001}]},{"osd":5,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.48499999999999999,"15min":0.54400000000000004},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66100000000000003,"5min":0.78200000000000003,"15min":14.387},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.50800000000000001,"15min":0.55500000000000005},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.68799999999999994,"5min":0.85499999999999998,"15min":14.430999999999999},"last":0.36199999999999999}]},{"osd":6,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.51300000000000001,"15min":0.52300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.63200000000000001,"5min":0.77000000000000002,"15min":4.399},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.54900000000000004,"15min":0.56999999999999995},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68500000000000005,"5min":0.82099999999999995,"15min":4.5910000000000002},"last":0.53200000000000003}]},{"osd":7,"last update":"Tue Dec 19 17:49:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.55100000000000005,"15min":0.57699999999999996},"min":{"1min":0.32700000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63700000000000001,"5min":0.89300000000000002,"15min":8.5139999999999993},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.59099999999999997,"15min":0.61299999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66900000000000004,"5min":0.83399999999999996,"15min":6.4169999999999998},"last":0.47899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834576086,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":644296,"kb_used_data":384,"kb_used_omap":71,"kb_used_meta":643832,"kb_avail":93727544,"statfs":{"total":96636764160,"available":95977005056,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":72831,"internal_metadata":659284865},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.39000000000000001,"15min":0.41499999999999998},"min":{"1min":0.224,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":4.7350000000000003,"5min":4.7350000000000003,"15min":11.298},"last":0.248},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.40699999999999997,"15min":0.39700000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":3.657,"5min":3.657,"15min":10.164999999999999},"last":0.26900000000000002}]},{"osd":1,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.42499999999999999,"15min":0.40600000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":5.6100000000000003,"5min":5.6100000000000003,"15min":5.6100000000000003},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.26300000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":3.899,"5min":3.899,"15min":8.8879999999999999},"last":0.28799999999999998}]},{"osd":2,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.45000000000000001,"15min":0.42099999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25700000000000001},"max":{"1min":4.8460000000000001,"5min":4.8460000000000001,"15min":5.4870000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.435,"15min":0.46500000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":8.8079999999999998},"last":0.34200000000000003}]},{"osd":4,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.65100000000000002,"15min":0.63},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.6899999999999999,"5min":3.6899999999999999,"15min":3.702},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.66100000000000003,"15min":0.624},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.29999999999999999},"max":{"1min":4.8799999999999999,"5min":4.8799999999999999,"15min":4.8799999999999999},"last":0.69799999999999995}]},{"osd":5,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.63100000000000001,"15min":0.65000000000000002},"min":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":4.4880000000000004,"5min":4.4880000000000004,"15min":5.5199999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.67400000000000004,"15min":0.64600000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":4.3630000000000004,"5min":4.3630000000000004,"15min":4.3630000000000004},"last":0.54000000000000004}]},{"osd":6,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.67900000000000005,"15min":0.63600000000000001},"min":{"1min":0.41899999999999998,"5min":0.40500000000000003,"15min":0.33000000000000002},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.64200000000000002,"15min":0.68799999999999994},"min":{"1min":0.45500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":3.46,"5min":3.46,"15min":11.099},"last":0.65600000000000003}]},{"osd":7,"last update":"Tue Dec 19 17:49:15 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":3.7400000000000002,"5min":3.7400000000000002,"15min":3.7669999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.70499999999999996,"15min":0.67100000000000004},"min":{"1min":0.47099999999999997,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":4.9219999999999997,"5min":4.9219999999999997,"15min":4.9219999999999997},"last":0.73899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834576089,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1555912,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":1555520,"kb_avail":92815928,"statfs":{"total":96636764160,"available":95043510272,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1592852480},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.223,"5min":0.20200000000000001,"15min":0.185},"max":{"1min":8.9529999999999994,"5min":8.9529999999999994,"15min":17.652999999999999},"last":0.44},{"interface":"front","average":{"1min":1.139,"5min":0.48999999999999999,"15min":0.54600000000000004},"min":{"1min":0.23300000000000001,"5min":0.218,"15min":0.155},"max":{"1min":9.8699999999999992,"5min":9.8699999999999992,"15min":22.620000000000001},"last":0.34399999999999997}]},{"osd":1,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":1.47,"5min":0.56699999999999995,"15min":0.61099999999999999},"min":{"1min":0.26200000000000001,"5min":0.22900000000000001,"15min":0.20899999999999999},"max":{"1min":11.515000000000001,"5min":11.515000000000001,"15min":23.327999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":2.9209999999999998,"5min":0.86899999999999999,"15min":0.68100000000000005},"min":{"1min":0.254,"5min":0.247,"15min":0.23899999999999999},"max":{"1min":30.975000000000001,"5min":30.975000000000001,"15min":30.975000000000001},"last":0.39800000000000002}]},{"osd":3,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.46999999999999997,"15min":0.57199999999999995},"min":{"1min":0.318,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":5.6280000000000001,"5min":5.6280000000000001,"15min":33.106000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":1.847,"5min":0.68799999999999994,"15min":0.69799999999999995},"min":{"1min":0.32000000000000001,"5min":0.28399999999999997,"15min":0.221},"max":{"1min":10.458,"5min":10.458,"15min":22.576000000000001},"last":0.56599999999999995}]},{"osd":4,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":0.73799999999999999,"15min":0.82499999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.34300000000000003},"max":{"1min":9.0350000000000001,"5min":9.0350000000000001,"15min":27.885999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.64800000000000002,"15min":0.80100000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.309},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":39.417000000000002},"last":0.58199999999999996}]},{"osd":5,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.68999999999999995,"15min":0.73999999999999999},"min":{"1min":0.45400000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.6989999999999998,"5min":5.6989999999999998,"15min":23.238},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.5089999999999999,"5min":0.77500000000000002,"15min":0.66900000000000004},"min":{"1min":0.41799999999999998,"5min":0.40899999999999997,"15min":0.379},"max":{"1min":9.0920000000000005,"5min":9.0920000000000005,"15min":9.0920000000000005},"last":0.52900000000000003}]},{"osd":6,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.625,"15min":0.69399999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":22.675999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.71299999999999997,"15min":0.76900000000000002},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":5.6689999999999996,"5min":5.6689999999999996,"15min":23.164999999999999},"last":0.626}]},{"osd":7,"last update":"Tue Dec 19 17:49:03 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.66000000000000003,"15min":0.73099999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":3.3980000000000001,"5min":3.3980000000000001,"15min":22.824999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":1.0669999999999999,"5min":0.72899999999999998,"15min":0.76700000000000002},"min":{"1min":0.50700000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":5.726,"5min":5.726,"15min":23.207999999999998},"last":0.69299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834576088,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":831816,"kb_used_data":384,"kb_used_omap":470,"kb_used_meta":830953,"kb_avail":93540024,"statfs":{"total":96636764160,"available":95784984576,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":481557,"internal_metadata":850896619},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:50:00 2023","interfaces":[{"interface":"back","average":{"1min":2.0049999999999999,"5min":0.67400000000000004,"15min":0.48499999999999999},"min":{"1min":0.223,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":37.258000000000003,"5min":37.258000000000003,"15min":37.258000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.41199999999999998,"15min":0.39800000000000002},"min":{"1min":0.23000000000000001,"5min":0.22,"15min":0.22},"max":{"1min":6.8129999999999997,"5min":6.8129999999999997,"15min":6.8129999999999997},"last":0.315}]},{"osd":2,"last update":"Tue Dec 19 17:50:00 2023","interfaces":[{"interface":"back","average":{"1min":2.9060000000000001,"5min":0.84799999999999998,"15min":0.51600000000000001},"min":{"1min":0.24299999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":32.451000000000001,"5min":32.451000000000001,"15min":32.451000000000001},"last":0.375},{"interface":"front","average":{"1min":2.371,"5min":0.80800000000000005,"15min":0.56899999999999995},"min":{"1min":0.28599999999999998,"5min":0.254,"15min":0.21099999999999999},"max":{"1min":32.259999999999998,"5min":32.259999999999998,"15min":32.259999999999998},"last":0.39100000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.53700000000000003,"15min":0.499},"min":{"1min":0.28100000000000003,"5min":0.23300000000000001,"15min":0.221},"max":{"1min":12.459,"5min":12.459,"15min":13.153},"last":0.43099999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.53300000000000003,"15min":0.49399999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.216},"max":{"1min":10.327,"5min":10.327,"15min":10.327},"last":0.45100000000000001}]},{"osd":4,"last update":"Tue Dec 19 17:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.65900000000000003,"15min":0.60199999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":12.215,"5min":12.215,"15min":12.215},"last":0.44400000000000001},{"interface":"front","average":{"1min":1.145,"5min":0.73899999999999999,"15min":0.65600000000000003},"min":{"1min":0.375,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":12.499000000000001,"5min":12.499000000000001,"15min":12.499000000000001},"last":0.56000000000000005}]},{"osd":5,"last update":"Tue Dec 19 17:50:00 2023","interfaces":[{"interface":"back","average":{"1min":2.9889999999999999,"5min":1.0960000000000001,"15min":0.82599999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.36099999999999999},"max":{"1min":56.218000000000004,"5min":56.218000000000004,"15min":56.218000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.0920000000000001,"5min":0.71199999999999997,"15min":0.67500000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.35499999999999998},"max":{"1min":13.134,"5min":13.134,"15min":13.134},"last":0.46800000000000003}]},{"osd":6,"last update":"Tue Dec 19 17:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.67100000000000004,"15min":0.65800000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.35799999999999998},"max":{"1min":6.8460000000000001,"5min":6.8460000000000001,"15min":11.055},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.01,"5min":0.69599999999999995,"15min":0.64200000000000002},"min":{"1min":0.41499999999999998,"5min":0.379,"15min":0.379},"max":{"1min":12.167999999999999,"5min":12.167999999999999,"15min":12.167999999999999},"last":0.48599999999999999}]},{"osd":7,"last update":"Tue Dec 19 17:50:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":0.80300000000000005,"15min":0.70499999999999996},"min":{"1min":0.38200000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":12.226000000000001,"5min":12.226000000000001,"15min":12.226000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.67900000000000005,"15min":0.66800000000000004},"min":{"1min":0.39600000000000002,"5min":0.38100000000000001,"15min":0.36499999999999999},"max":{"1min":6.9029999999999996,"5min":6.9029999999999996,"15min":6.9029999999999996},"last":0.61699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834576090,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1394316,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":1393344,"kb_avail":92977524,"statfs":{"total":96636764160,"available":95208984576,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1426784256},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.40899999999999997,"15min":0.44500000000000001},"min":{"1min":0.21299999999999999,"5min":0.19400000000000001,"15min":0.189},"max":{"1min":5.351,"5min":5.351,"15min":22.059000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.47499999999999998,"15min":0.42899999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":6.4269999999999996,"5min":6.4269999999999996,"15min":6.4269999999999996},"last":0.40300000000000002}]},{"osd":2,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.432,"15min":0.495},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23000000000000001},"max":{"1min":5.3739999999999997,"5min":5.3739999999999997,"15min":17.870999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":1.016,"5min":0.47699999999999998,"15min":0.41899999999999998},"min":{"1min":0.23599999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":6.3419999999999996,"5min":6.3419999999999996,"15min":6.3419999999999996},"last":0.33500000000000002}]},{"osd":3,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.40699999999999997,"15min":0.46800000000000003},"min":{"1min":0.23499999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":10.585000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.4670000000000001,"5min":0.60799999999999998,"15min":0.50900000000000001},"min":{"1min":0.29599999999999999,"5min":0.29099999999999998,"15min":0.27800000000000002},"max":{"1min":9.5139999999999993,"5min":9.5139999999999993,"15min":11.077},"last":0.54500000000000004}]},{"osd":4,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":0.68799999999999994,"15min":0.67500000000000004},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":6.4889999999999999,"5min":6.4889999999999999,"15min":6.4889999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.58699999999999997,"15min":0.63400000000000001},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.28699999999999998},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":6.1669999999999998},"last":0.63300000000000001}]},{"osd":5,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.58399999999999996,"15min":0.64200000000000002},"min":{"1min":0.379,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":9.8019999999999996},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40200000000000002},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.4080000000000004},"last":0.66300000000000003}]},{"osd":6,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":5.2990000000000004,"5min":5.2990000000000004,"15min":5.2990000000000004},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.1319999999999999,"5min":0.69699999999999995,"15min":0.65800000000000003},"min":{"1min":0.432,"5min":0.41699999999999998,"15min":0.36199999999999999},"max":{"1min":6.3860000000000001,"5min":6.3860000000000001,"15min":6.3860000000000001},"last":0.70199999999999996}]},{"osd":7,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":0.71999999999999997,"15min":0.78600000000000003},"min":{"1min":0.45000000000000001,"5min":0.42999999999999999,"15min":0.38700000000000001},"max":{"1min":6.4619999999999997,"5min":6.4619999999999997,"15min":31.004999999999999},"last":0.746},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.59999999999999998,"15min":0.71799999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":27.370999999999999},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T17:50:05.675 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-19T16:06:46.706871+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=16, tm_min=6, tm_sec=46, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=17, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T17:50:05.675 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-19T17:50:25.676 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T17:50:25.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.795+0000 7fbd853f0640 1 Processor -- start 2023-12-19T17:50:25.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.795+0000 7fbd853f0640 1 -- start start 2023-12-19T17:50:25.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.796+0000 7fbd853f0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbd800bcdd0 0x7fbd800b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:25.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.796+0000 7fbd853f0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd800bc6b0 con 0x7fbd80144ea0 2023-12-19T17:50:25.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.796+0000 7fbd853f0640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd800b6900 con 0x7fbd800b64c0 2023-12-19T17:50:25.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.796+0000 7fbd853f0640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd800a59f0 con 0x7fbd800bcdd0 2023-12-19T17:50:25.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.796+0000 7fbd7f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbd80144ea0 0x7fbd80155340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38098/0 (socket says 172.21.15.37:38098) 2023-12-19T17:50:25.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.796+0000 7fbd7f7fe640 1 -- 172.21.15.37:0/1703501593 learned_addr learned my addr 172.21.15.37:0/1703501593 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:50:25.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.796+0000 7fbd7effd640 1 --2- 172.21.15.37:0/1703501593 >> v2:172.21.15.78:3300/0 conn(0x7fbd800bcdd0 0x7fbd800b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:25.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.796+0000 7fbd7e7fc640 1 -- 172.21.15.37:0/1703501593 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2352204715 0 0) 0x7fbd800bc6b0 con 0x7fbd80144ea0 2023-12-19T17:50:25.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.796+0000 7fbd7e7fc640 1 -- 172.21.15.37:0/1703501593 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd6c003520 con 0x7fbd80144ea0 2023-12-19T17:50:25.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.796+0000 7fbd7e7fc640 1 -- 172.21.15.37:0/1703501593 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683942408 0 0) 0x7fbd800b6900 con 0x7fbd800b64c0 2023-12-19T17:50:25.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.796+0000 7fbd7e7fc640 1 -- 172.21.15.37:0/1703501593 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd800bc6b0 con 0x7fbd800b64c0 2023-12-19T17:50:25.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.796+0000 7fbd7effd640 1 -- 172.21.15.37:0/1703501593 >> v1:172.21.15.78:6789/0 conn(0x7fbd800b64c0 legacy=0x7fbd80144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:25.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.796+0000 7fbd7e7fc640 1 -- 172.21.15.37:0/1703501593 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1445864811 0 0) 0x7fbd6c003520 con 0x7fbd80144ea0 2023-12-19T17:50:25.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.796+0000 7fbd7effd640 1 -- 172.21.15.37:0/1703501593 >> v1:172.21.15.37:6789/0 conn(0x7fbd80144ea0 legacy=0x7fbd80155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:25.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.796+0000 7fbd7effd640 1 -- 172.21.15.37:0/1703501593 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd800bc0a0 con 0x7fbd800bcdd0 2023-12-19T17:50:25.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.797+0000 7fbd7effd640 1 --2- 172.21.15.37:0/1703501593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd800bcdd0 0x7fbd800b5f80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbd700097a0 tx=0x7fbd7002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=312e18d94e0b311e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:25.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.797+0000 7fbd7e7fc640 1 -- 172.21.15.37:0/1703501593 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd780019f0 con 0x7fbd800bcdd0 2023-12-19T17:50:25.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.797+0000 7fbd7e7fc640 1 -- 172.21.15.37:0/1703501593 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd70031590 con 0x7fbd800bcdd0 2023-12-19T17:50:25.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.797+0000 7fbd7e7fc640 1 -- 172.21.15.37:0/1703501593 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70031920 con 0x7fbd800bcdd0 2023-12-19T17:50:25.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.798+0000 7fbd853f0640 1 -- 172.21.15.37:0/1703501593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd800bcdd0 msgr2=0x7fbd800b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:25.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.798+0000 7fbd853f0640 1 --2- 172.21.15.37:0/1703501593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd800bcdd0 0x7fbd800b5f80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbd700097a0 tx=0x7fbd7002b8b0 comp rx=0 tx=0).stop 2023-12-19T17:50:25.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.798+0000 7fbd853f0640 1 -- 172.21.15.37:0/1703501593 shutdown_connections 2023-12-19T17:50:25.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.798+0000 7fbd853f0640 1 --2- 172.21.15.37:0/1703501593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd800bcdd0 0x7fbd800b5f80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:25.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.798+0000 7fbd853f0640 1 -- 172.21.15.37:0/1703501593 >> 172.21.15.37:0/1703501593 conn(0x7fbd80071e60 msgr2=0x7fbd800c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:25.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.798+0000 7fbd853f0640 1 -- 172.21.15.37:0/1703501593 shutdown_connections 2023-12-19T17:50:25.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.798+0000 7fbd853f0640 1 -- 172.21.15.37:0/1703501593 wait complete. 2023-12-19T17:50:25.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.799+0000 7fbd853f0640 1 Processor -- start 2023-12-19T17:50:25.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.799+0000 7fbd853f0640 1 -- start start 2023-12-19T17:50:25.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.800+0000 7fbd853f0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd800b64c0 0x7fbd801d49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:25.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.800+0000 7fbd853f0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbd800bcdd0 0x7fbd801e2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:25.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.800+0000 7fbd853f0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd80144ea0 0x7fbd801433a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:25.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.800+0000 7fbd853f0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd801d30a0 con 0x7fbd80144ea0 2023-12-19T17:50:25.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.800+0000 7fbd853f0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd801438e0 con 0x7fbd800b64c0 2023-12-19T17:50:25.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.800+0000 7fbd853f0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd80146530 con 0x7fbd800bcdd0 2023-12-19T17:50:25.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.800+0000 7fbd7f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd80144ea0 0x7fbd801433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:25.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.800+0000 7fbd7f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd80144ea0 0x7fbd801433a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33596/0 (socket says 172.21.15.37:33596) 2023-12-19T17:50:25.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.800+0000 7fbd7f7fe640 1 -- 172.21.15.37:0/1657216131 learned_addr learned my addr 172.21.15.37:0/1657216131 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:25.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.800+0000 7fbd7effd640 1 --2- 172.21.15.37:0/1657216131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd800b64c0 0x7fbd801d49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:25.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.800+0000 7fbd77fff640 1 --2- 172.21.15.37:0/1657216131 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbd800bcdd0 0x7fbd801e2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:25.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.800+0000 7fbd7f7fe640 1 -- 172.21.15.37:0/1657216131 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbd800bcdd0 msgr2=0x7fbd801e2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:25.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.800+0000 7fbd7f7fe640 1 --2- 172.21.15.37:0/1657216131 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbd800bcdd0 0x7fbd801e2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:25.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.800+0000 7fbd7f7fe640 1 -- 172.21.15.37:0/1657216131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd800b64c0 msgr2=0x7fbd801d49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:25.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.800+0000 7fbd7f7fe640 1 --2- 172.21.15.37:0/1657216131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd800b64c0 0x7fbd801d49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:25.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.800+0000 7fbd7f7fe640 1 -- 172.21.15.37:0/1657216131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd70009400 con 0x7fbd80144ea0 2023-12-19T17:50:25.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.800+0000 7fbd77fff640 1 --2- 172.21.15.37:0/1657216131 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbd800bcdd0 0x7fbd801e2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:50:25.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.800+0000 7fbd7f7fe640 1 --2- 172.21.15.37:0/1657216131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd80144ea0 0x7fbd801433a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fbd78001f00 tx=0x7fbd7800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:25.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.801+0000 7fbd777fe640 1 -- 172.21.15.37:0/1657216131 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78012400 con 0x7fbd80144ea0 2023-12-19T17:50:25.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.801+0000 7fbd777fe640 1 -- 172.21.15.37:0/1657216131 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd78012560 con 0x7fbd80144ea0 2023-12-19T17:50:25.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.801+0000 7fbd777fe640 1 -- 172.21.15.37:0/1657216131 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78012910 con 0x7fbd80144ea0 2023-12-19T17:50:25.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.801+0000 7fbd853f0640 1 -- 172.21.15.37:0/1657216131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd800bf2f0 con 0x7fbd80144ea0 2023-12-19T17:50:25.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.801+0000 7fbd853f0640 1 -- 172.21.15.37:0/1657216131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd801d4490 con 0x7fbd80144ea0 2023-12-19T17:50:25.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.802+0000 7fbd853f0640 1 -- 172.21.15.37:0/1657216131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd800bc320 con 0x7fbd80144ea0 2023-12-19T17:50:25.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.802+0000 7fbd777fe640 1 -- 172.21.15.37:0/1657216131 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbd78012a70 con 0x7fbd80144ea0 2023-12-19T17:50:25.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.802+0000 7fbd777fe640 1 --2- 172.21.15.37:0/1657216131 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbd6006a430 0x7fbd6006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:25.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.803+0000 7fbd777fe640 1 -- 172.21.15.37:0/1657216131 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbd78088bb0 con 0x7fbd80144ea0 2023-12-19T17:50:25.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.803+0000 7fbd7effd640 1 --2- 172.21.15.37:0/1657216131 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbd6006a430 0x7fbd6006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:25.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.803+0000 7fbd7effd640 1 --2- 172.21.15.37:0/1657216131 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbd6006a430 0x7fbd6006c8f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbd70036000 tx=0x7fbd7003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:25.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.807+0000 7fbd777fe640 1 -- 172.21.15.37:0/1657216131 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbd800bc320 con 0x7fbd80144ea0 2023-12-19T17:50:25.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.979+0000 7fbd853f0640 1 -- 172.21.15.37:0/1657216131 --> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd800b5500 con 0x7fbd6006a430 2023-12-19T17:50:25.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.981+0000 7fbd777fe640 1 -- 172.21.15.37:0/1657216131 <== mgr.4103 v2:172.21.15.78:6832/88890 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50342 (secure 0 0 0) 0x7fbd700319c0 con 0x7fbd6006a430 2023-12-19T17:50:25.982 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T17:50:25.982 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-19T17:50:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.983+0000 7fbd853f0640 1 -- 172.21.15.37:0/1657216131 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbd6006a430 msgr2=0x7fbd6006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.983+0000 7fbd853f0640 1 --2- 172.21.15.37:0/1657216131 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbd6006a430 0x7fbd6006c8f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbd70036000 tx=0x7fbd7003d040 comp rx=0 tx=0).stop 2023-12-19T17:50:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.983+0000 7fbd853f0640 1 -- 172.21.15.37:0/1657216131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd80144ea0 msgr2=0x7fbd801433a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.983+0000 7fbd853f0640 1 --2- 172.21.15.37:0/1657216131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd80144ea0 0x7fbd801433a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fbd78001f00 tx=0x7fbd7800a430 comp rx=0 tx=0).stop 2023-12-19T17:50:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.983+0000 7fbd853f0640 1 -- 172.21.15.37:0/1657216131 shutdown_connections 2023-12-19T17:50:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.983+0000 7fbd853f0640 1 --2- 172.21.15.37:0/1657216131 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7fbd6006a430 0x7fbd6006c8f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.983+0000 7fbd853f0640 1 --2- 172.21.15.37:0/1657216131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd80144ea0 0x7fbd801433a0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.983+0000 7fbd853f0640 1 --2- 172.21.15.37:0/1657216131 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbd800bcdd0 0x7fbd801e2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:25.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.983+0000 7fbd853f0640 1 --2- 172.21.15.37:0/1657216131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd800b64c0 0x7fbd801d49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:25.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.983+0000 7fbd853f0640 1 -- 172.21.15.37:0/1657216131 >> 172.21.15.37:0/1657216131 conn(0x7fbd80071e60 msgr2=0x7fbd801421f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:25.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.983+0000 7fbd853f0640 1 -- 172.21.15.37:0/1657216131 shutdown_connections 2023-12-19T17:50:25.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:25.983+0000 7fbd853f0640 1 -- 172.21.15.37:0/1657216131 wait complete. 2023-12-19T17:50:25.994 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":3135,"stamp":"2023-12-19T17:50:24.142561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":7672200,"kb_used_data":4232,"kb_used_omap":625,"kb_used_meta":7667278,"kb_avail":747302520,"statfs":{"total":773094113280,"available":765237780480,"internally_reserved":0,"allocated":4333568,"data_stored":2396024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":640065,"internal_metadata":7851293631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002478"},"pg_stats":[{"pgid":"1.0","version":"34'119","reported_seq":243,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T17:50:07.476151+0000","last_change":"2023-12-19T17:50:07.476267+0000","last_active":"2023-12-19T17:50:07.476151+0000","last_peered":"2023-12-19T17:50:07.476151+0000","last_clean":"2023-12-19T17:50:07.476151+0000","last_became_active":"2023-12-19T16:06:47.760252+0000","last_became_peered":"2023-12-19T16:06:47.760252+0000","last_unstale":"2023-12-19T17:50:07.476151+0000","last_undegraded":"2023-12-19T17:50:07.476151+0000","last_fullsized":"2023-12-19T17:50:07.476151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2023-12-19T17:50:07.476128+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2023-12-19T17:50:07.476128+0000","last_clean_scrub_stamp":"2023-12-19T17:50:07.476128+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:16:19.686560+0000","scrub_duration":0.038468829000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576091,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":775756,"kb_used_data":964,"kb_used_omap":67,"kb_used_meta":774716,"kb_avail":93596084,"statfs":{"total":96636764160,"available":95842390016,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68753,"internal_metadata":793310063},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:50:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.47799999999999998,"15min":0.55500000000000005},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":3.0270000000000001,"5min":3.0270000000000001,"15min":19.341000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.505,"15min":0.50700000000000001},"min":{"1min":0.34699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":5.0860000000000003,"5min":5.0860000000000003,"15min":5.1399999999999997},"last":0.38}]},{"osd":1,"last update":"Tue Dec 19 17:50:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.498,"15min":0.54400000000000004},"min":{"1min":0.35199999999999998,"5min":0.252,"15min":0.252},"max":{"1min":5.4299999999999997,"5min":5.4299999999999997,"15min":18.707999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.52200000000000002,"15min":0.59099999999999997},"min":{"1min":0.35899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.0489999999999999,"5min":3.0489999999999999,"15min":16.161000000000001},"last":0.621}]},{"osd":2,"last update":"Tue Dec 19 17:50:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.38900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":15.627000000000001,"5min":15.627000000000001,"15min":19.300999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.56000000000000005,"15min":0.54700000000000004},"min":{"1min":0.29899999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":6.242,"5min":6.242,"15min":6.242},"last":0.59199999999999997}]},{"osd":3,"last update":"Tue Dec 19 17:50:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.30099999999999999},"max":{"1min":2.0339999999999998,"5min":3.9630000000000001,"15min":10.005000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.52600000000000002,"15min":0.55300000000000005},"min":{"1min":0.34599999999999997,"5min":0.34399999999999997,"15min":0.32800000000000001},"max":{"1min":1.96,"5min":1.96,"15min":5.8209999999999997},"last":0.55700000000000005}]},{"osd":4,"last update":"Tue Dec 19 17:50:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.53900000000000003,"15min":0.59699999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.7930000000000001,"5min":4.7930000000000001,"15min":16.125},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.53800000000000003,"15min":0.57099999999999995},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":2.9860000000000002,"5min":2.9860000000000002,"15min":9.9659999999999993},"last":0.54100000000000004}]},{"osd":5,"last update":"Tue Dec 19 17:50:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.54000000000000004,"15min":0.63500000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":5.4029999999999996,"5min":5.4029999999999996,"15min":36.665999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":1.286,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":17.949000000000002,"5min":17.949000000000002,"15min":19.366},"last":0.45500000000000002}]},{"osd":6,"last update":"Tue Dec 19 17:50:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.60099999999999998,"15min":0.68300000000000005},"min":{"1min":0.376,"5min":0.36799999999999999,"15min":0.35899999999999999},"max":{"1min":2.911,"5min":2.911,"15min":22.800000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.38600000000000001,"5min":0.35999999999999999,"15min":0.33500000000000002},"max":{"1min":5.1189999999999998,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":0.46999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834576094,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1516040,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":1515648,"kb_avail":92855800,"statfs":{"total":96636764160,"available":95084339200,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1552023552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.58499999999999996,"15min":0.54500000000000004},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":9.5589999999999993,"5min":9.5589999999999993,"15min":10.109},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.59899999999999998,"15min":0.56299999999999994},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":9.6069999999999993,"5min":9.6069999999999993,"15min":10.172000000000001},"last":0.59899999999999998}]},{"osd":1,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.58599999999999997,"15min":0.51400000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27100000000000002},"max":{"1min":8.0579999999999998,"5min":8.0579999999999998,"15min":8.0579999999999998},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.52500000000000002,"15min":0.51500000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27500000000000002},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.496}]},{"osd":2,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.61299999999999999,"15min":0.59699999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":9.5830000000000002,"5min":9.5830000000000002,"15min":18.135000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.61099999999999999,"15min":0.55600000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.316},"max":{"1min":7.069,"5min":7.069,"15min":7.069},"last":0.66800000000000004}]},{"osd":3,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56000000000000005,"15min":0.54100000000000004},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":3.3519999999999999,"5min":3.3519999999999999,"15min":3.3519999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.64700000000000002,"15min":0.59399999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":9.6289999999999996,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.56599999999999995}]},{"osd":4,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.252},"max":{"1min":3.3900000000000001,"5min":3.3900000000000001,"15min":8.4309999999999992},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.56999999999999995,"15min":0.56699999999999995},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.26100000000000001},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":10.231},"last":0.71299999999999997}]},{"osd":5,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":3.2959999999999998,"5min":3.2959999999999998,"15min":10.198},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59899999999999998,"15min":0.56100000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":3.4340000000000002,"5min":3.4340000000000002,"15min":3.4340000000000002},"last":0.81200000000000006}]},{"osd":7,"last update":"Tue Dec 19 17:49:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.27,"5min":3.27,"15min":10.257999999999999},"last":0.746},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.68100000000000005,"15min":0.61799999999999999},"min":{"1min":0.32300000000000001,"5min":0.315,"15min":0.30299999999999999},"max":{"1min":9.5039999999999996,"5min":9.5039999999999996,"15min":9.5039999999999996},"last":0.65300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834576092,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":372488,"kb_used_data":384,"kb_used_omap":7,"kb_used_meta":372088,"kb_avail":93999352,"statfs":{"total":96636764160,"available":96255336448,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7169,"internal_metadata":381019135},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47999999999999998,"15min":0.48699999999999999},"min":{"1min":0.29399999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.508,"5min":1.508,"15min":5.0069999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55100000000000005,"15min":0.56000000000000005},"min":{"1min":0.29199999999999998,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":2.8980000000000001,"5min":2.8980000000000001,"15min":8.5549999999999997},"last":0.47799999999999998}]},{"osd":1,"last update":"Tue Dec 19 17:50:21 2023","interfaces":[{"interface":"back","average":{"1min":1.9019999999999999,"5min":0.79700000000000004,"15min":0.64400000000000002},"min":{"1min":0.28199999999999997,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":35.460999999999999,"5min":35.460999999999999,"15min":35.460999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.371,"5min":0.75600000000000001,"15min":0.59999999999999998},"min":{"1min":0.38500000000000001,"5min":0.246,"15min":0.246},"max":{"1min":21.608000000000001,"5min":21.608000000000001,"15min":21.608000000000001},"last":0.57499999999999996}]},{"osd":2,"last update":"Tue Dec 19 17:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57099999999999995,"15min":0.621},"min":{"1min":0.35199999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":3.1880000000000002,"5min":4.0049999999999999,"15min":21.789000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":1.0229999999999999,"5min":0.68600000000000005,"15min":0.64400000000000002},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":12.999000000000001,"5min":12.999000000000001,"15min":16.474},"last":0.55900000000000005}]},{"osd":3,"last update":"Tue Dec 19 17:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.58499999999999996,"15min":0.60599999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34599999999999997},"max":{"1min":0.71399999999999997,"5min":3.8929999999999998,"15min":12.544},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.048,"5min":0.63800000000000001,"15min":0.59199999999999997},"min":{"1min":0.35299999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":12.942,"5min":12.942,"15min":12.942},"last":0.44400000000000001}]},{"osd":4,"last update":"Tue Dec 19 17:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.495,"15min":0.56000000000000005},"min":{"1min":0.32700000000000001,"5min":0.308,"15min":0.26100000000000001},"max":{"1min":1.351,"5min":1.351,"15min":19.652000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57999999999999996,"15min":0.67100000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.252},"max":{"1min":2.1120000000000001,"5min":2.589,"15min":26.648},"last":0.54000000000000004}]},{"osd":6,"last update":"Tue Dec 19 17:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52600000000000002,"15min":0.53600000000000003},"min":{"1min":0.311,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":3.278},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.36499999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.45500000000000002}]},{"osd":7,"last update":"Tue Dec 19 17:50:21 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.627,"15min":0.625},"min":{"1min":0.41999999999999998,"5min":0.316,"15min":0.30299999999999999},"max":{"1min":4.9980000000000002,"5min":4.9980000000000002,"15min":8.7360000000000007},"last":0.436},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.58999999999999997,"15min":0.65100000000000002},"min":{"1min":0.377,"5min":0.371,"15min":0.36399999999999999},"max":{"1min":1.698,"5min":1.698,"15min":16.315000000000001},"last":0.58999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834576093,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":581576,"kb_used_data":384,"kb_used_omap":9,"kb_used_meta":581174,"kb_avail":93790264,"statfs":{"total":96636764160,"available":96041230336,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9755,"internal_metadata":595122661},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:50:16 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.307,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.65700000000000003,"5min":6.5389999999999997,"15min":6.5389999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.28899999999999998,"5min":0.26000000000000001,"15min":0.246},"max":{"1min":0.57799999999999996,"5min":1.7689999999999999,"15min":4.657},"last":0.42799999999999999}]},{"osd":1,"last update":"Tue Dec 19 17:50:16 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.33800000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.61399999999999999,"5min":6.6970000000000001,"15min":6.6970000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.495,"15min":0.51000000000000001},"min":{"1min":0.40500000000000003,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.70099999999999996,"5min":1.722,"15min":4.4809999999999999},"last":0.47199999999999998}]},{"osd":2,"last update":"Tue Dec 19 17:50:16 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.501,"15min":0.53400000000000003},"min":{"1min":0.31,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55600000000000005,"5min":2.379,"15min":8.3729999999999993},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.50700000000000001,"15min":0.56100000000000005},"min":{"1min":0.35299999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.63600000000000001,"5min":0.73299999999999998,"15min":8.3840000000000003},"last":0.53100000000000003}]},{"osd":3,"last update":"Tue Dec 19 17:50:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.51500000000000001,"15min":0.53900000000000003},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":0.622,"5min":1.7430000000000001,"15min":4.548},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.60199999999999998,"15min":0.58099999999999996},"min":{"1min":0.38300000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64300000000000002,"5min":4.3440000000000003,"15min":4.7850000000000001},"last":0.45200000000000001}]},{"osd":5,"last update":"Tue Dec 19 17:50:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.48399999999999999,"15min":0.54400000000000004},"min":{"1min":0.27200000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.60699999999999998,"5min":0.78200000000000003,"15min":14.387},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.504,"5min":0.50900000000000001,"15min":0.55400000000000005},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.65600000000000003,"5min":0.85499999999999998,"15min":14.430999999999999},"last":0.51800000000000002}]},{"osd":6,"last update":"Tue Dec 19 17:50:16 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.28100000000000003,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.68400000000000005,"5min":0.77000000000000002,"15min":4.399},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.57099999999999995},"min":{"1min":0.31900000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.67600000000000005,"5min":0.82099999999999995,"15min":4.5910000000000002},"last":0.59599999999999997}]},{"osd":7,"last update":"Tue Dec 19 17:50:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54700000000000004,"15min":0.57999999999999996},"min":{"1min":0.39100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68000000000000005,"5min":0.89300000000000002,"15min":8.5139999999999993},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58599999999999997,"15min":0.61299999999999999},"min":{"1min":0.39200000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70899999999999996,"5min":0.83399999999999996,"15min":6.4169999999999998},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834576090,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":644296,"kb_used_data":384,"kb_used_omap":71,"kb_used_meta":643832,"kb_avail":93727544,"statfs":{"total":96636764160,"available":95977005056,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":72831,"internal_metadata":659284865},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42099999999999999,"15min":0.35799999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":3.3149999999999999,"5min":4.7350000000000003,"15min":4.7350000000000003},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.43099999999999999,"15min":0.38800000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":2.1110000000000002,"5min":3.657,"15min":10.164999999999999},"last":0.52200000000000002}]},{"osd":1,"last update":"Tue Dec 19 17:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.48599999999999999,"15min":0.39500000000000002},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":6.9800000000000004,"5min":6.9800000000000004,"15min":6.9800000000000004},"last":0.317},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.46999999999999997,"15min":0.39900000000000002},"min":{"1min":0.27300000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":4.9400000000000004,"5min":4.9400000000000004,"15min":4.9400000000000004},"last":0.36699999999999999}]},{"osd":2,"last update":"Tue Dec 19 17:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.46100000000000002,"15min":0.40000000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.1150000000000002,"5min":4.8460000000000001,"15min":4.8460000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44600000000000001,"15min":0.41699999999999998},"min":{"1min":0.28899999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.3620000000000001,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.39800000000000002}]},{"osd":4,"last update":"Tue Dec 19 17:50:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":0.74199999999999999,"15min":0.64700000000000002},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":12.224,"5min":12.224,"15min":12.224},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66900000000000004,"15min":0.61799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.4970000000000001,"5min":4.8799999999999999,"15min":4.8799999999999999},"last":0.48999999999999999}]},{"osd":5,"last update":"Tue Dec 19 17:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.63400000000000001,"15min":0.61399999999999999},"min":{"1min":0.41599999999999998,"5min":0.38600000000000001,"15min":0.36599999999999999},"max":{"1min":0.71999999999999997,"5min":4.4880000000000004,"15min":4.4880000000000004},"last":0.505},{"interface":"front","average":{"1min":1.018,"5min":0.75800000000000001,"15min":0.66300000000000003},"min":{"1min":0.36599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":12.269,"5min":12.269,"15min":12.269},"last":0.46999999999999997}]},{"osd":6,"last update":"Tue Dec 19 17:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68999999999999995,"15min":0.63400000000000001},"min":{"1min":0.41899999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.748,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66300000000000003,"15min":0.63800000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.374},"max":{"1min":3.355,"5min":3.46,"15min":3.46},"last":0.53500000000000003}]},{"osd":7,"last update":"Tue Dec 19 17:50:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.73599999999999999,"15min":0.66600000000000004},"min":{"1min":0.42799999999999999,"5min":0.377,"15min":0.377},"max":{"1min":8.0830000000000002,"5min":8.0830000000000002,"15min":8.0830000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.73899999999999999,"15min":0.67600000000000005},"min":{"1min":0.436,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":4.8460000000000001,"5min":4.9219999999999997,"15min":4.9219999999999997},"last":0.56799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834576093,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1555912,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":1555520,"kb_avail":92815928,"statfs":{"total":96636764160,"available":95043510272,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1592852480},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.628,"15min":0.49299999999999999},"min":{"1min":0.23000000000000001,"5min":0.20200000000000001,"15min":0.185},"max":{"1min":10.923,"5min":10.923,"15min":17.652999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.62,"15min":0.56399999999999995},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.155},"max":{"1min":6.8540000000000001,"5min":9.8699999999999992,"15min":22.620000000000001},"last":0.23000000000000001}]},{"osd":1,"last update":"Tue Dec 19 17:50:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.64000000000000001,"15min":0.51800000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":6.4569999999999999,"5min":11.515000000000001,"15min":23.327999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":1.038,"5min":1.0109999999999999,"15min":0.66000000000000003},"min":{"1min":0.25900000000000001,"5min":0.254,"15min":0.23899999999999999},"max":{"1min":9.7260000000000009,"5min":30.975000000000001,"15min":30.975000000000001},"last":0.28599999999999998}]},{"osd":3,"last update":"Tue Dec 19 17:50:04 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":0.73799999999999999,"15min":0.61399999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.23699999999999999},"max":{"1min":10.710000000000001,"5min":10.710000000000001,"15min":33.106000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":1.597,"5min":0.93300000000000005,"15min":0.70599999999999996},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.221},"max":{"1min":9.8239999999999998,"5min":10.458,"15min":22.576000000000001},"last":0.32100000000000001}]},{"osd":4,"last update":"Tue Dec 19 17:50:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":0.83099999999999996,"15min":0.754},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":9.7919999999999998,"5min":9.7919999999999998,"15min":27.885999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.335,"5min":0.79300000000000004,"15min":0.79400000000000004},"min":{"1min":0.32800000000000001,"5min":0.318,"15min":0.309},"max":{"1min":13.451000000000001,"5min":13.451000000000001,"15min":39.417000000000002},"last":0.442}]},{"osd":5,"last update":"Tue Dec 19 17:50:04 2023","interfaces":[{"interface":"back","average":{"1min":1.716,"5min":0.91900000000000004,"15min":0.78000000000000003},"min":{"1min":0.36499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":22.484999999999999,"5min":22.484999999999999,"15min":23.238},"last":0.42499999999999999},{"interface":"front","average":{"1min":1.6819999999999999,"5min":0.997,"15min":0.72399999999999998},"min":{"1min":0.443,"5min":0.40899999999999997,"15min":0.379},"max":{"1min":12.923999999999999,"5min":12.923999999999999,"15min":12.923999999999999},"last":0.53300000000000003}]},{"osd":6,"last update":"Tue Dec 19 17:50:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":0.76800000000000002,"15min":0.73399999999999999},"min":{"1min":0.40999999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":13.204000000000001,"5min":13.204000000000001,"15min":22.675999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":1.212,"5min":0.83199999999999996,"15min":0.77500000000000002},"min":{"1min":0.41199999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":7.2080000000000002,"5min":7.2080000000000002,"15min":23.164999999999999},"last":0.48199999999999998}]},{"osd":7,"last update":"Tue Dec 19 17:50:04 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":0.81699999999999995,"15min":0.75700000000000001},"min":{"1min":0.47299999999999998,"5min":0.38,"15min":0.38},"max":{"1min":13.295,"5min":13.295,"15min":22.824999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.81000000000000005,"15min":0.76700000000000002},"min":{"1min":0.499,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":6.4950000000000001,"5min":6.4950000000000001,"15min":23.207999999999998},"last":0.45700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834576092,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":831816,"kb_used_data":384,"kb_used_omap":470,"kb_used_meta":830953,"kb_avail":93540024,"statfs":{"total":96636764160,"available":95784984576,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":481557,"internal_metadata":850896619},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:50:00 2023","interfaces":[{"interface":"back","average":{"1min":2.0049999999999999,"5min":0.67400000000000004,"15min":0.48499999999999999},"min":{"1min":0.223,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":37.258000000000003,"5min":37.258000000000003,"15min":37.258000000000003},"last":0.31},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.41199999999999998,"15min":0.39800000000000002},"min":{"1min":0.23000000000000001,"5min":0.22,"15min":0.22},"max":{"1min":6.8129999999999997,"5min":6.8129999999999997,"15min":6.8129999999999997},"last":0.28199999999999997}]},{"osd":2,"last update":"Tue Dec 19 17:50:00 2023","interfaces":[{"interface":"back","average":{"1min":2.9060000000000001,"5min":0.84799999999999998,"15min":0.51600000000000001},"min":{"1min":0.24299999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":32.451000000000001,"5min":32.451000000000001,"15min":32.451000000000001},"last":0.29599999999999999},{"interface":"front","average":{"1min":2.371,"5min":0.80800000000000005,"15min":0.56899999999999995},"min":{"1min":0.28599999999999998,"5min":0.254,"15min":0.21099999999999999},"max":{"1min":32.259999999999998,"5min":32.259999999999998,"15min":32.259999999999998},"last":0.36699999999999999}]},{"osd":3,"last update":"Tue Dec 19 17:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.53700000000000003,"15min":0.499},"min":{"1min":0.28100000000000003,"5min":0.23300000000000001,"15min":0.221},"max":{"1min":12.459,"5min":12.459,"15min":13.153},"last":0.39900000000000002},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.53300000000000003,"15min":0.49399999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.216},"max":{"1min":10.327,"5min":10.327,"15min":10.327},"last":0.33500000000000002}]},{"osd":4,"last update":"Tue Dec 19 17:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.65900000000000003,"15min":0.60199999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":12.215,"5min":12.215,"15min":12.215},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.145,"5min":0.73899999999999999,"15min":0.65600000000000003},"min":{"1min":0.375,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":12.499000000000001,"5min":12.499000000000001,"15min":12.499000000000001},"last":0.69799999999999995}]},{"osd":5,"last update":"Tue Dec 19 17:50:00 2023","interfaces":[{"interface":"back","average":{"1min":2.9889999999999999,"5min":1.0960000000000001,"15min":0.82599999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.36099999999999999},"max":{"1min":56.218000000000004,"5min":56.218000000000004,"15min":56.218000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":1.0920000000000001,"5min":0.71199999999999997,"15min":0.67500000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.35499999999999998},"max":{"1min":13.134,"5min":13.134,"15min":13.134},"last":0.68600000000000005}]},{"osd":6,"last update":"Tue Dec 19 17:50:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.67100000000000004,"15min":0.65800000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.35799999999999998},"max":{"1min":6.8460000000000001,"5min":6.8460000000000001,"15min":11.055},"last":0.56399999999999995},{"interface":"front","average":{"1min":1.01,"5min":0.69599999999999995,"15min":0.64200000000000002},"min":{"1min":0.41499999999999998,"5min":0.379,"15min":0.379},"max":{"1min":12.167999999999999,"5min":12.167999999999999,"15min":12.167999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Tue Dec 19 17:50:00 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":0.80300000000000005,"15min":0.70499999999999996},"min":{"1min":0.38200000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":12.226000000000001,"5min":12.226000000000001,"15min":12.226000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.67900000000000005,"15min":0.66800000000000004},"min":{"1min":0.39600000000000002,"5min":0.38100000000000001,"15min":0.36499999999999999},"max":{"1min":6.9029999999999996,"5min":6.9029999999999996,"15min":6.9029999999999996},"last":0.752}]}]},{"osd":0,"up_from":13,"seq":55834576094,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1394316,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":1393344,"kb_avail":92977524,"statfs":{"total":96636764160,"available":95208984576,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1426784256},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.40899999999999997,"15min":0.44500000000000001},"min":{"1min":0.21299999999999999,"5min":0.19400000000000001,"15min":0.189},"max":{"1min":5.351,"5min":5.351,"15min":22.059000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.47499999999999998,"15min":0.42899999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":6.4269999999999996,"5min":6.4269999999999996,"15min":6.4269999999999996},"last":0.251}]},{"osd":2,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.432,"15min":0.495},"min":{"1min":0.252,"5min":0.23799999999999999,"15min":0.23000000000000001},"max":{"1min":5.3739999999999997,"5min":5.3739999999999997,"15min":17.870999999999999},"last":0.26800000000000002},{"interface":"front","average":{"1min":1.016,"5min":0.47699999999999998,"15min":0.41899999999999998},"min":{"1min":0.23599999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":6.3419999999999996,"5min":6.3419999999999996,"15min":6.3419999999999996},"last":0.314}]},{"osd":3,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.40699999999999997,"15min":0.46800000000000003},"min":{"1min":0.23499999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":10.585000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":0.60799999999999998,"15min":0.50900000000000001},"min":{"1min":0.29599999999999999,"5min":0.29099999999999998,"15min":0.27800000000000002},"max":{"1min":9.5139999999999993,"5min":9.5139999999999993,"15min":11.077},"last":0.378}]},{"osd":4,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":0.68799999999999994,"15min":0.67500000000000004},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":6.4889999999999999,"5min":6.4889999999999999,"15min":6.4889999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.58699999999999997,"15min":0.63400000000000001},"min":{"1min":0.373,"5min":0.35099999999999998,"15min":0.28699999999999998},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":6.1669999999999998},"last":0.50900000000000001}]},{"osd":5,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.58399999999999996,"15min":0.64200000000000002},"min":{"1min":0.379,"5min":0.34100000000000003,"15min":0.32700000000000001},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":9.8019999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40200000000000002},"max":{"1min":5.3250000000000002,"5min":5.3250000000000002,"15min":5.4080000000000004},"last":0.55700000000000005}]},{"osd":6,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":5.2990000000000004,"5min":5.2990000000000004,"15min":5.2990000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.1319999999999999,"5min":0.69699999999999995,"15min":0.65800000000000003},"min":{"1min":0.432,"5min":0.41699999999999998,"15min":0.36199999999999999},"max":{"1min":6.3860000000000001,"5min":6.3860000000000001,"15min":6.3860000000000001},"last":0.498}]},{"osd":7,"last update":"Tue Dec 19 17:49:24 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":0.71999999999999997,"15min":0.78600000000000003},"min":{"1min":0.45000000000000001,"5min":0.42999999999999999,"15min":0.38700000000000001},"max":{"1min":6.4619999999999997,"5min":6.4619999999999997,"15min":31.004999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.59999999999999998,"15min":0.71799999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":27.370999999999999},"last":0.48799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T17:50:25.997 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-19T17:50:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.102+0000 7f0d4f105640 1 Processor -- start 2023-12-19T17:50:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.102+0000 7f0d4f105640 1 -- start start 2023-12-19T17:50:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.103+0000 7f0d4f105640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0d4806d950 0x7f0d48156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.103+0000 7f0d4f105640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d4806fe40 con 0x7f0d4814b670 2023-12-19T17:50:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.103+0000 7f0d4f105640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d480700b0 con 0x7f0d48069ba0 2023-12-19T17:50:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.103+0000 7f0d4f105640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d48070390 con 0x7f0d4806d950 2023-12-19T17:50:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.103+0000 7f0d47fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0d4814b670 0x7f0d481534a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38104/0 (socket says 172.21.15.37:38104) 2023-12-19T17:50:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.103+0000 7f0d47fff640 1 -- 172.21.15.37:0/3885744928 learned_addr learned my addr 172.21.15.37:0/3885744928 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-19T17:50:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.103+0000 7f0d477fe640 1 -- 172.21.15.37:0/3885744928 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939070459 0 0) 0x7f0d4806fe40 con 0x7f0d4814b670 2023-12-19T17:50:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.103+0000 7f0d477fe640 1 -- 172.21.15.37:0/3885744928 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d34003520 con 0x7f0d4814b670 2023-12-19T17:50:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.103+0000 7f0d4d6a2640 1 --2- 172.21.15.37:0/3885744928 >> v2:172.21.15.78:3300/0 conn(0x7f0d4806d950 0x7f0d48156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d477fe640 1 -- 172.21.15.37:0/3885744928 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3966364827 0 0) 0x7f0d34003520 con 0x7f0d4814b670 2023-12-19T17:50:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d477fe640 1 -- 172.21.15.37:0/3885744928 >> v2:172.21.15.78:3300/0 conn(0x7f0d4806d950 msgr2=0x7f0d48156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d477fe640 1 --2- 172.21.15.37:0/3885744928 >> v2:172.21.15.78:3300/0 conn(0x7f0d4806d950 0x7f0d48156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d477fe640 1 -- 172.21.15.37:0/3885744928 >> v1:172.21.15.78:6789/0 conn(0x7f0d48069ba0 legacy=0x7f0d4814af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d477fe640 1 -- 172.21.15.37:0/3885744928 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d480717e0 con 0x7f0d4814b670 2023-12-19T17:50:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d477fe640 1 -- 172.21.15.37:0/3885744928 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1596016049 0 0) 0x7f0d380019f0 con 0x7f0d4814b670 2023-12-19T17:50:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d477fe640 1 -- 172.21.15.37:0/3885744928 >> v1:172.21.15.37:6789/0 conn(0x7f0d4814b670 legacy=0x7f0d481534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d477fe640 1 --2- 172.21.15.37:0/3885744928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d34003970 0x7f0d34003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d477fe640 1 --2- 172.21.15.37:0/3885744928 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d340047c0 0x7f0d34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d477fe640 1 --2- 172.21.15.37:0/3885744928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d34005180 0x7f0d3400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d477fe640 1 -- 172.21.15.37:0/3885744928 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d48070390 con 0x7f0d34003970 2023-12-19T17:50:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d477fe640 1 -- 172.21.15.37:0/3885744928 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3400c120 con 0x7f0d34005180 2023-12-19T17:50:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d477fe640 1 -- 172.21.15.37:0/3885744928 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3400c2e0 con 0x7f0d340047c0 2023-12-19T17:50:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d4cea1640 1 --2- 172.21.15.37:0/3885744928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d34003970 0x7f0d34003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d47fff640 1 --2- 172.21.15.37:0/3885744928 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d340047c0 0x7f0d34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d4d6a2640 1 --2- 172.21.15.37:0/3885744928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d34005180 0x7f0d3400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d4cea1640 1 -- 172.21.15.37:0/3885744928 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d340047c0 msgr2=0x7f0d34004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d4cea1640 1 --2- 172.21.15.37:0/3885744928 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d340047c0 0x7f0d34004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d4cea1640 1 -- 172.21.15.37:0/3885744928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d34005180 msgr2=0x7f0d3400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d4cea1640 1 --2- 172.21.15.37:0/3885744928 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d34005180 0x7f0d3400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d4d6a2640 1 -- 172.21.15.37:0/3885744928 reap_dead start 2023-12-19T17:50:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.104+0000 7f0d4cea1640 1 -- 172.21.15.37:0/3885744928 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d34003520 con 0x7f0d34003970 2023-12-19T17:50:26.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.105+0000 7f0d4cea1640 1 --2- 172.21.15.37:0/3885744928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d34003970 0x7f0d34003d90 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f0d40001750 tx=0x7f0d340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0dde2f52b4ac306 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:26.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.105+0000 7f0d477fe640 1 -- 172.21.15.37:0/3885744928 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d400052d0 con 0x7f0d34003970 2023-12-19T17:50:26.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.105+0000 7f0d477fe640 1 -- 172.21.15.37:0/3885744928 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4002e050 con 0x7f0d34003970 2023-12-19T17:50:26.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.105+0000 7f0d477fe640 1 -- 172.21.15.37:0/3885744928 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40003830 con 0x7f0d34003970 2023-12-19T17:50:26.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.106+0000 7f0d4f105640 1 -- 172.21.15.37:0/3885744928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d34003970 msgr2=0x7f0d34003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:26.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.106+0000 7f0d4f105640 1 --2- 172.21.15.37:0/3885744928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d34003970 0x7f0d34003d90 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f0d40001750 tx=0x7f0d340057f0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.106+0000 7f0d4f105640 1 -- 172.21.15.37:0/3885744928 shutdown_connections 2023-12-19T17:50:26.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.106+0000 7f0d4f105640 1 --2- 172.21.15.37:0/3885744928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d34003970 0x7f0d34003d90 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.106+0000 7f0d4f105640 1 -- 172.21.15.37:0/3885744928 >> 172.21.15.37:0/3885744928 conn(0x7f0d480b9b50 msgr2=0x7f0d480b9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:26.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.106+0000 7f0d4f105640 1 -- 172.21.15.37:0/3885744928 shutdown_connections 2023-12-19T17:50:26.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.106+0000 7f0d4f105640 1 -- 172.21.15.37:0/3885744928 wait complete. 2023-12-19T17:50:26.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.107+0000 7f0d4f105640 1 Processor -- start 2023-12-19T17:50:26.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.107+0000 7f0d4f105640 1 -- start start 2023-12-19T17:50:26.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.107+0000 7f0d4f105640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d34003970 0x7f0d480bc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:26.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.107+0000 7f0d4f105640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d4813ac00 0x7f0d4814c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:26.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.107+0000 7f0d4f105640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d481371f0 0x7f0d48137670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:26.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.107+0000 7f0d4f105640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4814d5a0 con 0x7f0d4813ac00 2023-12-19T17:50:26.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.107+0000 7f0d4f105640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480bcd60 con 0x7f0d34003970 2023-12-19T17:50:26.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.107+0000 7f0d4f105640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4814cbe0 con 0x7f0d481371f0 2023-12-19T17:50:26.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.108+0000 7f0d47fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d4813ac00 0x7f0d4814c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:26.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.108+0000 7f0d47fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d4813ac00 0x7f0d4814c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33616/0 (socket says 172.21.15.37:33616) 2023-12-19T17:50:26.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.108+0000 7f0d47fff640 1 -- 172.21.15.37:0/3818108987 learned_addr learned my addr 172.21.15.37:0/3818108987 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:26.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.108+0000 7f0d4cea1640 1 --2- 172.21.15.37:0/3818108987 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d34003970 0x7f0d480bc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:26.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.108+0000 7f0d4d6a2640 1 --2- 172.21.15.37:0/3818108987 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d481371f0 0x7f0d48137670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:26.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.108+0000 7f0d47fff640 1 -- 172.21.15.37:0/3818108987 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d481371f0 msgr2=0x7f0d48137670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:26.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.108+0000 7f0d47fff640 1 --2- 172.21.15.37:0/3818108987 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d481371f0 0x7f0d48137670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.108+0000 7f0d47fff640 1 -- 172.21.15.37:0/3818108987 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d34003970 msgr2=0x7f0d480bc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:26.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.108+0000 7f0d47fff640 1 --2- 172.21.15.37:0/3818108987 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d34003970 0x7f0d480bc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.108+0000 7f0d47fff640 1 -- 172.21.15.37:0/3818108987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4814e8f0 con 0x7f0d4813ac00 2023-12-19T17:50:26.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.108+0000 7f0d4cea1640 1 --2- 172.21.15.37:0/3818108987 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d34003970 0x7f0d480bc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:50:26.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.108+0000 7f0d4d6a2640 1 --2- 172.21.15.37:0/3818108987 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d481371f0 0x7f0d48137670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:50:26.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.108+0000 7f0d47fff640 1 --2- 172.21.15.37:0/3818108987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d4813ac00 0x7f0d4814c6a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f0d38007950 tx=0x7f0d3800a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:26.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.108+0000 7f0d457fa640 1 -- 172.21.15.37:0/3818108987 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d380017b0 con 0x7f0d4813ac00 2023-12-19T17:50:26.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.108+0000 7f0d457fa640 1 -- 172.21.15.37:0/3818108987 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d380133f0 con 0x7f0d4813ac00 2023-12-19T17:50:26.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.108+0000 7f0d4f105640 1 -- 172.21.15.37:0/3818108987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4813a4a0 con 0x7f0d4813ac00 2023-12-19T17:50:26.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.108+0000 7f0d457fa640 1 -- 172.21.15.37:0/3818108987 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d380137a0 con 0x7f0d4813ac00 2023-12-19T17:50:26.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.108+0000 7f0d4f105640 1 -- 172.21.15.37:0/3818108987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d48142370 con 0x7f0d4813ac00 2023-12-19T17:50:26.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.109+0000 7f0d4f105640 1 -- 172.21.15.37:0/3818108987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4813a920 con 0x7f0d4813ac00 2023-12-19T17:50:26.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.110+0000 7f0d457fa640 1 -- 172.21.15.37:0/3818108987 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0d38013900 con 0x7f0d4813ac00 2023-12-19T17:50:26.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.110+0000 7f0d457fa640 1 --2- 172.21.15.37:0/3818108987 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0d2806a430 0x7f0d2806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:26.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.110+0000 7f0d457fa640 1 -- 172.21.15.37:0/3818108987 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0d38088f60 con 0x7f0d4813ac00 2023-12-19T17:50:26.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.110+0000 7f0d4cea1640 1 --2- 172.21.15.37:0/3818108987 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0d2806a430 0x7f0d2806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:26.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.111+0000 7f0d4cea1640 1 --2- 172.21.15.37:0/3818108987 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0d2806a430 0x7f0d2806c8f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0d40033000 tx=0x7f0d40009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:26.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.114+0000 7f0d457fa640 1 -- 172.21.15.37:0/3818108987 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0d4813a920 con 0x7f0d4813ac00 2023-12-19T17:50:26.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.290+0000 7f0d4f105640 1 -- 172.21.15.37:0/3818108987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f0d4813a4a0 con 0x7f0d4813ac00 2023-12-19T17:50:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.293+0000 7f0d457fa640 1 -- 172.21.15.37:0/3818108987 <== mon.0 v2:172.21.15.37:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0d380547b0 con 0x7f0d4813ac00 2023-12-19T17:50:26.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.294+0000 7f0d457fa640 1 -- 172.21.15.37:0/3818108987 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f0d4813a4a0 con 0x7f0d4813ac00 2023-12-19T17:50:26.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.296+0000 7f0d4f105640 1 -- 172.21.15.37:0/3818108987 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0d2806a430 msgr2=0x7f0d2806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:26.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.296+0000 7f0d4f105640 1 --2- 172.21.15.37:0/3818108987 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0d2806a430 0x7f0d2806c8f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0d40033000 tx=0x7f0d40009030 comp rx=0 tx=0).stop 2023-12-19T17:50:26.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.296+0000 7f0d4f105640 1 -- 172.21.15.37:0/3818108987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d4813ac00 msgr2=0x7f0d4814c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:26.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.296+0000 7f0d4f105640 1 --2- 172.21.15.37:0/3818108987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d4813ac00 0x7f0d4814c6a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f0d38007950 tx=0x7f0d3800a6e0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.296+0000 7f0d4f105640 1 -- 172.21.15.37:0/3818108987 shutdown_connections 2023-12-19T17:50:26.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.296+0000 7f0d4f105640 1 --2- 172.21.15.37:0/3818108987 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f0d2806a430 0x7f0d2806c8f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.296+0000 7f0d4f105640 1 --2- 172.21.15.37:0/3818108987 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d481371f0 0x7f0d48137670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.296+0000 7f0d4f105640 1 --2- 172.21.15.37:0/3818108987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d4813ac00 0x7f0d4814c6a0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.296+0000 7f0d4f105640 1 --2- 172.21.15.37:0/3818108987 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d34003970 0x7f0d480bc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.296+0000 7f0d4f105640 1 -- 172.21.15.37:0/3818108987 >> 172.21.15.37:0/3818108987 conn(0x7f0d480b9b50 msgr2=0x7f0d481433e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:26.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.296+0000 7f0d4f105640 1 -- 172.21.15.37:0/3818108987 shutdown_connections 2023-12-19T17:50:26.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.296+0000 7f0d4f105640 1 -- 172.21.15.37:0/3818108987 wait complete. 2023-12-19T17:50:26.307 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T17:50:26.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:50:26.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.414+0000 7f554e8db640 1 Processor -- start 2023-12-19T17:50:26.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.414+0000 7f554e8db640 1 -- start start 2023-12-19T17:50:26.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.414+0000 7f554e8db640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f55480b6690 0x7f5548144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:26.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.414+0000 7f554e8db640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5548144cd0 0x7f5548155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:26.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.414+0000 7f554e8db640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55480bc6b0 con 0x7f55480bcdd0 2023-12-19T17:50:26.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.414+0000 7f554e8db640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55480a59f0 con 0x7f5548144cd0 2023-12-19T17:50:26.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.414+0000 7f554e8db640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55480bc0a0 con 0x7f55480b6690 2023-12-19T17:50:26.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.415+0000 7f554ce78640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5548144cd0 0x7f5548155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:26.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.415+0000 7f554ce78640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5548144cd0 0x7f5548155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33632/0 (socket says 172.21.15.37:33632) 2023-12-19T17:50:26.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.415+0000 7f554ce78640 1 -- 172.21.15.37:0/1481083724 learned_addr learned my addr 172.21.15.37:0/1481083724 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:26.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.415+0000 7f55477fe640 1 --2- 172.21.15.37:0/1481083724 >> v2:172.21.15.78:3300/0 conn(0x7f55480b6690 0x7f5548144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:26.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.415+0000 7f554ce78640 1 -- 172.21.15.37:0/1481083724 >> v2:172.21.15.78:3300/0 conn(0x7f55480b6690 msgr2=0x7f5548144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:50:26.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.415+0000 7f554ce78640 1 --2- 172.21.15.37:0/1481083724 >> v2:172.21.15.78:3300/0 conn(0x7f55480b6690 0x7f5548144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.415+0000 7f554ce78640 1 -- 172.21.15.37:0/1481083724 >> v1:172.21.15.78:6789/0 conn(0x7f55480bcdd0 legacy=0x7f55480b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:26.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.415+0000 7f554ce78640 1 -- 172.21.15.37:0/1481083724 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55480bc340 con 0x7f5548144cd0 2023-12-19T17:50:26.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.416+0000 7f554ce78640 1 --2- 172.21.15.37:0/1481083724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5548144cd0 0x7f5548155340 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f55480b72e0 tx=0x7f554002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe65ce932262c85 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:26.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.416+0000 7f5546ffd640 1 -- 172.21.15.37:0/1481083724 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554002cbb0 con 0x7f5548144cd0 2023-12-19T17:50:26.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.416+0000 7f5546ffd640 1 -- 172.21.15.37:0/1481083724 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f554002cd10 con 0x7f5548144cd0 2023-12-19T17:50:26.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.416+0000 7f5546ffd640 1 -- 172.21.15.37:0/1481083724 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5540034630 con 0x7f5548144cd0 2023-12-19T17:50:26.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.416+0000 7f554e8db640 1 -- 172.21.15.37:0/1481083724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5548144cd0 msgr2=0x7f5548155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:26.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.416+0000 7f554e8db640 1 --2- 172.21.15.37:0/1481083724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5548144cd0 0x7f5548155340 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f55480b72e0 tx=0x7f554002c010 comp rx=0 tx=0).stop 2023-12-19T17:50:26.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.416+0000 7f554e8db640 1 -- 172.21.15.37:0/1481083724 shutdown_connections 2023-12-19T17:50:26.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.416+0000 7f554e8db640 1 --2- 172.21.15.37:0/1481083724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5548144cd0 0x7f5548155340 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.416+0000 7f554e8db640 1 --2- 172.21.15.37:0/1481083724 >> v2:172.21.15.78:3300/0 conn(0x7f55480b6690 0x7f5548144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.416+0000 7f554e8db640 1 -- 172.21.15.37:0/1481083724 >> 172.21.15.37:0/1481083724 conn(0x7f5548071e60 msgr2=0x7f55480c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:26.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.416+0000 7f554e8db640 1 -- 172.21.15.37:0/1481083724 shutdown_connections 2023-12-19T17:50:26.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.417+0000 7f554e8db640 1 -- 172.21.15.37:0/1481083724 wait complete. 2023-12-19T17:50:26.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.417+0000 7f554e8db640 1 Processor -- start 2023-12-19T17:50:26.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.418+0000 7f554e8db640 1 -- start start 2023-12-19T17:50:26.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.418+0000 7f554e8db640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f55480b6690 0x7f554814a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.418+0000 7f554e8db640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55480bcdd0 0x7f5548146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.418+0000 7f554e8db640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5548144cd0 0x7f5548141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.418+0000 7f554e8db640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5548147cb0 con 0x7f55480bcdd0 2023-12-19T17:50:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.418+0000 7f554e8db640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554814a620 con 0x7f5548144cd0 2023-12-19T17:50:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.418+0000 7f554e8db640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55481454b0 con 0x7f55480b6690 2023-12-19T17:50:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.418+0000 7f55477fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55480bcdd0 0x7f5548146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.418+0000 7f55477fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55480bcdd0 0x7f5548146e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33648/0 (socket says 172.21.15.37:33648) 2023-12-19T17:50:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.418+0000 7f55477fe640 1 -- 172.21.15.37:0/2441173168 learned_addr learned my addr 172.21.15.37:0/2441173168 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-19T17:50:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.419+0000 7f554ce78640 1 --2- 172.21.15.37:0/2441173168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5548144cd0 0x7f5548141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.419+0000 7f5547fff640 1 --2- 172.21.15.37:0/2441173168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f55480b6690 0x7f554814a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.419+0000 7f55477fe640 1 -- 172.21.15.37:0/2441173168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f55480b6690 msgr2=0x7f554814a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.419+0000 7f55477fe640 1 --2- 172.21.15.37:0/2441173168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f55480b6690 0x7f554814a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.419+0000 7f55477fe640 1 -- 172.21.15.37:0/2441173168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5548144cd0 msgr2=0x7f5548141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.419+0000 7f55477fe640 1 --2- 172.21.15.37:0/2441173168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5548144cd0 0x7f5548141280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.419+0000 7f55477fe640 1 -- 172.21.15.37:0/2441173168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5540009b30 con 0x7f55480bcdd0 2023-12-19T17:50:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.419+0000 7f55477fe640 1 --2- 172.21.15.37:0/2441173168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55480bcdd0 0x7f5548146e00 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f553c00d830 tx=0x7f553c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.419+0000 7f5544ff9640 1 -- 172.21.15.37:0/2441173168 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c00b6c0 con 0x7f55480bcdd0 2023-12-19T17:50:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.419+0000 7f5544ff9640 1 -- 172.21.15.37:0/2441173168 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f553c00b840 con 0x7f55480bcdd0 2023-12-19T17:50:26.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.419+0000 7f554e8db640 1 -- 172.21.15.37:0/2441173168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5548145790 con 0x7f55480bcdd0 2023-12-19T17:50:26.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.419+0000 7f5544ff9640 1 -- 172.21.15.37:0/2441173168 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c00bc10 con 0x7f55480bcdd0 2023-12-19T17:50:26.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.419+0000 7f554e8db640 1 -- 172.21.15.37:0/2441173168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5548148420 con 0x7f55480bcdd0 2023-12-19T17:50:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.420+0000 7f554e8db640 1 -- 172.21.15.37:0/2441173168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554804e840 con 0x7f55480bcdd0 2023-12-19T17:50:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.421+0000 7f5544ff9640 1 -- 172.21.15.37:0/2441173168 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f553c01e460 con 0x7f55480bcdd0 2023-12-19T17:50:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.421+0000 7f5544ff9640 1 --2- 172.21.15.37:0/2441173168 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f553406a430 0x7f553406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:50:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.421+0000 7f5544ff9640 1 -- 172.21.15.37:0/2441173168 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f553c088e00 con 0x7f55480bcdd0 2023-12-19T17:50:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.421+0000 7f5547fff640 1 --2- 172.21.15.37:0/2441173168 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f553406a430 0x7f553406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:50:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.422+0000 7f5547fff640 1 --2- 172.21.15.37:0/2441173168 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f553406a430 0x7f553406c8f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5538000f60 tx=0x7f5538009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:50:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.425+0000 7f5544ff9640 1 -- 172.21.15.37:0/2441173168 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f553c054660 con 0x7f55480bcdd0 2023-12-19T17:50:26.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.639+0000 7f554e8db640 1 -- 172.21.15.37:0/2441173168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55480b8bf0 con 0x7f55480bcdd0 2023-12-19T17:50:26.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.639+0000 7f5544ff9640 1 -- 172.21.15.37:0/2441173168 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2766 (secure 0 0 0) 0x7f553c057c80 con 0x7f55480bcdd0 2023-12-19T17:50:26.640 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-19T17:50:26.640 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":15,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4631,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/19970234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":19970234},{"type":"v1","addr":"172.21.15.37:6834","nonce":19970234}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2974397450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2974397450},{"type":"v1","addr":"172.21.15.78:6835","nonce":2974397450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":6783,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1017911783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1017911783},{"type":"v1","addr":"172.21.15.37:6835","nonce":1017911783}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[]} 2023-12-19T17:50:26.640 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 15 2023-12-19T17:50:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.641+0000 7f554e8db640 1 -- 172.21.15.37:0/2441173168 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f553406a430 msgr2=0x7f553406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.641+0000 7f554e8db640 1 --2- 172.21.15.37:0/2441173168 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f553406a430 0x7f553406c8f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5538000f60 tx=0x7f5538009040 comp rx=0 tx=0).stop 2023-12-19T17:50:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.641+0000 7f554e8db640 1 -- 172.21.15.37:0/2441173168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55480bcdd0 msgr2=0x7f5548146e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:50:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.641+0000 7f554e8db640 1 --2- 172.21.15.37:0/2441173168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55480bcdd0 0x7f5548146e00 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f553c00d830 tx=0x7f553c00dcf0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.641+0000 7f554e8db640 1 -- 172.21.15.37:0/2441173168 shutdown_connections 2023-12-19T17:50:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.641+0000 7f554e8db640 1 --2- 172.21.15.37:0/2441173168 >> [v2:172.21.15.78:6832/88890,v1:172.21.15.78:6833/88890] conn(0x7f553406a430 0x7f553406c8f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.641+0000 7f554e8db640 1 --2- 172.21.15.37:0/2441173168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5548144cd0 0x7f5548141280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.641+0000 7f554e8db640 1 --2- 172.21.15.37:0/2441173168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55480bcdd0 0x7f5548146e00 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.641+0000 7f554e8db640 1 --2- 172.21.15.37:0/2441173168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f55480b6690 0x7f554814a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:50:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.641+0000 7f554e8db640 1 -- 172.21.15.37:0/2441173168 >> 172.21.15.37:0/2441173168 conn(0x7f5548071e60 msgr2=0x7f55480b7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:50:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.641+0000 7f554e8db640 1 -- 172.21.15.37:0/2441173168 shutdown_connections 2023-12-19T17:50:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-19T17:50:26.641+0000 7f554e8db640 1 -- 172.21.15.37:0/2441173168 wait complete. 2023-12-19T17:50:26.653 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-19T17:50:26.653 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-19T17:50:26.654 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T17:50:26.654 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:50:26.663 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T17:50:26.664 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T17:50:26.664 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:50:26.713 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T17:50:26.714 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T17:50:26.714 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:50:26.726 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T17:50:26.726 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-19T17:50:26.726 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-19T17:50:26.726 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:50:32.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-12-19T17:50:32.828 INFO:tasks.ceph.osd.0:Stopped 2023-12-19T17:50:32.829 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-19T17:50:32.829 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:50:32.913 INFO:tasks.ceph.osd.1:Stopped 2023-12-19T17:50:32.913 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-19T17:50:32.913 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:50:33.007 INFO:tasks.ceph.osd.2:Stopped 2023-12-19T17:50:33.007 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-19T17:50:33.007 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:50:33.085 INFO:tasks.ceph.osd.3:Stopped 2023-12-19T17:50:33.085 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-19T17:50:33.085 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:50:33.150 INFO:tasks.ceph.osd.4:Stopped 2023-12-19T17:50:33.150 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-19T17:50:33.150 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:50:33.216 INFO:tasks.ceph.osd.5:Stopped 2023-12-19T17:50:33.217 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-19T17:50:33.217 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:50:33.297 INFO:tasks.ceph.osd.6:Stopped 2023-12-19T17:50:33.298 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-19T17:50:33.298 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:50:33.343 INFO:tasks.ceph.osd.7:Stopped 2023-12-19T17:50:33.343 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-19T17:50:33.344 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-19T17:50:33.344 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:50:33.371 INFO:tasks.ceph.mgr.y:Stopped 2023-12-19T17:50:33.371 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-19T17:50:33.371 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:50:33.397 INFO:tasks.ceph.mgr.x:Stopped 2023-12-19T17:50:33.397 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-19T17:50:33.398 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-19T17:50:33.398 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:50:33.428 INFO:tasks.ceph.mon.a:Stopped 2023-12-19T17:50:33.428 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-19T17:50:33.428 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:50:33.449 INFO:tasks.ceph.mon.b:Stopped 2023-12-19T17:50:33.450 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-19T17:50:33.450 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:50:33.502 INFO:tasks.ceph.mon.c:Stopped 2023-12-19T17:50:33.503 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-19T17:50:33.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-19T17:50:33.599 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-19T17:50:33.600 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-19T17:50:33.860 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-19T17:50:33.860 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-19T17:50:33.974 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-19T17:50:33.975 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-19T17:50:34.136 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-19T17:50:34.136 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-19T17:50:34.241 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi078.front.sepia.ceph.com 2023-12-19T17:50:34.241 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-19T17:50:34.539 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi078.front.sepia.ceph.com 2023-12-19T17:50:34.539 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-19T17:50:34.673 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi078.front.sepia.ceph.com 2023-12-19T17:50:34.674 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-19T17:50:34.809 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi078.front.sepia.ceph.com 2023-12-19T17:50:34.810 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-19T17:50:34.963 INFO:tasks.ceph:Archiving mon data... 2023-12-19T17:50:34.965 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066/data/mon.a.tgz 2023-12-19T17:50:34.965 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2023-12-19T17:50:34.984 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.FzA4VHppXJ 2023-12-19T17:50:34.985 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.FzA4VHppXJ 2023-12-19T17:50:35.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.FzA4VHppXJ 2023-12-19T17:50:35.268 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.FzA4VHppXJ is 311KB 2023-12-19T17:50:35.364 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.FzA4VHppXJ 2023-12-19T17:50:35.398 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066/data/mon.b.tgz 2023-12-19T17:50:35.398 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2023-12-19T17:50:35.426 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.5hhm0X2q5k 2023-12-19T17:50:35.427 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.5hhm0X2q5k 2023-12-19T17:50:35.576 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.5hhm0X2q5k 2023-12-19T17:50:35.723 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.5hhm0X2q5k is 320KB 2023-12-19T17:50:35.818 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.5hhm0X2q5k 2023-12-19T17:50:35.840 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066/data/mon.c.tgz 2023-12-19T17:50:35.840 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2023-12-19T17:50:35.894 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.9fmvcN0xPf 2023-12-19T17:50:35.895 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.9fmvcN0xPf 2023-12-19T17:50:36.014 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.9fmvcN0xPf 2023-12-19T17:50:36.098 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.9fmvcN0xPf is 320KB 2023-12-19T17:50:36.194 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.9fmvcN0xPf 2023-12-19T17:50:36.208 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-19T17:50:36.208 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T17:50:36.210 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T17:50:36.249 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T17:50:36.350 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-12-19T17:50:36.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-19T17:50:36.353 DEBUG:teuthology.orchestra.run.smithi078:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-19T17:50:36.356 DEBUG:teuthology.orchestra.run.smithi151:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-19T17:50:36.382 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-19T17:50:36.389 INFO:teuthology.orchestra.run.smithi037.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-19T17:50:36.740 INFO:teuthology.orchestra.run.smithi151.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-19T17:50:36.754 INFO:tasks.ceph:Archiving crash dumps... 2023-12-19T17:50:36.756 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066/remote/smithi037/crash 2023-12-19T17:50:36.757 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T17:50:36.793 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066/remote/smithi078/crash 2023-12-19T17:50:36.794 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T17:50:36.822 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066/remote/smithi151/crash 2023-12-19T17:50:36.824 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T17:50:36.937 INFO:tasks.ceph:Shutting down logrotate 2023-12-19T17:50:36.938 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:50:36.941 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:50:36.943 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:50:37.051 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-19T17:50:37.095 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-19T17:50:37.144 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-19T17:50:37.231 INFO:tasks.ceph:Compressing logs... 2023-12-19T17:50:37.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T17:50:37.234 DEBUG:teuthology.orchestra.run.smithi078:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T17:50:37.236 DEBUG:teuthology.orchestra.run.smithi151:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T17:50:37.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-12-19T17:54:40.229 INFO:tasks.ceph:Archiving logs... 2023-12-19T17:54:40.230 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066/remote/smithi037/log 2023-12-19T17:54:40.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T17:57:14.828 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066/remote/smithi078/log 2023-12-19T17:57:14.829 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T17:58:14.337 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066/remote/smithi151/log 2023-12-19T17:58:14.339 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T17:58:15.473 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-19T17:58:15.486 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-19T17:58:15.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T17:58:15.490 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T17:58:15.492 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T17:58:15.697 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-19T17:58:15.706 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-19T17:58:15.706 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T17:58:15.709 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T17:58:15.712 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T17:58:15.724 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2023-12-19T17:58:15.725 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: ntpq: command not found 2023-12-19T17:58:15.769 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2023-12-19T17:58:15.792 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T17:58:15.792 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2023-12-19T17:58:15.792 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 63 -152us[ -149us] +/- 94ms 2023-12-19T17:58:15.792 INFO:teuthology.orchestra.run.smithi078.stdout:^* hv02.front.sepia.ceph.com 3 6 377 4 +267us[ +266us] +/- 49ms 2023-12-19T17:58:15.792 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 0 -208us[ -208us] +/- 77ms 2023-12-19T17:58:15.793 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T17:58:15.797 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T17:58:15.797 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-12-19T17:58:15.797 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 122 -110us[ -66us] +/- 93ms 2023-12-19T17:58:15.797 INFO:teuthology.orchestra.run.smithi151.stdout:^* hv02.front.sepia.ceph.com 3 7 377 56 +315us[ +359us] +/- 49ms 2023-12-19T17:58:15.797 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 123 -212us[ -168us] +/- 75ms 2023-12-19T17:58:15.797 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T17:58:15.812 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T17:58:15.812 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2023-12-19T17:58:15.812 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 125 -137us[ -81us] +/- 93ms 2023-12-19T17:58:15.812 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv02.front.sepia.ceph.com 3 7 377 59 +289us[ +300us] +/- 49ms 2023-12-19T17:58:15.812 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 -204us[ -193us] +/- 76ms 2023-12-19T17:58:15.812 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T17:58:15.814 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-19T17:58:15.823 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-19T17:58:15.823 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-19T17:58:15.834 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-19T17:58:16.104 DEBUG:teuthology.orchestra.run.smithi078:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-19T17:58:16.278 DEBUG:teuthology.orchestra.run.smithi151:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-19T17:58:16.639 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T17:58:16.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:58:16.678 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T17:58:16.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:58:16.719 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T17:58:16.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:58:16.834 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-19T17:58:16.873 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-19T17:58:16.908 INFO:teuthology.task.internal:Duration was 7474.891892 seconds 2023-12-19T17:58:16.908 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-19T17:58:16.933 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-19T17:58:16.934 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T17:58:16.937 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T17:58:16.940 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T17:58:16.999 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T17:58:17.035 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T17:58:17.158 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T17:58:17.498 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-19T17:58:17.498 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2023-12-19T17:58:17.498 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T17:58:17.519 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2023-12-19T17:58:17.519 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T17:58:17.543 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2023-12-19T17:58:17.544 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T17:58:17.627 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-19T17:58:17.627 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T17:58:17.629 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T17:58:17.632 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T17:58:17.716 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-19T17:58:17.716 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T17:58:17.718 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T17:58:17.720 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T17:58:18.007 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-19T17:58:18.017 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-19T17:58:18.017 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T17:58:18.067 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T17:58:18.114 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T17:58:18.215 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-19T17:58:18.227 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T17:58:18.229 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T17:58:18.232 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T17:58:18.274 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2023-12-19T17:58:18.286 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2023-12-19T17:58:18.359 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2023-12-19T17:58:18.420 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T17:58:18.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:58:18.435 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T17:58:18.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:58:18.450 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T17:58:18.505 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:58:18.507 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-19T17:58:18.518 INFO:teuthology.task.internal:Transferring archived files... 2023-12-19T17:58:18.519 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066/remote/smithi037 2023-12-19T17:58:18.519 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-19T17:58:18.560 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066/remote/smithi078 2023-12-19T17:58:18.560 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-19T17:58:18.598 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066/remote/smithi151 2023-12-19T17:58:18.598 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-19T17:58:18.710 INFO:teuthology.task.internal:Removing archive directory... 2023-12-19T17:58:18.710 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-19T17:58:18.713 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-19T17:58:18.715 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-19T17:58:18.773 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-19T17:58:18.786 INFO:teuthology.task.internal:Not uploading archives. 2023-12-19T17:58:18.786 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-19T17:58:18.796 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-19T17:58:18.796 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T17:58:18.799 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T17:58:18.801 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T17:58:18.811 INFO:teuthology.orchestra.run.smithi037.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 17:58 /home/ubuntu/cephtest 2023-12-19T17:58:18.813 INFO:teuthology.orchestra.run.smithi078.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 17:58 /home/ubuntu/cephtest 2023-12-19T17:58:18.862 INFO:teuthology.orchestra.run.smithi151.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 17:58 /home/ubuntu/cephtest 2023-12-19T17:58:18.865 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-19T17:58:18.875 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-19T17:58:18.900 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T17:58:18.929 DEBUG:teuthology.nuke:shortname: smithi037 2023-12-19T17:58:18.930 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T17:58:18.968 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:43:50.566691', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLC3HYK0HgfNM7g/c5+f6H1JBDH7l2u8f8+8aghJwChwAt2AwvutoVKH9XH78ofqYTZ77wk3O9OYIWy4cjkSxFY='} 2023-12-19T17:58:18.982 DEBUG:teuthology.nuke:shortname: smithi078 2023-12-19T17:58:18.982 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T17:58:19.036 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:43:50.568164', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtnDg9DmOslbC2XB5fDJLZO6QCLpyuPIu+wauED0UaelHaDToCXKE3NYU7OcSn5dX9iwqvGaq++RFWj4tHXcjo='} 2023-12-19T17:58:19.037 DEBUG:teuthology.nuke:shortname: smithi151 2023-12-19T17:58:19.037 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T17:58:19.096 INFO:teuthology.orchestra.console.smithi037:Power off 2023-12-19T17:58:19.096 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T17:58:19.106 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497066', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:43:50.564833', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKrNCTuMGC/FXM8yGMmHjs5cvqKWNlrKt8PQhN1FijJ9JMdldr8Mmuq5ja2h962rxxOnvpyTaLyRjpiWWe+V2w8='} 2023-12-19T17:58:19.148 INFO:teuthology.orchestra.console.smithi078:Power off 2023-12-19T17:58:19.149 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T17:58:19.174 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-12-19T17:58:19.174 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T17:58:19.201 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2023-12-19T17:58:19.201 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T17:58:19.218 INFO:teuthology.orchestra.console.smithi151:Power off 2023-12-19T17:58:19.218 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T17:58:19.232 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-12-19T17:58:19.252 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-12-19T17:58:19.270 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-12-19T17:58:19.270 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T17:58:19.320 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-12-19T17:58:23.233 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T17:58:23.253 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T17:58:23.322 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T17:58:23.344 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-12-19T17:58:23.367 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-12-19T17:58:23.432 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-12-19T17:58:27.349 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T17:58:27.368 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T17:58:27.433 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T17:58:27.460 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-12-19T17:58:27.477 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-12-19T17:58:27.545 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-12-19T17:58:27.562 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-12-19T17:58:27.578 INFO:teuthology.orchestra.console.smithi078:Power off completed 2023-12-19T17:58:31.549 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T17:58:31.660 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-12-19T17:58:31.760 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-12-19T17:58:31.866 INFO:teuthology.run:Summary data: client.0-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} duration: 7474.891891956329 failure_reason: 'Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=de2d72adc8b3497ba4725a1bfe67dd59 status: fail success: false 2023-12-19T17:58:31.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T17:58:31.969 INFO:teuthology.run:FAIL